0


在线词典学习稀疏编码

Online Dictionary Learning for Sparse Coding
课程网址: http://videolectures.net/icml09_mairal_odlsc/  
主讲教师: Julien Mairal
开课单位: 法国国家信息与自动化研究所
开课时间: 信息不详。欢迎您在右侧留言补充。
课程语种: 英语
中文简介:
稀疏编码,即将数据向量建模为基础元素的稀疏线性组合,广泛应用于机器学习、神经科学、信号处理和统计。本文着重学习基集(也称为字典)以使其适应特定数据,这一方法最近被证明对音频和图像处理领域中的信号重建和分类非常有效。本文提出了一种基于随机逼近的在线词典学习优化算法,该算法能很好地扩展到具有数百万个训练样本的大数据集。本文给出了收敛性的证明,并对自然图像进行了实验,证明它比传统的小数据集和大数据集批处理算法具有更快的性能和更好的字典。
课程简介: Sparse coding—that is, modelling data vectors as sparse linear combinations of basis elements—is widely used in machine learning, neuroscience, signal processing, and statistics. This paper focuses on learning the basis set, also called dictionary, to adapt it to specific data, an approach that has recently proven to be very effective for signal reconstruction and classification in the audio and image processing domains. This paper proposes a new online optimization algorithm for dictionary learning, based on stochastic approximations, which scales up gracefully to large datasets with millions of training samples. A proof of convergence is presented, along with experiments with natural images demonstrating that it leads to faster performance and better dictionaries than classical batch algorithms for both small and large datasets.
关 键 词: 稀疏编码; 机器学习; 批处理算法
课程来源: 视频讲座网
最后编审: 2019-12-05:cwx
阅读次数: 73