0


稀疏滤波

Sparse Filtering
课程网址: http://videolectures.net/nips2011_ngiam_sparse/  
主讲教师: Jiquan Ngiam
开课单位: 斯坦福大学
开课时间: 2012-09-06
课程语种: 英语
中文简介:
无监督的特征学习已经被证明在学习在图像,视频和音频分类上表现良好的表示方面是有效的。然而,许多现有的特征学习算法难以使用并且需要广泛的超参数调整。在这项工作中,我们提出了稀疏过滤,一种简单的新算法,它是高效的,只有一个超参数,要学习的特征数量。与大多数其他特征学习方法相比,稀疏过滤没有明确地尝试构建数据分布的模型。相反,它优化了一个简单的成本函数,L2规范化特征的稀疏性可以很容易地在几行MATLAB代码中实现。稀疏过滤可以优雅地处理高维输入,也可以用于通过贪婪的层叠堆叠来学习其他层中的有意义的特征。我们评估自然图像,对象分类(STL 10)和电话分类(TIMIT)的稀疏过滤,并表明我们的方法适用于一系列不同的模态。
课程简介: Unsupervised feature learning has been shown to be effective at learning representations that perform well on image, video and audio classification. However, many existing feature learning algorithms are hard to use and require extensive hyperparameter tuning. In this work, we present sparse filtering, a simple new algorithm which is efficient and only has one hyperparameter, the number of features to learn. In contrast to most other feature learning methods, sparse filtering does not explicitly attempt to construct a model of the data distribution. Instead, it optimizes a simple cost function -- the sparsity of L2-normalized features -- which can easily be implemented in a few lines of MATLAB code. Sparse filtering scales gracefully to handle high-dimensional inputs, and can also be used to learn meaningful features in additional layers with greedy layer-wise stacking. We evaluate sparse filtering on natural images, object classification (STL-10), and phone classification (TIMIT), and show that our method works well on a range of different modalities.
关 键 词: 特征学习; 音频分类; 超参数调整
课程来源: 视频讲座网
最后编审: 2019-07-26:cwx
阅读次数: 141