图 书 馆
结构的无监督发现、简洁的表示和稀疏性Unsupervised Discovery of Structure, Succinct Representations and Sparsity |
|
| 课程网址: | http://videolectures.net/icml09_ng_udssrs/ |
| 主讲教师: | Andrew Ng |
| 开课单位: | 斯坦福大学 |
| 开课时间: | 2009-08-26 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | We describe a class of unsupervised learning methods that learn sparse representations of the training data, and thereby identify useful features. Further, we show that deep learning (multilayer) versions of these ideas, ones based on sparse DBNs, learn rich feature hierarchies, including part-whole decompositions of objects. Central to this is the idea of "probabilistic max pooling", which allows us to implement convolutional DBNs at a large scale, while maintaining probabilistically sound semantics. In the case of images, at the lowest level this method learns to detect edges; at the next level, it puts together edges to form "object parts"; and finally, at the highest level puts together object parts to form whole "object models". The features this method learns are useful for a wide range of tasks, including object recognition, text classification, and audio classification. We also present the result of comparing a two-layer version of the model (trained on natural images) to visual cortical areas V1 and V2 in the brain (the first and second stages of visual processing in the cortex). Finally, we'll conclude with a discussion on some open problems and directions for future research. |
| 关 键 词: | 无监督学习; 训练数据; 深度学习 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2019-04-24：cwx |
| 阅读次数: | 38 |