0


流形切线分级机

Manifold Tangent Classifier
课程网址: http://videolectures.net/nips2011_dauphin_manifold/  
主讲教师: Yann Dauphin
开课单位: 蒙特利尔大学
开课时间: 2012-01-25
课程语种: 英语
中文简介:
我们结合以前建立分类器工作中存在的三个重要思想:半监督假设(输入分布包含有关分类器的信息),无监督流形假设(数据密度集中在低维流形附近),以及分类的多重假设(不同类对应于由低密度分隔的不相交流形。我们利用一种新算法捕获流形结构(高阶压缩自动编码器),并展示它如何构建图表的拓扑图集,每个图表的特征在于表示映射的雅可比行列式的主要奇异向量。这种表示学习算法可以堆叠以产生深层体系结构,并且我们将其与TangentProp算法的领域知识免费版本组合以鼓励分类器对沿着流形的局部方向变化不敏感。获得了破纪录的结果,我们发现学习的切线方向非常有意义。
课程简介: We combine three important ideas present in previous work for building classifiers: the semi-supervised hypothesis (the input distribution contains information about the classifier), the unsupervised manifold hypothesis (data density concentrates near low-dimensional manifolds), and the manifold hypothesis for classification (different classes correspond to disjoint manifolds separated by low density). We exploit a new algorithm for capturing manifold structure (high-order contractive autoencoders) and we show how it builds a topological atlas of charts, each chart being characterized by the principal singular vectors of the Jacobian of a representation mapping. This representation learning algorithm can be stacked to yield a deep architecture, and we combine it with a domain knowledge-free version of the TangentProp algorithm to encourage the classifier to be insensitive to local directions changes along the manifold. Record-breaking results are obtained and we find that the learned tangent directions are very meaningful.
关 键 词: 半监督假设; 捕获流形结构; 拓扑图集
课程来源: 视频讲座网
最后编审: 2019-07-26:cwx
阅读次数: 30