0


深度学习

Deep Learning
课程网址: http://videolectures.net/kdd2014_salakhutdinov_deep_learning/  
主讲教师: Ruslan Salakhutdinov
开课单位: 多伦多大学
开课时间: 2014-10-09
课程语种: 英语
中文简介:
构建能够从高维感官数据中提取高级表示的智能系统是解决许多人工智能相关任务的核心,包括视觉对象或模式识别、语音感知和语言理解。理论和生物学上的争论强烈地表明,建立这样的系统需要涉及许多非线性处理层的深层结构。许多现有的学习算法使用浅层结构,包括只有一个隐藏层的神经网络、支持向量机、核逻辑回归等。这种系统所学习的内部表示必然是简单的,不能从高维输入中提取某些类型的复杂结构。在过去的几年里,从应用统计学到工程、计算机科学和神经科学等不同领域的研究人员提出了几种能够提取有用的、高层次的结构化表示的深层(层次)模型。这些模型的一个重要特性是,它们可以从高维的感官输入中提取复杂的统计依赖关系,并通过重用和组合中间概念有效地学习高级表示,从而使这些模型能够很好地概括各种任务。学习到的高级表示已经被证明在许多具有挑战性的学习问题中提供了最新的结果,在这些问题中,数据模式常常表现出高度的变化,并且已经成功地应用于各种应用领域,包括视觉对象识别、信息检索和,自然语言处理和语音感知。这类模型的几个显著例子包括Deep-confidence网络、Deep-Boltzmann机器、Deep自动编码器和基于稀疏编码的方法。
课程简介: Building intelligent systems that are capable of extracting high-level representations from high-dimensional sensory data lies at the core of solving many AI related tasks, including visual object or pattern recognition, speech perception, and language understanding. Theoretical and biological arguments strongly suggest that building such systems requires deep architectures that involve many layers of nonlinear processing. Many existing learning algorithms use shallow architectures, including neural networks with only one hidden layer, support vector machines, kernel logistic regression, and many others. The internal representations learned by such systems are necessarily simple and are incapable of extracting some types of complex structure from high-dimensional input. In the past few years, researchers across many different communities, from applied statistics to engineering, computer science and neuroscience, have proposed several deep (hierarchical) models that are capable of extracting useful, high-level structured representations. An important property of these models is that they can extract complex statistical dependencies from high-dimensional sensory input and efficiently learn high-level representations by re-using and combining intermediate concepts, allowing these models to generalize well across a wide variety of tasks. The learned high-level representations have been shown to give state-of-the-art results in many challenging learning problems, where data patterns often exhibit a high degree of variations, and have been successfully applied in a wide variety of application domains, including visual object recognition, information retrieval, natural language processing, and speech perception. A few notable examples of such models include Deep Belief Networks, Deep Boltzmann Machines, Deep Autoencoders, and sparse coding-based methods.
关 键 词: 深度学习; 神经网络; 高维感官
课程来源: 视频讲座网
数据采集: 2020-11-22:yxd
最后编审: 2020-11-22:yxd
阅读次数: 26