0


学习深层稀疏图形模型的结构

Learning the structure of deep sparse graphical models
课程网址: http://videolectures.net/aistats2010_wallach_ltsods/  
主讲教师: Hanna M. Wallach
开课单位: 马萨诸塞大学
开课时间: 2010-06-03
课程语种: 英语
中文简介:
深层信念网络是建立复杂概率分布模型的一种有效方法。然而,要了解一个信仰网络的结构是很困难的,特别是一个有隐藏单位的信仰网络。将印度自助过程作为一种非参数贝叶斯先验,应用于具有无限宽隐层的有向信念网络结构。在这里,我们介绍了层叠式印度自助过程(CIBP),它提供了一个分层的、有向的信念网络结构的优先级,该信念网络在深度和宽度上都是无界的,但允许易于操作的推断。我们使用CIBP先验和非线性高斯信念网络框架来允许每个单元在离散和连续表示之间改变其行为。在该模型中,我们使用马尔可夫链蒙特卡罗进行推理,并探讨了图像数据的结构。
课程简介: Deep belief networks are a powerful way to model complex probability distributions. However, it is difficult to learn the structure of a belief network, particularly one with hidden units. The Indian buffet process has been used as a nonparametric Bayesian prior on the structure of a directed belief network with a single infinitely wide hidden layer. Here, we introduce the cascading Indian buffet process (CIBP), which provides a prior on the structure of a layered, directed belief network that is unbounded in both depth and width, yet allows tractable inference. We use the CIBP prior with the nonlinear Gaussian belief network framework to allow each unit to vary its behavior between discrete and continuous representations. We use Markov chain Monte Carlo for inference in this model and explore the structures learned on image data.
关 键 词: 深层稀疏图形模型; 结构
课程来源: 视频讲座网
最后编审: 2020-07-13:yumf
阅读次数: 25