0


用贝斯近似法不能做到的东西

What cannot be learned with Bethe Approximations
课程网址: http://videolectures.net/nipsworkshops2012_globerson_bethe_approx...  
主讲教师: Amir Globerson
开课单位: 耶路撒冷希伯来大学
开课时间: 2013-01-16
课程语种: 英语
中文简介:
我们解决了当推理难以处理时学习图形模型中的参数的问题。在这种情况下,常见的策略是用其Bethe近似替换分区函数。然而,关于这种近似的理论性质知之甚少。在这里,我们表明存在一种经验边际制度,这种“贝特学习”将会失败。失败意味着不会实现时刻匹配。我们提供了几个关于经验边际的条件,这些条件产生了Bethe可学习边缘集的外部和内部边界。我们的结果有一个有趣的含义是存在一大类边缘,这些边缘不能作为稳定的信念传播的固定点而获得。总之,我们的结果提供了一种新的方法来分析学习与Bethe近似,并突出显示它可以预期工作或失败。
课程简介: We address the problem of learning the parameters in graphical models when inference is intractable. A common strategy in this case is to replace the partition function with its Bethe approximation. However not much is known about the theoretical properties of such approximations. Here we show that there exists a regime of empirical marginals where such "Bethe learning" will fail. By failure we mean that moment matching will not be achieved. We provide several conditions on empirical marginals that yield outer and inner bounds on the set of Bethe learnable marginals. An interesting implication of our results is that there exists a large class of marginals that cannot be obtained as stable fixed points of belief propagation. Taken together our results provide a novel approach to analyzing learning with Bethe approximations and highlight when it can be expected to work or fail.
关 键 词: 图形模型; Bethe近似; 分区函数
课程来源: 视频讲座网
最后编审: 2019-09-08:lxf
阅读次数: 83