图 书 馆
贝叶斯非参数模型序列MCMC推理的有序断棒先验Ordered Stick-Breaking Prior for Sequential MCMC Inference of Bayesian Nonparametric Models |
|
| 课程网址: | http://videolectures.net/icml2015_das_nonparametric_models/ |
| 主讲教师: | Mrinal Kanti Das |
| 开课单位: | 印度班加罗尔科学学院 |
| 开课时间: | 2015-12-05 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | This paper introduces ordered stick-breaking process (OSBP), where the atoms in a stick-breaking process (SBP) appear in order. The choice of weights on the atoms of OSBP ensure that; (1) probability of adding new atoms exponentially decrease, and (2) OSBP, though non-exchangeable, admit predictive probability functions (PPFs). In a Bayesian nonparametric (BNP) setting, OSBP serves as a natural prior over sequential mini-batches, facilitating exchange of relevant statistical information by sharing the atoms of OSBP. One of the major contributions of this paper is SUMO, an MCMC algorithm, for solving the inference problem arising from applying OSBP to BNP models. SUMO uses the PPFs of OSBP to obtain a Gibbs-sampling based truncation-free algorithm which applies generally to BNP models. For large scale inference problems existing algorithms such as particle filtering (PF) are not practical and variational procedures such as TSVI (Wang \& Blei, 2012) are the only alternative. For Dirichlet process mixture model (DPMM), SUMO outperforms TSVI on perplexity by 33\% on 3 datasets with million data points, which are beyond the scope of PF, using only 3GB RAM. |
| 关 键 词: | 有序断棒过程; 概率函数; 混合模型 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2022-11-08：chenjy |
| 最后编审: | 2022-11-08：chenjy |
| 阅读次数: | 25 |