0


稀疏主成分分析的密集消息传递

Dense message passing for sparse principal component analysis
课程网址: http://videolectures.net/aistats2010_sharp_dmpfs/  
主讲教师: Kevin Sharp
开课单位: 曼彻斯特大学
开课时间: 信息不详。欢迎您在右侧留言补充。
课程语种: 英语
中文简介:
摘要提出了一种基于零范数先验的稀疏贝叶斯PCA推理算法。贝叶斯推理在这类概率模型中是非常具有挑战性的。MCMC算法在高维环境中运行太慢,标准的平均场变分贝叶斯算法效率低下。我们采用了一种密集的消息传递算法,类似于统计物理社区中开发的算法,以前应用于编码和稀疏分类中的推理问题。该算法在综合数据上达到了接近最优的性能,从而导出了最优学习的统计力学理论。我们还研究了稀疏主成分分析中使用的两个基因表达数据集。我们发现我们的方法比一种已发表的算法表现得更好,并且与另一种算法相比具有可比性。
课程简介: We describe a novel inference algorithm for sparse Bayesian PCA with a zero-norm prior on the model parameters. Bayesian inference is very challenging in probabilistic models of this type. MCMC procedures are too slow to be practical in a very high-dimensional setting and standard mean-field variational Bayes algorithms are ineffective. We adopt a dense message passing algorithm similar to algorithms developed in the statistical physics community and previously applied to inference problems in coding and sparse classification. The algorithm achieves near-optimal performance on synthetic data for which a statistical mechanics theory of optimal learning can be derived. We also study two gene expression datasets used in previous studies of sparse PCA. We find our method performs better than one published algorithm and comparably to a second.
关 键 词: 稀疏主成分; 密集消息传递
课程来源: 视频讲座网
最后编审: 2019-10-30:cwx
阅读次数: 27