图 书 馆
用于协同过滤的大规模贝叶斯推理Large-scale Bayesian Inference for Collaborative Filtering |
|
| 课程网址: | http://videolectures.net/abi07_winther_lsb/ |
| 主讲教师: | Ole Winther |
| 开课单位: | 丹麦技术大学 |
| 开课时间: | 2007-12-31 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | The Netflix prize problem provides an excellent testing ground for machine learning. The problem is large scale and the data complex and noisy. It is therefore likely that relatively complex models with careful regularization are needed in order to get reasonable predictions. A Bayesian modeling approach seems ideal for the task if it is possible to scale it up to the size of the Netflix data set, where extremely high-dimensional Bayesian expectations will possibly have to be approximated. In this talk, an ordinal regression low-rank matrix decomposition model is presented. We use a variational Bayes (VB) inference algorithm to demonstrate that it is possible to make a large scale Bayesian algorithm. This model also highlight some of the general limitations of VB. The more accurate expectation propagation/expectation consistent (EP/C) inference cannot be applied to this bi-linear model without further approximations. We therefore propose a hybrid approach with EP/C inspired modifications of the VB algorithm. We compare the different variational approximations with a Laplace approximation, a MAP approximation and a Hamiltonian MCMC. In the latter one sample takes around 6 hours of computing time on a 1GHz processor, with fast C++ code, so there is a very clear case to be made for deterministic approximate inference. Another good feature of the Netflix data is the magnitude of the the test set which makes even small differences in the performance significant. |
| 关 键 词: | 机器学习; 贝叶斯建模; 矩阵分解 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2022-12-07：chenjy |
| 最后编审: | 2022-12-07：chenjy |
| 阅读次数: | 34 |