图 书 馆
贝叶斯推理中的追赶现象The Catch-Up Phenomenon in Bayesian Inference |
|
| 课程网址: | http://videolectures.net/uai08_grunwald_cup/ |
| 主讲教师: | Peter Grünwald |
| 开课单位: | 数学与计算机科学中心 |
| 开课时间: | 2008-07-30 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Standard Bayesian model selection/averaging sometimes learn too slowly: there exist other learning methods that lead to better predictions based on less data. We give a novel analysis of this "catch-up" phenomenon. Based on this analysis, we propose the switching method, a modification of Bayesian model averaging that never learns slower, but sometimes learns much faster than Bayes. The method is related to expert-tracking algorithms developed in the COLT literature, and has time complexity comparable to Bayes. The switching method resolves a long-standing debate in statistics, known as the AIC-BIC dilemma: model selection/averaging methods like BIC, Bayes, and MDL are consistent (they eventually infer the correct model) but, when used for prediction, the rate at which predictions improve can be suboptimal. Methods like AIC and leave-one-out cross-validation are inconsistent but typically converge at the optimal rate. Our method is the first that provably achieves both. Experiments with nonparametric density estimation confirm that these large-sample theoretical results also hold in practice in small samples. |
| 关 键 词: | 贝叶斯模型; 追赶现象; 非参数密度 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2020-07-29：yumf |
| 阅读次数: | 68 |