图 书 馆
伯恩斯坦推动实证Empirical Bernstein boosting |
|
| 课程网址: | http://videolectures.net/aistats2010_shivaswamy_ebb/ |
| 主讲教师: | Pannaga Shivaswamy |
| 开课单位: | 哥伦比亚大学 |
| 开课时间: | 2010-06-03 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Concentration inequalities that incorporate variance information (such as Bernstein's or Bennett's inequality) are often significantly tighter than counterparts (such as Hoeffding's inequality) that disregard variance. Nevertheless, many state of the art machine learning algorithms for classification problems like AdaBoost and support vector machines (SVMs) extensively use Hoeffding's inequalities to justify empirical risk minimization and its variants. This article proposes a novel boosting algorithm based on a recently introduced principle--sample variance penalization--which is motivated from an empirical version of Bernstein's inequality. This framework leads to an efficient algorithm that is as easy to implement as AdaBoost while producing a strict generalization. Experiments on a large number of datasets show significant performance gains over AdaBoost. This paper shows that sample variance penalization could be a viable alternative to empirical risk minimization. |
| 关 键 词: | 伯恩斯坦; 实证 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2021-01-31：nkq |
| 阅读次数: | 55 |