图 书 馆
从树到森林和规则集-集成方法的统一概述From Trees to Forests and Rule Sets - A Unified Overview of Ensemble Methods |
|
| 课程网址: | http://videolectures.net/kdd07_elder_seni_fttf/ |
| 主讲教师: | John Elder, Giovanni Seni |
| 开课单位: | 圣克拉拉大学 |
| 开课时间: | 2007-08-14 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Ensemble methods are one of the most influential developments in Machine Learning over the past decade. They perform extremely well in a variety of problem domains, have desirable statistical properties, and scale well computationally. By combining competing models into a committee, they can strengthen “weak” learning procedures. ;This tutorial explains two recent developments with ensemble methods: :**Importance Sampling** reveals “classic” ensemble methods (bagging, random forests, and boosting) to be special cases of a single algorithm. This unified view clarifies the properties of these methods and suggests ways to improve their accuracy and speed. :**Rule Ensembles** are linear rule models derived from decision tree ensembles. While maintaining (and often improving) the accuracy of the tree ensemble, the rule-based model is much more interpretable. This tutorial is aimed at both novice and advanced data mining researchers and practitioners especially in Engineering, Statistics, and Computer Science. Users with little exposure to ensemble methods will gain a clear overview of each method. Advanced practitioners already employing ensembles will gain insight into this breakthrough way to create next-generation models. ;**John Elder's lecture**: : In a Nutshell, Examples & Timeline : Predictive Learning : Decision Trees ;**Giovanni Seni's lecture**: : Model Selection (Bias-Variance Tradeoff , Regularization via shrinkage) : Ensemble Learning & Importance Sampling (ISLE) : Generic Ensemble Generation : Bagging, Random Forest, AdaBoost, MART : Rule Ensembles : Interpretation |
| 关 键 词: | 集合方法; 机器学习; 线性规则模型 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2019-05-08：lxf |
| 阅读次数: | 73 |