0


野外预测建模:数据挖掘竞赛和现实应用中的成功因素

Predictive Modelling in the Wild: Success Factors in Data Mining Competitions and Real-World Applications
课程网址: http://videolectures.net/kdd09_rosset_perlich_pmw/  
主讲教师: Saharon Rosset, Claudia Perlich
开课单位: 特拉维夫大学
开课时间: 2009-09-14
课程语种: 英语
中文简介:
在本教程中,我们将对预测建模成功应用于KDD Cup和现实商业智能项目等竞赛的关键进行了展望。我们认为这两种应用预测建模的模式有许多相似之处,但也存在一些重要的差异。我们讨论了预测建模的主要成功因素:领域理解,统计敏锐度和适当的算法方法。我们在三个最近的预测建模竞赛中描述了我们的相关经验,我们的团队取得了成功(KDD Cup 2007和2008以及INFORMS DM挑战2008)和两个我们在IBM Research领导的项目案例研究。我们还调查了实际预测建模应用中的一些反复出现的挑战和复杂性。一个关键问题是信息泄漏,我们讨论其定义,影响,检测和避免。我们认为泄漏是许多预测建模项目的沉默杀手,我们展示了它对竞争的影响,并讨论了在现实生活项目中解决它的挑战。其他挑战包括将现实生活建模目标框定为预测建模,并在建模“现实生活”复杂关系数据集时有用地应用关系学习概念。
课程简介: In this tutorial, we give our perspective on the keys to success in application of predictive modeling to competitions like KDD Cup and real-life business intelligence projects. We argue that these two modes of applying predictive modeling share many similarities, but have also some important differences. We discuss the main success factors in predictive modeling: domain understanding, statistical acumen, and appropriate algorithmic approaches. We describe our relevant experiences in the context of three recent predictive modeling competitions where our team has had success (KDD Cup 2007 and 2008 and INFORMS DM challenge 2008) and two case studies of projects we have led at IBM Research. We also survey some of the recurring challenges and complexities in practical predictive modeling applications. One key issue is information leakage, and we discuss its definition, influence, detection and avoidance. We consider leakage to be the silent killer of many predictive modeling projects, and we demonstrate its impact on the competitions, and discuss the challenges in addressing it in the real-life projects. Other challenges include framing real-life modeling objectives into predictive modeling, and usefully applying relational learning concepts when modeling "real-life" complex, relational datasets.
关 键 词: 预测建模; 信息泄漏; 关系学习
课程来源: 视频讲座网
最后编审: 2019-05-10:lxf
阅读次数: 101