图 书 馆
不匹配的模型、错误的结果和可怕的决策Mismatched Models, Wrong Results, and Dreadful Decisions |
|
| 课程网址: | http://videolectures.net/kdd09_hand_mmwrdd/ |
| 主讲教师: | David Hand |
| 开课单位: | 伦敦帝国学院 |
| 开课时间: | 2009-09-14 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Data mining techniques use score functions to quantify how well a model fits a given data set. Parameters are estimated by optimising the fit, as measured by the chosen score function, and model choice is guided by the size of the scores for the different models. Since different score functions summarise the fit in different ways, it is important to choose a function which matches the objectives of the data mining exercise. For predictive classification problems, a wide variety of score functions exist, including measures such as precision and recall, the F measure, misclassification rate, the area under the ROC curve (the AUC), and others. The first four of these require a classification threshold to be chosen, a choice which may not be easy, or may even be impossible, especially when the classification rule is to be applied in the future. In contrast, the AUC does not require the specification of a classification threshold, but summarises performance over the range of possible threshold choices. However, unfortunately, and despite the widespread use of the AUC, it has a previously unrecognised fundamental incoherence lying at the core of its definition. This means that using the AUC can lead to poor model choice and unecessary misclassifications. The AUC is set in context, its deficiency explained and the implications illustrated - with the bottom line being that the AUC should not be used. A family of coherent alternative scores is described. The ideas are illustrated with examples from bank loans, fraud, face recognition, and health screening. |
| 关 键 词: | 数据挖掘技术; 量化模型; 相干替代 |
| 课程来源: | 视频讲座网 |
| 数据采集: | 2022-12-12：chenjy |
| 最后编审: | 2022-12-12：chenjy |
| 阅读次数: | 22 |