0


朋友不让朋友部署黑盒模型:机器学习中可理解性的重要性

Friends Don’t Let Friends Deploy Black-Box Models: The Importance of Intelligibility in Machine Learning
课程网址: http://videolectures.net/kdd2019_caruana_friends_deploy/  
主讲教师: Rich Caruana
开课单位: 微软研究院
开课时间: 2020-03-02
课程语种: 英语
中文简介:
每一个数据集都有缺陷,通常以出乎意料和难以检测的方式出现。如果你不能理解你的模型学到了什么,那么你几乎可以肯定,你所交付的模型比它们可能的精度要低,甚至可能有风险。从历史上看,精确性和可理解性之间存在权衡:神经网络、增强树和随机森林等精确模型不太容易理解,逻辑回归和小树或决策列表等可理解模型通常不太准确。在诸如医疗等关键任务领域,能够理解、验证、编辑并最终信任模型非常重要,人们通常不得不选择不太准确的模型。但这正在改变。我们开发了一种基于具有两两相互作用的广义加性模型(GA2Ms)的学习方法,该方法与全复杂度模型一样精确,但比逻辑回归更易于解释。在这次演讲中,我将重点介绍潜伏在我们所有数据集中的各种问题,以及这些可解释、高性能的GAM是如何使以前隐藏的内容变得可见的。我还将展示我们如何使用这些模型来揭示公平性和透明度非常重要的模型中的偏见。(模型的代码最近已公开发布。)
课程简介: Every data set is flawed, often in ways that are unanticipated and difficult to detect. If you can’t understand what your model has learned, then you almost certainly are shipping models that are less accurate than they could be and which might even be risky. Historically there has been a tradeoff between accuracy and intelligibility: accurate models such as neural nets, boosted tress and random forests are not very intelligible, and intelligible models such as logistic regression and small trees or decision lists usually are less accurate. In mission-critical domains such as healthcare, where being able to understand, validate, edit and ultimately trust a model is important, one often had to choose less accurate models. But this is changing. We have developed a learning method based on generalized additive models with pairwise interactions (GA2Ms) that is as accurate as full complexity models yet even more interpretable than logistic regression. In this talk I’ll highlight the kinds of problems that are lurking in all of our datasets, and how these interpretable, high-performance GAMs are making what was previously hidden, visible. I’ll also show how we’re using these models to uncover bias in models where fairness and transparency are important. (Code for the models has recently been released open-source.)
关 键 词: 部署黑盒模型; 机器学习; 可理解性的重要性
课程来源: 视频讲座网
数据采集: 2022-09-16:cyh
最后编审: 2022-09-19:cyh
阅读次数: 25