0


人的归纳学习的贝叶斯模型

Bayesian models of human inductive learning
课程网址: http://videolectures.net/icml07_tenenbaum_bmhi/  
主讲教师: Tenenbaum Joshua B
开课单位: 麻省理工学院
开课时间: 2007-06-22
课程语种: 英语
中文简介:
在日常学习和推理中,人们通常从非常有限的证据中得出成功的概括。即使是幼儿也能从一个或几个相关的观察中推断出单词的含义、物体的隐藏属性或因果关系的存在——远远超过了传统学习机器的能力。他们是怎么做到的?我们怎样才能使机器更接近人类的学习能力呢?我认为,人们日常的归纳跳跃可以理解为对贝叶斯计算的近似,这种计算是在世界的结构化表示上运行的,认知科学家称之为直觉理论或模式。对于每一个日常学习任务,我将考虑如何构建和使用适当的知识表示,以及如何通过贝叶斯方法学习这些表示。关键的挑战是平衡对强约束归纳偏倚的需求——对极少数例子中的泛化至关重要——以及学习新域结构的灵活性,学习适用于我们无法预先编程执行的环境的新归纳偏倚。我讨论的模型将连接到当代机器学习的几个方向,例如半监督学习、图形模型中的结构学习、层次贝叶斯模型和非参数贝叶斯。
课程简介: In everyday learning and reasoning, people routinely draw successful generalizations from very limited evidence. Even young children can infer the meanings of words, hidden properties of objects, or the existence of causal relations from just one or a few relevant observations -- far outstripping the capabilities of conventional learning machines. How do they do it? And how can we bring machines closer to these human-like learning abilities? I will argue that people's everyday inductive leaps can be understood as approximations to Bayesian computations operating over structured representations of the world, what cognitive scientists have called "intuitive theories" or "schemas". For each of several everyday learning tasks, I will consider how appropriate knowledge representations are structured and used, and how these representations could themselves be learned via Bayesian methods. The key challenge is to balance the need for strongly constrained inductive biases -- critical for generalization from very few examples -- with the flexibility to learn about the structure of new domains, to learn new inductive biases suitable for environments which we could not have been pre-programmed to perform in. The models I discuss will connect to several directions in contemporary machine learning, such as semi-supervised learning, structure learning in graphical models, hierarchical Bayesian modeling, and nonparametric Bayes.
关 键 词: 机器学习; 贝叶斯计算; 电感偏差; 图形化模型
课程来源: 视频讲座网
最后编审: 2019-12-05:lxf
阅读次数: 22