0


从约束中学习

Learning from constraints
课程网址: http://videolectures.net/ecmlpkdd2011_gori_learning/  
主讲教师: Marco Gori
开课单位: 锡耶纳大学
开课时间: 2011-10-03
课程语种: 英语
中文简介:
在本次演讲中,我提出了一个功能框架,以了解暴露于示例和知识粒子的代理中智能的出现。该理论基于约束的抽象概念,它提供了从与环境的相互作用中获得的知识粒子的表示。我通过扩展内核机器的经典框架来结合逻辑形式(如一阶逻辑),从而在表示定理方面给出了“代理体”的图片。这可以通过在同一功能框架中统一连续和离散计算机制来实现,因此任何刺激(如监督示例和逻辑谓词)都被转换为约束。基于约束变分微积分的学习或者通过约束的简约匹配或者通过最小化熵表达的无监督机制来指导。我展示了一些具有不同种类的符号和子符号约束的实验,以及然后,我提出了在计算机视觉中采用拟议框架的见解。结果表明,在大多数有趣的任务中,从约束中学习自然会导致“深层架构”,这种架构在每个阶段遵循将注意力集中在“容易约束”的发展原则时出现。有趣的是,这表明在发展心理学中讨论的基于阶段的学习可能不是生物学的主要结果,但它可能是优化原则和复杂性问题的结果,而不管“身体”如何。
课程简介: In this talk, I propose a functional framework to understand the emergence of intelligence in agents exposed to examples and knowledge granules. The theory is based on the abstract notion of constraint, which provides a representation of knowledge granules gained from the interaction with the environment. I give a picture of the “agent body” in terms of representation theorems by extending the classic framework of kernel machines in such a way to incorporate logic formalisms, like first-order logic. This is made possible by the unification of continuous and discrete computational mechanisms in the same functional framework, so as any stimulus, like supervised examples and logic predicates, is translated into a constraint. The learning, which is based on constrained variational calculus, is either guided by a parsimonious match of the constraints or by unsupervised mechanisms expressed in terms of the minimization of the entropy. I show some experiments with different kinds of symbolic and sub-symbolic constraints, and then I give insights on the adoption of the proposed framework in computer vision. It is shown that in most interesting tasks the learning from constraints naturally leads to “deep architectures”, that emerge when following the developmental principle of focusing attention on “easy constraints”, at each stage. Interestingly, this suggests that stage-based learning, as discussed in developmental psychology, might not be primarily the outcome of biology, but it could be instead the consequence of optimization principles and complexity issues that hold regardless of the “body.”
关 键 词: 功能框架; 知识粒子; 抽象概念
课程来源: 视频讲座网
最后编审: 2019-04-02:cwx
阅读次数: 38