0


通过简单的运动模板学习复杂的运动

Learning Complex Motions by Sequencing Simpler Motion Templates
课程网址: http://videolectures.net/icml09_neumann_lcm/  
主讲教师: Gerhard Neumann
开课单位: 达姆施塔特理工大学
开课时间: 2009-08-26
课程语种: 英语
中文简介:
将复杂的、较长的运动任务抽象为简单的基本运动,使人类和动物展示出尚未被机器人所匹配的运动技能。人类凭直觉将复杂的运动分解成更小、更简单的部分。例如,当描述简单的动作时,比如用钢笔画三角形,我们可以很容易地说出这个动作的基本步骤。令人惊讶的是,这种抽象很少用于人工运动技能学习算法。这些算法通常以非常快的时间尺度选择新的动作(如扭矩或力)。因此,政策和时间信用分配问题变得不必要的复杂-往往超出了当前机器学习方法的范围。本文介绍了一种新的强化学习(RL)中时间抽象的框架,即带有运动模板的RL。我们提出了一种新的框架算法,该算法只需做出很少的抽象决策就可以学习高质量的策略。
课程简介: Abstraction of complex, longer motor tasks into simpler elemental movements enables humans and animals to exhibit motor skills which have not yet been matched by robots. Humans intuitively decompose complex motions into smaller, simpler segments. For example when describing simple movements like drawing a triangle with a pen, we can easily name the basic steps of this movement. Surprisingly, such abstractions have rarely been used in artificial motor skill learning algorithms. These algorithms typically choose a new action (such as a torque or a force) at a very fast time-scale. As a result, both policy and temporal credit assignment problem become unnecessarily complex - often beyond the reach of current machine learning methods. We introduce a new framework for temporal abstractions in reinforcement learning (RL), i.e. RL with motion templates. We present a new algorithm for this framework which can learn high-quality policies by making only few abstract decisions.
关 键 词: 运动技能; 时间尺度; 信贷分配问题; 抽象框架
课程来源: 视频讲座网
最后编审: 2019-12-08:lxf
阅读次数: 46