0


智能行为(2011-14):智能观察与执行的行动和操纵

IntellAct (2011-14): Intelligent observation and execution of Actions and manipulations
课程网址: http://videolectures.net/cogsys2012_krueger_intelligent/  
主讲教师: Norbert Krüger
开课单位: 南丹麦大学
开课时间: 2012-03-14
课程语种: 英语
中文简介:
智能行为解决的问题是理解和利用操作的意义(语义)的对象,行动和他们的后果与机器复制人类的行动。这对于人与机器人之间的互动是特别需要的,在这种互动中机器人必须理解人类的行为,然后将其转化为自己的身体。智能行为将提供一种手段,使这种转移不是通过复制人类的运动,而是通过在语义层面上转移人类的行动。智能行为将展示理解场景和动作语义的能力,并与机器人在两个领域执行动作。首先,在实验室环境中(以国际空间站(ISS)的实验室为例),其次,在工业环境中的装配过程中。智能行为包括三个构建模块:;学习——从显示人类演示操作的视频序列中提取操作的抽象、语义描述;;监测-在第二步中,根据所学的语义模型对观察到的操作进行评估;执行——基于学习的语义模型,机器人执行等价的操作。对语义内容(学习)的低级观测数据的分析和具体行为(执行)的综合构成了智能行为的主要科学挑战。基于语义解释和描述和增强与低级轨迹数据为基础,通过IntellAct来解决两个主要应用领域:第一,人力操作正确性的监控(如培训或在高风险的情况下)其次,有效教学的认知机器人在各种各样的应用程序执行操作。为了实现这些目标,智能行为汇集了最新的方法:;将场景解析为时空图和所谓的“语义事件链”。;对象及其操作的概率模型。;概率规则学习;机器人运动行为可训练和灵活描述的动态运动原语。它的实现采用了一种并行工程方法,其中包括虚拟现实增强的仿真以及物理机器人。它的最终目标是展示机器人对人类行为的理解、监控和复制。
课程简介: IntellAct addresses the problem of understanding and exploiting the meaning (semantics) of manipulations in terms of objects, actions and their consequences for reproducing human actions with machines. This is in particular required for the interaction between humans and robots in which the robot has to understand the human action and then to transfer it to its own embodiment. IntellAct will provide means to allow for this transfer not by copying movements of the human but by transferring the human action on a semantic level. IntellAct will demonstrate the ability to understand scene and action semantics and to execute actions with a robot in two domains. First, in a laboratory environment (exemplified by a lab in the International Space Station (ISS)) and second, in an assembly process in an industrial context. IntellAct consists of three building blocks: ;Learning - Abstract, semantic descriptions of manipulations are extracted from video sequences showing a human demonstrating the manipulations; ;Monitoring - In the second step, observed manipulations are evaluated against the learned, semantic models; ;Execution - Based on learned, semantic models, equivalent manipulations are executed by a robot. The analysis of low-level observation data for semantic content (Learning) and the synthesis of concrete behaviour (Execution) constitute the major scientific challenge of IntellAct. Based on the semantic interpretation and description and enhanced with low-level trajectory data for grounding, two major application areas are addressed by IntellAct: First, the monitoring of human manipulations for correctness (e.g., for training or in high-risk scenarios) and second, the efficient teaching of cognitive robots to perform manipulations in a wide variety of applications. To achieve these goals, IntellAct brings together recent methods for: ;parsing scenes into spatio-temporal graphs and so-called "semantic Event Chains‟. ;probabilistic models of objects and their manipulation. ;probabilistic rule learning, and ;dynamic motion primitives for trainable and flexible descriptions of robotic motor behaviour. Its implementation employs a concurrent-engineering approach that includes virtual-reality-enhanced simulation as well as physical robots. Its goal culminates in the demonstration of a robot understanding, monitoring and reproducing human action.
关 键 词: 智能行为; 人机互动; 操作的意义; 复制人类行动; 虚拟与现实仿真; 物理机器人
课程来源: 视频讲座网
最后编审: 2019-10-17:cwx
阅读次数: 63