0


基于多任务递归神经网络的即时性预测

Multi-Task Recurrent Neural Network for Immediacy Prediction
课程网址: http://videolectures.net/iccv2015_chu_neural_network/  
主讲教师: Xiao Chu
开课单位: 视频讲座网
开课时间: 2016-02-10
课程语种: 英语
中文简介:
在本文中,我们提出从静态图像中预测人与人之间互动的即时性。一个完整的直接集合包括相互作用、相对距离、身体倾斜方向和站立方向。这些指标与交际者的态度、社会关系、社会交往、行为、国籍和宗教有关。构建了一个包含10,000张图像的大规模数据集,在这个数据集中,所有的即时线索和人体姿势都被注释了。我们提出了一组丰富的即时性表示,帮助从不完美的1人和2人姿势估计结果中预测即时性。构造了一个多任务深度递归神经网络,以所提出的丰富直接性表示作为输入,通过多步细化来学习直接性预测之间的复杂关系。在大规模数据集上的大量实验证明了该方法的有效性。
课程简介: In this paper, we propose to predict immediacy for interacting persons from still images. A complete immediacy set includes interactions, relative distance, body leaning direction and standing orientation. These measures are found to be related to the attitude, social relationship, social interaction, action, nationality, and religion of the communicators. A large-scale dataset with 10,000 images is constructed, in which all the immediacy cues and the human poses are annotated. We propose a rich set of immediacy representations that help to predict immediacy from imperfect 1-person and 2-person pose estimation results. A multi-task deep recurrent neural network is constructed to take the proposed rich immediacy representations as the input and learn the complex relationship among immediacy predictions through multiple steps of refinement. The effectiveness of the proposed approach is proved through extensive experiments on the large-scale dataset.
关 键 词: 即时互动; 相对距离; 静态图像
课程来源: 视频讲座网
数据采集: 2022-12-02:chenxin01
最后编审: 2022-12-02:chenxin01
阅读次数: 23