0


连续手语电视广播的自动高效长期手臂和手部跟踪

Automatic and Efficient Long Term Arm and Hand Tracking for Continuous Sign Language TV Broadcasts
课程网址: http://videolectures.net/bmvc2012_pfister_sign_language/  
主讲教师: Tomas Pfister
开课单位: 牛津大学
开课时间: 2012-10-09
课程语种: 英语
中文简介:
我们提出了一个全自动的手臂和手跟踪器,检测关节位置连续手语视频序列超过一个小时的长度。我们的框架复制了Buehler等人(IJCV 2011)最先进的长期跟踪器,但不需要手工注释,在自动初始化后,执行实时跟踪。我们将这个问题描述为一个没有强空间模型的一帧一帧随机森林回归子问题。我们的贡献是(i)一种使用生成分层模型自动将签署人与任何已签署人的电视广播分开的共分割算法;一种仅给出分割和使用随机森林回归的颜色模型的关节位置预测方法;并且(iii)证明随机森林可以从现有的半自动但计算昂贵的跟踪器中训练出来。该方法适用于背景变化、成像条件复杂、签名者不同的视频签名。与Buehler等方法相比,我们获得了更好的联合定位结果。
课程简介: We present a fully automatic arm and hand tracker that detects joint positions over continuous sign language video sequences of more than an hour in length. Our framework replicates the state-of-the-art long term tracker by Buehler et al. (IJCV 2011), but does not require the manual annotation and, after automatic initialisation, performs tracking in real-time. We cast the problem as a generic frame-by-frame random forest regressor without a strong spatial model.\\ Our contributions are (i) a co-segmentation algorithm that automatically separates the signer from any signed TV broadcast using a generative layered model; (ii) a method of predicting joint positions given only the segmentation and a colour model using a random forest regressor; and (iii) demonstrating that the random forest can be trained from an existing semi-automatic, but computationally expensive, tracker.\\ The method is applied to signing footage with changing background, challenging imaging conditions, and for different signers. We achieve superior joint localisation results to those obtained using the method of Buehler et al.
关 键 词: 全自动手臂; 手动跟踪器; 手语视频
课程来源: 视频讲座网
最后编审: 2021-01-31:nkq
阅读次数: 47