图 书 馆
用于多模式交互的动态贝叶斯网络Dynamic Bayesian Networks for Multimodal Interaction |
|
| 课程网址: | http://videolectures.net/mlmi04uk_jebara_dbnmi/ |
| 主讲教师: | Tony Jebara |
| 开课单位: | 哥伦比亚大学 |
| 开课时间: | 2007-02-25 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Dynamic Bayesian networks (DBNs) offer a natural upgrade path beyond classical hidden Markov models and become especially relevant when temporal data contains higher order structure, multiple modalities or multi-person interaction. We describe several instantiations of dynamic Bayesian networks that are useful for modeling temporal phenomena spanning audio, video and haptic channels in single, two-person and multi-person activity. These models include input-output hidden Markov models, switched Kalman filters and, most generally, dynamical systems trees (DSTs). These models are used to learn audio-video interaction in social activities, video interaction in multi-person game playing and haptic-video interaction in robotic laparoscopy. Model parameters are estimated from data in an unsupervised setting using generalized expectation maximization methods. Subsequently, these models can predict, synthesize and classify various types of rich multimodal human activity. Experiments in gesture interaction, audio-video conversation, football game playing and surgical drill evaluation are shown. |
| 关 键 词: | 动态贝叶斯网络; 隐马尔可夫模型; 音频视频交互 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2019-06-30：yuh |
| 阅读次数: | 57 |