0


人体感应,隐式标签,和隐式交互

Human Sensing, Implicit Tagging, and Implicit Interaction
课程网址: http://videolectures.net/s3mr2011_nijholt_interaction/  
主讲教师: Anton Nijholt
开课单位: 特温特大学
开课时间: 2011-07-18
课程语种: 英语
中文简介:
多媒体数据的注释通常由人类注释器手动完成,或者使用直接分析多媒体数据的算法自动完成。这些方法的替代方案是使用隐式标记,其目的是在他/她与多媒体数据交互时观察用户并通过分析用户的反应来推断关于数据的知识。隐式标记可以通过各种形式进行,例如面部表情,身体姿势,EEG分析,凝视跟踪,口头和非言语交流等。在本次演讲中,我们将重点放在配备传感器的环境中的人体感知连续体上。用于未来检索目的的“离线标记”和用于实时支持用户的“在线标记”。通过观察他或她与应用程序或与其他人类的交互模式,我们可以从用户那里学到什么?我们如何才能离线和在线使用这些知识?配备传感器的人将成为“物联网”中的“事物”(或节点)。他们将自愿和非自愿地用他们的行为信息提供物联网,允许“物联网”进行行为检索,但也允许“物联网”更多地了解他们的生活,而不是他们可以接受的。在我们的演讲中,我们还将研究欺骗环境的可能性,即为环境提供隐藏我们真实感受和意图的信号。这在日常生活中并不罕见,并且能够在“无处不在”的传感环境中实现这一点,这样就可以在这种环境中保持我们行为的“自然性”。
课程简介: Annotation of multimedia data is usually done manually by human annotators or automatically, using algorithms that directly analyze the multimedia data. An alternative to these methods is the use of implicit tagging, where the aim is to observe the user as he/she engages with the multimedia data and infer knowledge about the data by analyzing the user's reactions. Implicit tagging can be performed through various modalities, such as facial expressions, body gestures, EEG analysis, gaze tracking, verbal and non-verbal communication etc. In this talk we we focus on the continuum of human sensing in a sensor-equipped environment for 'off-line tagging' for future retrieval purposes and 'on-line tagging' for real-time support of a user. What can we learn from a user by observing his or her interaction patterns with an application or with another human? And how can we make off-line and on-line use of this knowledge? Sensor-equipped humans will become 'things' (or nodes) in the 'Internet of Things'. They will voluntarily and involuntarily feed the Internet of Things with their behavioral information, allowing the 'Internet of Things' to do behavioral retrieval, but also allowing the 'Internet of Things' to learn more about their life than they may find acceptable. In our talk we will also look at possibilities to deceive the environment, that is, feeding the environment with signals that hide our true feelings and intentions. This is not unusual in daily life, and being able to do so in 'everywhere and always' sensing environments will make it possible to maintain 'naturalness' in our behavior in such environments.
关 键 词: 计算机科学; 人机交互; 计算机
课程来源: 视频讲座网
最后编审: 2020-06-27:zyk
阅读次数: 61