视觉检测及其应用Validating the Detection of Everyday Concepts in Visual Lifelogs |
|
课程网址: | http://videolectures.net/samt08_doherty_vdec/ |
主讲教师: | Aiden Roger Doherty |
开课单位: | 都柏林城市大学 |
开课时间: | 2008-12-18 |
课程语种: | 英语 |
中文简介: | Microsoft SenseCam是一款小巧轻便的可穿戴式相机,用于从用户的日常活动中被动捕获照片和其他传感器读数。它每天最多可拍摄3,000张图像,相当于每年近100万张图像。它用于通过创建个人多媒体生活日志或佩戴者生活的视觉记录来帮助记忆。然而,在视觉生活日志中捕获的大量图像数据产生了许多挑战,特别是对于定位相关内容。在这项工作中,我们探索语义概念检测的适用性,这是视频检索中经常使用的一种方法,适用于视觉生命线的新领域。概念检测器使用有监督的机器学习来模拟低级视觉特征与高级语义概念(诸如室内,室外,人,建筑物等)之间的对应关系。通过这样做,它确定概念存在的概率。我们将27个日常语义概念的检测应用于由5个用户的257,518个SenseCam图像组成的生活日志集合中。然后在95,907个图像的子集上评估结果,以确定检测每个语义概念的精度,并对这5个用户的生活方式进行一些有趣的推断。我们还在生活日志领域展示了概念检测的未来应用。 |
课程简介: | The Microsoft SenseCam is a small lightweight wearable camera used to passively capture photos and other sensor readings from a user's day-to-day activities. It can capture up to 3,000 images per day, equating to almost 1 million images per year. It is used to aid memory by creating a personal multimedia lifelog, or visual recording of the wearer's life. However the sheer volume of image data captured within a visual lifelog creates a number of challenges, particularly for locating relevant content. Within this work, we explore the applicability of semantic concept detection, a method often used within video retrieval, on the novel domain of visual lifelogs. A concept detector models the correspondence between low-level visual features and high-level semantic concepts (such as indoors, outdoors, people, buildings, etc.) using supervised machine learning. By doing so it determines the probability of a concept's presence. We apply detection of 27 everyday semantic concepts on a lifelog collection composed of 257,518 SenseCam images from 5 users. The results were then evaluated on a subset of 95,907 images, to determine the precision for detection of each semantic concept and to draw some interesting inferences on the lifestyles of those 5 users. We additionally present future applications of concept detection within the domain of lifelogging. |
关 键 词: | 可穿戴式相机; 视觉记录; 视觉记忆; 视觉生命线; 视频检索; 感念检测; 未来应用 |
课程来源: | 视频讲座网 |
最后编审: | 2020-06-08:cxin |
阅读次数: | 43 |