0


哪里是什么?-对城市环境的语义映射

Where's What? - Towards Semantic Mapping of Urban Environments
课程网址: http://videolectures.net/nipsworkshops09_posner_wwts/  
主讲教师: Ingmar Posner
开课单位: 牛津大学
开课时间: 2010-01-19
课程语种: 英语
中文简介:
从覆盖同一工作空间的多种模式获得连续数据流一直被机器人研究人员视为一种特权。数据融合在这一领域有着成功的记录,导致了目前为止非结构化环境中高质量大规模度量和拓扑图的常规生成。然而,随着这一成功,人们认识到机器人学中的重要应用——如动作选择和人机交互——需要的信息不仅仅是度量或拓扑表示。因此,整个社区的研究人员越来越有兴趣在获得的地图中添加更高阶的语义信息。在这种情况下,免费模式中丰富的数据集的可用性又一次发挥了作用。在本文中,我们提供了一个正在进行的工作的快照,旨在丰富移动机器人所提供的具有更高阶语义信息的标准度量或拓扑图。在不同尺度上考虑环境线索进行分类。第一阶段使用概率词袋分类器考虑局部场景属性。第二阶段通过马尔可夫随机场(MRF)将给定场景(空间上下文)和几个连续场景(时间上下文)中的上下文信息合并在一起。我们的方法是由车载摄像头和3D激光扫描仪的数据驱动的,并结合了视觉和几何特征。我们展示了在分类任务中考虑这种时空背景的优点,并分析了我们的技术对通过城市17公里轨道收集的数据的性能。
课程简介: The availability of continuous streams of data from multiple modalities covering the same workspace has long been recognised as a privilege by robotics researchers. Data fusion has a successful track record in the field leading to the by now routine generation of high-quality large scale metric and topological maps of unstructured environments. With this success, however, comes the realisation that prominent applications in robotics -- such as action selection and human machine interaction -- require information beyond mere metric or topological representations. As a result, researchers throughout the community are becoming increasingly interested in adding higher-order, semantic information to the maps obtained. In this context, the availability of a rich set of data from complimentary modalities once again comes into its own. In this talk we provide a snapshot of ongoing work aiming to enrich standard metric or topological maps as provided by a mobile robot with higher-order semantic information. Environmental cues are considered for classification at different scales. The first stage considers local scene properties using a probabilistic bag-of-words classifier. The second stage incorporates contextual information across a given scene (spatial context) and across several consecutive scenes (temporal context) via a Markov Random Field (MRF). Our approach is driven by data from an onboard camera and 3D laser scanner and uses a combination of visual and geometric features. We demonstrate the virtue of considering such spatial and temporal context during the classification task and analyse the performance of our technique on data gathered over 17 km of track through a city.
关 键 词: 数据融合; 人机交互; 高阶语义信息
课程来源: 视频讲座网
最后编审: 2020-06-02:毛岱琦(课程编辑志愿者)
阅读次数: 28