0


纹理曲线对象的可变形跟踪

Deformable Tracking of Textured Curvilinear Objects
课程网址: http://videolectures.net/bmvc2012_padoy_curvilinear_objects/  
主讲教师: Nicolas Padoy
开课单位: 约翰霍普金斯大学
开课时间: 2012-10-09
课程语种: 英语
中文简介:
涉及可变形曲线对象(如螺纹和电缆)操作的任务的评估和自动化需要从图像实时估计这些对象的三维形状。然而,由于可用的视觉信息量小、固有的几何模糊性和大的物体变形,这种估计非常具有挑战性。\\n我们提出了一种仅使用一个或多个校准相机的视觉信息跟踪可变形曲线物体的方法。其核心思想是将形状估计作为一个可变形的一维模板跟踪问题。物体首先用不同交替颜色的图案进行纹理处理。然后将跟踪问题表示为一组控制点上的能量最小化,这些控制点参数化了对象的三维NURBS建模。假设对象具有可扩展性,我们提出了一种基于纹理敏感距离图的新能量。\\n我们利用达芬奇机器人演示线程变形和操作的数据,在合成和真实实验中演示了这种能量的好处。特别是,我们证明了该方法允许在没有沿着曲线的正常运动的情况下进行可变形跟踪,这是一种具有挑战性的实际情况,当线程被一端拖动时会发生这种情况。
课程简介: The evaluation and automation of tasks involving the manipulation of deformable curvilinear objects, such as threads and cables, requires the real-time estimation of the 3D shapes of these objects from images. This estimation is however extremely challenging due to the small amount of available visual information, the inherent geometric ambiguities, and the large object deformations.\\ We propose an approach for tracking deformable curvilinear objects using solely visual information from one or more calibrated cameras. The key idea is to formulate the shape estimation as a deformable 1D template tracking problem. The object is first textured with a pattern of different alternating colors. The tracking problem is then expressed as an energy minimization over a set of control points parameterizing a 3D NURBS modeling the object. Assuming the object’s in-extensibility, we propose a novel energy based on a texture-sensitive distance map.\\ We demonstrate the benefits of this energy in synthetic and real experiments, using data illustrating the deformation and manipulation of a thread with a da Vinci robot. In particular, we show that the approach allows for deformable tracking in the absence of normal motion along the curve, a challenging practical situation that occurs when the thread is dragged by one extremity.
关 键 词: 可变化曲线; 计算机视觉; 图案纹理化
课程来源: 视频讲座网
最后编审: 2021-05-15:yumf
阅读次数: 43