图 书 馆
视觉词汇中的语义嵌入Towards Semantic Embedding in Visual Vocabulary |
|
| 课程网址: | http://videolectures.net/cvpr2010_ji_tsev/ |
| 主讲教师: | Rongrong Ji |
| 开课单位: | 哈尔滨工业大学 |
| 开课时间: | 2010-07-19 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | Visual vocabulary serves as a fundamental component in many computer vision tasks, such as object recognition, visual search, and scene modeling. While state-of-the-art approaches build visual vocabulary based solely on visual statistics of local image patches, the correlative image labels are left unexploited in generating visual words. In this work, we present a semantic embedding framework to integrate semantic information from Flickr labels for supervised vocabulary construction. Our main contribution is a Hidden Markov Random Field modeling to supervise feature space quantization, with specialized considerations to label correlations: Local visual features are modeled as an Observed Field, which follows visual metrics to partition feature space. Semantic labels are modeled as a Hidden Field, which imposes generative supervision to the Observed Field with WordNet-based correlation constraints as Gibbs distribution. By simplifying the Markov property in the Hidden Field, both unsupervised and supervised (label independent) vocabularies can be derived from our framework. We validate our performances in two challenging computer vision tasks with comparisons to state-of-the-arts: (1) Large-scale image search on a Flickr 60,000 database; (2) Object recognition on the PASCAL VOC database. |
| 关 键 词: | 视觉词汇; 计算机视觉任务; 语义嵌入 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2019-03-13：lxf |
| 阅读次数: | 50 |