图 书 馆
向文本到图像合成Toward Text-to-Picture Synthesis |
|
| 课程网址: | http://videolectures.net/nips09_goldberg_ttp/ |
| 主讲教师: | Andrew B. Goldberg |
| 开课单位: | 威斯康星大学 |
| 开课时间: | 2010-01-19 |
| 课程语种: | 英语 |
| 中文简介: |  |
| 课程简介: | It is estimated that more that 2 million people in the United States have significant communication impairments that result in them relying on methods other than natural speech alone for communication [2]. One type of commonly used augmentative and alternative communication (AAC) system is pictorial communication software such as SymWriter [8], which uses a lookup table to transliterate each word (or common phrase) in a sentence into an icon. This is an example of converting information between modalities. However, the resulting sequence of icons can be difficult to understand. We have been developing general-purpose Text-to-Picture (TTP) synthesis algorithms [10, 5] to improve understandability using machine learning techniques. Our goal is to help users with special needs, such as the elderly or those with disabilities, to rapidly browse documents through pictorial summaries (e.g., Figure 5). Our TTP system targets general English. This differs from other pictorial conversion systems that require hand-crafted narrative descriptions of a scene [1, 9], 3D models [3], or special domains [6]. Instead, we use a concatenative or “collage” approach. In this talk, we discuss how machine learning enables the key components of our TTP system. |
| 关 键 词: | 机器学习; 文本图像合成; 语义 |
| 课程来源: | 视频讲座网 |
| 最后编审: | 2021-05-15：yumf |
| 阅读次数: | 70 |