|
动态字幕：听力障碍的视频辅助功能增强
Dynamic Captioning: Video Accessibility Enhancement for Hearing Impairment |
|
| |
| 课程网址: |
http://videolectures.net/acmmm2010_hong_dcv/
|
| 主讲教师: |
Richang Hong
|
| 开课单位: |
新加坡国立大学
|
| 开课时间: |
2011-02-01
|
| 课程语种: |
英语
|
| 中文简介: |
世界上有6600多万人因听力障碍而失去听力，而听力障碍使他们在对视频内容的理解上有了很大的困难。如果脚本可用，字幕技术可以在一定程度上帮助他们在播放视频的同时同步播放脚本。然而，我们发现现有的字幕技术在帮助听力受损的观众观看欢乐视频方面远远不能令人满意。在这篇文章中,我们介绍一个计划来提高视频的可访问性使用动态字幕的方法,探讨了一组丰富的技术包括脸de - tection和识别、视觉特点分析,text-speech对齐,等Di®从现有的方法不同,分为静态字幕,动态字幕把脚本在合适的位置来帮助听障奥迪- ence更好的认识到说话的人物。此外，它通过将脚本与语音信号进行对齐，逐字逐句地突出显示脚本，并说明了音量的变化。通过这种方式，特殊的观众可以更好的跟踪剧本，感知音量变化所传达的情绪。我们对20个视频片段实施了technol- ogy，并对60名真正的听力受损用户进行了深入研究。结果表明，该视频无障碍增强方案具有一定的有效性和有效性。
|
| 课程简介: |
There are more than 66 million people su®ering from hear- ing impairment and this disability brings them di±culty in video content understanding due to the loss of audio infor- mation. If the scripts are available, captioning technology can help them in a certain degree by synchronously illus- trating the scripts during the playing of videos. However, we show that the existing captioning techniques are far from satisfactory in assisting the hearing impaired audience to en- joy videos. In this paper, we introduce a scheme to enhance video accessibility using a Dynamic Captioning approach, which explores a rich set of technologies including face de- tection and recognition, visual saliency analysis, text-speech alignment, etc. Di®erent from the existing methods that are categorized as static captioning, dynamic captioning puts scripts at suitable positions to help hearing impaired audi- ence better recognize the speaking characters. In addition, it progressively highlights the scripts word-by-word via align- ing them with the speech signal and illustrates the variation of voice volume. In this way, the special audience can better track the scripts and perceive the moods that are conveyed by the variation of volume. We implemented the technol- ogy on 20 video clips and conducted an in-depth study with 60 real hearing impaired users. The results demonstrated the e®ectiveness and usefulness of the video accessibility en- hancement scheme.
|
| 关 键 词: |
动态字幕; 听力障碍; 辅助
|
| 课程来源: |
视频讲座网
|
| 最后编审: |
2020-06-01：王勇彬(课程编辑志愿者)
|
| 阅读次数: |
81
|
|
图 书 馆