丢失损坏的流媒体视频中的显着性 - 认知错误隐藏Saliency-Cognizant Error Concealment In Loss-Corrupted Streaming Video |
|
课程网址: | http://videolectures.net/icme2012_hadizadeh_streaming/ |
主讲教师: | Hadi Hadizadeh |
开课单位: | 西蒙弗雷泽大学 |
开课时间: | 2012-09-18 |
课程语种: | 英语 |
中文简介: | 分组丢失中的错误隐藏损坏的流视频本质上是在确定的问题下,因为没有足够数量的明确定义的标准来完美地恢复丢失的块。当在视频流期间部署基于感兴趣区域(ROI)的不等错误保护(UEP)方案时即,在视觉上更加敏感的区域受到强烈保护,丢失的块在原始帧中可能具有低显着性。在本文中,我们建议在错误隐藏问题之前将低显着性作为正则化项。它有两个目的。首先,在基于ROI的UEP视频流中,低显着性先验为客户端提供右侧信息以识别用于隐藏的正确替换块。其次,如果完全匹配的块无法明确识别,则低显着性先验减少了观看者的视觉注意力。在损失严重的区域,导致更高的总体主观质量。我们在先前提出的RECAP [1]错误隐藏系统的背景下研究低显着性先验的有效性.RECAP将图像的低分辨率(LR)版本与原始高度一起发送分辨率(HR)版本,以便如果HR版本中的块丢失,则正确接收的LR版本可以用作从先前正确解码的HR帧匹配合适的替换块的模板。我们在块识别过程之前添加低显着性,以便只能选择具有良好匹配和低显着性的替换候选块。此外,我们在循环中迭代地设计和应用四个显着性降低算子,以减少候选块的显着性。实验结果表明:i)误差隐藏帧的PSNR可以显着提高(比最初的RECAP高达3.2dB),显示了在欠定神经隐藏问题中低显着性的有效性; ii)通过广泛的用户研究证实,使用我们的提案修复视频的主观质量优于原始RECAP。 |
课程简介: | Error concealment in packet-loss-corrupted streaming video is inherently an under-determined problem, as there are insufficient number of well-defined criteria to recover the missing blocks perfectly. When a Region-of-Interest (ROI) based unequal error protection (UEP) scheme is deployed during video streaming - i.e., more visually salient regions are strongly protected - a lost block is likely to be of low saliency in the original frame. In this paper, we propose to add a low-saliency prior to the error concealment problem as a regularization term. It serves two purposes. First, in ROI-based UEP video streaming, low-saliency prior provides the right side information for the client to identify the correct replacement blocks for concealment. Second, in the event that a perfectly matched block cannot be unambiguously identified, the low-saliency prior reduces viewer’s visual attention on the loss-stricken region, resulting in higher overall subjective quality. We study the effectiveness of a low-saliency prior in the context of a previously proposed RECAP [1] error concealment system. RECAP transmits a low-resolution (LR) version of an image alongside the original high-resolution (HR) version, so that if blocks in the HR version are lost, the correctly-received LR version can serve as a template for matching of suitable replacement blocks from a previously correctly-decoded HR frame. We add a low-saliency prior to the block identification process, so that only replacement candidate blocks with good match and low saliency can be selected. Further, we design and apply four saliency reduction operators iteratively in a loop, in order to reduce the saliency of candidate blocks. Experimental results show that: i) PSNR of the error-concealed frames can be increased dramatically (up to 3.2dB over the original RECAP), showing the effectiveness of a low-saliency prior in the underdetermined error concealment problem; and ii) subjective quality of the repaired video using our proposal, as confirmed by an extensive user study, is better than the original RECAP. |
关 键 词: | 分组丢失; 流视频; 修复视频 |
课程来源: | 视频讲座网 |
最后编审: | 2019-04-17:lxf |
阅读次数: | 44 |