论文标题

用户生成的视频质量评估:主观和客观研究

User-generated Video Quality Assessment: A Subjective and Objective Study

论文作者

Li, Yang, Meng, Shengbin, Zhang, Xinfeng, Wang, Shiqi, Wang, Yue, Ma, Siwei

论文摘要

最近,我们观察到用户生成的内容(UGC)视频的指数增加。 UGC视频的杰出特征源自视频制作和交付链,因为它们通常是由非专业用户在上传到托管平台以进行共享的。因此,这些视频通常会经历多个失真阶段,在最终观看之前可能会影响视觉质量。受到越来越多的共识的启发,即视频编码和处理的优化应由知觉质量完全驱动,在本文中,我们建议从客观和主观观点研究UGC视频的质量。我们首先构建了UGC视频质量评估(VQA)数据库,旨在为在托管平台中的UGC视频编码和处理提供有用的指导。该数据库包含上传到平台的源教UGC视频及其最终用户最终享受的转码版本以及其主观分数。此外,我们开发了一种客观质量评估算法,该算法会根据损坏的参考自动评估转码视频的质量,这与托管平台中的UGC视频共享的应用方案一致。来自损坏的参考文献的信息具有很好的杠杆作用,并且根据深层神经网络(DNN)的推断质量图(DNN)预测质量。实验结果表明,所提出的方法可产生卓越的性能。对教资会视频的主观和客观评估都阐明了感知UGC视频编码的设计。

Recently, we have observed an exponential increase of user-generated content (UGC) videos. The distinguished characteristic of UGC videos originates from the video production and delivery chain, as they are usually acquired and processed by non-professional users before uploading to the hosting platforms for sharing. As such, these videos usually undergo multiple distortion stages that may affect visual quality before ultimately being viewed. Inspired by the increasing consensus that the optimization of the video coding and processing shall be fully driven by the perceptual quality, in this paper, we propose to study the quality of the UGC videos from both objective and subjective perspectives. We first construct a UGC video quality assessment (VQA) database, aiming to provide useful guidance for the UGC video coding and processing in the hosting platform. The database contains source UGC videos uploaded to the platform and their transcoded versions that are ultimately enjoyed by end-users, along with their subjective scores. Furthermore, we develop an objective quality assessment algorithm that automatically evaluates the quality of the transcoded videos based on the corrupted reference, which is in accordance with the application scenarios of UGC video sharing in the hosting platforms. The information from the corrupted reference is well leveraged and the quality is predicted based on the inferred quality maps with deep neural networks (DNN). Experimental results show that the proposed method yields superior performance. Both subjective and objective evaluations of the UGC videos also shed lights on the design of perceptual UGC video coding.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源