论文标题

MIPI 2022 RGBW传感器融合挑战:数据集和报告

MIPI 2022 Challenge on RGBW Sensor Fusion: Dataset and Report

论文作者

Yang, Qingyu, Yang, Guang, Jiang, Jun, Li, Chongyi, Feng, Ruicheng, Zhou, Shangchen, Sun, Wenxiu, Zhu, Qingpeng, Loy, Chen Change, Gu, Jinwei

论文摘要

随着对移动平台上对计算摄影和成像的需求不断增长,在相机系统中开发和集成了高级图像传感器与相机系统中新型算法。但是,缺乏用于研究的高质量数据以及从行业和学术界进行深入交流的难得的机会限制了移动智能摄影和成像的发展(MIPI)。为了弥合差距,我们介绍了第一个MIPI挑战,其中包括五个曲目,这些曲目专注于新型图像传感器和成像算法。在本文中,引入了RGBW关节融合和Denoise,这是五个曲目之一,其中一条致力于将Binning Mode RGBW融合到拜耳。为参与者提供了一个新的数据集,包括70个(培训)和15个(验证)高品质RGBW和拜耳对的场景。此外,对于每个场景,在24dB和42dB处提供不同噪声水平的RGBW。所有数据均在室外和室内条件下使用RGBW传感器捕获。最终结果是使用目标指标评估的,包括PSNR,SSIM},LPIPS和KLD。本文提供了本挑战中所有模型的详细描述。有关此挑战的更多详细信息以及数据集的链接,请访问https://github.com/mipi-challenge/mipi2022。

Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge, including five tracks focusing on novel image sensors and imaging algorithms. In this paper, RGBW Joint Fusion and Denoise, one of the five tracks, working on the fusion of binning-mode RGBW to Bayer, is introduced. The participants were provided with a new dataset including 70 (training) and 15 (validation) scenes of high-quality RGBW and Bayer pairs. In addition, for each scene, RGBW of different noise levels was provided at 24dB and 42dB. All the data were captured using an RGBW sensor in both outdoor and indoor conditions. The final results are evaluated using objective metrics, including PSNR, SSIM}, LPIPS, and KLD. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源