论文标题

使用无监督域的适应来学习数值观察者

Learning Numerical Observers using Unsupervised Domain Adaptation

论文作者

He, Shenghua, Zhou, Weimin, Li, Hua, Anastasio, Mark A.

论文摘要

医学成像系统通常通过使用客观图像质量度量来评估。已经研究了监督的深度学习方法,以实施基于任务的图像质量评估的数值观察者。但是,标记大量的实验数据来训练深层神经网络是乏味,昂贵且容易出现主观错误的。可以使用计算机模拟的图像数据来规避这些问题;但是,通常很难在计算上对复杂的解剖结构,噪声源和现实世界成像系统的响应进行模拟。因此,模拟的图像数据通常将与他们试图效仿的实验图像数据具有物理和统计差异。在机器学习的上下文中,两个图像的集合之间的这些差异称为域移动。在这项研究中,我们提出并研究了对对抗结构域适应方法的使用,以减轻对基于深度学习的数值观察者(DL-NOS)在模拟图像上培训的模拟图像数据和实验图像数据之间的有害作用,这些效应是对模拟图像进行培训但应用于实验图像的有害影响。在提出的方法中,DL-NO最初将接受计算机模拟的图像数据的培训,并随后适用于实验图像数据,而无需任何标记的实验图像。作为概念证明,考虑了二进制信号检测任务。研究了该策略作为模拟图像数据和实验图像数据之间存在的域移位程度的成功。

Medical imaging systems are commonly assessed by use of objective image quality measures. Supervised deep learning methods have been investigated to implement numerical observers for task-based image quality assessment. However, labeling large amounts of experimental data to train deep neural networks is tedious, expensive, and prone to subjective errors. Computer-simulated image data can potentially be employed to circumvent these issues; however, it is often difficult to computationally model complicated anatomical structures, noise sources, and the response of real world imaging systems. Hence, simulated image data will generally possess physical and statistical differences from the experimental image data they seek to emulate. Within the context of machine learning, these differences between the sets of two images is referred to as domain shift. In this study, we propose and investigate the use of an adversarial domain adaptation method to mitigate the deleterious effects of domain shift between simulated and experimental image data for deep learning-based numerical observers (DL-NOs) that are trained on simulated images but applied to experimental ones. In the proposed method, a DL-NO will initially be trained on computer-simulated image data and subsequently adapted for use with experimental image data, without the need for any labeled experimental images. As a proof of concept, a binary signal detection task is considered. The success of this strategy as a function of the degree of domain shift present between the simulated and experimental image data is investigated.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源