论文标题
3D Matting:用于计算机断层扫描中应用的软分割方法的基准研究
3D Matting: A Benchmark Study on Soft Segmentation Method for Pulmonary Nodules Applied in Computed Tomography
论文作者
论文摘要
通常,病变不是孤立的,而与周围组织有关。例如,肿瘤的生长可以取决于或浸润到周围的组织中。由于病变的病理性质,要区分其在医学成像中的边界是一项挑战。但是,这些不确定的区域可能包含诊断信息。因此,通过传统的二元分割对病变的简单二进制会导致诊断信息的丢失。在这项工作中,我们将图像介绍到3D场景中,并使用Alpha Matte(即软面膜)描述3D医疗图像中的病变。传统的软膜是训练技巧,可以弥补易于标记或贴标记的歧义区域的训练技巧。相比之下,3D Matting使用软分割来更细微地表征不确定区域,这意味着它保留了更多结构信息,以进行后续诊断和治疗。当前对3D图像床位方法的研究受到限制。为了解决这个问题,我们对3D垫片进行了全面研究,包括传统和深度学习方法。我们将四种最新的2D图像矩阵算法调整为3D场景,并进一步自定义CT图像的方法以用放射性校准Alpha Matte。此外,我们提出了第一个端到端的深3D Matting网络,并实现了可靠的3D医疗图像效益基准。还提出了有效的对手,以实现良好的性能汇总平衡。此外,没有与3D垫片相关的高质量注释数据集,从而减慢了基于数据驱动的深度学习方法的开发。为了解决此问题,我们构建了第一个3D医疗垫数据集。通过临床医生的评估和下游实验来验证数据集的有效性。
Usually, lesions are not isolated but are associated with the surrounding tissues. For example, the growth of a tumour can depend on or infiltrate into the surrounding tissues. Due to the pathological nature of the lesions, it is challenging to distinguish their boundaries in medical imaging. However, these uncertain regions may contain diagnostic information. Therefore, the simple binarization of lesions by traditional binary segmentation can result in the loss of diagnostic information. In this work, we introduce the image matting into the 3D scenes and use the alpha matte, i.e., a soft mask, to describe lesions in a 3D medical image. The traditional soft mask acted as a training trick to compensate for the easily mislabelled or under-labelled ambiguous regions. In contrast, 3D matting uses soft segmentation to characterize the uncertain regions more finely, which means that it retains more structural information for subsequent diagnosis and treatment. The current study of image matting methods in 3D is limited. To address this issue, we conduct a comprehensive study of 3D matting, including both traditional and deep-learning-based methods. We adapt four state-of-the-art 2D image matting algorithms to 3D scenes and further customize the methods for CT images to calibrate the alpha matte with the radiodensity. Moreover, we propose the first end-to-end deep 3D matting network and implement a solid 3D medical image matting benchmark. Its efficient counterparts are also proposed to achieve a good performance-computation balance. Furthermore, there is no high-quality annotated dataset related to 3D matting, slowing down the development of data-driven deep-learning-based methods. To address this issue, we construct the first 3D medical matting dataset. The validity of the dataset was verified through clinicians' assessments and downstream experiments.