论文标题
肺叶细分和层次多实体分类的协同学习,用于自动严重性评估CT图像中COVID-19
Synergistic Learning of Lung Lobe Segmentation and Hierarchical Multi-Instance Classification for Automated Severity Assessment of COVID-19 in CT Images
论文作者
论文摘要
了解2019年冠状病毒病(COVID-19)的胸部CT成像将有助于尽早检测感染并评估疾病进展。特别是,CT图像中Covid-19的自动严重程度评估在识别非常需要密集临床护理的病例中起着至关重要的作用。但是,由于肺部的感染区域可变,相似的成像生物标志物和较大的例间变化,因此准确评估CT图像中该疾病的严重程度通常是具有挑战性的。为此,我们通过共同执行肺叶分割和多实体分类,提出了一个与3D CT图像中自动严重性评估的协同学习框架。考虑到CT图像中只有少数感染区域与严重性评估有关,我们首先用一个包含一组2D图像贴片的袋子表示每个输入图像(每个输入图像(每个输入从特定的切片中裁剪)。然后开发了多任务多任务深网(称为M $^2 $ UNET)来评估COVID-19患者的严重程度,并同时分割肺叶。我们的M $^2 $ UNET由一个补丁级编码器,用于肺叶细分的细分子网络以及严重性评估的分类子网络(具有独特的层次层次多实体学习策略)。在这里,可以隐式地使用分割提供的上下文信息来提高严重性评估的性能。在由666个胸部CT图像组成的真实COVID-19 CT图像数据集上进行了广泛的实验,结果表明我们提出的方法的有效性与几种最新方法相比。
Understanding chest CT imaging of the coronavirus disease 2019 (COVID-19) will help detect infections early and assess the disease progression. Especially, automated severity assessment of COVID-19 in CT images plays an essential role in identifying cases that are in great need of intensive clinical care. However, it is often challenging to accurately assess the severity of this disease in CT images, due to variable infection regions in the lungs, similar imaging biomarkers, and large inter-case variations. To this end, we propose a synergistic learning framework for automated severity assessment of COVID-19 in 3D CT images, by jointly performing lung lobe segmentation and multi-instance classification. Considering that only a few infection regions in a CT image are related to the severity assessment, we first represent each input image by a bag that contains a set of 2D image patches (with each cropped from a specific slice). A multi-task multi-instance deep network (called M$^2$UNet) is then developed to assess the severity of COVID-19 patients and also segment the lung lobe simultaneously. Our M$^2$UNet consists of a patch-level encoder, a segmentation sub-network for lung lobe segmentation, and a classification sub-network for severity assessment (with a unique hierarchical multi-instance learning strategy). Here, the context information provided by segmentation can be implicitly employed to improve the performance of severity assessment. Extensive experiments were performed on a real COVID-19 CT image dataset consisting of 666 chest CT images, with results suggesting the effectiveness of our proposed method compared to several state-of-the-art methods.