论文标题
半监督的混合脊柱网络,用于分割脊柱MR图像
Semi-Supervised Hybrid Spine Network for Segmentation of Spine MR Images
论文作者
论文摘要
3D磁共振(MR)图像中椎体(VBS)和椎间盘(IVD)的自动分割至关重要。但是,同时分割VBS和IVD并不是微不足道的。此外,存在问题,包括由各向异性分辨率,高计算成本,阶层间相似性和阶层内变异性以及数据失衡引起的模糊分割。我们提出了一种两阶段算法,称为半监督混合脊柱网络(SSHSNET),通过实现准确的同时VB和IVD分段来解决这些问题。在第一阶段,我们通过使用交叉伪监督来获得斜坡内特征和粗分割,构建了一个2D半监督的DeepLabv3+。在第二阶段,建立了一个基于3D全分辨率补丁的DeepLabV3+。该模型可用于提取切片间信息,并结合第一阶段提供的粗分割和薄板内特征。此外,还采用了一个跨三项意识模块来补偿从2D和3D网络分别生成的切片间和滑板内的损失,从而提高了特征表示能力并实现令人满意的分割结果。拟议的SSHSNET已在公开可用的脊柱MR图像数据集上进行了验证,并实现了出色的细分性能。此外,结果表明,所提出的方法在处理数据不平衡问题方面具有巨大的潜力。根据先前的报告,很少有研究与跨注意机制进行了半监督学习策略,用于脊柱分割。因此,所提出的方法可以为脊柱分割和临床上的脊柱疾病诊断和治疗提供有用的工具。代码可在以下网址公开获取:https://github.com/meiyan88/sshsnet。
Automatic segmentation of vertebral bodies (VBs) and intervertebral discs (IVDs) in 3D magnetic resonance (MR) images is vital in diagnosing and treating spinal diseases. However, segmenting the VBs and IVDs simultaneously is not trivial. Moreover, problems exist, including blurry segmentation caused by anisotropy resolution, high computational cost, inter-class similarity and intra-class variability, and data imbalances. We proposed a two-stage algorithm, named semi-supervised hybrid spine network (SSHSNet), to address these problems by achieving accurate simultaneous VB and IVD segmentation. In the first stage, we constructed a 2D semi-supervised DeepLabv3+ by using cross pseudo supervision to obtain intra-slice features and coarse segmentation. In the second stage, a 3D full-resolution patch-based DeepLabv3+ was built. This model can be used to extract inter-slice information and combine the coarse segmentation and intra-slice features provided from the first stage. Moreover, a cross tri-attention module was applied to compensate for the loss of inter-slice and intra-slice information separately generated from 2D and 3D networks, thereby improving feature representation ability and achieving satisfactory segmentation results. The proposed SSHSNet was validated on a publicly available spine MR image dataset, and remarkable segmentation performance was achieved. Moreover, results show that the proposed method has great potential in dealing with the data imbalance problem. Based on previous reports, few studies have incorporated a semi-supervised learning strategy with a cross attention mechanism for spine segmentation. Therefore, the proposed method may provide a useful tool for spine segmentation and aid clinically in spinal disease diagnoses and treatments. Codes are publicly available at: https://github.com/Meiyan88/SSHSNet.