论文标题

部分可观测时空混沌系统的无模型预测

Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification

论文作者

Qu, Linhao, Luo, Xiaoyuan, Wang, Manning, Song, Zhijian

论文摘要

基于整个幻灯片图像(WSI)分类的计算机辅助病理学诊断在临床实践中起着重要作用,并且通常将其作为弱监督的多个实例学习(MIL)问题表达。现有方法从袋子分类或实例分类的角度解决了此问题。在本文中,我们建议使用WSI分类的端到端弱监督的知识蒸馏框架(WENO),该框架将袋子分类器和实例分类器集成到知识蒸馏框架中,以相互提高两个分类器的性能。具体而言,基于注意力的袋子分类器被用作教师网络,该网络经过较弱的袋子标签训练,并将实例分类器用作学生网络,该学生网络使用从教师网络获得的归一化注意分数培训,作为柔软的伪伪标签,用于正面袋中的实例。教师和学生之间共享一个实例功能提取器,以进一步增强他们之间的知识交流。此外,我们根据学生网络的产出提出了一种艰难的积极实例挖掘策略,以迫使教师网络继续挖掘艰苦的积极实例。 WENO是一个插件框架,可以轻松地应用于任何基于注意力的行李分类方法。在五个数据集上进行的广泛实验证明了WENO的效率。代码可在https://github.com/miccaiif/weno上找到。

Computer-aided pathology diagnosis based on the classification of Whole Slide Image (WSI) plays an important role in clinical practice, and it is often formulated as a weakly-supervised Multiple Instance Learning (MIL) problem. Existing methods solve this problem from either a bag classification or an instance classification perspective. In this paper, we propose an end-to-end weakly supervised knowledge distillation framework (WENO) for WSI classification, which integrates a bag classifier and an instance classifier in a knowledge distillation framework to mutually improve the performance of both classifiers. Specifically, an attention-based bag classifier is used as the teacher network, which is trained with weak bag labels, and an instance classifier is used as the student network, which is trained using the normalized attention scores obtained from the teacher network as soft pseudo labels for the instances in positive bags. An instance feature extractor is shared between the teacher and the student to further enhance the knowledge exchange between them. In addition, we propose a hard positive instance mining strategy based on the output of the student network to force the teacher network to keep mining hard positive instances. WENO is a plug-and-play framework that can be easily applied to any existing attention-based bag classification methods. Extensive experiments on five datasets demonstrate the efficiency of WENO. Code is available at https://github.com/miccaiif/WENO.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源