论文标题

预训练的神经网络的合奏,用于分割和质量检测传输电子显微镜图像

Ensemble of Pre-Trained Neural Networks for Segmentation and Quality Detection of Transmission Electron Microscopy Images

论文作者

Baskaran, Arun, Lin, Yulin, Wen, Jianguo, Chan, Maria K. Y.

论文摘要

对电子显微镜数据集的自动分析提出了多个挑战,例如训练数据集大小的限制,样本质量和实验条件变化引起的数据分布的变化等。对训练的模型,继续提供可接受的段/分类性能在新数据上提供可接受的分类/分类性能,并量化与预测相关的不确定。在机器学习的广泛应用中,已经采用了各种方法来量化不确定性,例如贝叶斯建模,蒙特卡洛辍学,合奏等。目的是解决电子显微镜数据域特有的挑战,这是在这项工作中实现了两种不同类型的预训练神经网络的合奏。合奏在两相混合物中对冰晶进行语义分割,从而跟踪其相变成水。第一个合奏(EA)由具有不同基础体系结构的U-NET样式网络组成,而第二系列合奏(ER-I)由随机初始化的U-NET样式网络组成,其中每个基础学习者都具有相同的基础架构'i'。基础学习者的编码者已在Imagenet数据集上进行了预训练。对EA和ER的性能进行了三个不同的指标评估:准确性,校准和不确定性。可以看出,与ER相比,EA具有更高的分类精度,并且可以更好地校准。尽管这两种类型的集合的不确定性量化是可比的,但发现ER所表现出的不确定性得分取决于其基本成员的特定架构('i'),并且不一致地比EA更好。因此,与像ER这样的合奏设计相比,EA等集合设计对电子显微镜数据集进行分析所带来的挑战似乎可以更好地解决。

Automated analysis of electron microscopy datasets poses multiple challenges, such as limitation in the size of the training dataset, variation in data distribution induced by variation in sample quality and experiment conditions, etc. It is crucial for the trained model to continue to provide acceptable segmentation/classification performance on new data, and quantify the uncertainty associated with its predictions. Among the broad applications of machine learning, various approaches have been adopted to quantify uncertainty, such as Bayesian modeling, Monte Carlo dropout, ensembles, etc. With the aim of addressing the challenges specific to the data domain of electron microscopy, two different types of ensembles of pre-trained neural networks were implemented in this work. The ensembles performed semantic segmentation of ice crystal within a two-phase mixture, thereby tracking its phase transformation to water. The first ensemble (EA) is composed of U-net style networks having different underlying architectures, whereas the second series of ensembles (ER-i) are composed of randomly initialized U-net style networks, wherein each base learner has the same underlying architecture 'i'. The encoders of the base learners were pre-trained on the Imagenet dataset. The performance of EA and ER were evaluated on three different metrics: accuracy, calibration, and uncertainty. It is seen that EA exhibits a greater classification accuracy and is better calibrated, as compared to ER. While the uncertainty quantification of these two types of ensembles are comparable, the uncertainty scores exhibited by ER were found to be dependent on the specific architecture of its base member ('i') and not consistently better than EA. Thus, the challenges posed for the analysis of electron microscopy datasets appear to be better addressed by an ensemble design like EA, as compared to an ensemble design like ER.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源