Semi-Supervised Segmentation of Interstitial Lung Disease Patterns from CT Images via Self-Training with Selective Re-Training
Open Access
- 12 July 2023
- journal article
- research article
- Published by MDPI AG in Bioengineering
- Vol. 10 (7) , 830
Abstract
Accurate segmentation of interstitial lung disease (ILD) patterns from computed tomography (CT) images is an essential prerequisite to treatment and follow-up. However, it is highly time-consuming for radiologists to pixel-by-pixel segment ILD patterns from CT scans with hundreds of slices. Consequently, it is hard to obtain large amounts of well-annotated data, which poses a huge challenge for data-driven deep learning-based methods. To alleviate this problem, we propose an end-to-end semi-supervised learning framework for the segmentation of ILD patterns (ESSegILD) from CT images via self-training with selective re-training. The proposed ESSegILD model is trained using a large CT dataset with slice-wise sparse annotations, i.e., only labeling a few slices in each CT volume with ILD patterns. Specifically, we adopt a popular semi-supervised framework, i.e., Mean-Teacher, that consists of a teacher model and a student model and uses consistency regularization to encourage consistent outputs from the two models under different perturbations. Furthermore, we propose introducing the latest self-training technique with a selective re-training strategy to select reliable pseudo-labels generated by the teacher model, which are used to expand training samples to promote the student model during iterative training. By leveraging consistency regularization and self-training with selective re-training, our proposed ESSegILD can effectively utilize unlabeled data from a partially annotated dataset to progressively improve the segmentation performance. Experiments are conducted on a dataset of 67 pneumonia patients with incomplete annotations containing over 11,000 CT images with eight different lung patterns of ILDs, with the results indicating that our proposed method is superior to the state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (No.82172020, No.2021YFC2500700, No.2020B 1212060039)
- National Key Research and Development Program of China (No.82172020, No.2021YFC2500700, No.2020B 1212060039)
- Guangdong Provincial Key Laboratory of Medical Image Processing (No.82172020, No.2021YFC2500700, No.2020B 1212060039)
This publication has 44 references indexed in Scilit:
- Holistic classification of CT attenuation patterns for interstitial lung diseases via deep convolutional neural networksComputer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2016
- Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural NetworkIEEE Transactions on Medical Imaging, 2016
- Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer LearningIEEE Transactions on Medical Imaging, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Large Margin Local Estimate With Applications to Medical Image ClassificationIEEE Transactions on Medical Imaging, 2015
- Learning Features for Tissue Classification with the Classification Restricted Boltzmann Machine2014
- Classification of interstitial lung disease patterns using local DCT features and random forest2014
- Classification of diffuse lung diseases patterns by a sparse representation based method on HRCT images2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2013
- Building a reference multimedia database for interstitial lung diseasesComputerized Medical Imaging and Graphics, 2012
- Texture-Based Identification and Characterization of Interstitial Pneumonia Patterns in Lung Multidetector CTIEEE Transactions on Information Technology in Biomedicine, 2009