Is in-domain data beneficial in transfer learning for landmarks detection in x-ray images?
Preprint
Abstract
In recent years, deep learning has emerged as a promising technique for medical image analysis. However, this application domain is likely to suffer from a limited availability of large public datasets and annotations. A common solution to these challenges in deep learning is the usage of a transfer learning framework, typically with a fine-tuning protocol, where a large-scale source dataset is used to pre-train a model, further fine-tuned on the target dataset. In this paper, we present a systematic study analyzing whether the usage of small-scale in-domain x-ray image datasets may provide any improvement for landmark detection over models pre-trained on large natural image datasets only. We focus on the multi-landmark localization task for three datasets, including chest, head, and hand x-ray images. Our results show that using in-domain source datasets brings marginal or no benefit with respect to an ImageNet out-of-domain pre-training. Our findings can provide an indication for the development of robust landmark detection systems in medical images when no large annotated dataset is available.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Top-tuning: A study on transfer learning for an efficient alternative to fine tuning for image classification with fast kernel methodsImage and Vision Computing, 2023
- Two-Stage Mesh Deep Learning for Automated Tooth Segmentation and Landmark Localization on 3D Intraoral ScansIEEE Transactions on Medical Imaging, 2022
- Cephalometric landmark detection via global and local encoders and patch-wise attentionsNeurocomputing, 2022
- KNEEL: Knee Anatomical Landmark Localization Using Hourglass Networks2019
- Integrating spatial configuration into heatmap regression based CNNs for landmark localizationMedical Image Analysis, 2019
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018
- Integrating geometric configuration and appearance information into a unified framework for anatomical landmark localizationMedical Image Analysis, 2018
- Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral CephalogramsScientific Reports, 2016
- A benchmark for comparison of dental radiography analysis algorithmsMedical Image Analysis, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015