MedDChest: A Content-Aware Multimodal Foundational Vision Model for Thoracic Imaging
Authors:
Preprint
Abstract
The performance of vision models in medical imaging is often hindered by the prevailing paradigm of fine-tuning backbones pre-trained on out-of-domain natural images. To address this fundamental domain gap, we propose MedDChest, a new foundational Vision Transformer (ViT) model optimized specifically for thoracic imaging. We pre-trained MedDChest from scratch on a massive, curated, multimodal dataset of over 1.2 million images, encompassing different modalities including Chest X-ray and Computed Tomography (CT) compiled from 10 public sources. A core technical contribution of our work is Guided Random Resized Crops, a novel content-aware data augmentation strategy that biases sampling towards anatomically relevant regions, overcoming the inefficiency of standard cropping techniques on medical scans. We validate our model's effectiveness by fine-tuning it on a diverse set of downstream diagnostic tasks. Comprehensive experiments empirically demonstrate that MedDChest significantly outperforms strong, publicly available ImageNet-pretrained models. By establishing the superiority of large-scale, in-domain pre-training combined with domain-specific data augmentation, MedDChest provides a powerful and robust feature extractor that serves as a significantly better starting point for a wide array of thoracic diagnostic tasks. The model weights will be made publicly available to foster future research and applications.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- MedMAE: A Self-Supervised Backbone for Medical Imaging TasksComputation, 2025
- Efficient pneumonia detection using Vision Transformers on chest X-raysScientific Reports, 2024
- A Novel Transfer Learning Based Approach for Pneumonia Detection in Chest X-ray ImagesApplied Sciences, 2020
- An Efficient Deep Learning Approach to Pneumonia Classification in HealthcareJournal of Healthcare Engineering, 2019
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Quantitative Computed Tomographic Descriptors Associate Tumor Shape Complexity and Intratumor Heterogeneity with Prognosis in Lung AdenocarcinomaPLOS ONE, 2015
- The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): A Completed Reference Database of Lung Nodules on CT ScansMedical Physics, 2011