FEDMEKI: A Benchmark for Scaling Medical Foundation Models via Federated Knowledge Injection
Preprint
Abstract
This study introduces the Federated Medical Knowledge Injection (FEDMEKI) platform, a new benchmark designed to address the unique challenges of integrating medical knowledge into foundation models under privacy constraints. By leveraging a cross-silo federated learning approach, FEDMEKI circumvents the issues associated with centralized data collection, which is often prohibited under health regulations like the Health Insurance Portability and Accountability Act (HIPAA) in the USA. The platform is meticulously designed to handle multi-site, multi-modal, and multi-task medical data, which includes 7 medical modalities, including images, signals, texts, laboratory test results, vital signs, input variables, and output variables. The curated dataset to validate FEDMEKI covers 8 medical tasks, including 6 classification tasks (lung opacity detection, COVID-19 detection, electrocardiogram (ECG) abnormal detection, mortality prediction, sepsis prediction, and enlarged cardiomediastinum detection) and 2 generation tasks (medical visual question answering (MedVQA) and ECG noise clarification). This comprehensive dataset is partitioned across several clients to facilitate the decentralized training process under 16 benchmark approaches. FEDMEKI not only preserves data privacy but also enhances the capability of medical foundation models by allowing them to learn from a broader spectrum of medical knowledge without direct data exposure, thereby setting a new benchmark in the application of foundation models within the healthcare sector.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPTInternational Journal of Machine Learning and Cybernetics, 2024
- Towards building multilingual language model for medicineNature Communications, 2024
- Vision–language foundation model for echocardiogram interpretationNature Medicine, 2024
- PMC-LLaMA: toward building open-source language models for medicineJournal of the American Medical Informatics Association, 2024
- A visual–language foundation model for pathology image analysis using medical TwitterNature Medicine, 2023
- ricu: R’s interface to intensive care dataGigaScience, 2022
- Federated learning and differential privacy for medical image analysisScientific Reports, 2022
- Exploring the effect of image enhancement techniques on COVID-19 detection using chest X-ray imagesComputers in Biology and Medicine, 2021
- A dataset of clinically generated visual questions and answers about radiology imagesScientific Data, 2018
- Federated learning of predictive models from federated Electronic Health RecordsInternational Journal of Medical Informatics, 2018