ECG-Chat: A Large ECG-Language Model for Cardiac Disease Diagnosis
Authors:
Top Cited Papers
- 30 June 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
The success of Multimodal Large Language Models (MLLMs) in the medical auxiliary field shows great potential, allowing patients to engage in conversations using physiological signal data. However, general MLLMs perform poorly in cardiac disease diagnosis, particularly in the integration of ECG data analysis and medical report generation, mainly due to the complexity of ECG data analysis and the gap between text and ECG signal modalities. To address these issues, we propose ECG-Chat, a multitask MLLMs focused on ECG medical report generation, providing multimodal conversational capabilities based on cardiology knowledge. We propose a contrastive learning approach that integrates ECG waveform data with text reports, aligning ECG features with reports in a fine-grained manner. This method also results in an ECG encoder that excels in zero-shot report retrieval tasks. Additionally, expanding existing datasets, we constructed a 19k ECG diagnosis dataset and a 25k multi-turn dialogue dataset for training and fine-tuning ECG-Chat, which provides professional diagnostic and conversational capabilities. Furthermore, ECG-Chat can generate comprehensive ECG analysis reports through an automated LaTeX generation pipeline. We established a benchmark for the ECG report generation task and tested our model on multiple baselines. ECG-Chat achieved the best performance in classification, retrieval, and medical report generation tasks. Our code is available at https://github.com/YubaoZhao/ECG-Chat.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Dia-LLaMA: Towards Large Language Model-Driven CT Report Generation2025
- A Multi-Resolution Mutual Learning Network for Multi-Label ECG Classification2024
- PRISM: Patient Records Interpretation for Semantic clinical trial Matching system using large language modelsnpj Digital Medicine, 2024
- A transformer-based weakly supervised computational pathology method for clinical-grade diagnosis and molecular marker discovery of gliomasNature Machine Intelligence, 2024
- Outpatient reception via collaboration between nurses and a large language model: a randomized controlled trialNature Medicine, 2024
- MedCPT: Contrastive Pre-trained Transformers with large-scale PubMed search logs for zero-shot biomedical information retrievalBioinformatics, 2023
- Compressor-Based Classification for Atrial Fibrillation Detection2023
- A large-scale multi-label 12-lead electrocardiogram database with standardized diagnostic statementsScientific Data, 2022
- PTB-XL, a large publicly available electrocardiography datasetScientific Data, 2020
- Optimal Multi-Stage Arrhythmia Classification ApproachScientific Reports, 2020