A survey of transformers and large language models for ECG diagnosis: advances, challenges, and future directions
Top Cited Papers
Open Access
- 4 June 2025
- journal article
- research article
- Published by Springer Nature in Artificial Intelligence Review
- Vol. 58 (9) , 1-42
Abstract
Electrocardiograms (ECGs) are widely utilized in clinical practice as a non-invasive diagnostic tool for detecting cardiovascular diseases. Convolutional neural networks (CNNs) have been the primary choice for ECG analysis due to their capability to process raw signals. However, their localized convolutional operations limit the ability to capture long-range temporal dependencies across heartbeats, impeding a comprehensive cardiovascular assessment. To address these limitations, transformer-based frameworks have been introduced, employing self-attention mechanisms to effectively model complex temporal patterns over entire ECG sequences. Recent advancements in large language models (LLMs) have further expanded the utility of transformers by enabling multimodal integration and facilitating zero-shot diagnosis, thereby enhancing the scope of ECG-based clinical applications. Despite the increasing adoption of these methodologies, a comprehensive survey systematically examining transformer and LLM-based approaches for ECG analysis is absent from the literature. Consequently, this article surveys existing methods and proposes a novel hierarchical taxonomy based on the complexity of diagnosis, ranging from single-beat analysis to multi-beat and full-length signal evaluations. A thorough cross-category comparison is performed to highlight overarching commonalities and limitations. In light of these limitations, the paper presents a discussion of critical gaps and introduces new future directions aimed at improving ECG representation, enhancing positional encodings, refining self-attention architectures, and addressing challenges related to hallucinations and confidence measures in LLMs. The insights and guidelines presented aim to inform future research and clinical practices, enabling the next generation of intelligent ECG diagnostic systems.Keywords
Funding Information
- Qatar National Library
This publication has 129 references indexed in Scilit:
- FluidNet-Lite: Lightweight convolutional neural network for pore-scale modeling of multiphase flow in heterogeneous porous mediaAdvances in Water Resources, 2025
- Advancing paleontology: a survey on deep learning methodologies in fossil image analysisArtificial Intelligence Review, 2025
- Enhancing dynamic ECG heartbeat classification with lightweight transformer modelArtificial Intelligence in Medicine, 2022
- Classification of ECG beats using optimized decision tree and adaptive boosted optimized decision treeSignal, Image and Video Processing, 2021
- Effect of Continuous Electrocardiogram Monitoring on Detection of Undiagnosed Atrial Fibrillation After Hospitalization for Cardiac SurgeryJAMA Network Open, 2021
- Deep convolutional neural networks based ECG beats classification to diagnose cardiovascular conditionsBiomedical Engineering Letters, 2021
- Impact of QRS Morphology on Response to Conduction System Pacing After Atrioventricular Junction AblationESC Heart Failure, 2021
- Interpretation of T‐wave inversion in physiological and pathological conditions: Current state and future perspectivesClinical Cardiology, 2020
- Detection of atrial fibrillation using an implantable loop recorder following cryptogenic stroke: implications for post-stroke electrocardiographic monitoringJournal of Interventional Cardiac Electrophysiology, 2019
- Evaluation of bagging ensemble method with time-domain feature extraction for diagnosing of arrhythmia beatsNeural Computing and Applications, 2012