CSE database: extended annotations and new recommendations for ECG software testing
- 31 December 2016
- journal article
- research article
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 55 (8) , 1473-1482
Abstract
Nowadays, cardiovascular diseases represent the most common cause of death in western countries. Among various examination techniques, electrocardiography (ECG) is still a highly valuable tool used for the diagnosis of many cardiovascular disorders. In order to diagnose a person based on ECG, cardiologists can use automatic diagnostic algorithms. Research in this area is still necessary. In order to compare various algorithms correctly, it is necessary to test them on standard annotated databases, such as the Common Standards for Quantitative Electrocardiography (CSE) database. According to Scopus, the CSE database is the second most cited standard database. There were two main objectives in this work. First, new diagnoses were added to the CSE database, which extended its original annotations. Second, new recommendations for diagnostic software quality estimation were established. The ECG recordings were diagnosed by five new cardiologists independently, and in total, 59 different diagnoses were found. Such a large number of diagnoses is unique, even in terms of standard databases. Based on the cardiologists’ diagnoses, a four-round consensus (4R consensus) was established. Such a 4R consensus means a correct final diagnosis, which should ideally be the output of any tested classification software. The accuracy of the cardiologists’ diagnoses compared with the 4R consensus was the basis for the establishment of accuracy recommendations. The accuracy was determined in terms of sensitivity = 79.20–86.81%, positive predictive value = 79.10–87.11%, and the Jaccard coefficient = 72.21–81.14%, respectively. Within these ranges, the accuracy of the software is comparable with the accuracy of cardiologists. The accuracy quantification of the correct classification is unique. Diagnostic software developers can objectively evaluate the success of their algorithm and promote its further development. The annotations and recommendations proposed in this work will allow for faster development and testing of classification software. As a result, this might facilitate cardiologists’ work and lead to faster diagnoses and earlier treatment.Keywords
Funding Information
- Grantová Agentura České Republiky (GAČR P102/12/2034)
This publication has 32 references indexed in Scilit:
- Using inverse electrocardiography to image myocardial infarction—reflecting on the 2007 PhysioNet/Computers in Cardiology ChallengeJournal of Electrocardiology, 2008
- Abrupt changes in fibrillatory wave characteristics at the termination of paroxysmal atrial fibrillation in humansEP Europace, 2007
- Recommendations for the Standardization and Interpretation of the ElectrocardiogramCirculation, 2007
- Automatic Classification of Heartbeats Using ECG Morphology and Heartbeat Interval FeaturesIEEE Transactions on Biomedical Engineering, 2004
- The impact of the MIT-BIH Arrhythmia DatabaseIEEE Engineering in Medicine and Biology Magazine, 2001
- PhysioBank, PhysioToolkit, and PhysioNetCirculation, 2000
- Building the IMPROVE data libraryIEEE Engineering in Medicine and Biology Magazine, 1997
- The Diagnostic Performance of Computer Programs for the Interpretation of ElectrocardiogramsNew England Journal of Medicine, 1991
- Survival of patients with severe congestive heart failure treated with oral milrinoneJACC, 1986
- Assessment of the performance of electrocardiographic computer programs with the use of a reference data base.Circulation, 1985