Defining the real-world reproducibility of visual grading of left ventricular function and visual estimation of left ventricular ejection fraction: impact of image quality, experience and accreditation
Open Access
- 4 July 2015
- journal article
- research article
- Published by Springer Nature in The International Journal of Cardiovascular Imaging
- Vol. 31 (7) , 1303-1314
Abstract
Left ventricular function can be evaluated by qualitative grading and by eyeball estimation of ejection fraction (EF). We sought to define the reproducibility of these techniques, and how they are affected by image quality, experience and accreditation. Twenty apical four-chamber echocardiographic cine loops (Online Resource 1–20) of varying image quality and left ventricular function were anonymized and presented to 35 operators. Operators were asked to provide (1) a one-phrase grading of global systolic function (2) an “eyeball” EF estimate and (3) an image quality rating on a 0–100 visual analogue scale. Each observer viewed every loop twice unknowingly, a total of 1400 viewings. When grading LV function into five categories, an operator’s chance of agreement with another operator was 50 % and with themself on blinded re-presentation was 68 %. Blinded eyeball LVEF re-estimates by the same operator had standard deviation (SD) of difference of 7.6 EF units, with the SD across operators averaging 8.3 EF units. Image quality, defined as the average of all operators’ assessments, correlated with EF estimate variability (r = −0.616, p < 0.01) and visual grading agreement (r = 0.58, p < 0.01). However, operators’ own single quality assessments were not a useful forewarning of their estimate being an outlier, partly because individual quality assessments had poor within-operator reproducibility (SD of difference 17.8). Reproducibility of visual grading of LV function and LVEF estimation is dependent on image quality, but individuals cannot themselves identify when poor image quality is disrupting their LV function estimate. Clinicians should not assume that patients changing in grade or in visually estimated EF have had a genuine clinical change.Keywords
Funding Information
- British Heart Foundation (FS/12/12/29294, FS/14/27/20752, FS/010/038, FS/14/13/30619, FS/010/038, FS/10/65/28404)
- European Research Council (281524, 281524)
This publication has 23 references indexed in Scilit:
- The Limit of Plausibility for Predictors of Response: Application to Biventricular PacingJACC: Cardiovascular Imaging, 2012
- Can a Teaching Intervention Reduce Interobserver Variability in LVEF AssessmentJACC: Cardiovascular Imaging, 2011
- Improved cardiovascular diagnostic accuracy by pocket size imaging device in non-cardiologic outpatients: the NaUSiCa (Naples Ultrasound Stethoscope in Cardiology) studyCardiovascular Ultrasound, 2010
- Letter by Nagueh et al Regarding Article, “Tissue Doppler Imaging in the Estimation of Intracardiac Filling Pressure in Decompensated Patients With Advanced Systolic Heart Failure”Circulation, 2009
- Letter by Galderisi and Esposito Regarding Article, “Tissue Doppler Imaging in the Estimation of Intracardiac Filling Pressure in Decompensated Patients With Advanced Systolic Heart Failure”Circulation, 2009
- Tissue Doppler Imaging in the Estimation of Intracardiac Filling Pressure in Decompensated Patients With Advanced Systolic Heart FailureCirculation, 2009
- Visually estimated left ventricular ejection fraction by echocardiography is closely correlated with formal quantitative methodsInternational Journal of Cardiology, 2005
- Reliability of reporting left ventricular systolic function by echocardiography: A systematic review of 3 methodsAmerican Heart Journal, 2003
- Subjective visual echocardiographic estimate of left ventricular ejection fraction as an alternative to conventional echocardiographic methods: Comparison with contrast angiographyClinical Cardiology, 1991
- Determination of left ventricular ejection fraction by visual estimation during real-time two-dimensional echocardiographyAmerican Heart Journal, 1982