A Meta-analytic Method for Summarizing Diagnostic Test Performances
Authors:
- Therese A. StukelTSTherese A. Stukel
- Benjamin LittenbergBLBenjamin Littenberg
- 1 August 1993
- journal article
- Published by SAGE Publications in Medical Decision Making
- Vol. 13 (3) , 253-257
Abstract
The authors have devised a meta-analytic method to summarize diagnostic test perfor mances, which they describe along with a clinical example wherein they analyze the perfor mances of real-time ultrasonography in eight studies of the detection of proximal deep venous thrombosis of the lower extremity, selected on the basis of specific inclusion criteria. To evaluate the evidence for fitting a summary receiver operating characteristic (ROC) curve, a test of correlation between the estimates of true-positive rate (TPR) and false-positive rate (FPR) is performed. A high positive correlation argues for summarizing the studies with an ROC curve. In the absence of such correlation, a test of homogeneity is applied separately to the estimates of sensitivity (TPR) and specificity (TNR) to evaluate whether differences among studies are due to chance alone. If the estimates are homogeneous, a summary point estimate and confidence intervals (Cls) are calculated. As a final step, subgroup anal yses can be performed to assess alternative explanations of variability in TPR and FPR. Within groups defined by the presence or absence of symptoms of venous thrombosis, a negative correlation between TPR and FPR and homogeneity among studies were found. For symptomatic patients, the summary TPR was 0.97 with a 95% CI of (0.94, 0.99) and the summary TNR was 0.97 (0.95, 0.99). For asymptomatic patients, the summary TPR was 0.66 (0.50, 0.81), and the summary TNR was 0.96 (0.90, 0.99). The difference in TPR between symptomatic and asymptomatic patients was statistically significant. There was no evidence that test referral bias or lack of independent interpretation of test results influenced these findings. It is concluded that this meta-analytic method represents a quantitative ap proach to summarizing the performances of diagnostic tests. It provides criteria for deciding among the approaches of fitting a summary ROC curve, calculating a summary point esti mate, or reporting ranges of TPRs and TNRs. A summary point estimate is introduced for use when TPR and FPR are not positively correlated but index test characteristics are homogeneous among studies. This method also allows examination of alternative expla nations of differences in test performance characteristics such as differences among sub groups of patients or biases in study design. Key words: meta-analysis; technology as sessment; diagnostic test accuracy. (Med Decis Making 1993;13:253-257)Keywords
This publication has 11 references indexed in Scilit:
- The Diagnostic Accuracy of Rapid Dipstick Tests to Predict Urinary Tract InfectionAmerican Journal of Clinical Pathology, 1991
- Comparative Diagnostic Performance of Three Radiological Procedures for the Detection of Lumbar Disk HerniationMethods of Information in Medicine, 1990
- Real-Time Ultrasound for Diagnosis of Symptomatic Venous Thrombosis and for Screening of Patients at Risk: Correlation with Ascending Conventional VenographyAngiology, 1989
- Detection of Deep-Vein Thrombosis by Real-Time B-Mode UltrasonographyNew England Journal of Medicine, 1989
- Compression ultrasonography for the detection of deep venous thrombosis in patients who have a fracture of the hip. A prospective study.Journal of Bone and Joint Surgery, 1989
- A General Regression Methodology for ROC Curve EstimationMedical Decision Making, 1988
- ROC SteadyMedical Decision Making, 1987
- Deep venous thrombosis of the leg: US findings.Radiology, 1987
- Real-time ultrasound diagnosis of deep vein thrombosis: A comparison with venographyClinical Radiology, 1987
- Deep venous thrombosis: detection by probe compression of veins.Journal of Ultrasound in Medicine, 1986