Two-stage lot quality assurance sampling framework for monitoring and evaluation of neglected tropical diseases, allowing for imperfect diagnostics and spatial heterogeneity
Open Access
- 8 April 2022
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS Neglected Tropical Diseases
- Vol. 16 (4) , e0010353
Abstract
Background: Monitoring and evaluation (M&E) is a key component of large-scale neglected tropical diseases (NTD) control programs. Diagnostic tests deployed in these M&E surveys are often imperfect, and it remains unclear how this affects the population-based program decision-making. Methodology: We developed a 2-stage lot quality assurance sampling (LQAS) framework for decision-making that allows for both imperfect diagnostics and spatial heterogeneity of infections. We applied the framework to M&E of soil-transmitted helminth control programs as a case study. For this, we explored the impact of the diagnostic performance (sensitivity and specificity), spatial heterogeneity (intra-cluster correlation), and survey design on program decision-making around the prevalence decisions thresholds recommended by WHO (2%, 10%, 20% and 50%) and the associated total survey costs. Principal findings: The survey design currently recommended by WHO (5 clusters and 50 subjects per cluster) may lead to incorrect program decisions around the 2% and 10% prevalence thresholds, even when perfect diagnostic tests are deployed. To reduce the risk of incorrect decisions around the 2% prevalence threshold, including more clusters (≥10) and deploying highly specific diagnostic methods (≥98%) are the most-cost saving strategies when spatial heterogeneity is moderate-to-high (intra-cluster correlation >0.017). The higher cost and lower throughput of improved diagnostic tests are compensated by lower required sample sizes, though only when the cost per test is US$ and sample throughput is ≥3 per hour. Conclusion/Significance: Our framework provides a means to assess and update M&E guidelines and guide product development choices for NTD. Using soil-transmitted helminths as a case study, we show that current M&E guidelines may severely fall short, particularly in low-endemic and post-control settings. Furthermore, specificity rather than sensitivity is a critical parameter to consider. When the geographical distribution of an NTD within a district is highly heterogeneous, sampling more clusters (≥10) may be required.Keywords
Funding Information
- Dutch Research Council (NWO, grant 016.Veni.178.023)
- Universiteit Gent
This publication has 28 references indexed in Scilit:
- Investigating the Effectiveness of Current and Modified World Health Organization Guidelines for the Control of Soil-Transmitted Helminth InfectionsClinical Infectious Diseases, 2018
- Testing for soil-transmitted helminth transmission elimination: Analysing the impact of the sensitivity of different diagnostic toolsPLOS Neglected Tropical Diseases, 2018
- Comparison of sensitivity and faecal egg counts of Mini-FLOTAC using fixed stool samples and Kato-Katz technique for the diagnosis of Schistosoma mansoni and soil-transmitted helminthsActa Tropica, 2016
- Quality control in the diagnosis of Trichuris trichiura and Ascaris lumbricoides using the Kato-Katz technique: experience from three randomised controlled trialsParasites & Vectors, 2015
- Sm16, a major component of Schistosoma mansoni cercarial excretory/secretory products, prevents macrophage classical activation and delays antigen processingParasites & Vectors, 2015
- Sensitivity of diagnostic tests for human soil-transmitted helminth infections: a meta-analysis in the absence of a true gold standardInternational Journal for Parasitology, 2014
- Extending cluster lot quality assurance sampling designs for surveillance programsStatistics in Medicine, 2014
- Diagnostic Accuracy of Kato–Katz, FLOTAC, Baermann, and PCR Methods for the Detection of Light-Intensity Hookworm and Strongyloides stercoralis Infections in TanzaniaThe American Journal of Tropical Medicine and Hygiene, 2014
- Impact of Health Education on Soil-Transmitted Helminth Infections in Schoolchildren of the Peruvian Amazon: A Cluster-Randomized Controlled TrialPLOS Neglected Tropical Diseases, 2013
- Estimating the sensitivity and specificity of Kato-Katz stool examination technique for detection of hookworms, Ascaris lumbricoides and Trichuris trichiura infections in humans in the absence of a ‘gold standard’International Journal for Parasitology, 2010