Whole population cohorts versus sampled comparators designs for evaluating health and educational outcomes of children with inborn rare conditions: a simulation study
Preprint
Abstract
Background Linked administrative data covering whole populations are fundamental resources for longitudinal studies of children with rare conditions (cases) and unaffected peers (comparators). Data minimisation regulations sometimes limit the number of comparators per case (sampled comparators, SC), with unknown impact on study findings. Methods Using Monte Carlo draws, we simulated 100 000 children with and without an exemplar condition, congenital hypothyroidism (CHT), with covariates (sex and comorbidity). Three outcomes (Y: Maths tests z-score, age 11 years; L: achieving expected Maths attainment (binary); T: months to neurodevelopmental disorder diagnosis) were modelled as linear combinations of CHT, sex and comorbidity. Varying parameters (comorbidity prevalence; comorbidity-CHT association; CHT effect on Y/L/T) factorially produced 36 data-generating mechanisms (DGMs). We used regression coefficients (CHT effect), standard errors (SEs) and p-values from 1000 simulations to evaluate power, precision and bias, comparing SCn (n=5/10/15/25/50/100) versus full cohort (FC). Results Mean p-values and SEs for SC25 generally deviated ≤5% versus FC with medium effects (z-score difference=0.3; odds/hazard ratios≥2), and ≤2% for large effects (z-score difference≥0.6; odds/hazard ratios≥5). For all outcomes, no SC nor FC had sufficient power (>80% of p-values≤0.05) with small or medium effects, whilst all SC had sufficient power with large effects. Compared with FC, precision loss for SC25 was 2.0-4.3%, 5.0-8.9%, 6.7-15.5% for Y, L, T respectively. SC was not associated with bias. Conclusion SC25 provided comparable performance as FC for rare disease studies under several scenarios, but small effects posed challenges, notwithstanding sampling. This approach generates cost-effective recommendations for study design and data minimisation.Keywords
This publication has 27 references indexed in Scilit:
- Academic achievement at ages 11 and 16 in children born with congenital anomalies in England: A multi‐registry linked cohort studyPaediatric and Perinatal Epidemiology, 2024
- Global prevalence of congenital hypothyroidism among neonates from 1969 to 2020: a systematic review and meta-analysisEuropean Journal of Pediatrics, 2023
- Using simulation studies to evaluate statistical methodsStatistics in Medicine, 2019
- Association between borderline neonatal thyroid-stimulating hormone concentrations and educational and developmental outcomes: a population-based record-linkage studyThe Lancet Diabetes & Endocrinology, 2016
- The Supportive Care Needs of Parents With a Child With a Rare Disease: A Qualitative Descriptive StudyJournal of Pediatric Nursing, 2016
- Ways to Identify Children with Medical Complexity and the Importance of WhyThe Journal of Pediatrics, 2015
- Child and family experiences with inborn errors of metabolism: a qualitative interview study with representatives of patient groupsJournal of Inherited Metabolic Disease, 2015
- Thyroid dysfunction in children with Down syndrome: a literature reviewIrish Journal of Medical Science (1971 -), 2013
- Parents' experiences of living with a child with a long‐term condition: a rapid structured review of the literatureHealth Expectations, 2013
- Abnormalities of thyroid function in infants with Down syndromeThe Journal of Pediatrics, 1984