Assessment and Reporting of Harms in Randomized Controlled Trials: A Meta-Epidemiological Study on Trials of Public Health Interventions Published in 2023
BackgroundPublic health interventions can produce adverse and unintended consequences (i.e., harms), but it is unclear how consistently randomized controlled trials (RCTs) of public health interventions plan for and report harms. Incomplete or selective harms reporting can undermine interpretation and evidence synthesis.MethodsWe conducted a meta-epidemiological study of 100 RCTs of public health interventions whose primary full-text report was indexed in PubMed in 2023. Using the publication and publicly linked documents (registrations, protocols, supplements), we assessed harms specification, harms reporting, concordance, transparency of reporting criteria, and whether reported harms were grouped by PROGRESS-Plus equity-related factors.ResultsOnly 25% (25/100) specified at least one harm, and 23% (23/100) reported any harms, while 72% (72/100) neither specified nor reported harms. Among 28 trials that mentioned harms, 12 (43%) reported all specified harms, 8 (29%) reported only a subset, and 8 (29%) showed other discordance. No trial specified harms reporting criteria, and none reported harms using identifiable criteria. Trials with a registry listing and those with an identified protocol had higher odds of harms specification compared with trials without a registry or protocol (OR = 4.7 [1.5, 14.3] and OR = 3.9 [1.5, 10.1], respectively); trials with pharmacological interventions also showed higher odds of specification compared with other intervention types (OR = 9.8 [1.9, 49.9]). Similarly, harms reporting was higher in trials with a registry or protocol (OR = 4.0 [1.3, 12.4] and OR = 3.8 [1.4, 10.0], respectively). Although 89% of trial reports considered at least one PROGRESS-Plus factor among participant characteristics, none reported harms stratified by these factors. Compared with a parallel biomedical sample, public health trials specified and reported harms far less often.ConclusionsIn our sample of RCTs of public health interventions, most trials did not specify harms they planned to measure and did not report harms results. To make public health RCTs more useful in evidence syntheses and decision-making, investigators should specify plausible harms upfront in registries and protocols, then report results for all recorded harms consistently across reports and registries. When harms may differ across groups, reported harms should also be grouped by equity-related participant characteristics.