Publication bias in studies of an applied behavior‐analytic intervention: An initial analysis
Authors:
- 3 July 2014
- journal article
- review article
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 47 (3) , 663-678
Abstract
Publication bias arises when studies with favorable results are more likely to be reported than are studies with null findings. If this bias occurs in studies with single‐subject experimental designs (SSEDs) on applied behavior‐analytic (ABA) interventions, it could lead to exaggerated estimates of intervention effects. Therefore, we conducted an initial test of bias by comparing effect sizes, measured by percentage of nonoverlapping data (PND), in published SSED studies (n = 21) and unpublished dissertations (n = 10) on 1 well‐established intervention for children with autism, pivotal response treatment (PRT). Although published and unpublished studies had similar methodologies, the mean PND in published studies was 22% higher than in unpublished studies, 95% confidence interval (4%, 38%). Even when unpublished studies are included, PRT appeared to be effective (PND M = 62%). Nevertheless, the disparity between published and unpublished studies suggests a need for further assessment of publication bias in the ABA literature.Keywords
This publication has 40 references indexed in Scilit:
- An Application of the What Works Clearinghouse Standards for Evaluating Single-Subject ResearchRemedial and Special Education, 2012
- Fidelity and Effectiveness of PRT Implemented by Caregivers Without College DegreesFocus on Autism and Other Developmental Disabilities, 2011
- Improving Motivation for Academics in Children with AutismJournal of Autism and Developmental Disorders, 2010
- Why Most Published Research Findings Are FalsePLOS Medicine, 2005
- Individual Behavioral Profiles and Predictors of Treatment Effectiveness for Children With Autism.Journal of Consulting and Clinical Psychology, 2005
- Statistical Comparison of Four Effect Sizes for Single-Subject DesignsBehavior Modification, 2004
- Teaching Children with Autism Self-Initiations as a Pivotal ResponseTopics in Language Disorders, 2003
- Parent Education for Families of Children with Autism Living in Geographically Distant AreasJournal of Positive Behavior Interventions, 2002
- Summarizing Single-Subject ResearchBehavior Modification, 1998
- Publication prejudices: An experimental study of confirmatory bias in the peer review systemCognitive Therapy and Research, 1977