Masked Visual Analysis: Minimizing Type I Error in Visually Guided Single-Case Design for Communication Disorders
- 10 June 2017
- journal article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 60 (6) , 1455-1466
Abstract
Purpose: Single-case experimental designs are widely used to study interventions for communication disorders. Traditionally, single-case experiments follow a response-guided approach, where design decisions during the study are based on participants' observed patterns of behavior. However, this approach has been criticized for its high rate of Type I error. In masked visual analysis (MVA), response-guided decisions are made by a researcher who is blinded to participants' identities and treatment assignments. MVA also makes it possible to conduct a hypothesis test assessing the significance of treatment effects. Method: This tutorial describes the principles of MVA, including both how experiments can be set up and how results can be used for hypothesis testing. We then report a case study showing how MVA was deployed in a multiple-baseline across-subjects study investigating treatment for residual errors affecting rhotics. Strengths and weaknesses of MVA are discussed. Conclusions: Given their important role in the evidence base that informs clinical decision making, it is critical for single-case experimental studies to be conducted in a way that allows researchers to draw valid inferences. As a method that can increase the rigor of single-case studies while preserving the benefits of a response-guided approach, MVA warrants expanded attention from researchers in communication disorders.Keywords
This publication has 37 references indexed in Scilit:
- Effect size in clinical phonologyClinical Linguistics & Phonetics, 2011
- Comparison of Overlap Methods for Quantitatively Synthesizing Single-Subject DataThe Journal of Special Education, 2008
- Evaluating Single-Subject Treatment Research: Lessons Learned from the Aphasia LiteratureNeuropsychology Review, 2006
- Tests for the Visual Analysis of Response-Guided Multiple-Baseline DataThe Journal of Experimental Education, 2006
- The Relationship Between Visual Analysis and Five Statistical Analyses in a Simple AB Single-Case Research DesignBehavior Modification, 2006
- Single subject controlled experiments in aphasia: The science and the state of the scienceJournal of Communication Disorders, 2006
- A five-phase model for clinical-outcome researchJournal of Communication Disorders, 2004
- Review: Single-subject clinical-outcome research: designs, data, effect sizes, and analysesAphasiology, 1999
- Visual feedback in treatment of Residual Phonological disordersJournal of Communication Disorders, 1995
- The Quantitative Synthesis of Single-Subject ResearchRemedial and Special Education, 1987