Psychometric Properties of the Standardised Instruments that are Used to Measure (Pragmatic) Intervention Effects in Autistic Children: A Systematic Review
Open Access
- 7 May 2025
- journal article
- review article
- Published by SAGE Publications in Autism & Developmental Language Impairments
- Vol. 10
Abstract
Background and aims: Pragmatic language difficulties can negatively influence the learning, socialization, and mental health of children diagnosed with autism spectrum disorder (ASD). Several studies have sought to determine the effects of interventions, including competencies to help these children use language for social purposes. However, are the instruments used to measure the results of the interventions appropriate and psychometrically adequate? This systematic review aims to analyze the psychometric properties of the standardized instruments that are used to measure the effects of interventions addressing (not exclusively, but also) pragmatic language competencies for autistic children. Method: Following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, systematic literature research was carried out in four electronic indexing databases: CENTRAL, PubMed, Web of Science, and Scopus. Results: A total of 49 studies from 2005 to 2023 were included and 19 standardized instruments were identified. Conclusions: After analyzing the instruments psychometric properties, the results indicated that all present some evidence of validity and reliability, but none report responsiveness. Implications: Given the impact that an instrument can have on analyzing the effects of an intervention, this study highlights the importance of considering not only the validity and reliability of an instrument but also responsiveness as a psychometric property, and the need to better describe the rationale for the outcome measures and specify what abilities are being targeted and measured. This will accurately guide future research and improve clinical decision-making around ASD.Keywords
Funding Information
- Fundação para a Ciência e a Tecnologia (2020.08569.BD)
- Fundação para a Ciência e a Tecnologia (LA/P/0053/2020)
- Fundação para a Ciência e a Tecnologia (UIDB/00214/2020)
- Fundação para a Ciência e a Tecnologia (UIDB/4255/2020)
- Fundação para a Ciência e a Tecnologia (UIDP/4255/2020)
This publication has 87 references indexed in Scilit:
- Risk‐of‐bias VISualization (robvis): An R package and Shiny web app for visualizing risk‐of‐bias assessmentsResearch Synthesis Methods, 2020
- Cooperative parent-mediated therapy for Italian preschool children with autism spectrum disorder: a randomized controlled trialEuropean Child & Adolescent Psychiatry, 2019
- A randomized controlled trial evaluating the Hebrew adaptation of the PEERS® intervention: Behavioral and questionnaire‐based outcomesAutism Research, 2018
- Effects of Parent‐Implemented Early Start Denver Model Intervention on Chinese Toddlers with Autism Spectrum Disorder: A Non‐Randomized Controlled TrialAutism Research, 2018
- A Randomized Controlled Trial of the Korean Version of the PEERS® Parent‐Assisted Social Skills Training Program for Teens With ASDAutism Research, 2014
- Avatar Assistant: Improving Social Skills in Students with an ASD Through a Computer-Based InterventionJournal of Autism and Developmental Disorders, 2011
- The Efficacy of a Social Skills Group Intervention for Improving Social Behaviors in Children with High Functioning Autism Spectrum DisordersJournal of Autism and Developmental Disorders, 2010
- RCT of a Manualized Social Treatment for High-Functioning Autism Spectrum DisordersJournal of Autism and Developmental Disorders, 2010
- A Randomized Controlled Study of Parent-assisted Children’s Friendship Training with Children having Autism Spectrum DisordersJournal of Autism and Developmental Disorders, 2010
- Standardizing ADOS Scores for a Measure of Severity in Autism Spectrum DisordersJournal of Autism and Developmental Disorders, 2008