Digitally Diagnosing Multiple Developmental Delays Using Crowdsourcing Fused With Machine Learning: Protocol for a Human-in-the-Loop Machine Learning Study
Open Access
- 8 February 2024
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 13, e52205
Abstract
Background: A considerable number of minors in the United States are diagnosed with developmental or psychiatric conditions, potentially influenced by underdiagnosis factors such as cost, distance, and clinician availability. Despite the potential of digital phenotyping tools with machine learning (ML) approaches to expedite diagnoses and enhance diagnostic services for pediatric psychiatric conditions, existing methods face limitations because they use a limited set of social features for prediction tasks and focus on a single binary prediction, resulting in uncertain accuracies. Objective: This study aims to propose the development of a gamified web system for data collection, followed by a fusion of novel crowdsourcing algorithms with ML behavioral feature extraction approaches to simultaneously predict diagnoses of autism spectrum disorder and attention-deficit/hyperactivity disorder in a precise and specific manner. Methods: The proposed pipeline will consist of (1) gamified web applications to curate videos of social interactions adaptively based on the needs of the diagnostic system, (2) behavioral feature extraction techniques consisting of automated ML methods and novel crowdsourcing algorithms, and (3) the development of ML models that classify several conditions simultaneously and that adaptively request additional information based on uncertainties about the data. Results: A preliminary version of the web interface has been implemented, and a prior feature selection method has highlighted a core set of behavioral features that can be targeted through the proposed gamified approach. Conclusions: The prospect for high reward stems from the possibility of creating the first artificial intelligence–powered tool that can identify complex social behaviors well enough to distinguish conditions with nuanced differentiators such as autism spectrum disorder and attention-deficit/hyperactivity disorder. International Registered Report Identifier (IRRID): PRR1-10.2196/52205Keywords
All Related Versions
This publication has 57 references indexed in Scilit:
- A Gamified Mobile System for Crowdsourcing Video for Autism Research2018
- Computer vision analysis captures atypical attention in toddlers with autismAutism, 2018
- Feasibility Testing of a Wearable Behavioral Aid for Social Learning in Children with AutismApplied Clinical Informatics, 2018
- SuperpowerGlassProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2017
- Superpower glass2016
- A Wearable Social Interaction Aid for Children with Autism2016
- Behavior imaging and the study of autism2013
- Optimal outcome in individuals with a history of autismJournal of Child Psychology and Psychiatry, 2013
- A computer vision approach for the assessment of autism-related behavioral markers2012
- Racial and Ethnic Disparities in Quality of Health Care Among Children with Autism and Other Developmental DisabilitiesIntellectual and Developmental Disabilities, 2012