Digitally Diagnosing Multiple Developmental Delays Using Crowdsourcing Fused With Machine Learning: Protocol for a Human-in-the-Loop Machine Learning Study (Preprint)
Preprint
- 25 August 2023
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND A considerable number of minors in the United States are diagnosed with developmental or psychiatric conditions, potentially influenced by underdiagnosis factors such as cost, distance, and clinician availability. Despite the potential of digital phenotyping tools with machine learning (ML) approaches to expedite diagnoses and enhance diagnostic services for pediatric psychiatric conditions, existing methods face limitations because they use a limited set of social features for prediction tasks and focus on a single binary prediction, resulting in uncertain accuracies. OBJECTIVE This study aims to propose the development of a gamified web system for data collection, followed by a fusion of novel crowdsourcing algorithms with ML behavioral feature extraction approaches to simultaneously predict diagnoses of autism spectrum disorder and attention-deficit/hyperactivity disorder in a precise and specific manner. METHODS The proposed pipeline will consist of (1) gamified web applications to curate videos of social interactions adaptively based on the needs of the diagnostic system, (2) behavioral feature extraction techniques consisting of automated ML methods and novel crowdsourcing algorithms, and (3) the development of ML models that classify several conditions simultaneously and that adaptively request additional information based on uncertainties about the data. RESULTS A preliminary version of the web interface has been implemented, and a prior feature selection method has highlighted a core set of behavioral features that can be targeted through the proposed gamified approach. CONCLUSIONS The prospect for high reward stems from the possibility of creating the first artificial intelligence–powered tool that can identify complex social behaviors well enough to distinguish conditions with nuanced differentiators such as autism spectrum disorder and attention-deficit/hyperactivity disorder. INTERNATIONAL REGISTERED REPORT PRR1-10.2196/52205Keywords
All Related Versions
- Published version: JMIR Research Protocols, 13, e52205.
This publication has 42 references indexed in Scilit:
- Feasibility Testing of a Wearable Behavioral Aid for Social Learning in Children with AutismApplied Clinical Informatics, 2018
- SuperpowerGlassProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2017
- Increased Eye Contact During Conversation Compared to Play in Children With AutismJournal of Autism and Developmental Disorders, 2016
- Superpower glass2016
- A Wearable Social Interaction Aid for Children with Autism2016
- Behavior imaging and the study of autism2013
- Diagnostic and Statistical Manual of Mental Disorders2013
- Optimal outcome in individuals with a history of autismJournal of Child Psychology and Psychiatry, 2013
- A computer vision approach for the assessment of autism-related behavioral markers2012
- Racial and Ethnic Disparities in Quality of Health Care Among Children with Autism and Other Developmental DisabilitiesIntellectual and Developmental Disabilities, 2012