Exploiting ChatGPT for Diagnosing Autism-Associated Language Disorders and Identifying Distinct Features
Preprint
- 21 May 2024
- preprint
- Published by Springer Nature in Research Square
Abstract
Diagnosing language disorders associated with autism is a complex and nuanced challenge, often hindered by the subjective nature and variability of traditional assessment methods. Traditional diagnostic methods not only require intensive human effort but also often result in delayed interventions due to their lack of speed and specificity. In this study, we explored the application of ChatGPT, a state-of-the-art large language model, to overcome these obstacles by enhancing diagnostic accuracy and profiling specific linguistic features indicative of autism. Leveraging ChatGPT's advanced natural language processing capabilities, this research aims to streamline and refine the diagnostic process. Specifically, we compared ChatGPT's performance with that of conventional supervised learning models, including BERT, a model acclaimed for its effectiveness in various natural language processing tasks. We showed that ChatGPT substantially outperformed these models, achieving over 13\% improvement in both accuracy and F1-score in a zero-shot learning configuration. This marked enhancement highlights the model’s potential as a superior tool for neurological diagnostics. Additionally, we identified ten distinct features of autism-associated language disorders that vary significantly across different experimental scenarios. These features, which included echolalia, pronoun reversal, and atypical language usage, were crucial for accurately diagnosing ASD and customizing treatment plans. Together, our findings advocate for adopting sophisticated AI tools like ChatGPT in clinical settings to assess and diagnose developmental disorders. Our approach not only promises greater diagnostic precision but also aligns with the goals of personalized medicine, potentially transforming the evaluation landscape for autism and similar neurological conditions.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Large language models encode clinical knowledgeNature, 2023
- A large language model for electronic health recordsnpj Digital Medicine, 2022
- A Multimodal Approach for Identifying Autism Spectrum Disorders in ChildrenIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2022
- Cognitive, language, social and behavioural outcomes in adults with autism spectrum disorders: A systematic review of longitudinal follow-up studies in adulthoodClinical Psychology Review, 2014
- Autism Spectrum Disorders: Clinical Features and DiagnosisPediatric Clinics of North America, 2012
- Restricted and repetitive behaviors in autism spectrum disorders: A review of research in the last decade.Psychological Bulletin, 2011
- Early Language Patterns of Toddlers on the Autism Spectrum Compared to Toddlers with Developmental DelayJournal of Autism and Developmental Disorders, 2010
- Adult psychosocial outcomes of children with specific language impairment, pragmatic language impairment and autismInternational Journal of Language & Communication Disorders, 2009
- A Comparison of Motor Delays in Young Children: Autism Spectrum Disorder, Developmental Delay, and Developmental ConcernsJournal of Autism and Developmental Disorders, 2006
- Update on the language disorders of individuals on the autistic spectrumBrain and Development, 2003