LARGE LANGUAGE MODELS IN MENTAL HEALTH TRIAGE: A SYSTEMATIC REVIEW OF ACCURACY, BIAS, AND ETHICAL DEPLOYMENT ACROSS DIGITAL PLATFORMS
Authors:
- Alicja KwiatkowskaAKAlicja Kwiatkowska
- Faustyna Magdalena KołodziejFKFaustyna Magdalena Kołodziej
- Maciej Kamil MajchrzakMMMaciej Kamil Majchrzak
- Krzysztof KonopkaKKKrzysztof Konopka
- Michalina Justyna KozłowskaMKMichalina Justyna Kozłowska
- Eliza Zofia KabatEKEliza Zofia Kabat
- Maryan LiasotaMLMaryan Liasota
- Zuzanna Julia KominZKZuzanna Julia Komin
- Mateusz LisMLMateusz Lis
- Jakub JuskowiakJJJakub Juskowiak
Open Access
- 26 October 2026
- journal article
- review article
- Published by RS Global Sp. z O.O. in International Journal of Innovative Technologies in Social Science
- Vol. 1 (4(52))
Abstract
Background: The intersection of a global psychiatric workforce shortage and the rapid advancement of Generative Artificial Intelligence (GenAI) has catalyzed the integration of Large Language Models (LLMs) into digital healthcare. LLMs are increasingly deployed as preliminary triage agents to assess psychological distress, yet their diagnostic reliability, demographic neutrality, and safety protocols in crisis scenarios remain heavily debated within the psychiatric community. Objective: This review evaluates current research to determine the trustworthiness of large language models (LLMs) used in psychiatric screening. In doing so, it shines a light on the algorithmic biases present in practical use and maps out the necessary ethical standards to ensure digital health services remain safe and fair for all patients. Methodology: We sourced peer-reviewed publications released between 2023 and 2026 by running a systematic literature search across Google Scholar, PubMed/MEDLINE, and IEEE Xplore. The synthesis focused on comparative accuracy studies, observational evaluations, and sociotechnical analyses of leading LLMs (e.g., GPT-4, Claude 3.5 Sonnet, Gemini 1.5 Pro) applied specifically to psychiatric screening and automated clinical routing. Results: LLMs demonstrate high diagnostic concordance with human clinicians in structured assessments for high-prevalence conditions like major depressive disorder, effectively parsing unstructured clinical narratives. However, they exhibit a consistent tendency toward conservative over-triage in psychiatric emergencies. Profound algorithmic biases persist; models frequently recommend divergent, often inferior, treatment pathways for marginalized demographic groups and display gender-based stigmatization. Furthermore, models struggle with complex psychopathologies and display inconsistent safety mechanisms during acute suicidal ideation queries. Conclusion: While LLMs offer substantial utility for scaling preliminary psychiatric screening and reducing administrative triage burdens, their propensity for factual hallucination, demographic bias, and uncalibrated risk escalation currently precludes autonomous clinical deployment. Robust, human-in-the-loop governance and culturally representative training corpora are imperative prior to further integration into global digital health ecosystems.Keywords
This publication has 25 references indexed in Scilit:
- Large language models as mental health resources: Patterns of use in the United States.Practice Innovations, 2026
- Potential of ChatGPT in youth mental health emergency triage: Comparative analysis with cliniciansPsychiatry and Clinical Neurosciences Reports, 2025
- Assessing the accuracy and consistency of large language models in triaging social media posts for psychological distressPsychiatry Research, 2025
- Unveiling Public Stigma for Borderline Personality Disorder: A Comparative Study of Artificial Intelligence and Mental Health Care ProvidersPersonality and Mental Health, 2025
- Addressing bias in generative AI: Challenges and research opportunities in information managementInformation & Management, 2025
- Large language models for the mental health community: framework for translating code to careThe Lancet Digital Health, 2025
- Generative artificial intelligence (GenAI) and decision-making: Legal & ethical hurdles for implementation in mental healthInternational Journal of Law and Psychiatry, 2024
- Model development for bespoke large language models for digital triage assistance in mental health careArtificial Intelligence in Medicine, 2024
- AI generates covertly racist decisions about people based on their dialectNature, 2024
- Clinical decision support for bipolar depression using large language modelsNeuropsychopharmacology, 2024