Deploying a Mental Health Chatbot in Higher Education: The Development and Evaluation of Luna, an AI-Based Mental Health Support System
Open Access
Abstract
Rising mental health challenges among postsecondary students have increased the demand for scalable, ethical solutions. This paper presents the design, development, and safety evaluation of Luna, a GPT-4-based mental health chatbot. Built using a modular PHP architecture, Luna integrates multi-layered prompt engineering, safety guardrails, and referral logic. The Institutional Review Board (IRB) at the University of Detroit Mercy (Protocol #23-24-38) reviewed the proposed study and deferred full human subject approval, requesting technical validation prior to deployment. In response, we conducted a pilot test with a variety of users—including clinicians and students who simulated at-risk student scenarios. Results indicated that 96% of expert interactions were deemed safe, and 90.4% of prompts were considered useful. This paper describes Luna’s architecture, prompt strategy, and expert feedback, concluding with recommendations for future human research trials.Keywords
This publication has 33 references indexed in Scilit:
- Human vs. AI counseling: College students' perspectivesComputers in Human Behavior Reports, 2024
- The therapeutic effectiveness of artificial intelligence-based chatbots in alleviation of depressive and anxiety symptoms in short-course treatments: A systematic review and meta-analysisJournal of Affective Disorders, 2024
- Knowledge, Perceptions and Attitude of Researchers Towards Using ChatGPT in ResearchJournal of Medical Systems, 2024
- Trends in college student mental health and help-seeking by race/ethnicity: Findings from the national healthy minds study, 2013–2021Journal of Affective Disorders, 2022
- Building self-efficacy without letting stress knock it down: Stress and academic self-efficacy of university studentsInternational Journal of Educational Research Open, 2022
- College Mental Health Before and During the COVID-19 Pandemic: Results From a Nationwide SurveyCognitive Therapy and Research, 2021
- Prevalence and risk factors for mental health problems in university undergraduate students: A systematic review with meta-analysisJournal of Affective Disorders, 2021
- Student Perspectives on improving mental health support Services at universityCounselling and Psychotherapy Research, 2021
- Stress, self-compassion, and well-being during the transition to collegeSocial Science & Medicine, 2021
- WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders.Journal of Abnormal Psychology, 2018