Exploring Use, Usability, and Functionality in the Iterative Testing of a Co-Designed Preventative Mental Health Smartphone App for University Students: Comparison of Monash Thrive App Development Trials
Open Access
- 12 November 2026
- journal article
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 13, e67818
Abstract
Background: The emergence of digital tools in physical and mental health spaces is a necessary development to meet the growing need for preventative recognition and early care. Such tools must be appropriately tested throughout the development process to ensure that they are fit for purpose and both empirically and clinically valid. However, it is also critical that these tools are developed in an iterative and user-focused manner to ensure that they meet user needs for usability and functionality. Objective: This study explores the iterative testing of use, usability, and functionality key performance indicators of the Monash Thrive app, a preventative mental health app focusing on mental health literacy and mood check-in features. It was hypothesized that there would be an improvement in all variables in the second iteration testing of the app compared to the initial iteration. Methods: Two iterative trials of the app were compared, including an initial trial of the minimal viable product (MVP) of the app across 4 weeks of use and a secondary trial of the beta version of the app, redeveloped post-MVP testing, across 12 weeks of use. All recruitment and testing were delivered online through email surveys. Results: Retention rates for both trial 1 and 2 were low (59% and 46%, respectively). Despite redevelopment and resulting hypotheses, there was no significant improvement observed across any variable when comparing the 2 trials. No difference was identified across any Mobile App Rating Scale subscales, and a significant difference was detected ( P =.04; 95% CI −0.59 to 9.35), indicating higher usability scale scores in the MVP app trial compared to the beta. Conclusions: Results did not support the study hypotheses. Such findings could be due to changing expectations of smartphone apps, relatively low retention throughout the trials, or the lack of a control or comparison group for which to compare ratings. However, these lack of findings demonstrate the core importance of iterative testing to ensure that changes or upgrades are delivering the desired improvement in use, usability, and functionality.Keywords
This publication has 43 references indexed in Scilit:
- Naturalistic Evaluation of HeadGear: A Smartphone App to Reduce Depressive Symptoms in WorkersBehavior Therapy, 2024
- Feasibility of a Brief Online Mindfulness and Compassion-Based Intervention to Promote Mental Health Among University Students During the COVID-19 PandemicMindfulness, 2021
- Evaluating the quality and safety of health-related apps and e-tools: Adapting the Mobile App Rating Scale and developing a quality assurance protocolInternet Interventions, 2021
- Usability Evaluation of Artificial Intelligence-Based Voice Assistants: The Case of Amazon AlexaSN Computer Science, 2021
- Preventing depression using a smartphone app: a randomized controlled trialPsychological Medicine, 2020
- Usability Measurement of Mobile Applications with System Usability Scale (SUS)2019
- A randomized controlled trial of three smartphone apps for enhancing public mental healthBehaviour Research and Therapy, 2018
- ‘Prostate Cancer Risk Calculator’ mobile applications (Apps): a systematic review and scoring using the validated user version of the Mobile Application Rating Scale (uMARS)World Journal of Urology, 2017
- An Empirical Evaluation of the System Usability ScaleInternational Journal of Human–Computer Interaction, 2008
- Key principles for user-centred systems designBehaviour & Information Technology, 2003