Proof of concept studies in mental health systems research: strategy and steps
Open Access
- 19 August 2025
- journal article
- review article
- Published by Springer Nature in International Journal of Mental Health Systems
- Vol. 19 (1) , 1-11
Abstract
The implementation of interventions, digital tools, and policy plans in health systems research is highly complex. Proof-of-Concept (PoC) studies facilitate the development of these applications although they are rarely conducted or reported in mental health research. This paper describes the principles and processes to conduct PoC studies in mental health systems research. The Technology Readiness Level in Implementation Sciences (TRL-IS) serves as the reference framework for this study. A ‘lessons learned’ process was applied to refine the concepts and develop a research strategy based on previous experiences with PoC studies. This process incorporated insights gained from a scoping review, case studies and discussion with both a core group and an extended group of experts. PoC studies assess the workability of an application, formulating the basic concept and determining whether its functionality can be transformed into a real prototype to be tested as intended via a pilot study and later demonstrated in the real world. The strategy to conduct PoC studies should be part of the analysis of readiness of any application in health system’s research. The first four levels of readiness in the TRL-IS scale include (1) foundational knowledge, (2) formalised prior knowledge base, (3) completion of a workable PoC, and (4) prototyping. It’s design requires input from experts in all four levels. Twenty-three main elements relevant to PoC have been identified in these four phases. PoC is generally omitted (or not reported) in mental health systems research. Researchers should be actively encouraged to overcome this omission. A common language, classification and vocabulary is needed for implementation science which incorporate this domain. The description of the specific activities conducive to PoC and prototyping should be provided. Training on the use of the TRL-IS framework including expert knowledge should also be promoted in mental health system research.Keywords
This publication has 45 references indexed in Scilit:
- An ecosystem approach to the evaluation and impact analysis of heterogeneous preventive and/or early interventions projects for veterans and first responders in seven countriesComprehensive Psychiatry, 2025
- Determining the process components of impact assessment in health and social program implementation: A scoping review of theories, models and frameworksPublic Health, 2025
- Adaptation of the technology readiness levels for impact assessment in implementation sciences: The TRL-IS checklistHeliyon, 2024
- Barriers and facilitators systematic reviews in health: A methodological review and recommendations for reviewersResearch Synthesis Methods, 2020
- A call to action to address rural mental health disparitiesJournal of Clinical and Translational Science, 2020
- Study reporting guidelines: How valid are they?Contemporary Clinical Trials Communications, 2019
- What is Proof of Concept Research and how does it Generate Epistemic and Ethical Categories for Future Scientific Practice?Science and Engineering Ethics, 2015
- Moving Knowledge into Action: Developing the Rapid Synthesis and Translation Process Within the Interactive Systems FrameworkAmerican Journal of Community Psychology, 2012
- The role and interpretation of pilot studies in clinical researchJournal of Psychiatric Research, 2011
- Knowledge management in healthcare: towards ‘knowledge-driven’ decision-support servicesInternational Journal of Medical Informatics, 2001