Holistic Human-Serving Digitization of Health Care Needs Integrated Automated System-Level Assessment Tools
Open Access
- 20 December 2023
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25 (1) , e50158
Abstract
Digital health tools, platforms, and artificial intelligence– or machine learning–based clinical decision support systems are increasingly part of health delivery approaches, with an ever-greater degree of system interaction. Critical to the successful deployment of these tools is their functional integration into existing clinical routines and workflows. This depends on system interoperability and on intuitive and safe user interface design. The importance of minimizing emergent workflow stress through human factors research and purposeful design for integration cannot be overstated. Usability of tools in practice is as important as algorithm quality. Regulatory and health technology assessment frameworks recognize the importance of these factors to a certain extent, but their focus remains mainly on the individual product rather than on emergent system and workflow effects. The measurement of performance and user experience has so far been performed in ad hoc, nonstandardized ways by individual actors using their own evaluation approaches. We propose that a standard framework for system-level and holistic evaluation could be built into interacting digital systems to enable systematic and standardized system-wide, multiproduct, postmarket surveillance and technology assessment. Such a system could be made available to developers through regulatory or assessment bodies as an application programming interface and could be a requirement for digital tool certification, just as interoperability is. This would enable health systems and tool developers to collect system-level data directly from real device use cases, enabling the controlled and safe delivery of systematic quality assessment or improvement studies suitable for the complexity and interconnectedness of clinical workflows using developing digital health technologies.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Association of Clinician Diagnostic Performance With Machine Learning–Based Decision Support SystemsJAMA Network Open, 2021
- The need for a system view to regulate artificial intelligence/machine learning-based software as medical devicenpj Digital Medicine, 2020
- The second information revolution: digitalization brings opportunities and concerns for public healthEuropean Journal of Public Health, 2019
- Why digital medicine depends on interoperabilitynpj Digital Medicine, 2019
- Prevalence of Burnout Among PhysiciansJAMA, 2018
- Predictors of physicians’ stress related to information systems: a nine-year follow-up survey studyBMC Health Services Research, 2018
- Cyberchondria: Overlap with health anxiety and unique relations with impairment, quality of life, and service utilizationPsychiatry Research, 2018
- New Perspectives on the “Silo Effect”: Initial Comparisons of Network Structures Across Public Health CollaborativesAmerican Journal of Public Health, 2015
- Electronic medical records and physician stress in primary care: results from the MEMO StudyJournal of the American Medical Informatics Association, 2014
- Silo effect a prominence factor to decrease efficiency of pharmaceutical industry.2013