A hierarchical framework for selecting reference measures for the analytical validation of sensor-based digital health technologies (Preprint)
Preprint
- 29 March 2024
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
UNSTRUCTURED Sensor-based digital health technologies (sDHTs) are increasingly used to support scientific and clinical decision-making. The digital clinical measures they generate offer enormous benefits, including providing more patient-relevant data, improving patient access, reducing costs, and driving inclusion across healthcare ecosystems. Scientific best practices and regulatory guidance now provide clear direction to investigators seeking to evaluate sDHTs and document claims related to their suitability for use in different contexts. However, the quality of the evidence reported for analytical validation of sDHTs —evaluation of algorithms converting sample-level sensor data into a measure that is clinically interpretable— is inconsistent and too often insufficient to support rigorous claims based on digital clinical measures. We propose a hierarchical framework to address challenges related to selecting the most appropriate reference measure for conducting analytical validation, as dictated by the medical claims related to the sDHT algorithm, and codify best practices and an approach that will help capture the greatest value of sDHTs for public health, patient care, and medical product development.Keywords
This publication has 35 references indexed in Scilit:
- Assessing ‘readiness’ by tracking fluctuations in daily sleep duration and their effects on daily mood, motivation, and sleepinessSleep Medicine, 2023
- A Patient-Centred Conceptual Model of Nocturnal Scratch and its Impact in Atopic Dermatitis: A Mixed-Methods Study Supporting the Development of Novel Digital MeasurementsSkin Health and Disease, 2023
- Key considerations to reduce or address respondent burden in patient-reported outcome (PRO) data collectionNature Communications, 2022
- Validation of open-source step-counting algorithms for wrist-worn tri-axial accelerometers in cardiovascular patientsGait & Posture, 2022
- Development of digital measures for nighttime scratch and sleep using wrist-worn wearable devicesnpj Digital Medicine, 2021
- Digital health technologies in clinical trials for central nervous system drugs: an EU regulatory perspectiveNature Reviews Drug Discovery, 2020
- Verification, analytical validation, and clinical validation (V3): the foundation of determining fit-for-purpose for Biometric Monitoring Technologies (BioMeTs)npj Digital Medicine, 2020
- The Slow Evolution of Blood Pressure MonitoringJACC: Basic To Translational Science, 2017
- Scoring accuracy of automated sleep staging from a bipolar electroocular recording compared to manual scoring by multiple ratersSleep Medicine, 2013
- Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing resultsMovement Disorders, 2008