Daniel R. Karlin

Background: Wearable digital health technologies and mobile apps (personal digital health technologies [DHTs]) hold great promise for transforming health research and care. However, engagement in personal DHT research is poor. Objective: The objective of this paper is to describe how participant engagement techniques and different study designs affect participant adherence, retention, and overall engagement in research involving personal DHTs. Methods: Quantitative and qualitative analysis of engagement factors are reported across 6 unique personal DHT research studies that adopted aspects of a participant-centric design. Study populations included (1) frontline health care workers; (2) a conception, pregnant, and postpartum population; (3) individuals with Crohn disease; (4) individuals with pancreatic cancer; (5) individuals with central nervous system tumors; and (6) families with a Li-Fraumeni syndrome affected member. All included studies involved the use of a study smartphone app that collected both daily and intermittent passive and active tasks, as well as using multiple wearable devices including smartwatches, smart rings, and smart scales. All studies included a variety of participant-centric engagement strategies centered on working with participants as co-designers and regular check-in phone calls to provide support over study participation. Overall retention, probability of staying in the study, and median adherence to study activities are reported. Results: The median proportion of participants retained in the study across the 6 studies was 77.2% (IQR 72.6%-88%). The probability of staying in the study stayed above 80% for all studies during the first month of study participation and stayed above 50% for the entire active study period across all studies. Median adherence to study activities varied by study population. Severely ill cancer populations and postpartum mothers showed the lowest adherence to personal DHT research tasks, largely the result of physical, mental, and situational barriers. Except for the cancer and postpartum populations, median adherences for the Oura smart ring, Garmin, and Apple smartwatches were over 80% and 90%, respectively. Median adherence to the scheduled check-in calls was high across all but one cohort (50%, IQR 20%-75%: low-engagement cohort). Median adherence to study-related activities in this low-engagement cohort was lower than in all other included studies. Conclusions: Participant-centric engagement strategies aid in participant retention and maintain good adherence in some populations. Primary barriers to engagement were participant burden (task fatigue and inconvenience), physical, mental, and situational barriers (unable to complete tasks), and low perceived benefit (lack of understanding of the value of personal DHTs). More population-specific tailoring of personal DHT designs is needed so that these new tools can be perceived as personally valuable to the end user.

In the last few decades, developers of new drugs, biologics, and devices have increasingly leveraged digital health technologies (DHTs) to assess clinical trial digital endpoints. To our knowledge, a comprehensive assessment of the financial net benefits of digital endpoints in clinical trials has not been conducted. We obtained data from the Digital Medicine Society (DiMe) Library of Digital Endpoints and the US clinical trials registry, ClinicalTrials.gov. The benefit metrics are changes in trial phase duration and enrollment associated with the use of digital endpoints. The cost metric was obtained from an industry survey of the costs of including digital endpoints in clinical trials. We developed an expected net present value (eNPV) model of the cash flows for new drug development and commercialization to assess financial value. The value measure is the increment in eNPV that occurs when digital endpoints are employed. We also calculated a return on investment (ROI) as the ratio of the estimated increment in eNPV to the mean digital endpoint implementation cost. For phase II trials, the increase in eNPV varied from $2.2 million to $3.3 million, with ROIs between 32% and 48% per indication. The net benefits were substantially higher for phase III trials, with the increase in eNPV varying from $27 million to $40 million, with ROIs that were four to six times the investment. The use of digital endpoints in clinical trials can provide substantial extra value to sponsors developing new drugs, with high ROIs.

Wearables, apps and other remote smart devices can capture rich, objective physiologic, metabolic, and behavioral information that is particularly relevant to pregnancy. The objectives of this paper were to 1) characterize individual level pregnancy self-reported symptoms and objective features from wearables compared to the aggregate; 2) determine whether pregnancy self-reported symptoms and objective features can differentiate pregnancy-related conditions; and 3) describe associations between self-reported symptoms and objective features. Data are from the Better Understanding the Metamorphosis of Pregnancy study, which followed individuals from preconception to three-months postpartum. Participants (18-40 years) were provided with an Oura smart ring, a Garmin smartwatch, and a Bodyport Cardiac Scale. They also used a study smartphone app with surveys and tasks to measure symptoms. Analyses included descriptive spaghetti plots for both individual-level data and cohort averages for select weekly reported symptoms and objective measures from wearables. This data was further stratified by pregnancy-related clinical conditions such as preeclampsia and preterm birth. Mean Spearman correlations between pairs of self-reported symptoms and objective features were estimated. Self-reported symptoms and objective features during pregnancy were highly heterogeneous between individuals. While some aggregate trends were notable, including an inflection in heart rate variability approximately eight weeks prior to delivery, these average trends were highly variable at the n-of-1 level, even among healthy individuals. Pregnancy conditions were not well differentiated by objective features. With the exception of self-reported swelling and body fluid volume, self-reported symptoms and objective features were weakly correlated (mean Spearman correlations Author Summary The objective physiological and behavioral information from wearable and other smart devices is uniquely relevant to pregnancy. The objectives of this study were to: 1) describe the individual-level variability of pregnancy self-reported symptoms and objective wearable measures; 2) determine whether this variability can be explained by pregnancy clinical conditions; and 3) determine whether pregnancy self-reported symptoms are associated with objective wearable measures. Data are from the Better Understanding the Metamorphosis of Pregnancy study, which followed individuals from preconception to three-months postpartum. Participants (18-40 years) used an Oura smartring, a Garmin smartwatch, and a Bodyport Cardiac Scale alongside a study app to track self-reported symptoms. High heterogeneity was observed in self-reported pregnancy symptoms, and objective measures such as heart rate variability, activity and sleep over pregnancy that were dissimilar to the population average of these measures. Pregnancy clinical conditions did not explain well the observed high variability in objective wearable measures while self-reported symptoms were weakly correlated with objective wearable measures over pregnancy. In sum, high heterogeneity and complexities of associations between subjective experiences and objective measures from wearables across pregnant individuals pose challenges for researchers. Innovation in machine learning and AI individual level approaches will help to accelerate the field.

Background In the last few decades developers of new drugs, biologics, and devices have increasingly leveraged digital health technologies (DHTs) to assess clinical trial digital endpoints. To our knowledge, a comprehensive assessment of the financial net benefits of digital endpoints in clinical trials has not been conducted. Data and Methods We obtained data from the Digital Medicine Society (DiMe) Library of Digital Endpoints and the U.S. clinical trials registry, ClinicalTrials.gov. The benefit metrics are changes in trial phase duration and enrollment associated with the use of digital endpoints. The cost metric was obtained from an industry survey of the costs of including digital endpoints in clinical trials. We developed an expected net present value (eNPV) model of the cash flows for new drug development and commercialization to assess financial value. The value measure is the increment in eNPV that occurs when digital endpoints are employed. We also calculated a return on investment (ROI) as the ratio of the estimated increment in eNPV to the mean digital endpoint implementation cost. Results For phase 2 trials, the increase in eNPV varied from $2.2 million to $3.3 million, with ROIs between 32% to 48% per indication. The net benefits were substantially higher for phase 3 trials, with the increase in eNPV varying from $27 million to $48 million, with ROIs that were four to seven times the investment. Conclusions The use of digital endpoints in clinical trials can provide substantial extra value to sponsors developing new drugs, with high ROIs.

Digital psychiatry could empower individuals to navigate their context-specific experiences outside healthcare visits. This editorial discusses how leveraging digital health technologies could dramatically transform how we conceptualise mental health and the mental health professional's day-day practice, and how patients could be enabled to navigate their mental health with greater agency.

The Better Understanding the Metamorphosis of Pregnancy (BUMP) study is a longitudinal feasibility study aimed to gain a deeper understanding of the pre-pregnancy and pregnancy symptom experience using digital tools. The present paper describes the protocol for the BUMP study. Over 1000 participants are being recruited through a patient provider-platform and through other channels in the United States (US). Participants in a preconception cohort (BUMP-C) are followed for 6 months, or until conception, while participants in a pregnancy cohort (BUMP) are followed into their fourth trimester. Participants are provided with a smart ring, a smartwatch (BUMP only), and a smart scale (BUMP only) alongside cohort-specific study apps. Participant centric engagement strategies are used that aim to co-design the digital approach with participants while providing knowledge and support. The BUMP study is intended to lay the foundational work for a larger study to determine whether participant co-designed digital tools can be used to detect, track and return multimodal symptoms during the perinatal window to inform individual level symptom trajectories.

Mobile technologies, such as smart phone applications, wearables, ingestibles, and implantables, are increasingly used in clinical research to capture study endpoints. On behalf of the Clinical Trials Transformation Initiative, we aimed to conduct a systematic scoping review and compile a database summarizing pilot studies addressing mobile technology sensor performance, algorithm development, software performance, and/or operational feasibility, in order to provide a resource for guiding decisions about which technology is most suitable for a particular trial. Our systematic search identified 275 publications meeting inclusion criteria. From these papers, we extracted data including the medical condition, concept of interest captured by the mobile technology, outcomes captured by the digital measurement, and details regarding the sensors, algorithms, and study sample. Sixty-seven percent of the technologies identified were wearable sensors, with the remainder including tablets, smartphones, implanted sensors, and cameras. We noted substantial variability in terms of reporting completeness and terminology used. The data have been compiled into an online database maintained by the Clinical Trials Transformation Initiative that can be filtered and searched electronically, enabling a user to find information most relevant to their work. Our long-term goal is to maintain and update the online database, in order to promote standardization of methods and reporting, encourage collaboration, and avoid redundant studies, thereby contributing to the design and implementation of efficient, high-quality trials.

Technology is changing how we practice medicine. Sensors and wearables are getting smaller and cheaper, and algorithms are becoming powerful enough to predict medical outcomes. Yet despite rapid advances, healthcare lags behind other industries in truly putting these technologies to use. A major barrier to entry is the cross-disciplinary approach required to create such tools, requiring knowledge from many people across many fields. We aim to drive the field forward by unpacking that barrier, providing a brief introduction to core concepts and terms that define digital medicine. Specifically, we contrast “clinical research” versus routine “clinical care,” outlining the security, ethical, regulatory, and legal issues developers must consider as digital medicine products go to market. We classify types of digital measurements and how to use and validate these measures in different settings. To make this resource engaging and accessible, we have included illustrations and figures throughout that we hope readers will borrow from liberally. This primer is the first in a series that will accelerate the safe and effective advancement of the field of digital medicine.