Matthew Boyce
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Matthew Boyce has a total of 32 co-authors. Here are the top co-authors by number of shared publications:
- Randall Eckhoff
RTI International, Morrisville, NC, United States
7 shared publications - David Edward Dausch
RTI International, Morrisville, NC, United States
4 shared publications - Dorota Temple
RTI International, Morrisville, NC, United States
4 shared publications - Edward A. Preble
RTI International, Research Triangle Park, USA
4 shared publications - Hope C. Davis-Wilson
RTI International, Research Triangle Park, NC 27709, USA
4 shared publications - Howard J. Walls
RTI International, Morrisville, NC, United States
4 shared publications
Latest Publications
- Open Access
- 24 February 2025
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 9 (1) , e53645
Effects of Missing Data on Heart Rate Variability Measured From A Smartwatch: Exploratory Observational Study
Background: Measuring heart rate variability (HRV) through wearable photoplethysmography sensors from smartwatches is gaining popularity for monitoring many health conditions. However, missing data caused by insufficient wear compliance or signal quality can degrade the performance of health metrics or algorithm calculations. Research is needed on how to best account for missing data and to assess the accuracy of metrics derived from photoplethysmography sensors. Objective: This study aimed to evaluate the influence of missing data on HRV metrics collected from smartwatches both at rest and during activity in real-world settings and to evaluate HRV agreement and consistency between wearable photoplethysmography and gold-standard wearable electrocardiogram (ECG) sensors in real-world settings. Methods: Healthy participants were outfitted with a smartwatch with a photoplethysmography sensor that collected high-resolution interbeat interval (IBI) data to wear continuously (day and night) for up to 6 months. New datasets were created with various amounts of missing data and then compared with the original (reference) datasets. 5-minute windows of each HRV metric (median IBI, SD of IBI values [STDRR], root-mean-square of the difference in successive IBI values [RMSDRR], low-frequency [LF] power, high-frequency [HF] power, and the ratio of LF to HF power [LF/HF]) were compared between the reference and the missing datasets (10%, 20%, 35%, and 60% missing data). HRV metrics calculated from the photoplethysmography sensor were compared with HRV metrics calculated from a chest-worn ECG sensor. Results: At rest, median IBI remained stable until at least 60% of data degradation (P=.24), STDRR remained stable until at least 35% of data degradation (P=.02), and RMSDRR remained stable until at least 35% data degradation (P=.001). During the activity, STDRR remained stable until 20% data degradation (P=.02) while median IBI (P=.01) and RMSDRR P<.001) were unstable at 10% data degradation. LF (rest: P<.001; activity: P<.001), HF (rest: P<.001, activity: P<.001), and LF/HF (rest: P<.001, activity: P<.001) were unstable at 10% data degradation during rest and activity. Median IBI values calculated from photoplethysmography sensors had a moderate agreement (intraclass correlation coefficient [ICC]=0.585) and consistency (ICC=0.589) and LF had moderate consistency (ICC=0.545) with ECG sensors. Other HRV metrics demonstrated poor agreement (ICC=0.071-0.472). Conclusions: This study describes a methodology for the extraction of HRV metrics from photoplethysmography sensor data that resulted in stable and valid metrics while using the least amount of available data. While smartwatches containing photoplethysmography sensors are valuable for remote monitoring of patients, future work is needed to identify best practices for using these sensors to evaluate HRV in medical settings.
- 24 February 2025
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 9 (1) , e53645
Open AccessEffects of Missing Data on Heart Rate Variability Measured From A Smartwatch: Exploratory Observational Study
Background: Measuring heart rate variability (HRV) through wearable photoplethysmography sensors from smartwatches is gaining popularity for monitoring many health conditions. However, missing data caused by insufficient wear compliance or signal quality can degrade the performance of health metrics or algorithm calculations. Research is needed on how to best account for missing data and to assess the accuracy of metrics derived from photoplethysmography sensors. Objective: This study aimed to evaluate the influence of missing data on HRV metrics collected from smartwatches both at rest and during activity in real-world settings and to evaluate HRV agreement and consistency between wearable photoplethysmography and gold-standard wearable electrocardiogram (ECG) sensors in real-world settings. Methods: Healthy participants were outfitted with a smartwatch with a photoplethysmography sensor that collected high-resolution interbeat interval (IBI) data to wear continuously (day and night) for up to 6 months. New datasets were created with various amounts of missing data and then compared with the original (reference) datasets. 5-minute windows of each HRV metric (median IBI, SD of IBI values [STDRR], root-mean-square of the difference in successive IBI values [RMSDRR], low-frequency [LF] power, high-frequency [HF] power, and the ratio of LF to HF power [LF/HF]) were compared between the reference and the missing datasets (10%, 20%, 35%, and 60% missing data). HRV metrics calculated from the photoplethysmography sensor were compared with HRV metrics calculated from a chest-worn ECG sensor. Results: At rest, median IBI remained stable until at least 60% of data degradation (P=.24), STDRR remained stable until at least 35% of data degradation (P=.02), and RMSDRR remained stable until at least 35% data degradation (P=.001). During the activity, STDRR remained stable until 20% data degradation (P=.02) while median IBI (P=.01) and RMSDRR P<.001) were unstable at 10% data degradation. LF (rest: P<.001; activity: P<.001), HF (rest: P<.001, activity: P<.001), and LF/HF (rest: P<.001, activity: P<.001) were unstable at 10% data degradation during rest and activity. Median IBI values calculated from photoplethysmography sensors had a moderate agreement (intraclass correlation coefficient [ICC]=0.585) and consistency (ICC=0.589) and LF had moderate consistency (ICC=0.545) with ECG sensors. Other HRV metrics demonstrated poor agreement (ICC=0.071-0.472). Conclusions: This study describes a methodology for the extraction of HRV metrics from photoplethysmography sensor data that resulted in stable and valid metrics while using the least amount of available data. While smartwatches containing photoplethysmography sensors are valuable for remote monitoring of patients, future work is needed to identify best practices for using these sensors to evaluate HRV in medical settings.
- Open Access
- 7 August 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e53977
Continuous Monitoring of Heart Rate Variability in Free-Living Conditions Using Wearable Sensors: Exploratory Observational Study
Background: Wearable physiological monitoring devices are promising tools for remote monitoring and early detection of potential health changes of interest. The widespread adoption of such an approach across communities and over long periods of time will require an automated data platform for collecting, processing, and analyzing relevant health information. Objective: In this study, we explore prospective monitoring of individual health through an automated data collection, metrics extraction, and health anomaly analysis pipeline in free-living conditions over a continuous monitoring period of several months with a focus on viral respiratory infections, such as influenza or COVID-19. Methods: A total of 59 participants provided smartwatch data and health symptom and illness reports daily over an 8-month window. Physiological and activity data from photoplethysmography sensors, including high-resolution interbeat interval (IBI) and step counts, were uploaded directly from Garmin Fenix 6 smartwatches and processed automatically in the cloud using a stand-alone, open-source analytical engine. Health risk scores were computed based on a deviation in heart rate and heart rate variability metrics from each individual’s activity-matched baseline values, and scores exceeding a predefined threshold were checked for corresponding symptoms or illness reports. Conversely, reports of viral respiratory illnesses in health survey responses were also checked for corresponding changes in health risk scores to qualitatively assess the risk score as an indicator of acute respiratory health anomalies. Results: The median average percentage of sensor data provided per day indicating smartwatch wear compliance was 70%, and survey responses indicating health reporting compliance was 46%. A total of 29 elevated health risk scores were detected, of which 12 (41%) had concurrent survey data and indicated a health symptom or illness. A total of 21 influenza or COVID-19 illnesses were reported by study participants; 9 (43%) of these reports had concurrent smartwatch data, of which 6 (67%) had an increase in health risk score. Conclusions: We demonstrate a protocol for data collection, extraction of heart rate and heart rate variability metrics, and prospective analysis that is compatible with near real-time health assessment using wearable sensors for continuous monitoring. The modular platform for data collection and analysis allows for a choice of different wearable sensors and algorithms. Here, we demonstrate its implementation in the collection of high-fidelity IBI data from Garmin Fenix 6 smartwatches worn by individuals in free-living conditions, and the prospective, near real-time analysis of the data, culminating in the calculation of health risk scores. To our knowledge, this study demonstrates for the first time the feasibility of measuring high-resolution heart IBI and step count using smartwatches in near real time for respiratory illness detection over a long-term monitoring period in free-living conditions.
- 7 August 2024
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 8 (1) , e53977
Open AccessContinuous Monitoring of Heart Rate Variability in Free-Living Conditions Using Wearable Sensors: Exploratory Observational Study
Background: Wearable physiological monitoring devices are promising tools for remote monitoring and early detection of potential health changes of interest. The widespread adoption of such an approach across communities and over long periods of time will require an automated data platform for collecting, processing, and analyzing relevant health information. Objective: In this study, we explore prospective monitoring of individual health through an automated data collection, metrics extraction, and health anomaly analysis pipeline in free-living conditions over a continuous monitoring period of several months with a focus on viral respiratory infections, such as influenza or COVID-19. Methods: A total of 59 participants provided smartwatch data and health symptom and illness reports daily over an 8-month window. Physiological and activity data from photoplethysmography sensors, including high-resolution interbeat interval (IBI) and step counts, were uploaded directly from Garmin Fenix 6 smartwatches and processed automatically in the cloud using a stand-alone, open-source analytical engine. Health risk scores were computed based on a deviation in heart rate and heart rate variability metrics from each individual’s activity-matched baseline values, and scores exceeding a predefined threshold were checked for corresponding symptoms or illness reports. Conversely, reports of viral respiratory illnesses in health survey responses were also checked for corresponding changes in health risk scores to qualitatively assess the risk score as an indicator of acute respiratory health anomalies. Results: The median average percentage of sensor data provided per day indicating smartwatch wear compliance was 70%, and survey responses indicating health reporting compliance was 46%. A total of 29 elevated health risk scores were detected, of which 12 (41%) had concurrent survey data and indicated a health symptom or illness. A total of 21 influenza or COVID-19 illnesses were reported by study participants; 9 (43%) of these reports had concurrent smartwatch data, of which 6 (67%) had an increase in health risk score. Conclusions: We demonstrate a protocol for data collection, extraction of heart rate and heart rate variability metrics, and prospective analysis that is compatible with near real-time health assessment using wearable sensors for continuous monitoring. The modular platform for data collection and analysis allows for a choice of different wearable sensors and algorithms. Here, we demonstrate its implementation in the collection of high-fidelity IBI data from Garmin Fenix 6 smartwatches worn by individuals in free-living conditions, and the prospective, near real-time analysis of the data, culminating in the calculation of health risk scores. To our knowledge, this study demonstrates for the first time the feasibility of measuring high-resolution heart IBI and step count using smartwatches in near real time for respiratory illness detection over a long-term monitoring period in free-living conditions.
- Open Access
- 27 October 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Continuous Monitoring of Heart Rate Variability in Free-Living Conditions Using Wearable Sensors: Exploratory Observational Study (Preprint)
BACKGROUND Wearable physiological monitoring devices are promising tools for remote monitoring and early detection of potential health changes of interest. The widespread adoption of such an approach across communities and over long periods of time will require an automated data platform for collecting, processing, and analyzing relevant health information. OBJECTIVE In this study, we explore prospective monitoring of individual health through an automated data collection, metrics extraction, and health anomaly analysis pipeline in free-living conditions over a continuous monitoring period of several months with a focus on viral respiratory infections, such as influenza or COVID-19. METHODS A total of 59 participants provided smartwatch data and health symptom and illness reports daily over an 8-month window. Physiological and activity data from photoplethysmography sensors, including high-resolution interbeat interval (IBI) and step counts, were uploaded directly from Garmin Fenix 6 smartwatches and processed automatically in the cloud using a stand-alone, open-source analytical engine. Health risk scores were computed based on a deviation in heart rate and heart rate variability metrics from each individual’s activity-matched baseline values, and scores exceeding a predefined threshold were checked for corresponding symptoms or illness reports. Conversely, reports of viral respiratory illnesses in health survey responses were also checked for corresponding changes in health risk scores to qualitatively assess the risk score as an indicator of acute respiratory health anomalies. RESULTS The median average percentage of sensor data provided per day indicating smartwatch wear compliance was 70%, and survey responses indicating health reporting compliance was 46%. A total of 29 elevated health risk scores were detected, of which 12 (41%) had concurrent survey data and indicated a health symptom or illness. A total of 21 influenza or COVID-19 illnesses were reported by study participants; 9 (43%) of these reports had concurrent smartwatch data, of which 6 (67%) had an increase in health risk score. CONCLUSIONS We demonstrate a protocol for data collection, extraction of heart rate and heart rate variability metrics, and prospective analysis that is compatible with near real-time health assessment using wearable sensors for continuous monitoring. The modular platform for data collection and analysis allows for a choice of different wearable sensors and algorithms. Here, we demonstrate its implementation in the collection of high-fidelity IBI data from Garmin Fenix 6 smartwatches worn by individuals in free-living conditions, and the prospective, near real-time analysis of the data, culminating in the calculation of health risk scores. To our knowledge, this study demonstrates for the first time the feasibility of measuring high-resolution heart IBI and step count using smartwatches in near real time for respiratory illness detection over a long-term monitoring period in free-living conditions.
- 27 October 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessContinuous Monitoring of Heart Rate Variability in Free-Living Conditions Using Wearable Sensors: Exploratory Observational Study (Preprint)
BACKGROUND Wearable physiological monitoring devices are promising tools for remote monitoring and early detection of potential health changes of interest. The widespread adoption of such an approach across communities and over long periods of time will require an automated data platform for collecting, processing, and analyzing relevant health information. OBJECTIVE In this study, we explore prospective monitoring of individual health through an automated data collection, metrics extraction, and health anomaly analysis pipeline in free-living conditions over a continuous monitoring period of several months with a focus on viral respiratory infections, such as influenza or COVID-19. METHODS A total of 59 participants provided smartwatch data and health symptom and illness reports daily over an 8-month window. Physiological and activity data from photoplethysmography sensors, including high-resolution interbeat interval (IBI) and step counts, were uploaded directly from Garmin Fenix 6 smartwatches and processed automatically in the cloud using a stand-alone, open-source analytical engine. Health risk scores were computed based on a deviation in heart rate and heart rate variability metrics from each individual’s activity-matched baseline values, and scores exceeding a predefined threshold were checked for corresponding symptoms or illness reports. Conversely, reports of viral respiratory illnesses in health survey responses were also checked for corresponding changes in health risk scores to qualitatively assess the risk score as an indicator of acute respiratory health anomalies. RESULTS The median average percentage of sensor data provided per day indicating smartwatch wear compliance was 70%, and survey responses indicating health reporting compliance was 46%. A total of 29 elevated health risk scores were detected, of which 12 (41%) had concurrent survey data and indicated a health symptom or illness. A total of 21 influenza or COVID-19 illnesses were reported by study participants; 9 (43%) of these reports had concurrent smartwatch data, of which 6 (67%) had an increase in health risk score. CONCLUSIONS We demonstrate a protocol for data collection, extraction of heart rate and heart rate variability metrics, and prospective analysis that is compatible with near real-time health assessment using wearable sensors for continuous monitoring. The modular platform for data collection and analysis allows for a choice of different wearable sensors and algorithms. Here, we demonstrate its implementation in the collection of high-fidelity IBI data from Garmin Fenix 6 smartwatches worn by individuals in free-living conditions, and the prospective, near real-time analysis of the data, culminating in the calculation of health risk scores. To our knowledge, this study demonstrates for the first time the feasibility of measuring high-resolution heart IBI and step count using smartwatches in near real time for respiratory illness detection over a long-term monitoring period in free-living conditions.
- Open Access
- 16 October 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Effects of Missing Data on Heart Rate Variability Measured From A Smartwatch: Exploratory Observational Study (Preprint)
BACKGROUND Measuring heart rate variability (HRV) through wearable photoplethysmography sensors from smartwatches is gaining popularity for monitoring many health conditions. However, missing data caused by insufficient wear compliance or signal quality can degrade the performance of health metrics or algorithm calculations. Research is needed on how to best account for missing data and to assess the accuracy of metrics derived from photoplethysmography sensors. OBJECTIVE This study aimed to evaluate the influence of missing data on HRV metrics collected from smartwatches both at rest and during activity in real-world settings and to evaluate HRV agreement and consistency between wearable photoplethysmography and gold-standard wearable electrocardiogram (ECG) sensors in real-world settings. METHODS Healthy participants were outfitted with a smartwatch with a photoplethysmography sensor that collected high-resolution interbeat interval (IBI) data to wear continuously (day and night) for up to 6 months. New datasets were created with various amounts of missing data and then compared with the original (reference) datasets. 5-minute windows of each HRV metric (median IBI, SD of IBI values [STDRR], root-mean-square of the difference in successive IBI values [RMSDRR], low-frequency [LF] power, high-frequency [HF] power, and the ratio of LF to HF power [LF/HF]) were compared between the reference and the missing datasets (10%, 20%, 35%, and 60% missing data). HRV metrics calculated from the photoplethysmography sensor were compared with HRV metrics calculated from a chest-worn ECG sensor. RESULTS At rest, median IBI remained stable until at least 60% of data degradation (P=.24), STDRR remained stable until at least 35% of data degradation (P=.02), and RMSDRR remained stable until at least 35% data degradation (P=.001). During the activity, STDRR remained stable until 20% data degradation (P=.02) while median IBI (P=.01) and RMSDRR P<.001) were unstable at 10% data degradation. LF (rest: P<.001; activity: P<.001), HF (rest: P<.001, activity: P<.001), and LF/HF (rest: P<.001, activity: P<.001) were unstable at 10% data degradation during rest and activity. Median IBI values calculated from photoplethysmography sensors had a moderate agreement (intraclass correlation coefficient [ICC]=0.585) and consistency (ICC=0.589) and LF had moderate consistency (ICC=0.545) with ECG sensors. Other HRV metrics demonstrated poor agreement (ICC=0.071-0.472). CONCLUSIONS This study describes a methodology for the extraction of HRV metrics from photoplethysmography sensor data that resulted in stable and valid metrics while using the least amount of available data. While smartwatches containing photoplethysmography sensors are valuable for remote monitoring of patients, future work is needed to identify best practices for using these sensors to evaluate HRV in medical settings.
- 16 October 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEffects of Missing Data on Heart Rate Variability Measured From A Smartwatch: Exploratory Observational Study (Preprint)
BACKGROUND Measuring heart rate variability (HRV) through wearable photoplethysmography sensors from smartwatches is gaining popularity for monitoring many health conditions. However, missing data caused by insufficient wear compliance or signal quality can degrade the performance of health metrics or algorithm calculations. Research is needed on how to best account for missing data and to assess the accuracy of metrics derived from photoplethysmography sensors. OBJECTIVE This study aimed to evaluate the influence of missing data on HRV metrics collected from smartwatches both at rest and during activity in real-world settings and to evaluate HRV agreement and consistency between wearable photoplethysmography and gold-standard wearable electrocardiogram (ECG) sensors in real-world settings. METHODS Healthy participants were outfitted with a smartwatch with a photoplethysmography sensor that collected high-resolution interbeat interval (IBI) data to wear continuously (day and night) for up to 6 months. New datasets were created with various amounts of missing data and then compared with the original (reference) datasets. 5-minute windows of each HRV metric (median IBI, SD of IBI values [STDRR], root-mean-square of the difference in successive IBI values [RMSDRR], low-frequency [LF] power, high-frequency [HF] power, and the ratio of LF to HF power [LF/HF]) were compared between the reference and the missing datasets (10%, 20%, 35%, and 60% missing data). HRV metrics calculated from the photoplethysmography sensor were compared with HRV metrics calculated from a chest-worn ECG sensor. RESULTS At rest, median IBI remained stable until at least 60% of data degradation (P=.24), STDRR remained stable until at least 35% of data degradation (P=.02), and RMSDRR remained stable until at least 35% data degradation (P=.001). During the activity, STDRR remained stable until 20% data degradation (P=.02) while median IBI (P=.01) and RMSDRR P<.001) were unstable at 10% data degradation. LF (rest: P<.001; activity: P<.001), HF (rest: P<.001, activity: P<.001), and LF/HF (rest: P<.001, activity: P<.001) were unstable at 10% data degradation during rest and activity. Median IBI values calculated from photoplethysmography sensors had a moderate agreement (intraclass correlation coefficient [ICC]=0.585) and consistency (ICC=0.589) and LF had moderate consistency (ICC=0.545) with ECG sensors. Other HRV metrics demonstrated poor agreement (ICC=0.071-0.472). CONCLUSIONS This study describes a methodology for the extraction of HRV metrics from photoplethysmography sensor data that resulted in stable and valid metrics while using the least amount of available data. While smartwatches containing photoplethysmography sensors are valuable for remote monitoring of patients, future work is needed to identify best practices for using these sensors to evaluate HRV in medical settings.
- Open Access
- 16 November 2022
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 10 (11) , e41455
Examining the Use of Mobile Technology to Deliver Tailored Sexual Assault Prevention in a Classroom Environment in the Military: Development and Usability Study
Background: Advances in mobile technology over the last 10 years have expanded its use in scientific research. However, there are challenges in creating a reliable system for intervention content delivery and data collection in an environment with limited internet connectivity and limited staffing capacity. The Sexual Communication and Consent (SCC) study used tablets to provide individualized Sexual Assault Prevention and Response training in a classroom environment that was both technologically and support staff limited. Objective: We developed the SCC Basic Military Training app and a separate Sexual Assault Response Coordinator app to support individualized training within the new SCC program. This paper presents the functionality, protocols, challenges, and feasibility of deploying mobile technology in an educational environment in the military with limited resources. Methods: We developed both mobile apps targeting the Apple iOS ecosystem. The Basic Military Training app provided a screening instrument that routed the trainee into 1 of 5 specific intervention programs. Over 2 days of basic military training set 2 weeks apart, trainees received a combined 6 hours of program-specific tablet training, combined with universal, interactive classroom training, led by qualified instructors. The Sexual Assault Response Coordinator app, used to deliver supplemental content to a subgroup of trainees, was made available for voluntary and private use at the Sexual Assault Response Coordinator’s office on base. All anonymous data were manually transferred onto laptops, where the data were aggregated into files and securely transferred to the project staff for analysis. The study was conducted at the Lackland Air Force Base, Joint Base San Antonio, with 9196 trainees providing the data. Results: A total of 7742 trainees completed both the sessions of the SCC program and a series of evaluative assessments. Some trainees did not receive day 2 training, and only received day 1 training because the COVID-19 pandemic shortened the study period. Of the 190 SCC classes taught, only one class was unable to complete tablet training because of Apple licensing–related technology failure. The 360 study tablets were distributed across 3 classrooms (120 per classroom) and were handled at least 16,938 times with no reports of breakage or requiring replacement. Wi-Fi access limitations exacerbated the complexity of Apple licensing revalidation and the secure transfer of data from the classroom to project personnel. The instructor staff’s limited technical knowledge to perform certain technical tasks was challenging. Conclusions: The results demonstrated the feasibility of deploying a mobile app for tablet-based training in a military educational environment. Although successful, the study was not without technical challenges. This paper gives examples of technical lessons learned and recommendations for conducting the study differently, with the aim that the knowledge gained may be helpful to other researchers encountering similar requirements.
- 16 November 2022
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 10 (11) , e41455
Open AccessExamining the Use of Mobile Technology to Deliver Tailored Sexual Assault Prevention in a Classroom Environment in the Military: Development and Usability Study
Background: Advances in mobile technology over the last 10 years have expanded its use in scientific research. However, there are challenges in creating a reliable system for intervention content delivery and data collection in an environment with limited internet connectivity and limited staffing capacity. The Sexual Communication and Consent (SCC) study used tablets to provide individualized Sexual Assault Prevention and Response training in a classroom environment that was both technologically and support staff limited. Objective: We developed the SCC Basic Military Training app and a separate Sexual Assault Response Coordinator app to support individualized training within the new SCC program. This paper presents the functionality, protocols, challenges, and feasibility of deploying mobile technology in an educational environment in the military with limited resources. Methods: We developed both mobile apps targeting the Apple iOS ecosystem. The Basic Military Training app provided a screening instrument that routed the trainee into 1 of 5 specific intervention programs. Over 2 days of basic military training set 2 weeks apart, trainees received a combined 6 hours of program-specific tablet training, combined with universal, interactive classroom training, led by qualified instructors. The Sexual Assault Response Coordinator app, used to deliver supplemental content to a subgroup of trainees, was made available for voluntary and private use at the Sexual Assault Response Coordinator’s office on base. All anonymous data were manually transferred onto laptops, where the data were aggregated into files and securely transferred to the project staff for analysis. The study was conducted at the Lackland Air Force Base, Joint Base San Antonio, with 9196 trainees providing the data. Results: A total of 7742 trainees completed both the sessions of the SCC program and a series of evaluative assessments. Some trainees did not receive day 2 training, and only received day 1 training because the COVID-19 pandemic shortened the study period. Of the 190 SCC classes taught, only one class was unable to complete tablet training because of Apple licensing–related technology failure. The 360 study tablets were distributed across 3 classrooms (120 per classroom) and were handled at least 16,938 times with no reports of breakage or requiring replacement. Wi-Fi access limitations exacerbated the complexity of Apple licensing revalidation and the secure transfer of data from the classroom to project personnel. The instructor staff’s limited technical knowledge to perform certain technical tasks was challenging. Conclusions: The results demonstrated the feasibility of deploying a mobile app for tablet-based training in a military educational environment. Although successful, the study was not without technical challenges. This paper gives examples of technical lessons learned and recommendations for conducting the study differently, with the aim that the knowledge gained may be helpful to other researchers encountering similar requirements.
- Open Access
- 6 September 2019
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 7 (9) , e12590
Biofeedback-Assisted Resilience Training for Traumatic and Operational Stress: Preliminary Analysis of a Self-Delivered Digital Health Methodology
Background: Psychological resilience is critical to minimize the health effects of traumatic events. Trauma may induce a chronic state of hyperarousal, resulting in problems such as anxiety, insomnia, or posttraumatic stress disorder. Mind-body practices, such as relaxation breathing and mindfulness meditation, help to reduce arousal and may reduce the likelihood of such psychological distress. To better understand resilience-building practices, we are conducting the Biofeedback-Assisted Resilience Training (BART) study to evaluate whether the practice of slow, paced breathing with or without heart rate variability biofeedback can be effectively learned via a smartphone app to enhance psychological resilience. Objective: Our objective was to conduct a limited, interim review of user interactions and study data on use of the BART resilience training app and demonstrate analyses of real-time sensor-streaming data. Methods: We developed the BART app to provide paced breathing resilience training, with or without heart rate variability biofeedback, via a self-managed 6-week protocol. The app receives streaming data from a Bluetooth-linked heart rate sensor and displays heart rate variability biofeedback to indicate movement between calmer and stressful states. To evaluate the app, a population of military personnel, veterans, and civilian first responders used the app for 6 weeks of resilience training. We analyzed app usage and heart rate variability measures during rest, cognitive stress, and paced breathing. Currently released for the BART research study, the BART app is being used to collect self-reported survey and heart rate sensor data for comparative evaluation of paced breathing relaxation training with and without heart rate variability biofeedback. Results: To date, we have analyzed the results of 328 participants who began using the BART app for 6 weeks of stress relaxation training via a self-managed protocol. Of these, 207 (63.1%) followed the app-directed procedures and completed the training regimen. Our review of adherence to protocol and app-calculated heart rate variability measures indicated that the BART app acquired high-quality data for evaluating self-managed stress relaxation training programs. Conclusions: The BART app acquired high-quality data for studying changes in psychophysiological stress according to mind-body activity states, including conditions of rest, cognitive stress, and slow, paced breathing.
- 6 September 2019
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 7 (9) , e12590
Open AccessBiofeedback-Assisted Resilience Training for Traumatic and Operational Stress: Preliminary Analysis of a Self-Delivered Digital Health Methodology
Background: Psychological resilience is critical to minimize the health effects of traumatic events. Trauma may induce a chronic state of hyperarousal, resulting in problems such as anxiety, insomnia, or posttraumatic stress disorder. Mind-body practices, such as relaxation breathing and mindfulness meditation, help to reduce arousal and may reduce the likelihood of such psychological distress. To better understand resilience-building practices, we are conducting the Biofeedback-Assisted Resilience Training (BART) study to evaluate whether the practice of slow, paced breathing with or without heart rate variability biofeedback can be effectively learned via a smartphone app to enhance psychological resilience. Objective: Our objective was to conduct a limited, interim review of user interactions and study data on use of the BART resilience training app and demonstrate analyses of real-time sensor-streaming data. Methods: We developed the BART app to provide paced breathing resilience training, with or without heart rate variability biofeedback, via a self-managed 6-week protocol. The app receives streaming data from a Bluetooth-linked heart rate sensor and displays heart rate variability biofeedback to indicate movement between calmer and stressful states. To evaluate the app, a population of military personnel, veterans, and civilian first responders used the app for 6 weeks of resilience training. We analyzed app usage and heart rate variability measures during rest, cognitive stress, and paced breathing. Currently released for the BART research study, the BART app is being used to collect self-reported survey and heart rate sensor data for comparative evaluation of paced breathing relaxation training with and without heart rate variability biofeedback. Results: To date, we have analyzed the results of 328 participants who began using the BART app for 6 weeks of stress relaxation training via a self-managed protocol. Of these, 207 (63.1%) followed the app-directed procedures and completed the training regimen. Our review of adherence to protocol and app-calculated heart rate variability measures indicated that the BART app acquired high-quality data for evaluating self-managed stress relaxation training programs. Conclusions: The BART app acquired high-quality data for studying changes in psychophysiological stress according to mind-body activity states, including conditions of rest, cognitive stress, and slow, paced breathing.
- Open Access
- 23 October 2018
- Published by JMIR Publications Inc. in JMIR Preprints
Biofeedback-Assisted Resilience Training for Traumatic and Operational Stress: Preliminary Analysis of a Self-Delivered Digital Health Methodology (Preprint)
BACKGROUND Psychological resilience is critical to minimize the health effects of traumatic events. Trauma may induce a chronic state of hyperarousal, resulting in problems such as anxiety, insomnia, or posttraumatic stress disorder. Mind-body practices, such as relaxation breathing and mindfulness meditation, help to reduce arousal and may reduce the likelihood of such psychological distress. To better understand resilience-building practices, we are conducting the Biofeedback-Assisted Resilience Training (BART) study to evaluate whether the practice of slow, paced breathing with or without heart rate variability biofeedback can be effectively learned via a smartphone app to enhance psychological resilience. OBJECTIVE Our objective was to conduct a limited, interim review of user interactions and study data on use of the BART resilience training app and demonstrate analyses of real-time sensor-streaming data. METHODS We developed the BART app to provide paced breathing resilience training, with or without heart rate variability biofeedback, via a self-managed 6-week protocol. The app receives streaming data from a Bluetooth-linked heart rate sensor and displays heart rate variability biofeedback to indicate movement between calmer and stressful states. To evaluate the app, a population of military personnel, veterans, and civilian first responders used the app for 6 weeks of resilience training. We analyzed app usage and heart rate variability measures during rest, cognitive stress, and paced breathing. Currently released for the BART research study, the BART app is being used to collect self-reported survey and heart rate sensor data for comparative evaluation of paced breathing relaxation training with and without heart rate variability biofeedback. RESULTS To date, we have analyzed the results of 328 participants who began using the BART app for 6 weeks of stress relaxation training via a self-managed protocol. Of these, 207 (63.1%) followed the app-directed procedures and completed the training regimen. Our review of adherence to protocol and app-calculated heart rate variability measures indicated that the BART app acquired high-quality data for evaluating self-managed stress relaxation training programs. CONCLUSIONS The BART app acquired high-quality data for studying changes in psychophysiological stress according to mind-body activity states, including conditions of rest, cognitive stress, and slow, paced breathing.
- 23 October 2018
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessBiofeedback-Assisted Resilience Training for Traumatic and Operational Stress: Preliminary Analysis of a Self-Delivered Digital Health Methodology (Preprint)
BACKGROUND Psychological resilience is critical to minimize the health effects of traumatic events. Trauma may induce a chronic state of hyperarousal, resulting in problems such as anxiety, insomnia, or posttraumatic stress disorder. Mind-body practices, such as relaxation breathing and mindfulness meditation, help to reduce arousal and may reduce the likelihood of such psychological distress. To better understand resilience-building practices, we are conducting the Biofeedback-Assisted Resilience Training (BART) study to evaluate whether the practice of slow, paced breathing with or without heart rate variability biofeedback can be effectively learned via a smartphone app to enhance psychological resilience. OBJECTIVE Our objective was to conduct a limited, interim review of user interactions and study data on use of the BART resilience training app and demonstrate analyses of real-time sensor-streaming data. METHODS We developed the BART app to provide paced breathing resilience training, with or without heart rate variability biofeedback, via a self-managed 6-week protocol. The app receives streaming data from a Bluetooth-linked heart rate sensor and displays heart rate variability biofeedback to indicate movement between calmer and stressful states. To evaluate the app, a population of military personnel, veterans, and civilian first responders used the app for 6 weeks of resilience training. We analyzed app usage and heart rate variability measures during rest, cognitive stress, and paced breathing. Currently released for the BART research study, the BART app is being used to collect self-reported survey and heart rate sensor data for comparative evaluation of paced breathing relaxation training with and without heart rate variability biofeedback. RESULTS To date, we have analyzed the results of 328 participants who began using the BART app for 6 weeks of stress relaxation training via a self-managed protocol. Of these, 207 (63.1%) followed the app-directed procedures and completed the training regimen. Our review of adherence to protocol and app-calculated heart rate variability measures indicated that the BART app acquired high-quality data for evaluating self-managed stress relaxation training programs. CONCLUSIONS The BART app acquired high-quality data for studying changes in psychophysiological stress according to mind-body activity states, including conditions of rest, cognitive stress, and slow, paced breathing.