Timo B. Brakenhoff
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Timo B. Brakenhoff has a total of 102 co-authors. Here are the top co-authors by number of shared publications:
- Rolf Hendrik Herman Groenwold
Leiden University Medical Center
5 shared publications - Andjela Markovic
Department of Psychology, University of Fribourg, Fribourg, Switzerland
4 shared publications - Brianna Mae Goodale
Ava AG, Zurich, Switzerland
4 shared publications - Diederick E. Grobbee
Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Universiteitsweg 100, 3584 CG Utrecht, The Netherlands
4 shared publications - Duco Veen
Affiliations Department of Methodology and Statistics, Utrecht University, Utrecht, The Netherlands, Optentia Research Programme, North-West University, Potchefstroom, South Africa
3 shared publications - George Stanley Downward
Department of Environmental Epidemiology, Institute for Risk Assessment Sciences (IRAS), Utrecht University, Utrecht, the Netherlands; Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, the Netherlands
3 shared publications
Latest Publications
- Open Access
- 5 June 2025
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 20 (6) , e0325116
Remote early detection of SARS-CoV-2 infections using a wearable-based algorithm: Results from the COVID-RED study, a prospective randomised single-blinded crossover trial
Background: Rapid and early detection of SARS-CoV-2 infections, especially during the pre- or asymptomatic phase, could aid in reducing virus spread. Physiological parameters measured by wearable devices can be efficiently analysed to provide early detection of infections. The COVID-19 Remote Early Detection (COVID-RED) trial investigated the use of a wearable device (Ava bracelet) for improved early detection of SARS-CoV-2 infections in real-time. Trial design: Prospective, single-blinded, two-period, two-sequence, randomised controlled crossover trial. Methods: Subjects wore a medical device and synced it with a mobile application in which they also reported symptoms. Subjects in the experimental condition received real-time infection indications based on an algorithm using both wearable device and self-reported symptom data, while subjects in the control arm received indications based on daily symptom-reporting only. Subjects were asked to get tested for SARS-CoV-2 when receiving an app-generated alert, and additionally underwent periodic SARS-CoV-2 serology testing. The overall and early detection performance of both algorithms was evaluated and compared using metrics such as sensitivity and specificity. Results: A total of 17,825 subjects were randomised within the study. Subjects in the experimental condition received an alert significantly earlier than those in the control condition (median of 0 versus 7 days before a positive SARS-CoV-2 test). The experimental algorithm achieved high sensitivity (93.8–99.2%) but low specificity (0.8–4.2%) when detecting infections during a specified period, while the control algorithm achieved more moderate sensitivity (43.3–46.4%) and specificity (66.4–65.0%). When detecting infection on a given day, the experimental algorithm also achieved higher sensitivity compared to the control algorithm (45–52% versus 28–33%), but much lower specificity (38–50% versus 93–97%). Conclusions: Our findings highlight the potential role of wearable devices in early detection of SARS-CoV-2. The experimental algorithm overestimated infections, but future iterations could finetune the algorithm to improve specificity and enable it to differentiate between respiratory illnesses. Trial registration: Netherlands Trial Register number NL9320.
- 5 June 2025
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 20 (6) , e0325116
Open AccessRemote early detection of SARS-CoV-2 infections using a wearable-based algorithm: Results from the COVID-RED study, a prospective randomised single-blinded crossover trial
Background: Rapid and early detection of SARS-CoV-2 infections, especially during the pre- or asymptomatic phase, could aid in reducing virus spread. Physiological parameters measured by wearable devices can be efficiently analysed to provide early detection of infections. The COVID-19 Remote Early Detection (COVID-RED) trial investigated the use of a wearable device (Ava bracelet) for improved early detection of SARS-CoV-2 infections in real-time. Trial design: Prospective, single-blinded, two-period, two-sequence, randomised controlled crossover trial. Methods: Subjects wore a medical device and synced it with a mobile application in which they also reported symptoms. Subjects in the experimental condition received real-time infection indications based on an algorithm using both wearable device and self-reported symptom data, while subjects in the control arm received indications based on daily symptom-reporting only. Subjects were asked to get tested for SARS-CoV-2 when receiving an app-generated alert, and additionally underwent periodic SARS-CoV-2 serology testing. The overall and early detection performance of both algorithms was evaluated and compared using metrics such as sensitivity and specificity. Results: A total of 17,825 subjects were randomised within the study. Subjects in the experimental condition received an alert significantly earlier than those in the control condition (median of 0 versus 7 days before a positive SARS-CoV-2 test). The experimental algorithm achieved high sensitivity (93.8–99.2%) but low specificity (0.8–4.2%) when detecting infections during a specified period, while the control algorithm achieved more moderate sensitivity (43.3–46.4%) and specificity (66.4–65.0%). When detecting infection on a given day, the experimental algorithm also achieved higher sensitivity compared to the control algorithm (45–52% versus 28–33%), but much lower specificity (38–50% versus 93–97%). Conclusions: Our findings highlight the potential role of wearable devices in early detection of SARS-CoV-2. The experimental algorithm overestimated infections, but future iterations could finetune the algorithm to improve specificity and enable it to differentiate between respiratory illnesses. Trial registration: Netherlands Trial Register number NL9320.
- Open Access
- 31 July 2024
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26 (1) , e51120
Physiological Response to the COVID-19 Vaccine: Insights From a Prospective, Randomized, Single-Blinded, Crossover Trial
Background: Rapid development and implementation of vaccines constituted a crucial step in containing the COVID-19 pandemic. A comprehensive understanding of physiological responses to these vaccines is important to build trust in medicine. Objective: This study aims to investigate temporal dynamics before and after COVID-19 vaccination in 4 physiological parameters as well as the duration of menstrual cycle phases. Methods: In a prospective trial, 17,825 adults in the Netherlands wore a medical device on their wrist for up to 9 months. The device recorded their physiological signals and synchronized with a complementary smartphone app. By means of multilevel quadratic regression, we examined changes in wearable-recorded breathing rate, wrist skin temperature, heart rate, heart rate variability, and objectively assessed the duration of menstrual cycle phases in menstruating participants to assess the effects of COVID-19 vaccination. Results: The recorded physiological signals demonstrated short-term increases in breathing rate and heart rate after COVID-19 vaccination followed by a prompt rebound to baseline levels likely reflecting biological mechanisms accompanying the immune response to vaccination. No sex differences were evident in the measured physiological responses. In menstruating participants, we found a 0.8% decrease in the duration of the menstrual phase following vaccination. Conclusions: The observed short-term changes suggest that COVID-19 vaccines are not associated with long-term biophysical issues. Taken together, our work provides valuable insights into continuous fluctuations of physiological responses to vaccination and highlights the importance of digital solutions in health care. International Registered Report Identifier (IRRID): RR2-10.1186/s13063-021-05241-5
- 31 July 2024
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26 (1) , e51120
Open AccessPhysiological Response to the COVID-19 Vaccine: Insights From a Prospective, Randomized, Single-Blinded, Crossover Trial
Background: Rapid development and implementation of vaccines constituted a crucial step in containing the COVID-19 pandemic. A comprehensive understanding of physiological responses to these vaccines is important to build trust in medicine. Objective: This study aims to investigate temporal dynamics before and after COVID-19 vaccination in 4 physiological parameters as well as the duration of menstrual cycle phases. Methods: In a prospective trial, 17,825 adults in the Netherlands wore a medical device on their wrist for up to 9 months. The device recorded their physiological signals and synchronized with a complementary smartphone app. By means of multilevel quadratic regression, we examined changes in wearable-recorded breathing rate, wrist skin temperature, heart rate, heart rate variability, and objectively assessed the duration of menstrual cycle phases in menstruating participants to assess the effects of COVID-19 vaccination. Results: The recorded physiological signals demonstrated short-term increases in breathing rate and heart rate after COVID-19 vaccination followed by a prompt rebound to baseline levels likely reflecting biological mechanisms accompanying the immune response to vaccination. No sex differences were evident in the measured physiological responses. In menstruating participants, we found a 0.8% decrease in the duration of the menstrual phase following vaccination. Conclusions: The observed short-term changes suggest that COVID-19 vaccines are not associated with long-term biophysical issues. Taken together, our work provides valuable insights into continuous fluctuations of physiological responses to vaccination and highlights the importance of digital solutions in health care. International Registered Report Identifier (IRRID): RR2-10.1186/s13063-021-05241-5
- 5 November 2023
- Published by Springer Nature
- p. 97-108
Statistical Analysis—Measurement Error
- Open Access
- 21 July 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Physiological Response to the COVID-19 Vaccine: Insights From a Prospective, Randomized, Single-Blinded, Crossover Trial (Preprint)
BACKGROUND Rapid development and implementation of vaccines constituted a crucial step in containing the COVID-19 pandemic. A comprehensive understanding of physiological responses to these vaccines is important to build trust in medicine. OBJECTIVE This study aims to investigate temporal dynamics before and after COVID-19 vaccination in 4 physiological parameters as well as the duration of menstrual cycle phases. METHODS In a prospective trial, 17,825 adults in the Netherlands wore a medical device on their wrist for up to 9 months. The device recorded their physiological signals and synchronized with a complementary smartphone app. By means of multilevel quadratic regression, we examined changes in wearable-recorded breathing rate, wrist skin temperature, heart rate, heart rate variability, and objectively assessed the duration of menstrual cycle phases in menstruating participants to assess the effects of COVID-19 vaccination. RESULTS The recorded physiological signals demonstrated short-term increases in breathing rate and heart rate after COVID-19 vaccination followed by a prompt rebound to baseline levels likely reflecting biological mechanisms accompanying the immune response to vaccination. No sex differences were evident in the measured physiological responses. In menstruating participants, we found a 0.8% decrease in the duration of the menstrual phase following vaccination. CONCLUSIONS The observed short-term changes suggest that COVID-19 vaccines are not associated with long-term biophysical issues. Taken together, our work provides valuable insights into continuous fluctuations of physiological responses to vaccination and highlights the importance of digital solutions in health care. CLINICALTRIAL Netherlands Trial Register NL9320; https://www.trialregister.nl/trial/9320 INTERNATIONAL REGISTERED REPORT RR2-10.1186/s13063-021-05241-5
- 21 July 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessPhysiological Response to the COVID-19 Vaccine: Insights From a Prospective, Randomized, Single-Blinded, Crossover Trial (Preprint)
BACKGROUND Rapid development and implementation of vaccines constituted a crucial step in containing the COVID-19 pandemic. A comprehensive understanding of physiological responses to these vaccines is important to build trust in medicine. OBJECTIVE This study aims to investigate temporal dynamics before and after COVID-19 vaccination in 4 physiological parameters as well as the duration of menstrual cycle phases. METHODS In a prospective trial, 17,825 adults in the Netherlands wore a medical device on their wrist for up to 9 months. The device recorded their physiological signals and synchronized with a complementary smartphone app. By means of multilevel quadratic regression, we examined changes in wearable-recorded breathing rate, wrist skin temperature, heart rate, heart rate variability, and objectively assessed the duration of menstrual cycle phases in menstruating participants to assess the effects of COVID-19 vaccination. RESULTS The recorded physiological signals demonstrated short-term increases in breathing rate and heart rate after COVID-19 vaccination followed by a prompt rebound to baseline levels likely reflecting biological mechanisms accompanying the immune response to vaccination. No sex differences were evident in the measured physiological responses. In menstruating participants, we found a 0.8% decrease in the duration of the menstrual phase following vaccination. CONCLUSIONS The observed short-term changes suggest that COVID-19 vaccines are not associated with long-term biophysical issues. Taken together, our work provides valuable insights into continuous fluctuations of physiological responses to vaccination and highlights the importance of digital solutions in health care. CLINICALTRIAL Netherlands Trial Register NL9320; https://www.trialregister.nl/trial/9320 INTERNATIONAL REGISTERED REPORT RR2-10.1186/s13063-021-05241-5
- Open Access
- 5 August 2022
- Published by Wolters Kluwer Health in Journal of the American Heart Association
- Vol. 11 (16) , e024168
Revealing Unforeseen Diagnostic Image Features With Deep Learning by Detecting Cardiovascular Diseases From Apical 4‐Chamber Ultrasounds
Background: With the increase of highly portable, wireless, and low‐cost ultrasound devices and automatic ultrasound acquisition techniques, an automated interpretation method requiring only a limited set of views as input could make preliminary cardiovascular disease diagnoses more accessible. In this study, we developed a deep learning method for automated detection of impaired left ventricular (LV) function and aortic valve (AV) regurgitation from apical 4‐chamber ultrasound cineloops and investigated which anatomical structures or temporal frames provided the most relevant information for the deep learning model to enable disease classification. Methods and Results: Apical 4‐chamber ultrasounds were extracted from 3554 echocardiograms of patients with impaired LV function (n=928), AV regurgitation (n=738), or no significant abnormalities (n=1888). Two convolutional neural networks were trained separately to classify the respective disease cases against normal cases. The overall classification accuracy of the impaired LV function detection model was 86%, and that of the AV regurgitation detection model was 83%. Feature importance analyses demonstrated that the LV myocardium and mitral valve were important for detecting impaired LV function, whereas the tip of the mitral valve anterior leaflet, during opening, was considered important for detecting AV regurgitation. Conclusions: The proposed method demonstrated the feasibility of a 3‐dimensional convolutional neural network approach in detection of impaired LV function and AV regurgitation using apical 4‐chamber ultrasound cineloops. The current study shows that deep learning methods can exploit large training data to detect diseases in a different way than conventionally agreed on methods, and potentially reveal unforeseen diagnostic image features.
- 5 August 2022
- Published by Wolters Kluwer Health in Journal of the American Heart Association
- Vol. 11 (16) , e024168
Open AccessRevealing Unforeseen Diagnostic Image Features With Deep Learning by Detecting Cardiovascular Diseases From Apical 4‐Chamber Ultrasounds
Background: With the increase of highly portable, wireless, and low‐cost ultrasound devices and automatic ultrasound acquisition techniques, an automated interpretation method requiring only a limited set of views as input could make preliminary cardiovascular disease diagnoses more accessible. In this study, we developed a deep learning method for automated detection of impaired left ventricular (LV) function and aortic valve (AV) regurgitation from apical 4‐chamber ultrasound cineloops and investigated which anatomical structures or temporal frames provided the most relevant information for the deep learning model to enable disease classification. Methods and Results: Apical 4‐chamber ultrasounds were extracted from 3554 echocardiograms of patients with impaired LV function (n=928), AV regurgitation (n=738), or no significant abnormalities (n=1888). Two convolutional neural networks were trained separately to classify the respective disease cases against normal cases. The overall classification accuracy of the impaired LV function detection model was 86%, and that of the AV regurgitation detection model was 83%. Feature importance analyses demonstrated that the LV myocardium and mitral valve were important for detecting impaired LV function, whereas the tip of the mitral valve anterior leaflet, during opening, was considered important for detecting AV regurgitation. Conclusions: The proposed method demonstrated the feasibility of a 3‐dimensional convolutional neural network approach in detection of impaired LV function and AV regurgitation using apical 4‐chamber ultrasound cineloops. The current study shows that deep learning methods can exploit large training data to detect diseases in a different way than conventionally agreed on methods, and potentially reveal unforeseen diagnostic image features.
- Open Access
Investigation of the use of a sensor bracelet for the presymptomatic detection of changes in physiological parameters related to COVID-19: an interim analysis of a prospective cohort study (COVI-GAPP)
Objectives: We investigated machinelearningbased identification of presymptomatic COVID-19 and detection of infection-related changes in physiology using a wearable device.Design: Interim analysis of a prospective cohort study.Setting, participants and interventions: Participants from a national cohort study in Liechtenstein were included. Nightly they wore the Ava-bracelet that measured respiratory rate (RR), heart rate (HR), HR variability (HRV), wrist-skin temperature (WST) and skin perfusion. SARS-CoV-2 infection was diagnosed by molecular and/or serological assays.Results: A total of 1.5 million hours of physiological data were recorded from 1163 participants (mean age 44±5.5 years). COVID-19 was confirmed in 127 participants of which, 66 (52%) had worn their device from baseline to symptom onset (SO) and were included in this analysis. Multi-level modelling revealed significant changes in five (RR, HR, HRV, HRV ratio and WST) device-measured physiological parameters during the incubation, presymptomatic, symptomatic and recovery periods of COVID-19 compared with baseline. The training set represented an 8-day long instance extracted from day 10 to day 2 before SO. The training set consisted of 40 days measurements from 66 participants. Based on a random split, the test set included 30% of participants and 70% were selected for the training set. The developed long short-term memory (LSTM) based recurrent neural network (RNN) algorithm had a recall (sensitivity) of 0.73 in the training set and 0.68 in the testing set when detecting COVID-19 up to 2 days prior to SO.Conclusion: Wearable sensor technology can enable COVID-19 detection during the presymptomatic period. Our proposed RNN algorithm identified 68% of COVID-19 positive participants 2 days prior to SO and will be further trained and validated in a randomised, single-blinded, two-period, two-sequence crossover trial.Trial registration numberISRCTN51255782; Pre-results.
Open AccessInvestigation of the use of a sensor bracelet for the presymptomatic detection of changes in physiological parameters related to COVID-19: an interim analysis of a prospective cohort study (COVI-GAPP)
Objectives: We investigated machinelearningbased identification of presymptomatic COVID-19 and detection of infection-related changes in physiology using a wearable device.Design: Interim analysis of a prospective cohort study.Setting, participants and interventions: Participants from a national cohort study in Liechtenstein were included. Nightly they wore the Ava-bracelet that measured respiratory rate (RR), heart rate (HR), HR variability (HRV), wrist-skin temperature (WST) and skin perfusion. SARS-CoV-2 infection was diagnosed by molecular and/or serological assays.Results: A total of 1.5 million hours of physiological data were recorded from 1163 participants (mean age 44±5.5 years). COVID-19 was confirmed in 127 participants of which, 66 (52%) had worn their device from baseline to symptom onset (SO) and were included in this analysis. Multi-level modelling revealed significant changes in five (RR, HR, HRV, HRV ratio and WST) device-measured physiological parameters during the incubation, presymptomatic, symptomatic and recovery periods of COVID-19 compared with baseline. The training set represented an 8-day long instance extracted from day 10 to day 2 before SO. The training set consisted of 40 days measurements from 66 participants. Based on a random split, the test set included 30% of participants and 70% were selected for the training set. The developed long short-term memory (LSTM) based recurrent neural network (RNN) algorithm had a recall (sensitivity) of 0.73 in the training set and 0.68 in the testing set when detecting COVID-19 up to 2 days prior to SO.Conclusion: Wearable sensor technology can enable COVID-19 detection during the presymptomatic period. Our proposed RNN algorithm identified 68% of COVID-19 positive participants 2 days prior to SO and will be further trained and validated in a randomised, single-blinded, two-period, two-sequence crossover trial.Trial registration numberISRCTN51255782; Pre-results.
- Open Access
- 11 October 2021
- Published by Springer Nature in Trials
- Vol. 22 (1) , 1-5
A prospective, randomized, single-blinded, crossover trial to investigate the effect of a wearable device in addition to a daily symptom diary for the Remote Early Detection of SARS-CoV-2 infections (COVID-RED): a structured summary of a study protocol for a randomized controlled trial
Objectives: It is currently thought that most—but not all—individuals infected with SARS-CoV-2 develop symptoms, but the infectious period starts on average 2 days before the first overt symptoms appear. It is estimated that pre- and asymptomatic individuals are responsible for more than half of all transmissions. By detecting infected individuals before they have overt symptoms, wearable devices could potentially and significantly reduce the proportion of transmissions by pre-symptomatic individuals. Using laboratory-confirmed SARS-CoV-2 infections (detected via serology tests [to determine if there are antibodies against the SARS-CoV-2 in the blood] or SARS-CoV-2 infection tests such as polymerase chain reaction [PCR] or antigen tests) as the gold standard, we will determine the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for the following two algorithms to detect first time SARS-CoV-2 infection including early or asymptomatic infection: • The algorithm using Ava bracelet data when coupled with self-reported Daily Symptom Diary data (Wearable + Symptom Data Algo; experimental condition) • The algorithm using self-reported Daily Symptom Diary data alone (Symptom Only Algo; control condition) In addition, we will determine which of the two algorithms has superior performance characteristics for detecting SARS-CoV-2 infection including early or asymptomatic infection as confirmed by SARS-CoV-2 virus testing. Trial design: The trial is a randomized, single-blinded, two-period, two-sequence crossover trial. The study will start with an initial learning phase (maximum of 3 months), followed by period 1 (3 months) and period 2 (3 months). Subjects entering the study at the end of the recruitment period may directly start with period 1 and will not be part of the learning phase. Each subject will undergo the experimental condition (the Wearable + Symptom Data Algo) in either period 1 or period 2 and the control condition (Symptom Only Algo) in the other period. The order will be randomly assigned, resulting in subjects being allocated 1:1 to either sequence 1 (experimental condition first) or sequence 2 (control condition first). Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence. Participants: The trial will be conducted in the Netherlands. A target of 20,000 subjects will be enrolled. Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence. This results in approximately 6500 normal-risk individuals and 3500 high-risk individuals per sequence. Subjects will be recruited from previously studied cohorts as well as via public campaigns and social media. All data for this study will be collected remotely through the Ava COVID-RED app, the Ava bracelet, surveys in the COVID-RED web portal and self-sampling serology and PCR kits. More information on the study can be found in www.covid-red.eu . During recruitment, subjects will be invited to visit the COVID-RED web portal. After successfully completing the enrolment questionnaire, meeting eligibility criteria and indicating interest in joining the study, subjects will receive the subject information sheet and informed consent form. Subjects can enrol in COVID-RED if they comply with the following inclusion and exclusion criteria: Inclusion criteria: • Resident of the Netherlands • At least 18 years old • Informed consent provided (electronic) • Willing to adhere to the study procedures described in the protocol • Must have a smartphone that runs at least Android 8.0 or iOS 13.0 operating systems and is active for the duration of the study (in the case of a change of mobile number, the study team should be notified) • Be able to read, understand and write Dutch Exclusion criteria: • Previous positive SARS-CoV-2 test result (confirmed either through PCR/antigen or antibody tests; self-reported) • Current suspected (e.g. waiting for test result) COVID-19 infection or symptoms of a COVID-19 infection (self-reported) • Participating in any other COVID-19 clinical drug, vaccine or medical device trial (self-reported) • Electronic implanted device (such as a pacemaker; self-reported) • Pregnant at the time of informed consent (self-reported) • Suffering from cholinergic urticaria (per the Ava bracelet’s user manual; self-reported) • Staff involved in the management or conduct of this study Intervention and comparator: All subjects will be instructed to complete the Daily Symptom Diary in the Ava COVID-RED app daily, wear their Ava bracelet each night and synchronize it with the app each day for the entire period of study participation. Provided with wearable sensor and/or self-reported symptom data within the last 24 h, the Ava COVID-RED app’s underlying algorithms will provide subjects with a real-time indicator of their overall health and well-being. Subjects will see one of three messages, notifying them that no seeming deviations in symptoms and/or physiological parameters have been detected; some changes in symptoms and/or physiological parameters have been detected and they should self-isolate; or alerting them that deviations in their symptoms and/or physiological parameters could be suggestive of a potential COVID-19 infection and to seek additional testing. We will assess the intraperson performance of the algorithms in the experimental condition (Wearable + Symptom Data Algo) and control conditions (Symptom Only Algo). Note that both algorithms will also instruct to seek testing when any SARS-CoV-2 symptoms are reported in line with those defined by the Dutch national institute for public health and the environment ‘Rijksinstituut voor Volksgezondheid en Milieu’ (RIVM) guidelines. Main outcomes: The trial will evaluate the use and performance of the Ava COVID-RED app and Ava bracelet, which uses sensors to measure breathing rate, pulse rate, skin temperature and heart rate variability for the purpose of early and asymptomatic detection and monitoring of SARS-CoV-2 in general and high-risk populations. Using laboratory-confirmed SARS-CoV-2 infections (detected via serology tests, PCR tests and/or antigen tests) as the gold standard, we will determine the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for each of the following two algorithms to detect first-time SARS-CoV-2 infection including early or asymptomatic infection: the algorithm using Ava bracelet data when coupled with the self-reported Daily Symptom Diary data and the algorithm using self-reported Daily Symptom Diary data alone. In addition, we will determine which of the two algorithms has superior performance characteristics for detecting SARS-CoV-2 infection including early or asymptomatic infection as confirmed by SARS-CoV-2 virus testing. The protocol contains an additional twenty secondary and exploratory objectives which address, among others, infection incidence rates, health resource utilization, symptoms reported by SARS-CoV-2-infected participants and the rate of breakthrough and asymptomatic SARS-CoV-2 infections among individuals vaccinated against COVID-19. PCR or antigen testing will occur when the subject receives a notification from the algorithm to seek additional testing. Subjects will be advised to get tested via the national testing programme and report the testing result in the Ava COVID-RED app and a survey. If they cannot obtain a test via the national testing programme, they will receive a nasal swab self-sampling kit at home, and the sample will be tested by PCR in a trial-affiliated laboratory. In addition, all subjects will be asked to take a capillary blood sample at home at baseline (between month 0 and 3.5 months after the start of subject recruitment), at the end of the learning phase (month 3; note that this sampling moment is skipped if a subject entered the study at the end of the recruitment period), period 1 (month 6) and period 2 (month 9). These samples will be used for SARS-CoV-2-specific antibody testing in a trial-affiliated laboratory, differentiating between antibodies resulting from a natural infection and antibodies resulting from COVID-19 vaccination (as vaccination will gradually be rolled out during the trial period). Baseline samples will only be analysed if the sample collected at the end of the learning phase is positive, or if the subject entered the study at the end of the recruitment period, and samples collected at the end of period 1 will only be analysed if the sample collected at the end of period 2 is positive. When subjects obtain a positive PCR/antigen or serology test result during the study, they will continue to be in the study but will be moved into a so-called COVID-positive mode in the Ava COVID-RED app. This means that they will no longer receive recommendations from the algorithms but can still contribute and track symptom and bracelet data. The primary analysis of the main objective will be executed using the data collected in period 2 (months 6 through 9). Within this period, serology tests (before and after period 2) and PCR/antigen tests (taken based on recommendations by the algorithms) will be used to determine if a subject was infected with SARS-CoV-2 or not. Within this same time period, it will be determined if the algorithms gave any recommendations for testing. The agreement between these quantities will be used to evaluate the performance of the algorithms and how these compare between the study conditions. Randomization: All eligible subjects will be randomized using a stratified block randomization approach with an allocation ratio of 1:1 to one of two sequences (experimental condition followed by control condition or control condition followed by experimental condition). Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence, resulting in approximately equal numbers of high-risk and normal-risk individuals between the sequences. Blinding (masking): In this study, subjects will be blinded to the study condition and randomization sequence. Relevant study staff and the device manufacturer will be aware of the assigned sequence. The subject will wear the Ava bracelet and complete the Daily Symptom Diary in the Ava COVID-RED app for the full duration of the study, and they will not know if the feedback they receive about their potential infection status will only be based on the data they entered in the Daily Symptom Diary within the Ava COVID-RED app or based on both the data from the Daily Symptom Diary and the Ava bracelet. Numbers to be randomized (sample size): A total of 20,000 subjects will be recruited and randomized 1:1 to either sequence 1 (experimental condition followed by control condition) or sequence 2 (control condition followed by experimental condition), taking into account their risk level. This results in approximately 6500 normal-risk and 3500 high-risk individuals per sequence. Trial status: Protocol version: 3.0, dated May 3, 2021. Start of recruitment: February 19, 2021. End of recruitment: June 3, 2021. End of follow-up (estimated): November 2021 Trial registration: The Netherlands Trial Register on the 18th of February, 2021 with number NL9320 (https://www.trialregister.nl/trial/9320) Full protocol: The full protocol is attached as an additional file, accessible from the Trials website (Additional file 1). In the interest in expediting dissemination of this material, the familiar formatting has been eliminated; this letter serves as a summary of the key elements of the full protocol.
- 11 October 2021
- Published by Springer Nature in Trials
- Vol. 22 (1) , 1-5
Open AccessA prospective, randomized, single-blinded, crossover trial to investigate the effect of a wearable device in addition to a daily symptom diary for the Remote Early Detection of SARS-CoV-2 infections (COVID-RED): a structured summary of a study protocol for a randomized controlled trial
Objectives: It is currently thought that most—but not all—individuals infected with SARS-CoV-2 develop symptoms, but the infectious period starts on average 2 days before the first overt symptoms appear. It is estimated that pre- and asymptomatic individuals are responsible for more than half of all transmissions. By detecting infected individuals before they have overt symptoms, wearable devices could potentially and significantly reduce the proportion of transmissions by pre-symptomatic individuals. Using laboratory-confirmed SARS-CoV-2 infections (detected via serology tests [to determine if there are antibodies against the SARS-CoV-2 in the blood] or SARS-CoV-2 infection tests such as polymerase chain reaction [PCR] or antigen tests) as the gold standard, we will determine the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for the following two algorithms to detect first time SARS-CoV-2 infection including early or asymptomatic infection: • The algorithm using Ava bracelet data when coupled with self-reported Daily Symptom Diary data (Wearable + Symptom Data Algo; experimental condition) • The algorithm using self-reported Daily Symptom Diary data alone (Symptom Only Algo; control condition) In addition, we will determine which of the two algorithms has superior performance characteristics for detecting SARS-CoV-2 infection including early or asymptomatic infection as confirmed by SARS-CoV-2 virus testing. Trial design: The trial is a randomized, single-blinded, two-period, two-sequence crossover trial. The study will start with an initial learning phase (maximum of 3 months), followed by period 1 (3 months) and period 2 (3 months). Subjects entering the study at the end of the recruitment period may directly start with period 1 and will not be part of the learning phase. Each subject will undergo the experimental condition (the Wearable + Symptom Data Algo) in either period 1 or period 2 and the control condition (Symptom Only Algo) in the other period. The order will be randomly assigned, resulting in subjects being allocated 1:1 to either sequence 1 (experimental condition first) or sequence 2 (control condition first). Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence. Participants: The trial will be conducted in the Netherlands. A target of 20,000 subjects will be enrolled. Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence. This results in approximately 6500 normal-risk individuals and 3500 high-risk individuals per sequence. Subjects will be recruited from previously studied cohorts as well as via public campaigns and social media. All data for this study will be collected remotely through the Ava COVID-RED app, the Ava bracelet, surveys in the COVID-RED web portal and self-sampling serology and PCR kits. More information on the study can be found in www.covid-red.eu . During recruitment, subjects will be invited to visit the COVID-RED web portal. After successfully completing the enrolment questionnaire, meeting eligibility criteria and indicating interest in joining the study, subjects will receive the subject information sheet and informed consent form. Subjects can enrol in COVID-RED if they comply with the following inclusion and exclusion criteria: Inclusion criteria: • Resident of the Netherlands • At least 18 years old • Informed consent provided (electronic) • Willing to adhere to the study procedures described in the protocol • Must have a smartphone that runs at least Android 8.0 or iOS 13.0 operating systems and is active for the duration of the study (in the case of a change of mobile number, the study team should be notified) • Be able to read, understand and write Dutch Exclusion criteria: • Previous positive SARS-CoV-2 test result (confirmed either through PCR/antigen or antibody tests; self-reported) • Current suspected (e.g. waiting for test result) COVID-19 infection or symptoms of a COVID-19 infection (self-reported) • Participating in any other COVID-19 clinical drug, vaccine or medical device trial (self-reported) • Electronic implanted device (such as a pacemaker; self-reported) • Pregnant at the time of informed consent (self-reported) • Suffering from cholinergic urticaria (per the Ava bracelet’s user manual; self-reported) • Staff involved in the management or conduct of this study Intervention and comparator: All subjects will be instructed to complete the Daily Symptom Diary in the Ava COVID-RED app daily, wear their Ava bracelet each night and synchronize it with the app each day for the entire period of study participation. Provided with wearable sensor and/or self-reported symptom data within the last 24 h, the Ava COVID-RED app’s underlying algorithms will provide subjects with a real-time indicator of their overall health and well-being. Subjects will see one of three messages, notifying them that no seeming deviations in symptoms and/or physiological parameters have been detected; some changes in symptoms and/or physiological parameters have been detected and they should self-isolate; or alerting them that deviations in their symptoms and/or physiological parameters could be suggestive of a potential COVID-19 infection and to seek additional testing. We will assess the intraperson performance of the algorithms in the experimental condition (Wearable + Symptom Data Algo) and control conditions (Symptom Only Algo). Note that both algorithms will also instruct to seek testing when any SARS-CoV-2 symptoms are reported in line with those defined by the Dutch national institute for public health and the environment ‘Rijksinstituut voor Volksgezondheid en Milieu’ (RIVM) guidelines. Main outcomes: The trial will evaluate the use and performance of the Ava COVID-RED app and Ava bracelet, which uses sensors to measure breathing rate, pulse rate, skin temperature and heart rate variability for the purpose of early and asymptomatic detection and monitoring of SARS-CoV-2 in general and high-risk populations. Using laboratory-confirmed SARS-CoV-2 infections (detected via serology tests, PCR tests and/or antigen tests) as the gold standard, we will determine the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for each of the following two algorithms to detect first-time SARS-CoV-2 infection including early or asymptomatic infection: the algorithm using Ava bracelet data when coupled with the self-reported Daily Symptom Diary data and the algorithm using self-reported Daily Symptom Diary data alone. In addition, we will determine which of the two algorithms has superior performance characteristics for detecting SARS-CoV-2 infection including early or asymptomatic infection as confirmed by SARS-CoV-2 virus testing. The protocol contains an additional twenty secondary and exploratory objectives which address, among others, infection incidence rates, health resource utilization, symptoms reported by SARS-CoV-2-infected participants and the rate of breakthrough and asymptomatic SARS-CoV-2 infections among individuals vaccinated against COVID-19. PCR or antigen testing will occur when the subject receives a notification from the algorithm to seek additional testing. Subjects will be advised to get tested via the national testing programme and report the testing result in the Ava COVID-RED app and a survey. If they cannot obtain a test via the national testing programme, they will receive a nasal swab self-sampling kit at home, and the sample will be tested by PCR in a trial-affiliated laboratory. In addition, all subjects will be asked to take a capillary blood sample at home at baseline (between month 0 and 3.5 months after the start of subject recruitment), at the end of the learning phase (month 3; note that this sampling moment is skipped if a subject entered the study at the end of the recruitment period), period 1 (month 6) and period 2 (month 9). These samples will be used for SARS-CoV-2-specific antibody testing in a trial-affiliated laboratory, differentiating between antibodies resulting from a natural infection and antibodies resulting from COVID-19 vaccination (as vaccination will gradually be rolled out during the trial period). Baseline samples will only be analysed if the sample collected at the end of the learning phase is positive, or if the subject entered the study at the end of the recruitment period, and samples collected at the end of period 1 will only be analysed if the sample collected at the end of period 2 is positive. When subjects obtain a positive PCR/antigen or serology test result during the study, they will continue to be in the study but will be moved into a so-called COVID-positive mode in the Ava COVID-RED app. This means that they will no longer receive recommendations from the algorithms but can still contribute and track symptom and bracelet data. The primary analysis of the main objective will be executed using the data collected in period 2 (months 6 through 9). Within this period, serology tests (before and after period 2) and PCR/antigen tests (taken based on recommendations by the algorithms) will be used to determine if a subject was infected with SARS-CoV-2 or not. Within this same time period, it will be determined if the algorithms gave any recommendations for testing. The agreement between these quantities will be used to evaluate the performance of the algorithms and how these compare between the study conditions. Randomization: All eligible subjects will be randomized using a stratified block randomization approach with an allocation ratio of 1:1 to one of two sequences (experimental condition followed by control condition or control condition followed by experimental condition). Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence, resulting in approximately equal numbers of high-risk and normal-risk individuals between the sequences. Blinding (masking): In this study, subjects will be blinded to the study condition and randomization sequence. Relevant study staff and the device manufacturer will be aware of the assigned sequence. The subject will wear the Ava bracelet and complete the Daily Symptom Diary in the Ava COVID-RED app for the full duration of the study, and they will not know if the feedback they receive about their potential infection status will only be based on the data they entered in the Daily Symptom Diary within the Ava COVID-RED app or based on both the data from the Daily Symptom Diary and the Ava bracelet. Numbers to be randomized (sample size): A total of 20,000 subjects will be recruited and randomized 1:1 to either sequence 1 (experimental condition followed by control condition) or sequence 2 (control condition followed by experimental condition), taking into account their risk level. This results in approximately 6500 normal-risk and 3500 high-risk individuals per sequence. Trial status: Protocol version: 3.0, dated May 3, 2021. Start of recruitment: February 19, 2021. End of recruitment: June 3, 2021. End of follow-up (estimated): November 2021 Trial registration: The Netherlands Trial Register on the 18th of February, 2021 with number NL9320 (https://www.trialregister.nl/trial/9320) Full protocol: The full protocol is attached as an additional file, accessible from the Trials website (Additional file 1). In the interest in expediting dissemination of this material, the familiar formatting has been eliminated; this letter serves as a summary of the key elements of the full protocol.
- Open Access
- 22 June 2021
- Published by Springer Nature in Trials
- Vol. 22 (1) , 1-5
A prospective, randomized, single-blinded, crossover trial to investigate the effect of a wearable device in addition to a daily symptom diary for the remote early detection of SARS-CoV-2 infections (COVID-RED): a structured summary of a study protocol for a randomized controlled trial
Objectives: It is currently thought that most—but not all—individuals infected with SARS-CoV-2 develop symptoms, but that the infectious period starts on average two days before the first overt symptoms appear. It is estimated that pre- and asymptomatic individuals are responsible for more than half of all transmissions. By detecting infected individuals before they have overt symptoms, wearable devices could potentially and significantly reduce the proportion of transmissions by pre-symptomatic individuals. Using laboratory-confirmed SARS-CoV-2 infections (detected via serology tests [to determine if there are antibodies against the SARS-CoV-2 in the blood] or SARS-CoV-2 infection tests such as polymerase chain reaction [PCR] or antigen tests) as the gold standard, we will determine the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for the following two algorithms to detect first time SARS-CoV-2 infection including early or asymptomatic infection: the algorithm using Ava bracelet data when coupled with self-reported Daily Symptom Diary data (Wearable + Symptom Data Algo; experimental condition) the algorithm using self-reported Daily Symptom Diary data alone (Symptom Only Algo; control condition) In addition, we will determine which of the two algorithms has superior performance characteristics for detecting SARS-CoV-2 infection including early or asymptomatic infection as confirmed by SARS-CoV-2 virus testing. Trial design: The trial is a randomized, single-blinded, two-period, two-sequence crossover trial. All subjects will participate in an initial Learning Phase (varying from 2 weeks to 3 months depending on enrolment date), followed by two contiguous 3-month test phases, Period 1 and Period 2. Each subject will undergo the experimental condition (the Wearable + Symptom Data Algo) in one of these periods and the control condition (Symptom Only Algo) in the other period. The order will be randomly assigned, resulting in subjects being allocated 1:1 to either Sequence 1 (experimental condition first) or Sequence 2 (control condition first). Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence. Participants: The trial will be conducted in the Netherlands. A target of 20,000 subjects will be enrolled. Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence. This results in approximately 6,500 normal-risk individuals and 3,500 high-risk individuals per sequence. Subjects will be recruited from previously studied cohorts as well as via public campaigns and social media. All data for this study will be collected remotely through the Ava COVID-RED app, the Ava bracelet, surveys in the COVID-RED web portal, and self-sampling serology and PCR kits. During recruitment, subjects will be invited to visit the COVID-RED web portal (www.covid-red.eu). After successfully completing the enrolment questionnaire, meeting eligibility criteria and indicating interest in joining the study, subjects will receive the subject information sheet and informed consent form. Subjects can enrol in COVID-RED if they comply with the following inclusion and exclusion criteria. Inclusion criteria: Resident of the Netherlands At least 18 years old Informed consent provided (electronic) Willing to adhere to the study procedures described in the protocol Must have a smartphone that runs at least Android 8.0 or iOS 13.0 operating systems and is active for the duration of the study (in the case of a change of mobile number, study team should be notified) Be able to read, understand and write Dutch Exclusion criteria: Previous positive SARS-CoV-2 test result (confirmed either through PCR/antigen or antibody tests; self-reported) Previously received a vaccine developed specifically for COVID-19 or in possession of an appointment for vaccination in the near future (self-reported) Current suspected (e.g., waiting for test result) COVID-19 infection or symptoms of a COVID-19 infection (self-reported) Participating in any other COVID-19 clinical drug, vaccine, or medical device trial (self-reported) Electronic implanted device (such as a pacemaker; self-reported) Pregnant at time of informed consent (self-reported) Suffering from cholinergic urticaria (per the Ava bracelet’s User Manual; self-reported) Staff involved in the management or conduct of this study Intervention and comparator: All subjects will be instructed to complete the Daily Symptom Diary in the Ava COVID-RED app daily, wear their Ava bracelet each night and synchronise it with the app each day for the entire period of study participation. Provided with wearable sensor and/or self-reported symptom data within the last 24 hours, the Ava COVID-RED app’s underlying algorithms will provide subjects with a real-time indicator of their overall health and well-being. Subjects will see one of three messages, notifying them that: no seeming deviations in symptoms and/or physiological parameters have been detected; some changes in symptoms and/or physiological parameters have been detected and they should self-isolate; or alerting them that deviations in their symptoms and/or physiological parameters could be suggestive of a potential COVID-19 infection and to seek additional testing. We will assess intraperson performance of the algorithms in the experimental condition (Wearable + Symptom Data Algo) and control conditions (Symptom Only Algo). Main outcomes: The trial will evaluate the use and performance of the Ava COVID-RED app and Ava bracelet, which uses sensors to measure breathing rate, pulse rate, skin temperature, and heart rate variability for the purpose of early and asymptomatic detection and monitoring of SARS-CoV-2 in general and high-risk populations. Using laboratory-confirmed SARS-CoV-2 infections (detected via serology tests, PCR tests and/or antigen tests) as the gold standard, we will determine the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for each of the following two algorithms to detect first-time SARS-CoV-2 infection including early or asymptomatic infection: the algorithm using Ava Bracelet data when coupled with the self-reported Daily Symptom Diary data, and the algorithm using self-reported Daily Symptom Diary data alone. In addition, we will determine which of the two algorithms has superior performance characteristics for detecting SARS-CoV-2 infection including early or asymptomatic infection as confirmed by SARS-CoV-2 virus testing. The protocol contains an additional seventeen secondary outcomes which address infection incidence rates, health resource utilization, symptoms reported by SARS-CoV-2 infected participants, and the rate of breakthrough and asymptomatic SARS-CoV-2 infections among individuals vaccinated against COVID-19. PCR or antigen testing will occur when the subject receives a notification from the algorithm to seek additional testing. Subjects will be advised to get tested via the national testing programme, and report the testing result in the Ava COVID-RED app and a survey. If they cannot obtain a test via the national testing programme, they will receive a nasal swab self-sampling kit at home, and the sample will be tested by PCR in a trial-affiliated laboratory. In addition, all subjects will be asked to take a capillary blood sample at home at baseline (Month 0), and at the end of the Learning Phase (Month 3), Period 1 (Month 6) and Period 2 (Month 9). These samples will be used for SARS-CoV-2-specific antibody testing in a trial-affiliated laboratory, differentiating between antibodies resulting from a natural infection and antibodies resulting from COVID-19 vaccination (as vaccination will gradually be rolled out during the trial period). Baseline samples will only be analysed if the sample collected at the end of the Learning Phase is positive, and samples collected at the end of Period 1 will only be analysed if the sample collected at the end of Period 2 is positive. When subjects obtain a positive PCR/antigen or serology test result during the study, they will continue to be in the study but will be moved into a so-called “COVID-positive” mode in the Ava COVID-RED app. This means that they will no longer receive recommendations from the algorithms but can still contribute and track symptom and bracelet data. The primary analysis of the main objective will be executed using data collected in Period 2 (Month 6 through 9). Within this period, serology tests (before and after Period 2) and PCR/antigen tests (taken based on recommendations by the algorithms) will be used to determine if a subject was infected with SARS-CoV-2 or not. Within this same time period, it will be determined if the algorithms gave any recommendations for testing. The agreement between these quantities will be used to evaluate the performance of the algorithms and how these compare between the study conditions. Randomisation: All eligible subjects will be randomized using a stratified block randomization approach with an allocation ratio of 1:1 to one of two sequences (experimental condition followed by control condition or control condition followed by experimental condition). Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence, resulting in equal numbers of high-risk and normal-risk individuals between the sequences. Blinding (masking): In this study, subjects will be blinded as to study condition and randomization sequence. Relevant study staff and the device manufacturer will be aware of the assigned sequence. The subject will wear the Ava bracelet and complete the Daily Symptom Diary in the Ava COVID-RED app for the full duration of the study, and they will not know if the feedback they receive about their potential infection status will only be based on data they entered in the Daily Symptom Diary within the Ava COVID-RED app or based on both the data from the Daily Symptom Diary and the Ava bracelet. Numbers to be randomised (sample size): 20,000 subjects will be recruited and randomized 1:1 to either Sequence 1 (experimental condition followed by control condition) or Sequence 2 (control condition followed by experimental condition), taking into account their risk level. This results in approximately 6,500 normal-risk and 3,500 high-risk individuals per sequence. Trial Status: Protocol version: 1.2, dated January 22nd, 2021 Start of recruitment: February 22nd, 2021 End of recruitment (estimated): April 2021 End of follow-up (estimated): December 2021 Trial registration: The trial has been registered at the Netherlands Trial Register on the 18th of February, 2021 with number NL9320 (https://www.trialregister.nl/trial/9320) Full protocol: The full protocol is attached as an additional file, accessible from the Trials website (Additional file 1). In the interest in expediting dissemination of this material, the familiar formatting has been eliminated; this Letter serves as a summary of the key elements of the full protocol.
- 22 June 2021
- Published by Springer Nature in Trials
- Vol. 22 (1) , 1-5
Open AccessA prospective, randomized, single-blinded, crossover trial to investigate the effect of a wearable device in addition to a daily symptom diary for the remote early detection of SARS-CoV-2 infections (COVID-RED): a structured summary of a study protocol for a randomized controlled trial
Objectives: It is currently thought that most—but not all—individuals infected with SARS-CoV-2 develop symptoms, but that the infectious period starts on average two days before the first overt symptoms appear. It is estimated that pre- and asymptomatic individuals are responsible for more than half of all transmissions. By detecting infected individuals before they have overt symptoms, wearable devices could potentially and significantly reduce the proportion of transmissions by pre-symptomatic individuals. Using laboratory-confirmed SARS-CoV-2 infections (detected via serology tests [to determine if there are antibodies against the SARS-CoV-2 in the blood] or SARS-CoV-2 infection tests such as polymerase chain reaction [PCR] or antigen tests) as the gold standard, we will determine the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for the following two algorithms to detect first time SARS-CoV-2 infection including early or asymptomatic infection: the algorithm using Ava bracelet data when coupled with self-reported Daily Symptom Diary data (Wearable + Symptom Data Algo; experimental condition) the algorithm using self-reported Daily Symptom Diary data alone (Symptom Only Algo; control condition) In addition, we will determine which of the two algorithms has superior performance characteristics for detecting SARS-CoV-2 infection including early or asymptomatic infection as confirmed by SARS-CoV-2 virus testing. Trial design: The trial is a randomized, single-blinded, two-period, two-sequence crossover trial. All subjects will participate in an initial Learning Phase (varying from 2 weeks to 3 months depending on enrolment date), followed by two contiguous 3-month test phases, Period 1 and Period 2. Each subject will undergo the experimental condition (the Wearable + Symptom Data Algo) in one of these periods and the control condition (Symptom Only Algo) in the other period. The order will be randomly assigned, resulting in subjects being allocated 1:1 to either Sequence 1 (experimental condition first) or Sequence 2 (control condition first). Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence. Participants: The trial will be conducted in the Netherlands. A target of 20,000 subjects will be enrolled. Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence. This results in approximately 6,500 normal-risk individuals and 3,500 high-risk individuals per sequence. Subjects will be recruited from previously studied cohorts as well as via public campaigns and social media. All data for this study will be collected remotely through the Ava COVID-RED app, the Ava bracelet, surveys in the COVID-RED web portal, and self-sampling serology and PCR kits. During recruitment, subjects will be invited to visit the COVID-RED web portal (www.covid-red.eu). After successfully completing the enrolment questionnaire, meeting eligibility criteria and indicating interest in joining the study, subjects will receive the subject information sheet and informed consent form. Subjects can enrol in COVID-RED if they comply with the following inclusion and exclusion criteria. Inclusion criteria: Resident of the Netherlands At least 18 years old Informed consent provided (electronic) Willing to adhere to the study procedures described in the protocol Must have a smartphone that runs at least Android 8.0 or iOS 13.0 operating systems and is active for the duration of the study (in the case of a change of mobile number, study team should be notified) Be able to read, understand and write Dutch Exclusion criteria: Previous positive SARS-CoV-2 test result (confirmed either through PCR/antigen or antibody tests; self-reported) Previously received a vaccine developed specifically for COVID-19 or in possession of an appointment for vaccination in the near future (self-reported) Current suspected (e.g., waiting for test result) COVID-19 infection or symptoms of a COVID-19 infection (self-reported) Participating in any other COVID-19 clinical drug, vaccine, or medical device trial (self-reported) Electronic implanted device (such as a pacemaker; self-reported) Pregnant at time of informed consent (self-reported) Suffering from cholinergic urticaria (per the Ava bracelet’s User Manual; self-reported) Staff involved in the management or conduct of this study Intervention and comparator: All subjects will be instructed to complete the Daily Symptom Diary in the Ava COVID-RED app daily, wear their Ava bracelet each night and synchronise it with the app each day for the entire period of study participation. Provided with wearable sensor and/or self-reported symptom data within the last 24 hours, the Ava COVID-RED app’s underlying algorithms will provide subjects with a real-time indicator of their overall health and well-being. Subjects will see one of three messages, notifying them that: no seeming deviations in symptoms and/or physiological parameters have been detected; some changes in symptoms and/or physiological parameters have been detected and they should self-isolate; or alerting them that deviations in their symptoms and/or physiological parameters could be suggestive of a potential COVID-19 infection and to seek additional testing. We will assess intraperson performance of the algorithms in the experimental condition (Wearable + Symptom Data Algo) and control conditions (Symptom Only Algo). Main outcomes: The trial will evaluate the use and performance of the Ava COVID-RED app and Ava bracelet, which uses sensors to measure breathing rate, pulse rate, skin temperature, and heart rate variability for the purpose of early and asymptomatic detection and monitoring of SARS-CoV-2 in general and high-risk populations. Using laboratory-confirmed SARS-CoV-2 infections (detected via serology tests, PCR tests and/or antigen tests) as the gold standard, we will determine the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) for each of the following two algorithms to detect first-time SARS-CoV-2 infection including early or asymptomatic infection: the algorithm using Ava Bracelet data when coupled with the self-reported Daily Symptom Diary data, and the algorithm using self-reported Daily Symptom Diary data alone. In addition, we will determine which of the two algorithms has superior performance characteristics for detecting SARS-CoV-2 infection including early or asymptomatic infection as confirmed by SARS-CoV-2 virus testing. The protocol contains an additional seventeen secondary outcomes which address infection incidence rates, health resource utilization, symptoms reported by SARS-CoV-2 infected participants, and the rate of breakthrough and asymptomatic SARS-CoV-2 infections among individuals vaccinated against COVID-19. PCR or antigen testing will occur when the subject receives a notification from the algorithm to seek additional testing. Subjects will be advised to get tested via the national testing programme, and report the testing result in the Ava COVID-RED app and a survey. If they cannot obtain a test via the national testing programme, they will receive a nasal swab self-sampling kit at home, and the sample will be tested by PCR in a trial-affiliated laboratory. In addition, all subjects will be asked to take a capillary blood sample at home at baseline (Month 0), and at the end of the Learning Phase (Month 3), Period 1 (Month 6) and Period 2 (Month 9). These samples will be used for SARS-CoV-2-specific antibody testing in a trial-affiliated laboratory, differentiating between antibodies resulting from a natural infection and antibodies resulting from COVID-19 vaccination (as vaccination will gradually be rolled out during the trial period). Baseline samples will only be analysed if the sample collected at the end of the Learning Phase is positive, and samples collected at the end of Period 1 will only be analysed if the sample collected at the end of Period 2 is positive. When subjects obtain a positive PCR/antigen or serology test result during the study, they will continue to be in the study but will be moved into a so-called “COVID-positive” mode in the Ava COVID-RED app. This means that they will no longer receive recommendations from the algorithms but can still contribute and track symptom and bracelet data. The primary analysis of the main objective will be executed using data collected in Period 2 (Month 6 through 9). Within this period, serology tests (before and after Period 2) and PCR/antigen tests (taken based on recommendations by the algorithms) will be used to determine if a subject was infected with SARS-CoV-2 or not. Within this same time period, it will be determined if the algorithms gave any recommendations for testing. The agreement between these quantities will be used to evaluate the performance of the algorithms and how these compare between the study conditions. Randomisation: All eligible subjects will be randomized using a stratified block randomization approach with an allocation ratio of 1:1 to one of two sequences (experimental condition followed by control condition or control condition followed by experimental condition). Based on demographics, medical history and/or profession, each subject will be stratified at baseline into a high-risk and normal-risk group within each sequence, resulting in equal numbers of high-risk and normal-risk individuals between the sequences. Blinding (masking): In this study, subjects will be blinded as to study condition and randomization sequence. Relevant study staff and the device manufacturer will be aware of the assigned sequence. The subject will wear the Ava bracelet and complete the Daily Symptom Diary in the Ava COVID-RED app for the full duration of the study, and they will not know if the feedback they receive about their potential infection status will only be based on data they entered in the Daily Symptom Diary within the Ava COVID-RED app or based on both the data from the Daily Symptom Diary and the Ava bracelet. Numbers to be randomised (sample size): 20,000 subjects will be recruited and randomized 1:1 to either Sequence 1 (experimental condition followed by control condition) or Sequence 2 (control condition followed by experimental condition), taking into account their risk level. This results in approximately 6,500 normal-risk and 3,500 high-risk individuals per sequence. Trial Status: Protocol version: 1.2, dated January 22nd, 2021 Start of recruitment: February 22nd, 2021 End of recruitment (estimated): April 2021 End of follow-up (estimated): December 2021 Trial registration: The trial has been registered at the Netherlands Trial Register on the 18th of February, 2021 with number NL9320 (https://www.trialregister.nl/trial/9320) Full protocol: The full protocol is attached as an additional file, accessible from the Trials website (Additional file 1). In the interest in expediting dissemination of this material, the familiar formatting has been eliminated; this Letter serves as a summary of the key elements of the full protocol.
- Open Access
- 15 June 2018
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 18 (1) , 54
Outlier classification performance of risk adjustment methods when profiling multiple providers
When profiling multiple health care providers, adjustment for case-mix is essential to accurately classify the quality of providers. Unfortunately, misclassification of provider performance is not uncommon and can have grave implications. Propensity score (PS) methods have been proposed as viable alternatives to conventional multivariable regression. The objective was to assess the outlier classification performance of risk adjustment methods when profiling multiple providers. In a simulation study based on empirical data, the classification performance of logistic regression (fixed and random effects), PS adjustment, and three PS weighting methods was evaluated when varying parameters such as the number of providers, the average incidence of the outcome, and the percentage of outliers. Traditional classification accuracy measures were considered, including sensitivity and specificity. Fixed effects logistic regression consistently had the highest sensitivity and negative predictive value, yet a low specificity and positive predictive value. Of the random effects methods, PS adjustment and random effects logistic regression performed equally well or better than all the remaining PS methods for all classification accuracy measures across the studied scenarios. Of the evaluated PS methods, only PS adjustment can be considered a viable alternative to random effects logistic regression when profiling multiple providers in different scenarios.
- 15 June 2018
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 18 (1) , 54
Open AccessOutlier classification performance of risk adjustment methods when profiling multiple providers
When profiling multiple health care providers, adjustment for case-mix is essential to accurately classify the quality of providers. Unfortunately, misclassification of provider performance is not uncommon and can have grave implications. Propensity score (PS) methods have been proposed as viable alternatives to conventional multivariable regression. The objective was to assess the outlier classification performance of risk adjustment methods when profiling multiple providers. In a simulation study based on empirical data, the classification performance of logistic regression (fixed and random effects), PS adjustment, and three PS weighting methods was evaluated when varying parameters such as the number of providers, the average incidence of the outcome, and the percentage of outliers. Traditional classification accuracy measures were considered, including sensitivity and specificity. Fixed effects logistic regression consistently had the highest sensitivity and negative predictive value, yet a low specificity and positive predictive value. Of the random effects methods, PS adjustment and random effects logistic regression performed equally well or better than all the remaining PS methods for all classification accuracy measures across the studied scenarios. Of the evaluated PS methods, only PS adjustment can be considered a viable alternative to random effects logistic regression when profiling multiple providers in different scenarios.
- Open Access
- 1 June 2018
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 98, 89-97
Measurement error is often neglected in medical literature: a systematic review
- 1 June 2018
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 98, 89-97
Open AccessMeasurement error is often neglected in medical literature: a systematic review