Guy Martin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Guy Martin has a total of 190 co-authors. Here are the top co-authors by number of shared publications:
- James Kinross
Department of Surgery & Cancer, Imperial College London, London, UK
15 shared publications - Ara Darzi
Imperial College London, London, UK
10 shared publications - Sanjay Purkayastha
Imperial College London
9 shared publications - Jonathan Clarke
Centre for Mathematics of Precision Healthcare, Department of Mathematics, Imperial College London, London, UK
8 shared publications Ara Darzi
Imperial College London
7 shared publications- Hutan Ashrafian
Institute of Global Health Innovation, Imperial College London, London, UK
7 shared publications
Latest Publications
- Open Access
- 3 June 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Effective and equitable hypertension management; retrospective comparative cohort analysis of a novel proactive digital care platform for the management of hypertension in primary care in England. (Preprint)
BACKGROUND The ever-increasing burden of cardiovascular disease presents significant quality, cost and sustainability challenges in primary care. Novel digitally supported models of care may help address these challenges. OBJECTIVE The aim of this study sought to assess the comparative clinical and cost effectiveness of a novel, integrated community-based proactive digital care platform compared to usual models of care for managing hypertension in primary care in England. METHODS A retrospective pre-/post-implementation cohort study across eligible patients from 10 Primary Care Networks (PCNs) in England was performed. 4,895 patients utilising the digital care platform were retrospectively compared to that of 3,504 who had received usual care. The primary outcome was the achievement of HYP008 (<80 years, BP 80 years, BP <150/90mmHg) UK Quality and Outcomes Framework (QOF) indicators. Secondary outcomes assessed the effectiveness of BP control, patient engagement and hypothecated cost analyses. Sub-group analyses were performed for the CORE20 cohort - the most deprived 20% of the population. There were no significant differences in sex, deprivation decile or ethnicity between the two cohorts. The usual care cohort were slightly older in age (65.8yrs vs. 65.1yrs, p=<0.05) and contained a greater proportion of CORE20 patients (28.31% vs. 24.15%, p=<0.05). RESULTS Digitally cared for patients were 3.15 times more likely to achieve the HYP008 BP target (74.56% vs. 48.16%, OR 3.15; 95% CI 2.86 to 3.48), and 1.40 times more likely to achieve the HYP009 target (85.82% vs. 81.21%, OR 1.40; 95% CI 1.01 to 1.94). Mean time to blood pressure control was significantly shorter with digital care (16.1 days (0-309) vs. 92.8 days, (1-345), p=<0.05). The mean reduction in systolic BP did not differ between groups (-5.97mmHg vs. -5.74mmHg, p=0.56). There was significantly better patient engagement in the digital care cohort with 25.64 additional BP reading captured (29.11 vs. 3.47, p=<0.05) during the study period. The digital care platform was also cost saving compared to usual care, estimated to be in the order of £17.22 - £73.08 per patient per year. CONCLUSIONS Novel integrated community-based proactive digital care platforms may deliver superior blood pressure control rates, more consistently and in shorter timeframes compared to usual care and may do so equitably. In addition to delivering better blood pressure control and addressing therapeutic inertia, it is highly likely to be cost-effective through generating substantial gains in incentivisation payments whilst delivering care at a reduced cost compared to usual models of care. Further implementation at scale will need to consider how the platform integrates with the management of other chronic health conditions and the impact it may have on the delivery of chronic disease management in other primary care settings and in diverse populations. CLINICALTRIAL N/A
- 3 June 2026
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEffective and equitable hypertension management; retrospective comparative cohort analysis of a novel proactive digital care platform for the management of hypertension in primary care in England. (Preprint)
BACKGROUND The ever-increasing burden of cardiovascular disease presents significant quality, cost and sustainability challenges in primary care. Novel digitally supported models of care may help address these challenges. OBJECTIVE The aim of this study sought to assess the comparative clinical and cost effectiveness of a novel, integrated community-based proactive digital care platform compared to usual models of care for managing hypertension in primary care in England. METHODS A retrospective pre-/post-implementation cohort study across eligible patients from 10 Primary Care Networks (PCNs) in England was performed. 4,895 patients utilising the digital care platform were retrospectively compared to that of 3,504 who had received usual care. The primary outcome was the achievement of HYP008 (<80 years, BP 80 years, BP <150/90mmHg) UK Quality and Outcomes Framework (QOF) indicators. Secondary outcomes assessed the effectiveness of BP control, patient engagement and hypothecated cost analyses. Sub-group analyses were performed for the CORE20 cohort - the most deprived 20% of the population. There were no significant differences in sex, deprivation decile or ethnicity between the two cohorts. The usual care cohort were slightly older in age (65.8yrs vs. 65.1yrs, p=<0.05) and contained a greater proportion of CORE20 patients (28.31% vs. 24.15%, p=<0.05). RESULTS Digitally cared for patients were 3.15 times more likely to achieve the HYP008 BP target (74.56% vs. 48.16%, OR 3.15; 95% CI 2.86 to 3.48), and 1.40 times more likely to achieve the HYP009 target (85.82% vs. 81.21%, OR 1.40; 95% CI 1.01 to 1.94). Mean time to blood pressure control was significantly shorter with digital care (16.1 days (0-309) vs. 92.8 days, (1-345), p=<0.05). The mean reduction in systolic BP did not differ between groups (-5.97mmHg vs. -5.74mmHg, p=0.56). There was significantly better patient engagement in the digital care cohort with 25.64 additional BP reading captured (29.11 vs. 3.47, p=<0.05) during the study period. The digital care platform was also cost saving compared to usual care, estimated to be in the order of £17.22 - £73.08 per patient per year. CONCLUSIONS Novel integrated community-based proactive digital care platforms may deliver superior blood pressure control rates, more consistently and in shorter timeframes compared to usual care and may do so equitably. In addition to delivering better blood pressure control and addressing therapeutic inertia, it is highly likely to be cost-effective through generating substantial gains in incentivisation payments whilst delivering care at a reduced cost compared to usual models of care. Further implementation at scale will need to consider how the platform integrates with the management of other chronic health conditions and the impact it may have on the delivery of chronic disease management in other primary care settings and in diverse populations. CLINICALTRIAL N/A
- Open Access
- 17 September 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Digital-first approach to Long COVID management: feasibility and efficacy of the Avid health programme. (Preprint)
BACKGROUND Long COVID is characterised by an array of physical and psychological symptoms that can be debilitating. Given the enormous number of individuals affected by long COVID, it presents a significant, and poorly understood emerging long-term medical and socioeconomic challenge. As such, there is a pressing need to develop and test new holistic and efficient approaches to whole-person treatment and rehabilitation at scale for patients with long COVID. OBJECTIVE To evaluate the effectiveness of a new human-centred, digital-first health platform - Avid - for the management of long COVID by examining its impact on participants quality of life scores and symptom severity in the short-term, and the platform’s usability and acceptability for end-users. METHODS 37 participants (35 female, mean age 46.5 years, 8.1% previously hospitalised with acute COVID) with long Covid were recruited into the Avid program. Avid is a human-centred, digital-first platform that delivers a 6-week program providing structured, personalised health coaching and tailored digital content aligned to specific weekly goals. The approach facilitates a standardised approach through evidenced-based treatment strategies, whilst simultaneously supporting personalised, adaptable care at scale. A quasi-experimental single arm pre-post intervention design was employed to evaluate the platform. The primary outcome measures were C19-YRSm and EQ5D-5L quality of life scores. Usability and acceptability of the program for participants was examined through Net Promoter Scores (NPS) and qualitative semi-structured interviews. RESULTS The Avid program led to significant and sustained improvements in C19-YRSm scores at week 6 (5.57 (SD 1.79) vs. 3.95 (SD 1.35), p=0.0001, mean improvement 41.0%); week 10 (5.07 (SD1.78) vs. 3.93 (1.18), p=0.0003, mean improvement 29.0%); and week 22 (5.08 (SD 1.68) vs. 3.88 (SD 1.13), p=0.0001, mean improvement 30.9%). The program also led to significant improvements in EQ5D-5L Index scores at week 6 (0.54 (SD 0.25) vs. 0.44 (SD 0.23) p=0.0005, mean improvement 25.0%); week 10 (0.51 (SD 0.25) vs. 0.44 (SD 0.24), p=0.0382, mean improvement 15.9%); and week 22 (0.54 (SD 0.23) vs. 0.46 (SD 0.23), p=0.0103, mean improvement 17.4%. The program was well received with 100% engagement and completion at 6 weeks. NPS scores showed 70% of participants were promoters of the program with a mean individual score of 8.64. CONCLUSIONS The pilot study indicates that the Avid platform is safe, feasible and effective. It produces significant and sustained improvements in the symptoms and severity of long COVID, and wider measures of quality of life in the short-term. These findings suggest that the approach may provide a clinically impactful, cost-effective, and scalable platform that can successfully manage the challenges of long COVID. The modular approach of the platform also readily facilitates its rapid development and expansion to address other health challenges and long-term conditions in the future.
- 17 September 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDigital-first approach to Long COVID management: feasibility and efficacy of the Avid health programme. (Preprint)
BACKGROUND Long COVID is characterised by an array of physical and psychological symptoms that can be debilitating. Given the enormous number of individuals affected by long COVID, it presents a significant, and poorly understood emerging long-term medical and socioeconomic challenge. As such, there is a pressing need to develop and test new holistic and efficient approaches to whole-person treatment and rehabilitation at scale for patients with long COVID. OBJECTIVE To evaluate the effectiveness of a new human-centred, digital-first health platform - Avid - for the management of long COVID by examining its impact on participants quality of life scores and symptom severity in the short-term, and the platform’s usability and acceptability for end-users. METHODS 37 participants (35 female, mean age 46.5 years, 8.1% previously hospitalised with acute COVID) with long Covid were recruited into the Avid program. Avid is a human-centred, digital-first platform that delivers a 6-week program providing structured, personalised health coaching and tailored digital content aligned to specific weekly goals. The approach facilitates a standardised approach through evidenced-based treatment strategies, whilst simultaneously supporting personalised, adaptable care at scale. A quasi-experimental single arm pre-post intervention design was employed to evaluate the platform. The primary outcome measures were C19-YRSm and EQ5D-5L quality of life scores. Usability and acceptability of the program for participants was examined through Net Promoter Scores (NPS) and qualitative semi-structured interviews. RESULTS The Avid program led to significant and sustained improvements in C19-YRSm scores at week 6 (5.57 (SD 1.79) vs. 3.95 (SD 1.35), p=0.0001, mean improvement 41.0%); week 10 (5.07 (SD1.78) vs. 3.93 (1.18), p=0.0003, mean improvement 29.0%); and week 22 (5.08 (SD 1.68) vs. 3.88 (SD 1.13), p=0.0001, mean improvement 30.9%). The program also led to significant improvements in EQ5D-5L Index scores at week 6 (0.54 (SD 0.25) vs. 0.44 (SD 0.23) p=0.0005, mean improvement 25.0%); week 10 (0.51 (SD 0.25) vs. 0.44 (SD 0.24), p=0.0382, mean improvement 15.9%); and week 22 (0.54 (SD 0.23) vs. 0.46 (SD 0.23), p=0.0103, mean improvement 17.4%. The program was well received with 100% engagement and completion at 6 weeks. NPS scores showed 70% of participants were promoters of the program with a mean individual score of 8.64. CONCLUSIONS The pilot study indicates that the Avid platform is safe, feasible and effective. It produces significant and sustained improvements in the symptoms and severity of long COVID, and wider measures of quality of life in the short-term. These findings suggest that the approach may provide a clinically impactful, cost-effective, and scalable platform that can successfully manage the challenges of long COVID. The modular approach of the platform also readily facilitates its rapid development and expansion to address other health challenges and long-term conditions in the future.
- Open Access
- 6 May 2024
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 11 (1) , e49769
Barriers to and Facilitators of Key Stakeholders Influencing Successful Digital Implementation of Remote Monitoring Solutions: Mixed Methods Analysis
Background: Implementation of remote monitoring solutions and digital alerting tools in health care has historically been challenging, despite the impetus provided by the COVID-19 pandemic. To date, a health systems–based approach to systematically describe barriers and facilitators across multiple domains has not been undertaken. Objective: We aimed to undertake a comprehensive mixed methods analysis of barriers and facilitators for successful implementation of remote monitoring and digital alerting tools in complex health organizations. Methods: A mixed methods approach using a modified Technology Acceptance Model questionnaire and semistructured interviews mapped to the validated fit among humans, organizations, and technology (HOT-fit) framework was undertaken. Likert frequency responses and deductive thematic analyses were performed. Results: A total of 11 participants responded to the questionnaire and 18 participants to the interviews. Key barriers and facilitators could be mapped onto 6 dimensions, which incorporated aspects of digitization: system use (human), user satisfaction (human), environment (organization), structure (organization), information and service quality (technology), and system quality (technology). Conclusions: The recommendations proposed can enhance the potential for future remote sensing solutions to be more successfully integrated in health care practice, resulting in more successful use of “virtual wards.” Trial Registration: ClinicalTrials.gov NCT05321004; https://www.clinicaltrials.gov/study/NCT05321004
- 6 May 2024
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 11 (1) , e49769
Open AccessBarriers to and Facilitators of Key Stakeholders Influencing Successful Digital Implementation of Remote Monitoring Solutions: Mixed Methods Analysis
Background: Implementation of remote monitoring solutions and digital alerting tools in health care has historically been challenging, despite the impetus provided by the COVID-19 pandemic. To date, a health systems–based approach to systematically describe barriers and facilitators across multiple domains has not been undertaken. Objective: We aimed to undertake a comprehensive mixed methods analysis of barriers and facilitators for successful implementation of remote monitoring and digital alerting tools in complex health organizations. Methods: A mixed methods approach using a modified Technology Acceptance Model questionnaire and semistructured interviews mapped to the validated fit among humans, organizations, and technology (HOT-fit) framework was undertaken. Likert frequency responses and deductive thematic analyses were performed. Results: A total of 11 participants responded to the questionnaire and 18 participants to the interviews. Key barriers and facilitators could be mapped onto 6 dimensions, which incorporated aspects of digitization: system use (human), user satisfaction (human), environment (organization), structure (organization), information and service quality (technology), and system quality (technology). Conclusions: The recommendations proposed can enhance the potential for future remote sensing solutions to be more successfully integrated in health care practice, resulting in more successful use of “virtual wards.” Trial Registration: ClinicalTrials.gov NCT05321004; https://www.clinicaltrials.gov/study/NCT05321004
- Open Access
- 1 August 2023
- Published by American Medical Association (AMA) in JAMA Network Open
- Vol. 6 (8) , e2330338
Effect of Mixed Reality on Delivery of Emergency Medical Care in a Simulated Environment
Importance: Mixed-reality (MR) technology has the potential to enhance care delivery, but there remains a paucity of evidence for its efficacy and feasibility.Objective: To assess the efficacy and feasibility of MR technology to enhance emergency care delivery in a simulated environment.Design, Setting, and Participants: This pilot randomized crossover trial was conducted from September to November 2021 at a single center in a high-fidelity simulated environment with participants block randomized to standard care (SC) or MR-supported care (MR-SC) groups. Participants were 22 resident-grade physicians working in acute medical and surgical specialties prospectively recruited from a single UK Academic Health Sciences Centre. Data were analyzed from September to December 2022.Intervention: Participants resuscitated a simulated patient who was acutely unwell, including undertaking invasive procedures. Participants completed 2 scenarios and were randomly assigned to SC or MR-SC for the first scenario prior to crossover. The HoloLens 2 MR device provided interactive holographic content and bidirectional audiovisual communication with senior physicians in the MR-SC group.Main Outcomes and Measures: The primary outcome was error rate assessed via the Imperial College Error Capture (ICECAP) multidimensional error-capture tool. Secondary outcomes included teamwork (Observational Teamwork Assessment for Surgery [OTAS]; range, 0-6 and Teamwork Skills Assessment for Ward Care [T-SAW-C]; range, 1-5), scenario completion, stress and cognitive load (NASA Task Load Index [NASA-TLX; range 0-100]), and MR device user acceptability.Results: A total of 22 physicians (15 males [68.2%]; median [range] age, 28 [25-34] years) were recruited. MR technology significantly reduced the mean (SD) number of errors per scenario compared with SC (5.16 [3.34] vs 8.30 [3.09] errors; P = .003), with substantial reductions in procedural (0.79 [0.75] vs 1.52 [1.20] errors; P = .02), technical (1.95 [1.40] vs 3.65 [2.03] errors; P = .01), and safety (0.37 [0.96] vs 0.96 [0.85] errors; P = .04) domains. MR resulted in significantly greater scenario completion rates vs SC (22 scenarios [100%] vs 14 scenarios [63.6%]; P = .003). It also led to significant improvements in the overall quality of teamwork and interactions vs SC as measured by mean (SD) OTAS (25.41 [6.30] vs 16.33 [5.49]; P < .001) and T-SAW-C (27.35 [6.89] vs 18.37 [6.09]; P < .001) scores. As reported via mean (range) NASA-TLX score, there were significant reductions for MR-SC vs SC in participant temporal demands (38 [20-50] vs 46 [30-70]; P = .03) and significant improvements in self-reported task performance (50 [30-60] vs 39 [10-70]; P = .01). Overall, 19 participants (86.4%) reported that they were more confident in making clinical decisions and undertaking clinical procedures with MR support.Conclusions and Relevance: This study found that the use of MR technology reduced error, improved teamwork, and enhanced practitioner confidence when used to support the delivery of simulated emergency medical care.Trial Registration: ClinicalTrials.gov Identifier: NCT05870137
- 1 August 2023
- Published by American Medical Association (AMA) in JAMA Network Open
- Vol. 6 (8) , e2330338
Open AccessEffect of Mixed Reality on Delivery of Emergency Medical Care in a Simulated Environment
Importance: Mixed-reality (MR) technology has the potential to enhance care delivery, but there remains a paucity of evidence for its efficacy and feasibility.Objective: To assess the efficacy and feasibility of MR technology to enhance emergency care delivery in a simulated environment.Design, Setting, and Participants: This pilot randomized crossover trial was conducted from September to November 2021 at a single center in a high-fidelity simulated environment with participants block randomized to standard care (SC) or MR-supported care (MR-SC) groups. Participants were 22 resident-grade physicians working in acute medical and surgical specialties prospectively recruited from a single UK Academic Health Sciences Centre. Data were analyzed from September to December 2022.Intervention: Participants resuscitated a simulated patient who was acutely unwell, including undertaking invasive procedures. Participants completed 2 scenarios and were randomly assigned to SC or MR-SC for the first scenario prior to crossover. The HoloLens 2 MR device provided interactive holographic content and bidirectional audiovisual communication with senior physicians in the MR-SC group.Main Outcomes and Measures: The primary outcome was error rate assessed via the Imperial College Error Capture (ICECAP) multidimensional error-capture tool. Secondary outcomes included teamwork (Observational Teamwork Assessment for Surgery [OTAS]; range, 0-6 and Teamwork Skills Assessment for Ward Care [T-SAW-C]; range, 1-5), scenario completion, stress and cognitive load (NASA Task Load Index [NASA-TLX; range 0-100]), and MR device user acceptability.Results: A total of 22 physicians (15 males [68.2%]; median [range] age, 28 [25-34] years) were recruited. MR technology significantly reduced the mean (SD) number of errors per scenario compared with SC (5.16 [3.34] vs 8.30 [3.09] errors; P = .003), with substantial reductions in procedural (0.79 [0.75] vs 1.52 [1.20] errors; P = .02), technical (1.95 [1.40] vs 3.65 [2.03] errors; P = .01), and safety (0.37 [0.96] vs 0.96 [0.85] errors; P = .04) domains. MR resulted in significantly greater scenario completion rates vs SC (22 scenarios [100%] vs 14 scenarios [63.6%]; P = .003). It also led to significant improvements in the overall quality of teamwork and interactions vs SC as measured by mean (SD) OTAS (25.41 [6.30] vs 16.33 [5.49]; P < .001) and T-SAW-C (27.35 [6.89] vs 18.37 [6.09]; P < .001) scores. As reported via mean (range) NASA-TLX score, there were significant reductions for MR-SC vs SC in participant temporal demands (38 [20-50] vs 46 [30-70]; P = .03) and significant improvements in self-reported task performance (50 [30-60] vs 39 [10-70]; P = .01). Overall, 19 participants (86.4%) reported that they were more confident in making clinical decisions and undertaking clinical procedures with MR support.Conclusions and Relevance: This study found that the use of MR technology reduced error, improved teamwork, and enhanced practitioner confidence when used to support the delivery of simulated emergency medical care.Trial Registration: ClinicalTrials.gov Identifier: NCT05870137
- Open Access
- 8 June 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Barriers to and Facilitators of Key Stakeholders Influencing Successful Digital Implementation of Remote Monitoring Solutions: Mixed Methods Analysis (Preprint)
BACKGROUND Implementation of remote monitoring solutions and digital alerting tools in health care has historically been challenging, despite the impetus provided by the COVID-19 pandemic. To date, a health systems–based approach to systematically describe barriers and facilitators across multiple domains has not been undertaken. OBJECTIVE We aimed to undertake a comprehensive mixed methods analysis of barriers and facilitators for successful implementation of remote monitoring and digital alerting tools in complex health organizations. METHODS A mixed methods approach using a modified Technology Acceptance Model questionnaire and semistructured interviews mapped to the validated fit among humans, organizations, and technology (HOT-fit) framework was undertaken. Likert frequency responses and deductive thematic analyses were performed. RESULTS A total of 11 participants responded to the questionnaire and 18 participants to the interviews. Key barriers and facilitators could be mapped onto 6 dimensions, which incorporated aspects of digitization: system use (human), user satisfaction (human), environment (organization), structure (organization), information and service quality (technology), and system quality (technology). CONCLUSIONS The recommendations proposed can enhance the potential for future remote sensing solutions to be more successfully integrated in health care practice, resulting in more successful use of “virtual wards.” CLINICALTRIAL ClinicalTrials.gov NCT05321004; https://www.clinicaltrials.gov/study/NCT05321004
- 8 June 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessBarriers to and Facilitators of Key Stakeholders Influencing Successful Digital Implementation of Remote Monitoring Solutions: Mixed Methods Analysis (Preprint)
BACKGROUND Implementation of remote monitoring solutions and digital alerting tools in health care has historically been challenging, despite the impetus provided by the COVID-19 pandemic. To date, a health systems–based approach to systematically describe barriers and facilitators across multiple domains has not been undertaken. OBJECTIVE We aimed to undertake a comprehensive mixed methods analysis of barriers and facilitators for successful implementation of remote monitoring and digital alerting tools in complex health organizations. METHODS A mixed methods approach using a modified Technology Acceptance Model questionnaire and semistructured interviews mapped to the validated fit among humans, organizations, and technology (HOT-fit) framework was undertaken. Likert frequency responses and deductive thematic analyses were performed. RESULTS A total of 11 participants responded to the questionnaire and 18 participants to the interviews. Key barriers and facilitators could be mapped onto 6 dimensions, which incorporated aspects of digitization: system use (human), user satisfaction (human), environment (organization), structure (organization), information and service quality (technology), and system quality (technology). CONCLUSIONS The recommendations proposed can enhance the potential for future remote sensing solutions to be more successfully integrated in health care practice, resulting in more successful use of “virtual wards.” CLINICALTRIAL ClinicalTrials.gov NCT05321004; https://www.clinicaltrials.gov/study/NCT05321004
- Open Access
- 3 March 2023
- Published by Springer Nature in BMC Medical Education
- Vol. 23 (1) , 1-8
Can mixed reality technologies teach surgical skills better than traditional methods? A prospective randomised feasibility study
Background: Basic surgical skills teaching is often delivered with didactic audio-visual content, and new digital technologies may allow more engaging and effective ways of teaching to be developed. The Microsoft HoloLens 2 (HL2) is a multi-functional mixed reality headset. This prospective feasibility study sought to assess the device as a tool for enhancing technical surgical skills training. Methods: A prospective randomised feasibility study was conducted. 36 novice medical students were trained to perform a basic arteriotomy and closure using a synthetic model. Participants were randomised to receive a structured surgical skills tutorial via a bespoke mixed reality HL2 tutorial (n = 18), or via a standard video-based tutorial (n = 18). Proficiency scores were assessed by blinded examiners using a validated objective scoring system and participant feedback collected. Results: The HL2 group showed significantly greater improvement in overall technical proficiency compared to the video group (10.1 vs. 6.89, p = 0.0076), and a greater consistency in skill progression with a significantly narrower range of scores (SD 2.48 vs. 4.03, p = 0.026). Participant feedback showed the HL2 technology to be more interactive and engaging with minimal device related problems experienced. Conclusions: This study has demonstrated that mixed reality technology may provide a higher quality educational experience, improved skill progression and greater consistency in learning when compared to traditional teaching methodologies for basic surgical skills. Further work is required to refine, translate, and evaluate the scalability and applicability of the technology across a broad range of skills-based disciplines.
- 3 March 2023
- Published by Springer Nature in BMC Medical Education
- Vol. 23 (1) , 1-8
Open AccessCan mixed reality technologies teach surgical skills better than traditional methods? A prospective randomised feasibility study
Background: Basic surgical skills teaching is often delivered with didactic audio-visual content, and new digital technologies may allow more engaging and effective ways of teaching to be developed. The Microsoft HoloLens 2 (HL2) is a multi-functional mixed reality headset. This prospective feasibility study sought to assess the device as a tool for enhancing technical surgical skills training. Methods: A prospective randomised feasibility study was conducted. 36 novice medical students were trained to perform a basic arteriotomy and closure using a synthetic model. Participants were randomised to receive a structured surgical skills tutorial via a bespoke mixed reality HL2 tutorial (n = 18), or via a standard video-based tutorial (n = 18). Proficiency scores were assessed by blinded examiners using a validated objective scoring system and participant feedback collected. Results: The HL2 group showed significantly greater improvement in overall technical proficiency compared to the video group (10.1 vs. 6.89, p = 0.0076), and a greater consistency in skill progression with a significantly narrower range of scores (SD 2.48 vs. 4.03, p = 0.026). Participant feedback showed the HL2 technology to be more interactive and engaging with minimal device related problems experienced. Conclusions: This study has demonstrated that mixed reality technology may provide a higher quality educational experience, improved skill progression and greater consistency in learning when compared to traditional teaching methodologies for basic surgical skills. Further work is required to refine, translate, and evaluate the scalability and applicability of the technology across a broad range of skills-based disciplines.
- Open Access
- 23 August 2022
- Published by Springer Nature in BMC Medical Education
- Vol. 22 (1) , 1-8
The use of mixed reality technology for the objective assessment of clinical skills: a validation study
Background: Mixed Reality technology may provide many advantages over traditional teaching methods. Despite its potential, the technology has yet to be used for the formal assessment of clinical competency. This study sought to collect validity evidence and assess the feasibility of using the HoloLens 2 mixed reality headset for the conduct and augmentation of Objective Structured Clinical Examinations (OSCEs). Methods: A prospective cohort study was conducted to compare the assessment of undergraduate medical students undertaking OSCEs via HoloLens 2 live (HLL) and recorded (HLR), and gold-standard in-person (IP) methods. An augmented mixed reality scenario was also assessed. Results: Thirteen undergraduate participants completed a total of 65 OSCE stations. Overall inter-modality correlation was 0.81 (p = 0.01), 0.98 (p = 0.01) and 0.82 (p = 0.01) for IP vs. HLL, HLL vs. HLR and IP vs. HLR respectively. Skill based correlations for IP vs. HLR were assessed for history taking (0.82, p = 0.01), clinical examination (0.81, p = 0.01), procedural (0.88, p = 0.01) and clinical skills (0.92, p = 0.01), and assessment of a virtual mixed reality patient (0.74, p = 0.01). The HoloLens device was deemed to be usable and practical (Standard Usability Scale (SUS) score = 51.5), and the technology was thought to deliver greater flexibility and convenience, and have the potential to expand and enhance assessment opportunities. Conclusions: HoloLens 2 is comparable to traditional in-person examination of undergraduate medical students for both live and recorded assessments, and therefore is a valid and robust method for objectively assessing performance. The technology is in its infancy, and users need to develop confidence in its usability and reliability as an assessment tool. However, the potential to integrate additional functionality including holographic content, automated tracking and data analysis, and to facilitate remote assessment may allow the technology to enhance, expand and standardise examinations across a range of educational contexts.
- 23 August 2022
- Published by Springer Nature in BMC Medical Education
- Vol. 22 (1) , 1-8
Open AccessThe use of mixed reality technology for the objective assessment of clinical skills: a validation study
Background: Mixed Reality technology may provide many advantages over traditional teaching methods. Despite its potential, the technology has yet to be used for the formal assessment of clinical competency. This study sought to collect validity evidence and assess the feasibility of using the HoloLens 2 mixed reality headset for the conduct and augmentation of Objective Structured Clinical Examinations (OSCEs). Methods: A prospective cohort study was conducted to compare the assessment of undergraduate medical students undertaking OSCEs via HoloLens 2 live (HLL) and recorded (HLR), and gold-standard in-person (IP) methods. An augmented mixed reality scenario was also assessed. Results: Thirteen undergraduate participants completed a total of 65 OSCE stations. Overall inter-modality correlation was 0.81 (p = 0.01), 0.98 (p = 0.01) and 0.82 (p = 0.01) for IP vs. HLL, HLL vs. HLR and IP vs. HLR respectively. Skill based correlations for IP vs. HLR were assessed for history taking (0.82, p = 0.01), clinical examination (0.81, p = 0.01), procedural (0.88, p = 0.01) and clinical skills (0.92, p = 0.01), and assessment of a virtual mixed reality patient (0.74, p = 0.01). The HoloLens device was deemed to be usable and practical (Standard Usability Scale (SUS) score = 51.5), and the technology was thought to deliver greater flexibility and convenience, and have the potential to expand and enhance assessment opportunities. Conclusions: HoloLens 2 is comparable to traditional in-person examination of undergraduate medical students for both live and recorded assessments, and therefore is a valid and robust method for objectively assessing performance. The technology is in its infancy, and users need to develop confidence in its usability and reliability as an assessment tool. However, the potential to integrate additional functionality including holographic content, automated tracking and data analysis, and to facilitate remote assessment may allow the technology to enhance, expand and standardise examinations across a range of educational contexts.
- Open Access
- 17 May 2022
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 6 (5) , e35674
Using Mixed Reality Headsets to Deliver Remote Bedside Teaching During the COVID-19 Pandemic: Feasibility Trial of HoloLens 2
Background: COVID-19 has had a catastrophic impact in terms of human lives lost. Medical education has also been impacted as appropriately stringent infection control policies precluded medical trainees from attending clinical teaching. Lecture-based education has been easily transferred to a digital platform, but bedside teaching has not. Objective: This study aims to assess the feasibility of using a mixed reality (MR) headset to deliver remote bedside teaching. Methods: Two MR sessions were led by senior doctors wearing the HoloLens headset. The trainers selected patients requiring their specialist input. The headset allowed bidirectional audiovisual communication between the trainer and trainee doctors. Trainee doctor conceptions of bedside teaching, impact of the COVID-19 pandemic on bedside teaching, and the MR sessions were evaluated using pre- and postround questionnaires, using Likert scales. Data related to clinician exposure to at-risk patients and use of personal protective equipment (PPE) were collected. Results: Prequestionnaire respondents (n=24) strongly agreed that bedside teaching is key to educating clinicians (median 7, IQR 6-7). Postsession questionnaires showed that, overall, users subjectively agreed the MR session was helpful to their learning (median 6, IQR 5.25-7) and that it was worthwhile (median 6, IQR 5.25-7). Mixed reality versus in-person teaching led to a 79.5% reduction in cumulative clinician exposure time and 83.3% reduction in PPE use. Conclusions: This study is proof of principle that HoloLens can be used effectively to deliver clinical bedside teaching. This novel format confers significant advantages in terms of minimizing exposure of trainees to COVID-19, reducing PPE use, enabling larger attendance, and delivering convenient and accessible real-time clinical training.
- 17 May 2022
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 6 (5) , e35674
Open AccessUsing Mixed Reality Headsets to Deliver Remote Bedside Teaching During the COVID-19 Pandemic: Feasibility Trial of HoloLens 2
Background: COVID-19 has had a catastrophic impact in terms of human lives lost. Medical education has also been impacted as appropriately stringent infection control policies precluded medical trainees from attending clinical teaching. Lecture-based education has been easily transferred to a digital platform, but bedside teaching has not. Objective: This study aims to assess the feasibility of using a mixed reality (MR) headset to deliver remote bedside teaching. Methods: Two MR sessions were led by senior doctors wearing the HoloLens headset. The trainers selected patients requiring their specialist input. The headset allowed bidirectional audiovisual communication between the trainer and trainee doctors. Trainee doctor conceptions of bedside teaching, impact of the COVID-19 pandemic on bedside teaching, and the MR sessions were evaluated using pre- and postround questionnaires, using Likert scales. Data related to clinician exposure to at-risk patients and use of personal protective equipment (PPE) were collected. Results: Prequestionnaire respondents (n=24) strongly agreed that bedside teaching is key to educating clinicians (median 7, IQR 6-7). Postsession questionnaires showed that, overall, users subjectively agreed the MR session was helpful to their learning (median 6, IQR 5.25-7) and that it was worthwhile (median 6, IQR 5.25-7). Mixed reality versus in-person teaching led to a 79.5% reduction in cumulative clinician exposure time and 83.3% reduction in PPE use. Conclusions: This study is proof of principle that HoloLens can be used effectively to deliver clinical bedside teaching. This novel format confers significant advantages in terms of minimizing exposure of trainees to COVID-19, reducing PPE use, enabling larger attendance, and delivering convenient and accessible real-time clinical training.
- Open Access
- 8 February 2022
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 10 (2) , e31497
Defining the Enablers and Barriers to the Implementation of Large-scale, Health Care–Related Mobile Technology: Qualitative Case Study in a Tertiary Hospital Setting
Background: The successful implementation of clinical smartphone apps in hospital settings requires close collaboration with industry partners. A large-scale, hospital-wide implementation of a clinical mobile app for health care professionals developed in partnership with Google Health and academic partners was deployed on a bring-your-own-device basis using mobile device management at our UK academic hospital. As this was the first large-scale implementation of this type of innovation in the UK health system, important insights and lessons learned from the deployment may be useful to other organizations considering implementing similar technology in partnership with commercial companies. Objective: The aims of this study are to define the key enablers and barriers and to propose a road map for the implementation of a hospital-wide clinical mobile app developed in collaboration with an industry partner as a data processor and an academic partner for independent evaluation. Methods: Semistructured interviews were conducted with high-level stakeholders from industry, academia, and health care providers who had instrumental roles in the implementation of the app at our hospital. The interviews explored the participants’ views on the enablers and barriers to the implementation process. The interviews were analyzed using a broadly deductive approach to thematic analysis. Results: In total, 14 participants were interviewed. Key enablers identified were the establishment of a steering committee with high-level clinical involvement, well-defined roles and responsibilities between partners, effective communication strategies with end users, safe information governance precautions, and increased patient engagement and transparency. Barriers identified were the lack of dedicated resources for mobile change at our hospital, risk aversion, unclear strategy and regulation, and the implications of bring-your-own-device and mobile device management policies. The key lessons learned from the deployment process were highlighted, and a road map for the implementation of large-scale clinical mobile apps in hospital settings was proposed. Conclusions: Despite partnering with one of the world’s biggest technology companies, the cultural and technological change required for mobile working and implementation in health care was found to be a significant challenge. With an increasing requirement for health care organizations to partner with industry for advanced mobile technologies, the lessons learned from our implementation can influence how other health care organizations undertake a similar mobile change and improve the chances of successful widespread mobile transformation.
- 8 February 2022
- Published by JMIR Publications Inc. in JMIR mHealth and uHealth
- Vol. 10 (2) , e31497
Open AccessDefining the Enablers and Barriers to the Implementation of Large-scale, Health Care–Related Mobile Technology: Qualitative Case Study in a Tertiary Hospital Setting
Background: The successful implementation of clinical smartphone apps in hospital settings requires close collaboration with industry partners. A large-scale, hospital-wide implementation of a clinical mobile app for health care professionals developed in partnership with Google Health and academic partners was deployed on a bring-your-own-device basis using mobile device management at our UK academic hospital. As this was the first large-scale implementation of this type of innovation in the UK health system, important insights and lessons learned from the deployment may be useful to other organizations considering implementing similar technology in partnership with commercial companies. Objective: The aims of this study are to define the key enablers and barriers and to propose a road map for the implementation of a hospital-wide clinical mobile app developed in collaboration with an industry partner as a data processor and an academic partner for independent evaluation. Methods: Semistructured interviews were conducted with high-level stakeholders from industry, academia, and health care providers who had instrumental roles in the implementation of the app at our hospital. The interviews explored the participants’ views on the enablers and barriers to the implementation process. The interviews were analyzed using a broadly deductive approach to thematic analysis. Results: In total, 14 participants were interviewed. Key enablers identified were the establishment of a steering committee with high-level clinical involvement, well-defined roles and responsibilities between partners, effective communication strategies with end users, safe information governance precautions, and increased patient engagement and transparency. Barriers identified were the lack of dedicated resources for mobile change at our hospital, risk aversion, unclear strategy and regulation, and the implications of bring-your-own-device and mobile device management policies. The key lessons learned from the deployment process were highlighted, and a road map for the implementation of large-scale clinical mobile apps in hospital settings was proposed. Conclusions: Despite partnering with one of the world’s biggest technology companies, the cultural and technological change required for mobile working and implementation in health care was found to be a significant challenge. With an increasing requirement for health care organizations to partner with industry for advanced mobile technologies, the lessons learned from our implementation can influence how other health care organizations undertake a similar mobile change and improve the chances of successful widespread mobile transformation.
- Open Access
- 13 December 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Using Mixed Reality Headsets to Deliver Remote Bedside Teaching During the COVID-19 Pandemic: Feasibility Trial of HoloLens 2 (Preprint)
BACKGROUND COVID-19 has had a catastrophic impact in terms of human lives lost. Medical education has also been impacted as appropriately stringent infection control policies precluded medical trainees from attending clinical teaching. Lecture-based education has been easily transferred to a digital platform, but bedside teaching has not. OBJECTIVE This study aims to assess the feasibility of using a mixed reality (MR) headset to deliver remote bedside teaching. METHODS Two MR sessions were led by senior doctors wearing the HoloLens headset. The trainers selected patients requiring their specialist input. The headset allowed bidirectional audiovisual communication between the trainer and trainee doctors. Trainee doctor conceptions of bedside teaching, impact of the COVID-19 pandemic on bedside teaching, and the MR sessions were evaluated using pre- and postround questionnaires, using Likert scales. Data related to clinician exposure to at-risk patients and use of personal protective equipment (PPE) were collected. RESULTS Prequestionnaire respondents (n=24) strongly agreed that bedside teaching is key to educating clinicians (median 7, IQR 6-7). Postsession questionnaires showed that, overall, users subjectively agreed the MR session was helpful to their learning (median 6, IQR 5.25-7) and that it was worthwhile (median 6, IQR 5.25-7). Mixed reality versus in-person teaching led to a 79.5% reduction in cumulative clinician exposure time and 83.3% reduction in PPE use. CONCLUSIONS This study is proof of principle that HoloLens can be used effectively to deliver clinical bedside teaching. This novel format confers significant advantages in terms of minimizing exposure of trainees to COVID-19, reducing PPE use, enabling larger attendance, and delivering convenient and accessible real-time clinical training.
- 13 December 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessUsing Mixed Reality Headsets to Deliver Remote Bedside Teaching During the COVID-19 Pandemic: Feasibility Trial of HoloLens 2 (Preprint)
BACKGROUND COVID-19 has had a catastrophic impact in terms of human lives lost. Medical education has also been impacted as appropriately stringent infection control policies precluded medical trainees from attending clinical teaching. Lecture-based education has been easily transferred to a digital platform, but bedside teaching has not. OBJECTIVE This study aims to assess the feasibility of using a mixed reality (MR) headset to deliver remote bedside teaching. METHODS Two MR sessions were led by senior doctors wearing the HoloLens headset. The trainers selected patients requiring their specialist input. The headset allowed bidirectional audiovisual communication between the trainer and trainee doctors. Trainee doctor conceptions of bedside teaching, impact of the COVID-19 pandemic on bedside teaching, and the MR sessions were evaluated using pre- and postround questionnaires, using Likert scales. Data related to clinician exposure to at-risk patients and use of personal protective equipment (PPE) were collected. RESULTS Prequestionnaire respondents (n=24) strongly agreed that bedside teaching is key to educating clinicians (median 7, IQR 6-7). Postsession questionnaires showed that, overall, users subjectively agreed the MR session was helpful to their learning (median 6, IQR 5.25-7) and that it was worthwhile (median 6, IQR 5.25-7). Mixed reality versus in-person teaching led to a 79.5% reduction in cumulative clinician exposure time and 83.3% reduction in PPE use. CONCLUSIONS This study is proof of principle that HoloLens can be used effectively to deliver clinical bedside teaching. This novel format confers significant advantages in terms of minimizing exposure of trainees to COVID-19, reducing PPE use, enabling larger attendance, and delivering convenient and accessible real-time clinical training.