Nusrat Choudhury
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Nusrat Choudhury has a total of 61 co-authors. Here are the top co-authors by number of shared publications:
- Melanie Segado
University of Pennsylvania Department of Bioengineering 220 S 33rd Street, Philadelphia, PA 19104
7 shared publications - Vincent Gagnon Shaigetz
National Research Council, Boucherville, QC, Canada
7 shared publications - Mark Hewko
National Research Council, Winnipeg, MB, Canada
6 shared publications - Michael Sean Dyck Smith
National Research Council, Winnipeg, MB, Canada
6 shared publications - Anne Cabral
National Research Council, Boucherville, QC, Canada
4 shared publications - Catherine Proulx
Medical Devices Research Centre, National Research Council of Canada, Boucherville, QC J4B 6Y4, Canada
4 shared publications
Latest Publications
- 19 October 2026
- Published by Taylor & Francis in Aging & Mental Health
- p. 1-12
Acceptability and perceived value of dementia caregiving simulations in virtual reality: insights from consultation focus groups
Population ageing is occurring at an unprecedented pace globally. The World Health Organization (WHO) reported that between 2015 and 2050, the proportion of the world’s population over 60 years wil...
- 19 October 2026
- Published by Taylor & Francis in Aging & Mental Health
- p. 1-12
Acceptability and perceived value of dementia caregiving simulations in virtual reality: insights from consultation focus groups
Population ageing is occurring at an unprecedented pace globally. The World Health Organization (WHO) reported that between 2015 and 2050, the proportion of the world’s population over 60 years wil...
- Open Access
Deep-Learning-Derived Facial Electromyogram Signatures of Emotion in Immersive Virtual Reality (bWell): Exploring the Impact of Emotional, Cognitive, and Physical Demands
Emotional and workload-related states unfold dynamically during immersive virtual reality (VR) experiences, yet reliable physiological modeling in such environments remains challenging. We investigated whether multi-channel facial electromyography (fEMG), combined with spatio-temporal deep learning, can (i) accurately classify calibrated facial expressions across participants and (ii) transfer to spontaneous, task-elicited behavior in immersive VR. Twelve adults completed a calibration phase involving four intentional expressions (smile, frown, raised eyebrow, neutral), followed by VR scenes designed to elicit emotional, cognitive, physical, and dual task demands. After participant-level physiological normalization, a single shared Convolutional Neural Network–Temporal Convolutional Network (CNN–TCN) model was trained and evaluated using leave-one-participant-out (LOPO) validation. The model achieved strong cross-participant performance (Macro-F1 = 0.88 ± 0.13; ROC-AUC = 0.95 ± 0.06). When applied to unlabeled spontaneous VR task-elicited fEMG recordings, the trained model generated continuous expression classes. Derived static and temporal expression features showed scene-dependent modulation and False Discovery Rate (FDR)-surviving associations, primarily with perceived physical demand (NASA-TLX). The observed muscle activation patterns were physiologically plausible and aligned with Facial Action Coding System (FACS)-based interpretations of underlying muscle activity. These findings demonstrate that end-to-end spatio-temporal modeling of raw fEMG enables facial expression sensing in immersive VR using a single shared model following physiological normalization. The proposed framework bridges calibrated expression learning and spontaneous task-elicited behavior, supporting privacy-preserving, continuous and physiologically grounded monitoring in human-centered VR applications.
Open AccessDeep-Learning-Derived Facial Electromyogram Signatures of Emotion in Immersive Virtual Reality (bWell): Exploring the Impact of Emotional, Cognitive, and Physical Demands
Emotional and workload-related states unfold dynamically during immersive virtual reality (VR) experiences, yet reliable physiological modeling in such environments remains challenging. We investigated whether multi-channel facial electromyography (fEMG), combined with spatio-temporal deep learning, can (i) accurately classify calibrated facial expressions across participants and (ii) transfer to spontaneous, task-elicited behavior in immersive VR. Twelve adults completed a calibration phase involving four intentional expressions (smile, frown, raised eyebrow, neutral), followed by VR scenes designed to elicit emotional, cognitive, physical, and dual task demands. After participant-level physiological normalization, a single shared Convolutional Neural Network–Temporal Convolutional Network (CNN–TCN) model was trained and evaluated using leave-one-participant-out (LOPO) validation. The model achieved strong cross-participant performance (Macro-F1 = 0.88 ± 0.13; ROC-AUC = 0.95 ± 0.06). When applied to unlabeled spontaneous VR task-elicited fEMG recordings, the trained model generated continuous expression classes. Derived static and temporal expression features showed scene-dependent modulation and False Discovery Rate (FDR)-surviving associations, primarily with perceived physical demand (NASA-TLX). The observed muscle activation patterns were physiologically plausible and aligned with Facial Action Coding System (FACS)-based interpretations of underlying muscle activity. These findings demonstrate that end-to-end spatio-temporal modeling of raw fEMG enables facial expression sensing in immersive VR using a single shared model following physiological normalization. The proposed framework bridges calibrated expression learning and spontaneous task-elicited behavior, supporting privacy-preserving, continuous and physiologically grounded monitoring in human-centered VR applications.
- Open Access
- 5 March 2026
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 15 (1) , e87107
Supporting Unpaid Caregivers of Persons Living With Dementia: Protocol for a Pilot Feasibility Study to Explore Caregiver Outcomes and Impact of a Co-Designed Simulation–Based Psychoeducation Program in Virtual Reality
Background: Dementia is a global public health concern, with prevalence projected to reach 78 million individuals by 2030 and 139 million by 2050. Most persons living with dementia reside in community settings and are supported by family caregivers. As caregiving demands grow, caregivers experience significant psychosocial, emotional, and financial burden, including high rates of stress, social isolation, and depressive symptoms. Access to effective support services remains limited, highlighting the urgent need for innovative and accessible caregiver interventions. Objective: This pilot study first aims to assess the feasibility, acceptability, and tolerability of VR-SIM Carers, a virtual reality (VR)–based psychoeducational training program for family caregivers or care partners of people living with dementia. Second, it will aim to provide a preliminary evaluation of potential impact on caregiver outcomes, including caregiver competence, stress, resilience, empathy, and quality of life. The study is not designed to support causal inference regarding the effectiveness of VR-SIM Carers. Methods: A mixed methods design will be used with a sample of 30 family caregivers of people living with dementia. Participants will complete 3 immersive, self-paced VR caregiving scenarios—Managing Apathy, Crisis Response, and Refusal of Care—receiving real-time feedback from simulated characters, including clinician and person living with dementia avatars. Primary outcomes (feasibility and educational impact) include recruitment, retention, adherence, usability, acceptability, and tolerability and caregiver competence (Pearlin Caregiving Competence Scale), perceived stress (Cohen Perceived Stress Scale), resilience (Connor-Davidson Resilience Scale), and empathy (Empathy Assessment Scale). Secondary outcomes (preliminary efficacy) include caregiver quality of life (Adult Carer Quality of Life Questionnaire), caregiver burden (Burden Questionnaire), and behavioral symptoms (Neuropsychiatric Inventory, Center for Epidemiologic Studies Depression Scale Short Form) assessed at baseline, postintervention, and 1-month follow-up. Feasibility and user engagement will be evaluated via the 18-item Gaming Use Engagement and Severity Scale, Igroup Presence Questionnaire, qualitative interviews, reflection notes, and open-ended feedback. Quantitative data will be analyzed using repeated-measures ANOVA and paired 2-tailed t tests, while qualitative data will be analyzed using an inductive thematic coding framework. Data analyses are descriptive and exploratory only, and no causal claims regarding intervention effectiveness will be made. Consistent with CONSORT (Consolidated Standards of Reporting Trials) guidance for pilot and feasibility studies, caregiver outcomes (eg, competence, stress, resilience, empathy) are treated as exploratory. Results: The findings from this study will inform the feasibility, acceptability, and educational value of immersive VR for caregiver training, while providing preliminary evidence regarding the efficacy of VR-SIM Carers as a training tool to improve psychoeducation outcomes for family caregivers of people living with dementia and reduce caregiving burden. Data collection commenced in March 2024 with a projected end date of March 2026. As of the submission of the manuscript (December 2025), 21 participants have been enrolled. Data analysis will be completed in April 2026, and the results are expected to be published in fall 2026. Conclusions: VR-SIM Carers represents an innovative, scalable intervention designed to enhance caregiver preparedness, psychosocial outcomes, and sustainable community–based dementia care. This pilot study will provide critical evidence to guide further development and implementation of VR-based caregiver support programs.
- 5 March 2026
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 15 (1) , e87107
Open AccessSupporting Unpaid Caregivers of Persons Living With Dementia: Protocol for a Pilot Feasibility Study to Explore Caregiver Outcomes and Impact of a Co-Designed Simulation–Based Psychoeducation Program in Virtual Reality
Background: Dementia is a global public health concern, with prevalence projected to reach 78 million individuals by 2030 and 139 million by 2050. Most persons living with dementia reside in community settings and are supported by family caregivers. As caregiving demands grow, caregivers experience significant psychosocial, emotional, and financial burden, including high rates of stress, social isolation, and depressive symptoms. Access to effective support services remains limited, highlighting the urgent need for innovative and accessible caregiver interventions. Objective: This pilot study first aims to assess the feasibility, acceptability, and tolerability of VR-SIM Carers, a virtual reality (VR)–based psychoeducational training program for family caregivers or care partners of people living with dementia. Second, it will aim to provide a preliminary evaluation of potential impact on caregiver outcomes, including caregiver competence, stress, resilience, empathy, and quality of life. The study is not designed to support causal inference regarding the effectiveness of VR-SIM Carers. Methods: A mixed methods design will be used with a sample of 30 family caregivers of people living with dementia. Participants will complete 3 immersive, self-paced VR caregiving scenarios—Managing Apathy, Crisis Response, and Refusal of Care—receiving real-time feedback from simulated characters, including clinician and person living with dementia avatars. Primary outcomes (feasibility and educational impact) include recruitment, retention, adherence, usability, acceptability, and tolerability and caregiver competence (Pearlin Caregiving Competence Scale), perceived stress (Cohen Perceived Stress Scale), resilience (Connor-Davidson Resilience Scale), and empathy (Empathy Assessment Scale). Secondary outcomes (preliminary efficacy) include caregiver quality of life (Adult Carer Quality of Life Questionnaire), caregiver burden (Burden Questionnaire), and behavioral symptoms (Neuropsychiatric Inventory, Center for Epidemiologic Studies Depression Scale Short Form) assessed at baseline, postintervention, and 1-month follow-up. Feasibility and user engagement will be evaluated via the 18-item Gaming Use Engagement and Severity Scale, Igroup Presence Questionnaire, qualitative interviews, reflection notes, and open-ended feedback. Quantitative data will be analyzed using repeated-measures ANOVA and paired 2-tailed t tests, while qualitative data will be analyzed using an inductive thematic coding framework. Data analyses are descriptive and exploratory only, and no causal claims regarding intervention effectiveness will be made. Consistent with CONSORT (Consolidated Standards of Reporting Trials) guidance for pilot and feasibility studies, caregiver outcomes (eg, competence, stress, resilience, empathy) are treated as exploratory. Results: The findings from this study will inform the feasibility, acceptability, and educational value of immersive VR for caregiver training, while providing preliminary evidence regarding the efficacy of VR-SIM Carers as a training tool to improve psychoeducation outcomes for family caregivers of people living with dementia and reduce caregiving burden. Data collection commenced in March 2024 with a projected end date of March 2026. As of the submission of the manuscript (December 2025), 21 participants have been enrolled. Data analysis will be completed in April 2026, and the results are expected to be published in fall 2026. Conclusions: VR-SIM Carers represents an innovative, scalable intervention designed to enhance caregiver preparedness, psychosocial outcomes, and sustainable community–based dementia care. This pilot study will provide critical evidence to guide further development and implementation of VR-based caregiver support programs.
- Open Access
- 31 March 2025
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 13 (1) , e59514
Considering Theory-Based Gamification in the Co-Design and Development of a Virtual Reality Cognitive Remediation Intervention for Depression (bWell-D): Mixed Methods Study
Background: In collaboration with clinical domain experts, we developed a prototype of immersive virtual reality (VR) cognitive remediation for major depressive disorder (bWell-D). In the development of a new digital intervention, there is a need to determine the effective components and clinical relevance using systematic methodologies. From an implementation perspective, the effectiveness of digital intervention delivery is challenged by low uptake and high noncompliance rates. Gamification may play a role in addressing this as it can boost adherence. However, careful consideration is required in its application to promote user motivation intrinsically. Objective: We aimed to address these challenges through an iterative process for development that involves co-design for developing content as well as in the application of gamification while also taking into consideration behavior change theories. This effort followed the methodological framework guidelines outlined by an international working group for development of VR therapies. Methods: In previously reported work, we collected qualitative data from patients and care providers to understand end-user perceptions on the use of VR technologies for cognitive remediation, reveal insights on the drivers for behavior change, and obtain suggestions for changes specific to the VR program. In this study, we translated these findings into concrete representative software functionalities or features and evaluated them against behavioral theories to characterize gamification elements in terms of factors that drive behavior change and intrinsic engagement, which is of particular importance in the context of cognitive remediation. The implemented changes were formally evaluated through user trials. Results: The results indicated that feedback from end users centered on using gamification to add artificial challenges, personalization and customization options, and artificial assistance while focusing on capability as the behavior change driver. It was also found that, in terms of promoting intrinsic engagement, the need to meet competence was most frequently raised. In user trials, bWell-D was well tolerated, and preliminary results suggested an increase in user experience ratings with high engagement reported throughout a 4-week training program. Conclusions: In this paper, we present a process for the application of gamification that includes characterizing what was applied in a standardized way and identifying the underlying mechanisms that are targeted. Typical gamification elements such as points and scoring and rewards and prizes target motivation in an extrinsic fashion. In this work, it was found that modifications suggested by end users resulted in the inclusion of gamification elements less commonly observed and that tend to focus more on individual ability. It was found that the incorporation of end-user feedback can lead to the application of gamification in broader ways, with the identification of elements that are potentially better suited for mental health domains.
- 31 March 2025
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 13 (1) , e59514
Open AccessConsidering Theory-Based Gamification in the Co-Design and Development of a Virtual Reality Cognitive Remediation Intervention for Depression (bWell-D): Mixed Methods Study
Background: In collaboration with clinical domain experts, we developed a prototype of immersive virtual reality (VR) cognitive remediation for major depressive disorder (bWell-D). In the development of a new digital intervention, there is a need to determine the effective components and clinical relevance using systematic methodologies. From an implementation perspective, the effectiveness of digital intervention delivery is challenged by low uptake and high noncompliance rates. Gamification may play a role in addressing this as it can boost adherence. However, careful consideration is required in its application to promote user motivation intrinsically. Objective: We aimed to address these challenges through an iterative process for development that involves co-design for developing content as well as in the application of gamification while also taking into consideration behavior change theories. This effort followed the methodological framework guidelines outlined by an international working group for development of VR therapies. Methods: In previously reported work, we collected qualitative data from patients and care providers to understand end-user perceptions on the use of VR technologies for cognitive remediation, reveal insights on the drivers for behavior change, and obtain suggestions for changes specific to the VR program. In this study, we translated these findings into concrete representative software functionalities or features and evaluated them against behavioral theories to characterize gamification elements in terms of factors that drive behavior change and intrinsic engagement, which is of particular importance in the context of cognitive remediation. The implemented changes were formally evaluated through user trials. Results: The results indicated that feedback from end users centered on using gamification to add artificial challenges, personalization and customization options, and artificial assistance while focusing on capability as the behavior change driver. It was also found that, in terms of promoting intrinsic engagement, the need to meet competence was most frequently raised. In user trials, bWell-D was well tolerated, and preliminary results suggested an increase in user experience ratings with high engagement reported throughout a 4-week training program. Conclusions: In this paper, we present a process for the application of gamification that includes characterizing what was applied in a standardized way and identifying the underlying mechanisms that are targeted. Typical gamification elements such as points and scoring and rewards and prizes target motivation in an extrinsic fashion. In this work, it was found that modifications suggested by end users resulted in the inclusion of gamification elements less commonly observed and that tend to focus more on individual ability. It was found that the incorporation of end-user feedback can lead to the application of gamification in broader ways, with the identification of elements that are potentially better suited for mental health domains.
- Open Access
- 4 March 2025
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 9 (1) , e64492
An Integrated Platform Combining Immersive Virtual Reality and Physiological Sensors for Systematic and Individualized Assessment of Stress Response (bWell): Design and Implementation Study
Background: Stress is a pervasive issue in modern society, manifesting in various forms such as emotional, physical, and work-related stress, each with distinct impacts on individuals and society. Traditional stress studies often rely on psychological, performance, or social tests; however, recently, immersive virtual reality (VR), which provides a sense of presence and natural interaction, offers the opportunity to simulate real-world tasks and stressors in controlled environments. Despite its potential, the use of VR to investigate the multifaceted manifestations of stress has not been thoroughly explored. Objective: This study aimed to explore the feasibility of using a VR-based platform, bWell, to elicit multifaceted stress responses and measure the resulting behavioral and physiological changes. Specifically, we aimed to design various VR stress exercises based on neurocardiac models to systematically test cardiac functioning within specific contexts of self-regulation (executive functioning, physical efforts, and emotional regulation). Methods: The development process adhered to guidelines for VR clinical trials and complex health interventions, encompassing 3 phases: preparation, development, and verification. The preparation phase involved a comprehensive literature review to establish links between stress, the heart, and the brain, leading to the formulation of a conceptual model based on the Neurovisceral Integration Model (NVIM) and Vagal Tank Theory (VTT). The development phase involved designing VR exercises targeting specific stressors and integrating physiological sensors such as photoplethysmography (PPG) and electromyography (EMG) to capture heart rate variability (HRV) and facial expressions. The verification phase, conducted with a small number of trials, aimed to design a study and implement a workflow for testing the feasibility, acceptability, and tolerability of the VR exercises. In addition, the potential for capturing physiological measures along with subjective ratings of stress for specific dimensions was assessed. Results: Verification trials demonstrated that the VR exercises were well tolerated, with negligible cybersickness and high user engagement. The different VR exercises successfully elicited the intended stress demands, along with the physiological responses. Conclusions: The study presents a novel VR-based experimental setup that allows a systematic and individualized assessment of stress responses, paving the way for future research to identify features that confer stress resilience and help individuals manage stress effectively. While our conceptual model highlights the role of HRV in providing valuable insights into stress responses, future research will involve multivariate and machine learning analyses to predict individual stress responses based on comprehensive sensor data, including EMG and the VR-based behavioral data, ultimately guiding personalized stress management interventions.
- 4 March 2025
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 9 (1) , e64492
Open AccessAn Integrated Platform Combining Immersive Virtual Reality and Physiological Sensors for Systematic and Individualized Assessment of Stress Response (bWell): Design and Implementation Study
Background: Stress is a pervasive issue in modern society, manifesting in various forms such as emotional, physical, and work-related stress, each with distinct impacts on individuals and society. Traditional stress studies often rely on psychological, performance, or social tests; however, recently, immersive virtual reality (VR), which provides a sense of presence and natural interaction, offers the opportunity to simulate real-world tasks and stressors in controlled environments. Despite its potential, the use of VR to investigate the multifaceted manifestations of stress has not been thoroughly explored. Objective: This study aimed to explore the feasibility of using a VR-based platform, bWell, to elicit multifaceted stress responses and measure the resulting behavioral and physiological changes. Specifically, we aimed to design various VR stress exercises based on neurocardiac models to systematically test cardiac functioning within specific contexts of self-regulation (executive functioning, physical efforts, and emotional regulation). Methods: The development process adhered to guidelines for VR clinical trials and complex health interventions, encompassing 3 phases: preparation, development, and verification. The preparation phase involved a comprehensive literature review to establish links between stress, the heart, and the brain, leading to the formulation of a conceptual model based on the Neurovisceral Integration Model (NVIM) and Vagal Tank Theory (VTT). The development phase involved designing VR exercises targeting specific stressors and integrating physiological sensors such as photoplethysmography (PPG) and electromyography (EMG) to capture heart rate variability (HRV) and facial expressions. The verification phase, conducted with a small number of trials, aimed to design a study and implement a workflow for testing the feasibility, acceptability, and tolerability of the VR exercises. In addition, the potential for capturing physiological measures along with subjective ratings of stress for specific dimensions was assessed. Results: Verification trials demonstrated that the VR exercises were well tolerated, with negligible cybersickness and high user engagement. The different VR exercises successfully elicited the intended stress demands, along with the physiological responses. Conclusions: The study presents a novel VR-based experimental setup that allows a systematic and individualized assessment of stress responses, paving the way for future research to identify features that confer stress resilience and help individuals manage stress effectively. While our conceptual model highlights the role of HRV in providing valuable insights into stress responses, future research will involve multivariate and machine learning analyses to predict individual stress responses based on comprehensive sensor data, including EMG and the VR-based behavioral data, ultimately guiding personalized stress management interventions.
- Open Access
- 18 July 2024
- Published by JMIR Publications Inc. in JMIR Preprints
An Integrated Platform Combining Immersive Virtual Reality and Physiological Sensors for Systematic and Individualized Assessment of Stress Response (bWell): Design and Implementation Study (Preprint)
BACKGROUND Stress is a pervasive issue in modern society, manifesting in various forms such as emotional, physical, and work-related stress, each with distinct impacts on individuals and society. Traditional stress studies often rely on psychological, performance, or social tests; however, recently, immersive virtual reality (VR), which provides a sense of presence and natural interaction, offers the opportunity to simulate real-world tasks and stressors in controlled environments. Despite its potential, the use of VR to investigate the multifaceted manifestations of stress has not been thoroughly explored. OBJECTIVE This study aimed to explore the feasibility of using a VR-based platform, bWell, to elicit multifaceted stress responses and measure the resulting behavioral and physiological changes. Specifically, we aimed to design various VR stress exercises based on neurocardiac models to systematically test cardiac functioning within specific contexts of self-regulation (executive functioning, physical efforts, and emotional regulation). METHODS The development process adhered to guidelines for VR clinical trials and complex health interventions, encompassing 3 phases: preparation, development, and verification. The preparation phase involved a comprehensive literature review to establish links between stress, the heart, and the brain, leading to the formulation of a conceptual model based on the Neurovisceral Integration Model (NVIM) and Vagal Tank Theory (VTT). The development phase involved designing VR exercises targeting specific stressors and integrating physiological sensors such as photoplethysmography (PPG) and electromyography (EMG) to capture heart rate variability (HRV) and facial expressions. The verification phase, conducted with a small number of trials, aimed to design a study and implement a workflow for testing the feasibility, acceptability, and tolerability of the VR exercises. In addition, the potential for capturing physiological measures along with subjective ratings of stress for specific dimensions was assessed. RESULTS Verification trials demonstrated that the VR exercises were well tolerated, with negligible cybersickness and high user engagement. The different VR exercises successfully elicited the intended stress demands, along with the physiological responses. CONCLUSIONS The study presents a novel VR-based experimental setup that allows a systematic and individualized assessment of stress responses, paving the way for future research to identify features that confer stress resilience and help individuals manage stress effectively. While our conceptual model highlights the role of HRV in providing valuable insights into stress responses, future research will involve multivariate and machine learning analyses to predict individual stress responses based on comprehensive sensor data, including EMG and the VR-based behavioral data, ultimately guiding personalized stress management interventions.
- 18 July 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessAn Integrated Platform Combining Immersive Virtual Reality and Physiological Sensors for Systematic and Individualized Assessment of Stress Response (bWell): Design and Implementation Study (Preprint)
BACKGROUND Stress is a pervasive issue in modern society, manifesting in various forms such as emotional, physical, and work-related stress, each with distinct impacts on individuals and society. Traditional stress studies often rely on psychological, performance, or social tests; however, recently, immersive virtual reality (VR), which provides a sense of presence and natural interaction, offers the opportunity to simulate real-world tasks and stressors in controlled environments. Despite its potential, the use of VR to investigate the multifaceted manifestations of stress has not been thoroughly explored. OBJECTIVE This study aimed to explore the feasibility of using a VR-based platform, bWell, to elicit multifaceted stress responses and measure the resulting behavioral and physiological changes. Specifically, we aimed to design various VR stress exercises based on neurocardiac models to systematically test cardiac functioning within specific contexts of self-regulation (executive functioning, physical efforts, and emotional regulation). METHODS The development process adhered to guidelines for VR clinical trials and complex health interventions, encompassing 3 phases: preparation, development, and verification. The preparation phase involved a comprehensive literature review to establish links between stress, the heart, and the brain, leading to the formulation of a conceptual model based on the Neurovisceral Integration Model (NVIM) and Vagal Tank Theory (VTT). The development phase involved designing VR exercises targeting specific stressors and integrating physiological sensors such as photoplethysmography (PPG) and electromyography (EMG) to capture heart rate variability (HRV) and facial expressions. The verification phase, conducted with a small number of trials, aimed to design a study and implement a workflow for testing the feasibility, acceptability, and tolerability of the VR exercises. In addition, the potential for capturing physiological measures along with subjective ratings of stress for specific dimensions was assessed. RESULTS Verification trials demonstrated that the VR exercises were well tolerated, with negligible cybersickness and high user engagement. The different VR exercises successfully elicited the intended stress demands, along with the physiological responses. CONCLUSIONS The study presents a novel VR-based experimental setup that allows a systematic and individualized assessment of stress responses, paving the way for future research to identify features that confer stress resilience and help individuals manage stress effectively. While our conceptual model highlights the role of HRV in providing valuable insights into stress responses, future research will involve multivariate and machine learning analyses to predict individual stress responses based on comprehensive sensor data, including EMG and the VR-based behavioral data, ultimately guiding personalized stress management interventions.
- Open Access
- 15 April 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Considering Theory-Based Gamification in the Co-Design and Development of a Virtual Reality Cognitive Remediation Intervention for Depression (bWell-D): Mixed Methods Study (Preprint)
BACKGROUND In collaboration with clinical domain experts, we developed a prototype of immersive virtual reality (VR) cognitive remediation for major depressive disorder (bWell-D). In the development of a new digital intervention, there is a need to determine the effective components and clinical relevance using systematic methodologies. From an implementation perspective, the effectiveness of digital intervention delivery is challenged by low uptake and high noncompliance rates. Gamification may play a role in addressing this as it can boost adherence. However, careful consideration is required in its application to promote user motivation intrinsically. OBJECTIVE We aimed to address these challenges through an iterative process for development that involves co-design for developing content as well as in the application of gamification while also taking into consideration behavior change theories. This effort followed the methodological framework guidelines outlined by an international working group for development of VR therapies. METHODS In previously reported work, we collected qualitative data from patients and care providers to understand end-user perceptions on the use of VR technologies for cognitive remediation, reveal insights on the drivers for behavior change, and obtain suggestions for changes specific to the VR program. In this study, we translated these findings into concrete representative software functionalities or features and evaluated them against behavioral theories to characterize gamification elements in terms of factors that drive behavior change and intrinsic engagement, which is of particular importance in the context of cognitive remediation. The implemented changes were formally evaluated through user trials. RESULTS The results indicated that feedback from end users centered on using gamification to add artificial challenges, personalization and customization options, and artificial assistance while focusing on capability as the behavior change driver. It was also found that, in terms of promoting intrinsic engagement, the need to meet competence was most frequently raised. In user trials, bWell-D was well tolerated, and preliminary results suggested an increase in user experience ratings with high engagement reported throughout a 4-week training program. CONCLUSIONS In this paper, we present a process for the application of gamification that includes characterizing what was applied in a standardized way and identifying the underlying mechanisms that are targeted. Typical gamification elements such as points and scoring and rewards and prizes target motivation in an extrinsic fashion. In this work, it was found that modifications suggested by end users resulted in the inclusion of gamification elements less commonly observed and that tend to focus more on individual ability. It was found that the incorporation of end-user feedback can lead to the application of gamification in broader ways, with the identification of elements that are potentially better suited for mental health domains.
- 15 April 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessConsidering Theory-Based Gamification in the Co-Design and Development of a Virtual Reality Cognitive Remediation Intervention for Depression (bWell-D): Mixed Methods Study (Preprint)
BACKGROUND In collaboration with clinical domain experts, we developed a prototype of immersive virtual reality (VR) cognitive remediation for major depressive disorder (bWell-D). In the development of a new digital intervention, there is a need to determine the effective components and clinical relevance using systematic methodologies. From an implementation perspective, the effectiveness of digital intervention delivery is challenged by low uptake and high noncompliance rates. Gamification may play a role in addressing this as it can boost adherence. However, careful consideration is required in its application to promote user motivation intrinsically. OBJECTIVE We aimed to address these challenges through an iterative process for development that involves co-design for developing content as well as in the application of gamification while also taking into consideration behavior change theories. This effort followed the methodological framework guidelines outlined by an international working group for development of VR therapies. METHODS In previously reported work, we collected qualitative data from patients and care providers to understand end-user perceptions on the use of VR technologies for cognitive remediation, reveal insights on the drivers for behavior change, and obtain suggestions for changes specific to the VR program. In this study, we translated these findings into concrete representative software functionalities or features and evaluated them against behavioral theories to characterize gamification elements in terms of factors that drive behavior change and intrinsic engagement, which is of particular importance in the context of cognitive remediation. The implemented changes were formally evaluated through user trials. RESULTS The results indicated that feedback from end users centered on using gamification to add artificial challenges, personalization and customization options, and artificial assistance while focusing on capability as the behavior change driver. It was also found that, in terms of promoting intrinsic engagement, the need to meet competence was most frequently raised. In user trials, bWell-D was well tolerated, and preliminary results suggested an increase in user experience ratings with high engagement reported throughout a 4-week training program. CONCLUSIONS In this paper, we present a process for the application of gamification that includes characterizing what was applied in a standardized way and identifying the underlying mechanisms that are targeted. Typical gamification elements such as points and scoring and rewards and prizes target motivation in an extrinsic fashion. In this work, it was found that modifications suggested by end users resulted in the inclusion of gamification elements less commonly observed and that tend to focus more on individual ability. It was found that the incorporation of end-user feedback can lead to the application of gamification in broader ways, with the identification of elements that are potentially better suited for mental health domains.
- Open Access
- 25 December 2023
- Published by Wiley in Alzheimer's & Dementia
- Vol. 19 (S24)
The influence of auditory change on cognitive processes associated with aging in virtual reality
Background: With increased age, older adults experience subtle changes in their cognitive functioning. For example, it is well established that our ability to complete dual‐tasking activities decreases with increased age and cognitive decline. One issue with current dual‐task paradigms is the lack of ecological value in lab‐based environments. The present study employed working memory (WM) tasks designed within an immersive and interactive virtual reality (VR) environment by the National Research Council Canada, to examine the processing of unattended input using event‐related potentials (ERPs) which measure the changes in the electrical activity of the brain.Method: Twenty young adults (ages 17‐30) and twenty healthy older adults (ages 65+) were recruited from the Rotman Research Institute. Participants were engaged in a VR‐WM task while to‐be‐ignored auditory stimuli were presented. The difficulty of the VR tasks was designed to be either very easy or very difficult. Auditory stimulus with an average intensity of 60‐90 dB SPL were presented in a fast (low saliency) and a slow (high saliency) presentation rate.Result: During the VR task, young adults’ accuracy was significantly higher in the easy condition than in the difficult condition (p < .001). When auditory stimuli were presented rapidly, a robust ERP was elicited at the frontal (p = 0.005) and central (p = 0.003) brain regions. The slowly presented auditory stimulus elicited a robust ERP at the central brain region (p = 0.003). Preliminary data indicates that accuracy was lower in older adults than young adults for both conditions. Older adults also had lower accuracy in the hard condition than in the easy condition.Conclusion: The ERPs examined here show that participants were able to successfully switch processing priorities away from the VR‐WM task to salient auditory stimulus, but that older adults were less efficient than younger adults. These tools (VR, auditory stimuli, and ERPs) may be useful at detecting subtle electrophysiological and cognitive changes that occur with age and cognitive decline. They may offer promise to identify the pathology underlying cognitive impairment in aging and could reveal the electrophysiological changes associated with conversion to dementia at an individual level in clinical and non‐clinical settings.
- 25 December 2023
- Published by Wiley in Alzheimer's & Dementia
- Vol. 19 (S24)
Open AccessThe influence of auditory change on cognitive processes associated with aging in virtual reality
Background: With increased age, older adults experience subtle changes in their cognitive functioning. For example, it is well established that our ability to complete dual‐tasking activities decreases with increased age and cognitive decline. One issue with current dual‐task paradigms is the lack of ecological value in lab‐based environments. The present study employed working memory (WM) tasks designed within an immersive and interactive virtual reality (VR) environment by the National Research Council Canada, to examine the processing of unattended input using event‐related potentials (ERPs) which measure the changes in the electrical activity of the brain.Method: Twenty young adults (ages 17‐30) and twenty healthy older adults (ages 65+) were recruited from the Rotman Research Institute. Participants were engaged in a VR‐WM task while to‐be‐ignored auditory stimuli were presented. The difficulty of the VR tasks was designed to be either very easy or very difficult. Auditory stimulus with an average intensity of 60‐90 dB SPL were presented in a fast (low saliency) and a slow (high saliency) presentation rate.Result: During the VR task, young adults’ accuracy was significantly higher in the easy condition than in the difficult condition (p < .001). When auditory stimuli were presented rapidly, a robust ERP was elicited at the frontal (p = 0.005) and central (p = 0.003) brain regions. The slowly presented auditory stimulus elicited a robust ERP at the central brain region (p = 0.003). Preliminary data indicates that accuracy was lower in older adults than young adults for both conditions. Older adults also had lower accuracy in the hard condition than in the easy condition.Conclusion: The ERPs examined here show that participants were able to successfully switch processing priorities away from the VR‐WM task to salient auditory stimulus, but that older adults were less efficient than younger adults. These tools (VR, auditory stimuli, and ERPs) may be useful at detecting subtle electrophysiological and cognitive changes that occur with age and cognitive decline. They may offer promise to identify the pathology underlying cognitive impairment in aging and could reveal the electrophysiological changes associated with conversion to dementia at an individual level in clinical and non‐clinical settings.
- Open Access
- 7 April 2023
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 11 (1) , e43904
Co-design of a Virtual Reality Cognitive Remediation Program for Depression (bWell-D) With Patient End Users and Clinicians: Qualitative Interview Study Among Patients and Clinicians
Background: Major depressive disorder (MDD) is the leading cause of global disability; however, the existing treatments do not always address cognitive dysfunction—a core feature of MDD. Immersive virtual reality (VR) has emerged as a promising modality to enhance the real-world effectiveness of cognitive remediation. Objective: This study aimed to develop the first prototype VR cognitive remediation program for MDD (“bWell-D”). This study gathered qualitative data from end users early in the design process to enhance its efficacy and feasibility in clinical settings. Methods: Semistructured end-user interviews were conducted remotely (n=15 patients and n=12 clinicians), assessing the participants’ perceptions and goals for a VR cognitive remediation program. Video samples of bWell-D were also shared to obtain feedback regarding the program. The interviews were transcribed, coded, and analyzed via thematic analysis. Results: End users showed an optimistic outlook toward VR as a treatment modality, and perceived it as a novel approach with the potential of having multiple applications. The participants expressed a need for an engaging VR treatment that included realistic and multisensorial settings and activities, as well as customizable features. Some skepticism regarding its effectiveness was also reported, especially when the real-world applications of the practiced skills were not made explicit, as well as some concerns regarding equipment accessibility. A home-based or hybrid (ie, home and clinic) treatment modality was preferred. Conclusions: Patients and clinicians considered bWell-D interesting, acceptable, and potentially feasible, and provided suggestions to enhance its real-world applicability. The inclusion of end-user feedback is encouraged when developing future VR programs for clinical purposes.
- 7 April 2023
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 11 (1) , e43904
Open AccessCo-design of a Virtual Reality Cognitive Remediation Program for Depression (bWell-D) With Patient End Users and Clinicians: Qualitative Interview Study Among Patients and Clinicians
Background: Major depressive disorder (MDD) is the leading cause of global disability; however, the existing treatments do not always address cognitive dysfunction—a core feature of MDD. Immersive virtual reality (VR) has emerged as a promising modality to enhance the real-world effectiveness of cognitive remediation. Objective: This study aimed to develop the first prototype VR cognitive remediation program for MDD (“bWell-D”). This study gathered qualitative data from end users early in the design process to enhance its efficacy and feasibility in clinical settings. Methods: Semistructured end-user interviews were conducted remotely (n=15 patients and n=12 clinicians), assessing the participants’ perceptions and goals for a VR cognitive remediation program. Video samples of bWell-D were also shared to obtain feedback regarding the program. The interviews were transcribed, coded, and analyzed via thematic analysis. Results: End users showed an optimistic outlook toward VR as a treatment modality, and perceived it as a novel approach with the potential of having multiple applications. The participants expressed a need for an engaging VR treatment that included realistic and multisensorial settings and activities, as well as customizable features. Some skepticism regarding its effectiveness was also reported, especially when the real-world applications of the practiced skills were not made explicit, as well as some concerns regarding equipment accessibility. A home-based or hybrid (ie, home and clinic) treatment modality was preferred. Conclusions: Patients and clinicians considered bWell-D interesting, acceptable, and potentially feasible, and provided suggestions to enhance its real-world applicability. The inclusion of end-user feedback is encouraged when developing future VR programs for clinical purposes.