Amitabh Varshney
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Amitabh Varshney has a total of 87 co-authors. Here are the top co-authors by number of shared publications:
- Eric Krokos
Department of Defense, Washington, DC, USA
4 shared publications - Kirsten Whitley
Department of Defense, Washington, DC, USA
4 shared publications - Brandon Yushan Feng
Department of Computer Science, University of Maryland, College Park, MD 20742 USA
3 shared publications - David Li
XR Labs, Google, San Jose, California, USA
3 shared publications - Matthew Johnson
Computer Science Department, University of Maryland, College Park, USA
3 shared publications - Alexander Rowden
Government of the United States of America
2 shared publications
Latest Publications
- Open Access
- 25 September 2026
- Published by Springer Nature in Virtual Reality
Quantifying and characterizing vergence-accommodation-conflict-induced cybersickness in immersive environments
A significant challenge to the widespread adoption of virtual reality (VR) and augmented reality (AR) environments is cybersickness, which affects a majority of users. With symptoms such as headache, nausea, and blurred vision, cybersickness disrupts the illusion of presence in a virtual environment. Understanding this phenomenon is imperative to democratizing the accessibility and use of this powerful technology. Different visual stimuli induce cybersickness in distinct ways. The psychophysical differences between cybersicknesses induced by distinct sources are largely unknown. Vergence-accommodation conflict (VAC) is believed to contribute to cybersickness. In this paper, we present a systematic user study that specifically analyzes VAC-induced cybersickness. We initiate VAC in a sample of 40 participants by displaying a dynamic sphere that moves in and out of the Zone of Comfort—the region near the focal plane where VAC is minimal. We present evidence for a real-time quantitative measure of VAC-induced cybersickness based on electroencephalogram data. Our findings provide statistically significant evidence that participants exposed to our VAC-inducing condition exhibit decreased beta and gamma spectral power in component clusters with anterior dipole centroids and reduced theta power in clusters with posterior centroids. We present these as candidate correlates rather than a VAC-specific signature because the eyes-open baseline does not match the VAC scene conditions and residual ocular and muscle contributions cannot be fully excluded. We anticipate that this work will lead to the development of strategies to monitor and mitigate VAC-induced cybersickness in virtual environments to improve user experiences and increase adoption of VR and AR.
- 25 September 2026
- Published by Springer Nature in Virtual Reality
Open AccessQuantifying and characterizing vergence-accommodation-conflict-induced cybersickness in immersive environments
A significant challenge to the widespread adoption of virtual reality (VR) and augmented reality (AR) environments is cybersickness, which affects a majority of users. With symptoms such as headache, nausea, and blurred vision, cybersickness disrupts the illusion of presence in a virtual environment. Understanding this phenomenon is imperative to democratizing the accessibility and use of this powerful technology. Different visual stimuli induce cybersickness in distinct ways. The psychophysical differences between cybersicknesses induced by distinct sources are largely unknown. Vergence-accommodation conflict (VAC) is believed to contribute to cybersickness. In this paper, we present a systematic user study that specifically analyzes VAC-induced cybersickness. We initiate VAC in a sample of 40 participants by displaying a dynamic sphere that moves in and out of the Zone of Comfort—the region near the focal plane where VAC is minimal. We present evidence for a real-time quantitative measure of VAC-induced cybersickness based on electroencephalogram data. Our findings provide statistically significant evidence that participants exposed to our VAC-inducing condition exhibit decreased beta and gamma spectral power in component clusters with anterior dipole centroids and reduced theta power in clusters with posterior centroids. We present these as candidate correlates rather than a VAC-specific signature because the eyes-open baseline does not match the VAC scene conditions and residual ocular and muscle contributions cannot be fully excluded. We anticipate that this work will lead to the development of strategies to monitor and mitigate VAC-induced cybersickness in virtual environments to improve user experiences and increase adoption of VR and AR.
- 1 May 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet Computing
- Vol. 30 (3) , 94-102
AI-Native Immersive Computing: Toward Scalable, Intelligent, and Trustworthy Digital–Physical Continuums
- 1 May 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet Computing
- Vol. 30 (3) , 94-102
AI-Native Immersive Computing: Toward Scalable, Intelligent, and Trustworthy Digital–Physical Continuums
- Open Access
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 1687-1703
SIA: A Framework for Context-Aware Intent Clarification in Speech-Driven Immersive Analytics
The rise of generative AI has increased attention to voice interfaces. In immersive analytics, we conceptualize this trend as Speech-driven Immersive Analytics. While speech interfaces enable natural interactions, users, especially novices, still face a learning curve in articulating analytic intent and exploring data during the foraging phase. Prior work has primarily addressed these challenges through multimodal interaction or textual disambiguation. We introduce a context-aware Speech-driven Immersive Analytics framework (SIA) as a speech-oriented approach that leverages speech acts to convey actionable intent. This framework (SIA) was designed based on a formative study, a prototype development, three technical studies, and a user study. By extracting speech acts from utterances, SIA infers analytic tasks and embodiment tendencies, then integrates them with spatial, chart, and data context to generate feedforward: previews of potential actions and outcomes. The formative study identified user needs. The technical studies demonstrated that SIA improved the inference quality, enabling context-aware feedforward generation. The user study highlighted that the SIA-based prototype was responsive and intuitive, and feedforward helped users learn during the onboarding phase of data exploration. In particular, the user study identified which feedforward elements participants referenced and how they applied them when expressing intent in immersive analytics. Our key technical findings emphasize that the ensemble model, embedded in the Uncertainty Estimator, improves accuracy and stabilizes task inference. The Projector’s context summary was critical in generating context-aware feedforward. Based on these results, we discuss future research directions for intelligent Speech-driven Immersive Analytics.
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 1687-1703
Open AccessSIA: A Framework for Context-Aware Intent Clarification in Speech-Driven Immersive Analytics
The rise of generative AI has increased attention to voice interfaces. In immersive analytics, we conceptualize this trend as Speech-driven Immersive Analytics. While speech interfaces enable natural interactions, users, especially novices, still face a learning curve in articulating analytic intent and exploring data during the foraging phase. Prior work has primarily addressed these challenges through multimodal interaction or textual disambiguation. We introduce a context-aware Speech-driven Immersive Analytics framework (SIA) as a speech-oriented approach that leverages speech acts to convey actionable intent. This framework (SIA) was designed based on a formative study, a prototype development, three technical studies, and a user study. By extracting speech acts from utterances, SIA infers analytic tasks and embodiment tendencies, then integrates them with spatial, chart, and data context to generate feedforward: previews of potential actions and outcomes. The formative study identified user needs. The technical studies demonstrated that SIA improved the inference quality, enabling context-aware feedforward generation. The user study highlighted that the SIA-based prototype was responsive and intuitive, and feedforward helped users learn during the onboarding phase of data exploration. In particular, the user study identified which feedforward elements participants referenced and how they applied them when expressing intent in immersive analytics. Our key technical findings emphasize that the ensemble model, embedded in the Uncertainty Estimator, improves accuracy and stabilizes task inference. The Projector’s context summary was critical in generating context-aware feedforward. Based on these results, we discuss future research directions for intelligent Speech-driven Immersive Analytics.
- Open Access
- 16 December 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Sensor Networks
- Vol. 22 (5) , 1-17
Assessing the Scalability of Immersive WiFi Visualizations
Current commercial applications for visualizing WiFi data often provide limited capabilities. Few existing models effectively present multiple routers within an environmental context while simultaneously conveying signal strength and channel frequency information. However, recent academic studies have proposed visualizations that can. These novel visualizations are effective for analytical tasks in small data sets. However, their ability to help users with larger datasets has not yet been demonstrated. This work identifies Contour Lines, Wavelines, and Stacked Bars as three promising visualizations for immersive WiFi signal visualization. We tested their performance when representing networks with 10, 25, and 40 routers through an analytical user study.
- 16 December 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Sensor Networks
- Vol. 22 (5) , 1-17
Open AccessAssessing the Scalability of Immersive WiFi Visualizations
Current commercial applications for visualizing WiFi data often provide limited capabilities. Few existing models effectively present multiple routers within an environmental context while simultaneously conveying signal strength and channel frequency information. However, recent academic studies have proposed visualizations that can. These novel visualizations are effective for analytical tasks in small data sets. However, their ability to help users with larger datasets has not yet been demonstrated. This work identifies Contour Lines, Wavelines, and Stacked Bars as three promising visualizations for immersive WiFi signal visualization. We tested their performance when representing networks with 10, 25, and 40 routers through an analytical user study.
- Open Access
Effects of childhood adversity on socially learned placebo analgesia in virtual reality: A cross-sectional study
Early life adversity (ELA), indexed through Adverse Childhood Experiences (ACEs), is associated with long-term alterations in emotion regulation, stress responsivity, and social learning—factors that may shape learned pain modulation. Social observation in immersive virtual environments offers a powerful way to investigate these mechanisms. To examine whether ELA influences social observation-induced placebo analgesia and empathy responses in immersive and non-immersive contexts. Adults with self-reported low versus high ACE exposure completed an observational learning task in immersive virtual reality (VR) or a non-immersive format. Participants observed Human or Avatar demonstrators experiencing pain relief and then underwent self-pain testing. Measures included socially induced placebo analgesia and affective and cognitive components of state empathy. Individuals with high ACE exposure showed stronger social observation-induced placebo analgesia, particularly within immersive VR. High ACE participants exhibited reduced affective state empathy, while cognitive empathy remained comparable to the low ACE group. Elevated ELA is unexpectedly associated with enhanced responsiveness to socially learned placebo analgesia, especially in immersive VR settings. These findings highlight how early adversity may shape sensitivity to socially transmitted treatment cues, with implications for the design of VR-based therapeutic interventions.
Open AccessEffects of childhood adversity on socially learned placebo analgesia in virtual reality: A cross-sectional study
Early life adversity (ELA), indexed through Adverse Childhood Experiences (ACEs), is associated with long-term alterations in emotion regulation, stress responsivity, and social learning—factors that may shape learned pain modulation. Social observation in immersive virtual environments offers a powerful way to investigate these mechanisms. To examine whether ELA influences social observation-induced placebo analgesia and empathy responses in immersive and non-immersive contexts. Adults with self-reported low versus high ACE exposure completed an observational learning task in immersive virtual reality (VR) or a non-immersive format. Participants observed Human or Avatar demonstrators experiencing pain relief and then underwent self-pain testing. Measures included socially induced placebo analgesia and affective and cognitive components of state empathy. Individuals with high ACE exposure showed stronger social observation-induced placebo analgesia, particularly within immersive VR. High ACE participants exhibited reduced affective state empathy, while cognitive empathy remained comparable to the low ACE group. Elevated ELA is unexpectedly associated with enhanced responsiveness to socially learned placebo analgesia, especially in immersive VR settings. These findings highlight how early adversity may shape sensitivity to socially transmitted treatment cues, with implications for the design of VR-based therapeutic interventions.
- 4 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (1) , 1098-1108
Embodied Natural Language Interaction (NLI): Speech Input Patterns in Immersive Analytics
Embodiment shapes how users verbally express intent when interacting with data through speech interfaces in immersive analytics. Despite growing interest in Natural Language Interactions (NLIs) for visual analytics in immersive environments, users' speech patterns and their use of embodiment cues in speech remain underexplored. Understanding their interplay is crucial to bridging the gap between users' intent and an immersive analytic system. To address this, we report the results from 15 participants in a user study conducted using the Wizard of Oz method. We performed axial coding on 1,280 speech acts derived from 734 utterances, examining how analysis tasks are carried out with embodiment and linguistic features. Next, we measured Speech Input Uncertainty for each analysis task using the semantic entropy of utterances, estimating how uncertain users' speech inputs appear to an analytic system. Through these analyses, we identified five speech input patterns, showing that users dynamically blend embodied and non-embodied speech acts depending on data analysis tasks, phases, and Embodiment Reliance driven by the counts and types of embodiment cues in each utterance. We then examined how these patterns align with user reflections on factors that challenge speech interaction during the study. Finally, we propose design implications aligned with the five patterns.
- 4 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (1) , 1098-1108
Embodied Natural Language Interaction (NLI): Speech Input Patterns in Immersive Analytics
Embodiment shapes how users verbally express intent when interacting with data through speech interfaces in immersive analytics. Despite growing interest in Natural Language Interactions (NLIs) for visual analytics in immersive environments, users' speech patterns and their use of embodiment cues in speech remain underexplored. Understanding their interplay is crucial to bridging the gap between users' intent and an immersive analytic system. To address this, we report the results from 15 participants in a user study conducted using the Wizard of Oz method. We performed axial coding on 1,280 speech acts derived from 734 utterances, examining how analysis tasks are carried out with embodiment and linguistic features. Next, we measured Speech Input Uncertainty for each analysis task using the semantic entropy of utterances, estimating how uncertain users' speech inputs appear to an analytic system. Through these analyses, we identified five speech input patterns, showing that users dynamically blend embodied and non-embodied speech acts depending on data analysis tasks, phases, and Embodiment Reliance driven by the counts and types of embodiment cues in each utterance. We then examined how these patterns align with user reflections on factors that challenge speech interaction during the study. Finally, we propose design implications aligned with the five patterns.
- Open Access
Detecting and Monitoring Bias for Subgroups in Breast Cancer Detection AI
Automated mammography screening plays an important role in early breast cancer detection. However, current machine learning models, developed on some training datasets, may exhibit performance degradation and bias when deployed in real-world settings. In this paper, we analyze the performance of high-performing AI models on two mammography datasets-the Emory Breast Imaging Dataset (EMBED) and the RSNA 2022 challenge dataset. Specifically, we evaluate how these models perform across different subgroups, defined by six attributes, to detect potential biases using a range of classification metrics. Our analysis identifies certain subgroups that demonstrate notable underperformance, highlighting the need for ongoing monitoring of these subgroups' performance. To address this, we adopt a monitoring method designed to detect performance drifts over time. Upon identifying a drift, this method issues an alert, which can enable timely interventions. This approach not only provides a tool for tracking the performance but also helps ensure that AI models continue to perform effectively across diverse populations.
Open AccessDetecting and Monitoring Bias for Subgroups in Breast Cancer Detection AI
Automated mammography screening plays an important role in early breast cancer detection. However, current machine learning models, developed on some training datasets, may exhibit performance degradation and bias when deployed in real-world settings. In this paper, we analyze the performance of high-performing AI models on two mammography datasets-the Emory Breast Imaging Dataset (EMBED) and the RSNA 2022 challenge dataset. Specifically, we evaluate how these models perform across different subgroups, defined by six attributes, to detect potential biases using a range of classification metrics. Our analysis identifies certain subgroups that demonstrate notable underperformance, highlighting the need for ongoing monitoring of these subgroups' performance. To address this, we adopt a monitoring method designed to detect performance drifts over time. Upon identifying a drift, this method issues an alert, which can enable timely interventions. This approach not only provides a tool for tracking the performance but also helps ensure that AI models continue to perform effectively across diverse populations.
- Open Access
Instant-SFH: Non-Iterative Sparse Fourier Holograms Using Perlin Noise
Holographic displays are an upcoming technology for AR and VR applications, with the ability to show 3D content with accurate depth cues, including accommodation and motion parallax. Recent research reveals that only a fraction of holographic pixels are needed to display images with high fidelity, improving energy efficiency in future holographic displays. However, the existing iterative method for computing sparse amplitude and phase layouts does not run in real time; instead, it takes hundreds of milliseconds to render an image into a sparse hologram. In this paper, we present a non-iterative amplitude and phase computation for sparse Fourier holograms that uses Perlin noise in the image–plane phase. We conduct simulated and optical experiments. Compared to the Gaussian-weighted Gerchberg–Saxton method, our method achieves a run time improvement of over 600 times while producing a nearly equal PSNR and SSIM quality. The real-time performance of our method enables the presentation of dynamic content crucial to AR and VR applications, such as video streaming and interactive visualization, on holographic displays.
Open AccessInstant-SFH: Non-Iterative Sparse Fourier Holograms Using Perlin Noise
Holographic displays are an upcoming technology for AR and VR applications, with the ability to show 3D content with accurate depth cues, including accommodation and motion parallax. Recent research reveals that only a fraction of holographic pixels are needed to display images with high fidelity, improving energy efficiency in future holographic displays. However, the existing iterative method for computing sparse amplitude and phase layouts does not run in real time; instead, it takes hundreds of milliseconds to render an image into a sparse hologram. In this paper, we present a non-iterative amplitude and phase computation for sparse Fourier holograms that uses Perlin noise in the image–plane phase. We conduct simulated and optical experiments. Compared to the Gaussian-weighted Gerchberg–Saxton method, our method achieves a run time improvement of over 600 times while producing a nearly equal PSNR and SSIM quality. The real-time performance of our method enables the presentation of dynamic content crucial to AR and VR applications, such as video streaming and interactive visualization, on holographic displays.
- 1 November 2024
- Published by SPIE-Intl Soc Optical Eng in Journal of Medical Imaging
- Vol. 11 (06) , 1-12
Role of eXtended Reality use in medical imaging interpretation for pre-surgical planning and intraoperative augmentation
PurposeeXtended Reality (XR) technology, including virtual reality (VR), augmented reality (AR), and mixed reality (MR), is a growing field in healthcare. Each modality offers unique benefits and drawbacks for medical education, simulation, and clinical care. We review current studies to understand how XR technology uses medical imaging to enhance surgical diagnostics, planning, and performance. We also highlight current limitations and future directions.ApproachWe reviewed the literature on immersive XR technologies for surgical planning and intraoperative augmentation, excluding studies on telemedicine and 2D video–based training. We cited publications highlighting XR’s advantages and limitations in these categories.ResultsA review of 556 papers on XR for medical imaging in surgery yielded 155 relevant papers reviewed utilizing the aid of chatGPT. XR technology may improve procedural times, reduce errors, and enhance surgical workflows. It aids in preoperative planning, surgical navigation, and real-time data integration, improving surgeon ergonomics and enabling remote collaboration. However, adoption faces challenges such as high costs, infrastructure needs, and regulatory hurdles. Despite these, XR shows significant potential in advancing surgical care.ConclusionsImmersive technologies in healthcare enhance visualization and understanding of medical conditions, promising better patient outcomes and innovative treatments but face adoption challenges such as cost, technological constraints, and regulatory hurdles. Addressing these requires strategic collaborations and improvements in image quality, hardware, integration, and training.
- 1 November 2024
- Published by SPIE-Intl Soc Optical Eng in Journal of Medical Imaging
- Vol. 11 (06) , 1-12
Role of eXtended Reality use in medical imaging interpretation for pre-surgical planning and intraoperative augmentation
PurposeeXtended Reality (XR) technology, including virtual reality (VR), augmented reality (AR), and mixed reality (MR), is a growing field in healthcare. Each modality offers unique benefits and drawbacks for medical education, simulation, and clinical care. We review current studies to understand how XR technology uses medical imaging to enhance surgical diagnostics, planning, and performance. We also highlight current limitations and future directions.ApproachWe reviewed the literature on immersive XR technologies for surgical planning and intraoperative augmentation, excluding studies on telemedicine and 2D video–based training. We cited publications highlighting XR’s advantages and limitations in these categories.ResultsA review of 556 papers on XR for medical imaging in surgery yielded 155 relevant papers reviewed utilizing the aid of chatGPT. XR technology may improve procedural times, reduce errors, and enhance surgical workflows. It aids in preoperative planning, surgical navigation, and real-time data integration, improving surgeon ergonomics and enabling remote collaboration. However, adoption faces challenges such as high costs, infrastructure needs, and regulatory hurdles. Despite these, XR shows significant potential in advancing surgical care.ConclusionsImmersive technologies in healthcare enhance visualization and understanding of medical conditions, promising better patient outcomes and innovative treatments but face adoption challenges such as cost, technological constraints, and regulatory hurdles. Addressing these requires strategic collaborations and improvements in image quality, hardware, integration, and training.
- Open Access
- 2 June 2024
- Published by Wiley in Journal of the Society for Information Display
- Vol. 32 (8) , 555-567
Quantifying the optical and rendering pipeline contributions to spatial resolution in augmented reality displays
The measured spatial resolution of augmented reality head‐mounted displays (AR HMDs) is determined by three components: optics, display, and the rendering pipeline, which includes the anti‐aliasing method. Therefore, separating and quantifying the contributions from these components is necessary for evaluating the spatial resolution of AR HMDs. We demonstrate a method for quantifying the contributions from the optical performance and the rendering pipeline on the spatial resolution of AR HMD using point‐spread function (PSF) analysis. In this method, an imaging photometer captures a series of rendered scenes on the AR HMD that consist of arrays of spheres of increasing sizes with different anti‐aliasing (AA) methods. The contributions from the optics, display, and anti‐aliasing methods can be separated, and we find that temporal anti‐aliasing (TAA) and multisample anti‐aliasing (MSAA) are in good agreement with the performance of no AA. However, fast approximate anti‐aliasing (FXAA) results in decreased luminance for smaller rendered targets and a different spatial resolution for larger targets. Finally, we repeated our methods on multiple HMDs and characterized the dependence of the spatial resolution across the field of view. These measurements show significant non‐uniformity in the optical contribution to the spatial resolution.
- 2 June 2024
- Published by Wiley in Journal of the Society for Information Display
- Vol. 32 (8) , 555-567
Open AccessQuantifying the optical and rendering pipeline contributions to spatial resolution in augmented reality displays
The measured spatial resolution of augmented reality head‐mounted displays (AR HMDs) is determined by three components: optics, display, and the rendering pipeline, which includes the anti‐aliasing method. Therefore, separating and quantifying the contributions from these components is necessary for evaluating the spatial resolution of AR HMDs. We demonstrate a method for quantifying the contributions from the optical performance and the rendering pipeline on the spatial resolution of AR HMD using point‐spread function (PSF) analysis. In this method, an imaging photometer captures a series of rendered scenes on the AR HMD that consist of arrays of spheres of increasing sizes with different anti‐aliasing (AA) methods. The contributions from the optics, display, and anti‐aliasing methods can be separated, and we find that temporal anti‐aliasing (TAA) and multisample anti‐aliasing (MSAA) are in good agreement with the performance of no AA. However, fast approximate anti‐aliasing (FXAA) results in decreased luminance for smaller rendered targets and a different spatial resolution for larger targets. Finally, we repeated our methods on multiple HMDs and characterized the dependence of the spatial resolution across the field of view. These measurements show significant non‐uniformity in the optical contribution to the spatial resolution.