AVAmitabh Varshney

Amitabh Varshney

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Amitabh Varshney has a total of 87 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Quantifying and characterizing vergence-accommodation-conflict-induced cybersickness in immersive environments

    by Mattie Johnson, Sujal Bista, Sida Li, Jonathan Heagerty, Ryan Beams, Barbara Brawn, Hiroshi Mukawa, Amitabh Varshney

    A significant challenge to the widespread adoption of virtual reality (VR) and augmented reality (AR) environments is cybersickness, which affects a majority of users. With symptoms such as headache, nausea, and blurred vision, cybersickness disrupts the illusion of presence in a virtual environment. Understanding this phenomenon is imperative to democratizing the accessibility and use of this powerful technology. Different visual stimuli induce cybersickness in distinct ways. The psychophysical differences between cybersicknesses induced by distinct sources are largely unknown. Vergence-accommodation conflict (VAC) is believed to contribute to cybersickness. In this paper, we present a systematic user study that specifically analyzes VAC-induced cybersickness. We initiate VAC in a sample of 40 participants by displaying a dynamic sphere that moves in and out of the Zone of Comfort—the region near the focal plane where VAC is minimal. We present evidence for a real-time quantitative measure of VAC-induced cybersickness based on electroencephalogram data. Our findings provide statistically significant evidence that participants exposed to our VAC-inducing condition exhibit decreased beta and gamma spectral power in component clusters with anterior dipole centroids and reduced theta power in clusters with posterior centroids. We present these as candidate correlates rather than a VAC-specific signature because the eyes-open baseline does not match the VAC scene conditions and residual ocular and muscle contributions cannot be fully excluded. We anticipate that this work will lead to the development of strategies to monitor and mitigate VAC-induced cybersickness in virtual environments to improve user experiences and increase adoption of VR and AR.

  • Open Access

    SIA: A Framework for Context-Aware Intent Clarification in Speech-Driven Immersive Analytics

    by Hyemi Song, Kirsten Whitley, Eric Krokos, Amitabh Varshney

    The rise of generative AI has increased attention to voice interfaces. In immersive analytics, we conceptualize this trend as Speech-driven Immersive Analytics. While speech interfaces enable natural interactions, users, especially novices, still face a learning curve in articulating analytic intent and exploring data during the foraging phase. Prior work has primarily addressed these challenges through multimodal interaction or textual disambiguation. We introduce a context-aware Speech-driven Immersive Analytics framework (SIA) as a speech-oriented approach that leverages speech acts to convey actionable intent. This framework (SIA) was designed based on a formative study, a prototype development, three technical studies, and a user study. By extracting speech acts from utterances, SIA infers analytic tasks and embodiment tendencies, then integrates them with spatial, chart, and data context to generate feedforward: previews of potential actions and outcomes. The formative study identified user needs. The technical studies demonstrated that SIA improved the inference quality, enabling context-aware feedforward generation. The user study highlighted that the SIA-based prototype was responsive and intuitive, and feedforward helped users learn during the onboarding phase of data exploration. In particular, the user study identified which feedforward elements participants referenced and how they applied them when expressing intent in immersive analytics. Our key technical findings emphasize that the ensemble model, embedded in the Uncertainty Estimator, improves accuracy and stabilizes task inference. The Projector’s context summary was critical in generating context-aware feedforward. Based on these results, we discuss future research directions for intelligent Speech-driven Immersive Analytics.

  • Open Access

    Assessing the Scalability of Immersive WiFi Visualizations

    by Alexander Rowden, Eric Krokos, Kirsten Whitley, Amitabh Varshney

    Current commercial applications for visualizing WiFi data often provide limited capabilities. Few existing models effectively present multiple routers within an environmental context while simultaneously conveying signal strength and channel frequency information. However, recent academic studies have proposed visualizations that can. These novel visualizations are effective for analytical tasks in small data sets. However, their ability to help users with larger datasets has not yet been demonstrated. This work identifies Contour Lines, Wavelines, and Stacked Bars as three promising visualizations for immersive WiFi signal visualization. We tested their performance when representing networks with 10, 25, and 40 routers through an analytical user study.

  • Open Access

    Effects of childhood adversity on socially learned placebo analgesia in virtual reality: A cross-sectional study

    by Lakota Watson, Yang Wang, Jewel Nuru White, Roni Shafir, Giancarlo Colloca, Jonathan Michael Heagerty, Sida Li, Barbara Brawn, Amitabh Varshney, Shuo Chen, et al.

    Early life adversity (ELA), indexed through Adverse Childhood Experiences (ACEs), is associated with long-term alterations in emotion regulation, stress responsivity, and social learning—factors that may shape learned pain modulation. Social observation in immersive virtual environments offers a powerful way to investigate these mechanisms. To examine whether ELA influences social observation-induced placebo analgesia and empathy responses in immersive and non-immersive contexts. Adults with self-reported low versus high ACE exposure completed an observational learning task in immersive virtual reality (VR) or a non-immersive format. Participants observed Human or Avatar demonstrators experiencing pain relief and then underwent self-pain testing. Measures included socially induced placebo analgesia and affective and cognitive components of state empathy. Individuals with high ACE exposure showed stronger social observation-induced placebo analgesia, particularly within immersive VR. High ACE participants exhibited reduced affective state empathy, while cognitive empathy remained comparable to the low ACE group. Elevated ELA is unexpectedly associated with enhanced responsiveness to socially learned placebo analgesia, especially in immersive VR settings. These findings highlight how early adversity may shape sensitivity to socially transmitted treatment cues, with implications for the design of VR-based therapeutic interventions.

  • Embodied Natural Language Interaction (NLI): Speech Input Patterns in Immersive Analytics

    by Hyemi Song, Matthew Johnson, Kirsten Whitley, Eric Krokos, Amitabh Varshney

    Embodiment shapes how users verbally express intent when interacting with data through speech interfaces in immersive analytics. Despite growing interest in Natural Language Interactions (NLIs) for visual analytics in immersive environments, users' speech patterns and their use of embodiment cues in speech remain underexplored. Understanding their interplay is crucial to bridging the gap between users' intent and an immersive analytic system. To address this, we report the results from 15 participants in a user study conducted using the Wizard of Oz method. We performed axial coding on 1,280 speech acts derived from 734 utterances, examining how analysis tasks are carried out with embodiment and linguistic features. Next, we measured Speech Input Uncertainty for each analysis task using the semantic entropy of utterances, estimating how uncertain users' speech inputs appear to an analytic system. Through these analyses, we identified five speech input patterns, showing that users dynamically blend embodied and non-embodied speech acts depending on data analysis tasks, phases, and Embodiment Reliance driven by the counts and types of embodiment cues in each utterance. We then examined how these patterns align with user reflections on factors that challenge speech interaction during the study. Finally, we propose design implications aligned with the five patterns.


  • Open Access

    Detecting and Monitoring Bias for Subgroups in Breast Cancer Detection AI

    by Amit Kumar Kundu, Florence X. Doo, Vaishnavi Patil, Amitabh Varshney, Joseph Jaja

    Automated mammography screening plays an important role in early breast cancer detection. However, current machine learning models, developed on some training datasets, may exhibit performance degradation and bias when deployed in real-world settings. In this paper, we analyze the performance of high-performing AI models on two mammography datasets-the Emory Breast Imaging Dataset (EMBED) and the RSNA 2022 challenge dataset. Specifically, we evaluate how these models perform across different subgroups, defined by six attributes, to detect potential biases using a range of classification metrics. Our analysis identifies certain subgroups that demonstrate notable underperformance, highlighting the need for ongoing monitoring of these subgroups' performance. To address this, we adopt a monitoring method designed to detect performance drifts over time. Upon identifying a drift, this method issues an alert, which can enable timely interventions. This approach not only provides a tool for tracking the performance but also helps ensure that AI models continue to perform effectively across diverse populations.


  • Open Access

    Instant-SFH: Non-Iterative Sparse Fourier Holograms Using Perlin Noise

    by David Li, Susmija Jabbireddy, Yang Zhang, Christopher Metzler, Amitabh Varshney

    Holographic displays are an upcoming technology for AR and VR applications, with the ability to show 3D content with accurate depth cues, including accommodation and motion parallax. Recent research reveals that only a fraction of holographic pixels are needed to display images with high fidelity, improving energy efficiency in future holographic displays. However, the existing iterative method for computing sparse amplitude and phase layouts does not run in real time; instead, it takes hundreds of milliseconds to render an image into a sparse hologram. In this paper, we present a non-iterative amplitude and phase computation for sparse Fourier holograms that uses Perlin noise in the image–plane phase. We conduct simulated and optical experiments. Compared to the Gaussian-weighted Gerchberg–Saxton method, our method achieves a run time improvement of over 600 times while producing a nearly equal PSNR and SSIM quality. The real-time performance of our method enables the presentation of dynamic content crucial to AR and VR applications, such as video streaming and interactive visualization, on holographic displays.


  • Role of eXtended Reality use in medical imaging interpretation for pre-surgical planning and intraoperative augmentation

    by Taylor Kantor, Prashant Mahajan, Sarah Murthi, Candice Stegink, Barbara Brawn, Amitabh Varshney, Rishindra M. Reddy

    PurposeeXtended Reality (XR) technology, including virtual reality (VR), augmented reality (AR), and mixed reality (MR), is a growing field in healthcare. Each modality offers unique benefits and drawbacks for medical education, simulation, and clinical care. We review current studies to understand how XR technology uses medical imaging to enhance surgical diagnostics, planning, and performance. We also highlight current limitations and future directions.ApproachWe reviewed the literature on immersive XR technologies for surgical planning and intraoperative augmentation, excluding studies on telemedicine and 2D video–based training. We cited publications highlighting XR’s advantages and limitations in these categories.ResultsA review of 556 papers on XR for medical imaging in surgery yielded 155 relevant papers reviewed utilizing the aid of chatGPT. XR technology may improve procedural times, reduce errors, and enhance surgical workflows. It aids in preoperative planning, surgical navigation, and real-time data integration, improving surgeon ergonomics and enabling remote collaboration. However, adoption faces challenges such as high costs, infrastructure needs, and regulatory hurdles. Despite these, XR shows significant potential in advancing surgical care.ConclusionsImmersive technologies in healthcare enhance visualization and understanding of medical conditions, promising better patient outcomes and innovative treatments but face adoption challenges such as cost, technological constraints, and regulatory hurdles. Addressing these requires strategic collaborations and improvements in image quality, hardware, integration, and training.


  • Open Access

    Quantifying the optical and rendering pipeline contributions to spatial resolution in augmented reality displays

    by Matthew Johnson, Chumin Zhao, Amitabh Varshney, Ryan Beams

    The measured spatial resolution of augmented reality head‐mounted displays (AR HMDs) is determined by three components: optics, display, and the rendering pipeline, which includes the anti‐aliasing method. Therefore, separating and quantifying the contributions from these components is necessary for evaluating the spatial resolution of AR HMDs. We demonstrate a method for quantifying the contributions from the optical performance and the rendering pipeline on the spatial resolution of AR HMD using point‐spread function (PSF) analysis. In this method, an imaging photometer captures a series of rendered scenes on the AR HMD that consist of arrays of spheres of increasing sizes with different anti‐aliasing (AA) methods. The contributions from the optics, display, and anti‐aliasing methods can be separated, and we find that temporal anti‐aliasing (TAA) and multisample anti‐aliasing (MSAA) are in good agreement with the performance of no AA. However, fast approximate anti‐aliasing (FXAA) results in decreased luminance for smaller rendered targets and a different spatial resolution for larger targets. Finally, we repeated our methods on multiple HMDs and characterized the dependence of the spatial resolution across the field of view. These measurements show significant non‐uniformity in the optical contribution to the spatial resolution.