Tobias Langlotz
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Tobias Langlotz has a total of 145 co-authors. Here are the top co-authors by number of shared publications:
Dieter Schmalstieg
Graz University of Technology., Austria
12 shared publications- Holger Regenbrecht
School of Computing, University of Otago, Dunedin, New Zealand
12 shared publications Stefanie Zollmann
Dept. of Computer Science, University of Otago, Dunedin, New Zealand
10 shared publicationsHolger Regenbrecht
University of Otago, Dunedin, New Zealand
9 shared publications- Stefanie Zollmann
Computer Science, Aarhus University, Aarhus, Denmark
8 shared publications - Mark Billinghurst
Auckland Bioengineering Institute, The University of Auckland
7 shared publications
Latest Publications
- Open Access
- 15 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Augmented Reality-based Training for Casual Sports
- 15 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-5
Open AccessAugmented Reality-based Training for Casual Sports
- Open Access
- 25 February 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 33 (1) , 1-47
Understanding Freehand Cursorless Pointing Variability and Its Impact on Selection Performance
Freehand pointing is a fundamental gesture commonly used for cursorless interactions. Prior work in HCI often elicits the same pointing behaviour—facing the target with an outstretched dominant arm and index finger. However, freehand pointing outside of HCI shows more variability across hand pose, usage, and coordination with gaze. To understand what variability exists and how it affects pointing performance, we collected data (N = 23) using a hybrid motion capture system. To elicit a wide variety of pointing behaviours, we included different levels of user effort and attention, as well as the widest range of target placements studied. We systematically characterised and described three distinct pointing behaviours, each with three different traits, ranging from accurate stereotypical pointing observed in prior works to more casual hip fire-style pointing. Our analysis demonstrates how different pointing behaviours affect pointing performance and highlights their importance when designing interactive systems for more naturalistic freehand pointing.
- 25 February 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 33 (1) , 1-47
Open AccessUnderstanding Freehand Cursorless Pointing Variability and Its Impact on Selection Performance
Freehand pointing is a fundamental gesture commonly used for cursorless interactions. Prior work in HCI often elicits the same pointing behaviour—facing the target with an outstretched dominant arm and index finger. However, freehand pointing outside of HCI shows more variability across hand pose, usage, and coordination with gaze. To understand what variability exists and how it affects pointing performance, we collected data (N = 23) using a hybrid motion capture system. To elicit a wide variety of pointing behaviours, we included different levels of user effort and attention, as well as the widest range of target placements studied. We systematically characterised and described three distinct pointing behaviours, each with three different traits, ranging from accurate stereotypical pointing observed in prior works to more casual hip fire-style pointing. Our analysis demonstrates how different pointing behaviours affect pointing performance and highlights their importance when designing interactive systems for more naturalistic freehand pointing.
- Open Access
- 6 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (11) , 9603-9613
See what I Mean? Mobile Eye-Perspective Rendering for Optical See-Through Head-Mounted Displays
Image-based scene understanding allows Augmented Reality (AR) systems to provide contextual visual guidance in unprepared, real-world environments. While effective on video see-through (VST) head-mounted displays (HMDs), such methods suffer on optical see-through (OST) HMDs due to misregistration between the world-facing camera and the user's eye perspective. To approximate the user's true eye view, we implement and evaluate three software-based eye-perspective rendering (EPR) techniques on a commercially available, untethered OST HMD (Microsoft HoloLens 2): (1) Plane-Proxy EPR, projecting onto a fixed-distance plane; (2) Mesh-Proxy EPR, using SLAM-based reconstruction for projection; and (3) Gaze-Proxy EPR, a novel eye-tracking-based method that aligns the projection with the user's gaze depth. A user study on real-world tasks underscores the importance of accurate EPR and demonstrates gaze-proxy as a lightweight alternative to geometry-based methods. We release our EPR framework as open source.
- 6 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (11) , 9603-9613
Open AccessSee what I Mean? Mobile Eye-Perspective Rendering for Optical See-Through Head-Mounted Displays
Image-based scene understanding allows Augmented Reality (AR) systems to provide contextual visual guidance in unprepared, real-world environments. While effective on video see-through (VST) head-mounted displays (HMDs), such methods suffer on optical see-through (OST) HMDs due to misregistration between the world-facing camera and the user's eye perspective. To approximate the user's true eye view, we implement and evaluate three software-based eye-perspective rendering (EPR) techniques on a commercially available, untethered OST HMD (Microsoft HoloLens 2): (1) Plane-Proxy EPR, projecting onto a fixed-distance plane; (2) Mesh-Proxy EPR, using SLAM-based reconstruction for projection; and (3) Gaze-Proxy EPR, a novel eye-tracking-based method that aligns the projection with the user's gaze depth. A user study on real-world tasks underscores the importance of accurate EPR and demonstrates gaze-proxy as a lightweight alternative to geometry-based methods. We release our EPR framework as open source.
- Open Access
See What I Mean? Mobile Eye-Perspective Rendering for Optical See-through Head-mounted Displays
Image-based scene understanding allows Augmented Reality systems to provide contextual visual guidance in unprepared, real-world environments. While effective on video see-through (VST) head-mounted displays (HMDs), such methods suffer on optical see-through (OST) HMDs due to misregistration between the world-facing camera and the user's eye perspective. To approximate the user's true eye view, we implement and evaluate three software-based eye-perspective rendering (EPR) techniques on a commercially available, untethered OST HMD (Microsoft HoloLens 2): (1) Plane-Proxy EPR, projecting onto a fixed-distance plane; (2) Mesh-Proxy EPR, using SLAM-based reconstruction for projection; and (3) Gaze-Proxy EPR, a novel eye-tracking-based method that aligns the projection with the user's gaze depth. A user study on real-world tasks underscores the importance of accurate EPR and demonstrates gaze-proxy as a lightweight alternative to geometry-based methods. We release our EPR framework as open source.
Open AccessSee What I Mean? Mobile Eye-Perspective Rendering for Optical See-through Head-mounted Displays
Image-based scene understanding allows Augmented Reality systems to provide contextual visual guidance in unprepared, real-world environments. While effective on video see-through (VST) head-mounted displays (HMDs), such methods suffer on optical see-through (OST) HMDs due to misregistration between the world-facing camera and the user's eye perspective. To approximate the user's true eye view, we implement and evaluate three software-based eye-perspective rendering (EPR) techniques on a commercially available, untethered OST HMD (Microsoft HoloLens 2): (1) Plane-Proxy EPR, projecting onto a fixed-distance plane; (2) Mesh-Proxy EPR, using SLAM-based reconstruction for projection; and (3) Gaze-Proxy EPR, a novel eye-tracking-based method that aligns the projection with the user's gaze depth. A user study on real-world tasks underscores the importance of accurate EPR and demonstrates gaze-proxy as a lightweight alternative to geometry-based methods. We release our EPR framework as open source.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Virtual Voyages: Evaluating the Role of Real-Time and Narrated Virtual Tours in Shaping User Experience and Memories
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-19
Open AccessVirtual Voyages: Evaluating the Role of Real-Time and Narrated Virtual Tours in Shaping User Experience and Memories
- Open Access
- 30 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 59-73
What you see is (not necessarily) what I see – Pervasive AR for Public Displays
- 30 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 59-73
Open AccessWhat you see is (not necessarily) what I see – Pervasive AR for Public Displays
- Open Access
- 30 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 752-759
Exploring Eye Visibility and Mutual Gaze in Augmented Reality Glasses
- 30 November 2024
- Published by Association for Computing Machinery (ACM)
- p. 752-759
Open AccessExploring Eye Visibility and Mutual Gaze in Augmented Reality Glasses
- Open Access
Semantics-Controlled Gaussian Splatting for Outdoor Scene Reconstruction and Rendering in Virtual Reality
Advancements in 3D rendering like Gaussian Splatting (GS) allow novel view synthesis and real-time rendering in virtual reality (VR). However, GS-created 3D environments are often difficult to edit. For scene enhancement or to incorporate 3D assets, segmenting Gaussians by class is essential. Existing segmentation approaches are typically limited to certain types of scenes, e.g., ''circular'' scenes, to determine clear object boundaries. However, this method is ineffective when removing large objects in non-''circling'' scenes such as large outdoor scenes. We propose Semantics-Controlled GS (SCGS), a segmentation-driven GS approach, enabling the separation of large scene parts in uncontrolled, natural environments. SCGS allows scene editing and the extraction of scene parts for VR. Additionally, we introduce a challenging outdoor dataset, overcoming the ''circling'' setup. We outperform the state-of-the-art in visual quality on our dataset and in segmentation quality on the 3D-OVS dataset. We conducted an exploratory user study, comparing a 360-video, plain GS, and SCGS in VR with a fixed viewpoint. In our subsequent main study, users were allowed to move freely, evaluating plain GS and SCGS. Our main study results show that participants clearly prefer SCGS over plain GS. We overall present an innovative approach that surpasses the state-of-the-art both technically and in user experience.
Open AccessSemantics-Controlled Gaussian Splatting for Outdoor Scene Reconstruction and Rendering in Virtual Reality
Advancements in 3D rendering like Gaussian Splatting (GS) allow novel view synthesis and real-time rendering in virtual reality (VR). However, GS-created 3D environments are often difficult to edit. For scene enhancement or to incorporate 3D assets, segmenting Gaussians by class is essential. Existing segmentation approaches are typically limited to certain types of scenes, e.g., ''circular'' scenes, to determine clear object boundaries. However, this method is ineffective when removing large objects in non-''circling'' scenes such as large outdoor scenes. We propose Semantics-Controlled GS (SCGS), a segmentation-driven GS approach, enabling the separation of large scene parts in uncontrolled, natural environments. SCGS allows scene editing and the extraction of scene parts for VR. Additionally, we introduce a challenging outdoor dataset, overcoming the ''circling'' setup. We outperform the state-of-the-art in visual quality on our dataset and in segmentation quality on the 3D-OVS dataset. We conducted an exploratory user study, comparing a 360-video, plain GS, and SCGS in VR with a fixed viewpoint. In our subsequent main study, users were allowed to move freely, evaluating plain GS and SCGS. Our main study results show that participants clearly prefer SCGS over plain GS. We overall present an innovative approach that surpasses the state-of-the-art both technically and in user experience.
- Open Access
- 21 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Train Me: Exploring Mobile Sports Capture and Replay for Immersive Sports Coaching
In recent years, a wide variety of instructional materials and applications have been developed to enhance athletes’ learning in different sports. The amount of instructional videos, in particular, has increased significantly, though these often impose a high cognitive load as users must map displayed instructions to their actions and body movements. Mobile Augmented Reality (AR) interfaces can reduce this burden by presenting instructional information directly where it is needed. This paper explores a mobile sports capture and replay approach for immersive self-training, aiming to help users improve their skills without needing coaches on-site. We investigate different capturing methods, including an Exocentric capturing method, to enhance instructor mobility and flexibility. Using the captured data, we visualize sports training instructions in an immersive 3D environment on an AR headset. We propose three visualization methods and create a first prototype that allows us to explore the approach’s feasibility across different sports.
- 21 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessTrain Me: Exploring Mobile Sports Capture and Replay for Immersive Sports Coaching
In recent years, a wide variety of instructional materials and applications have been developed to enhance athletes’ learning in different sports. The amount of instructional videos, in particular, has increased significantly, though these often impose a high cognitive load as users must map displayed instructions to their actions and body movements. Mobile Augmented Reality (AR) interfaces can reduce this burden by presenting instructional information directly where it is needed. This paper explores a mobile sports capture and replay approach for immersive self-training, aiming to help users improve their skills without needing coaches on-site. We investigate different capturing methods, including an Exocentric capturing method, to enhance instructor mobility and flexibility. Using the captured data, we visualize sports training instructions in an immersive 3D environment on an AR headset. We propose three visualization methods and create a first prototype that allows us to explore the approach’s feasibility across different sports.
- Open Access
- 21 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Exploring Visual Discomfort and Opportunities for Vision Augmentations: Visual Noise Cancellation and Head-worn LCD Light Actuators for Perception Modulation
Recently, Head-Mounted Displays have shown great potential for augmenting vision beyond traditional visual aids, such as compensating for complex visual impairments or providing superhuman vision to the unimpaired eye. Example applications addressed colour vision deficiency or emphasised visual cues for people with low vision. However, Visual Discomfort or Visual Noise and how to address it in vision augmentations are less explored, which is surprising given that acoustic noise control or cancellation is widely applied in modern audio headphones. In my PhD, we explore the area of Visual Noise and Discomfort through a series of studies. Specifically, we explore the general problem of what represents Visual Discomfort and Visual Noise, prototypically explore the first prototypes to receive feedback on the concept of Visual Noise cancellation, including novel prototypes for vision augmentation using LCD light actuators, also review the literature for the current state of vision augmentation.
- 21 September 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessExploring Visual Discomfort and Opportunities for Vision Augmentations: Visual Noise Cancellation and Head-worn LCD Light Actuators for Perception Modulation
Recently, Head-Mounted Displays have shown great potential for augmenting vision beyond traditional visual aids, such as compensating for complex visual impairments or providing superhuman vision to the unimpaired eye. Example applications addressed colour vision deficiency or emphasised visual cues for people with low vision. However, Visual Discomfort or Visual Noise and how to address it in vision augmentations are less explored, which is surprising given that acoustic noise control or cancellation is widely applied in modern audio headphones. In my PhD, we explore the area of Visual Noise and Discomfort through a series of studies. Specifically, we explore the general problem of what represents Visual Discomfort and Visual Noise, prototypically explore the first prototypes to receive feedback on the concept of Visual Noise cancellation, including novel prototypes for vision augmentation using LCD light actuators, also review the literature for the current state of vision augmentation.