Mathias N. Lystbæk
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Mathias N. Lystbæk has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Hans Gellersen
Lancaster University, Lancaster, United Kingdom and Aarhus University, Aarhus, Denmark
6 shared publications - Ken Pfeuffer
Department of Computer Science, Aarhus University, Aarhus, Denmark
5 shared publications - Eric J. Gonzalez
Google, Seattle, Washington, USA
2 shared publications - Jens Emil Sloth Grønbæk
Department of Computer Science, Aarhus University, Aarhus, Denmark
2 shared publications - Ludwig Sidenmark
University of Toronto, Toronto, Ontario, Canada
2 shared publications - Mar Gonzalez-Franco
Google, Seattle, Washington, USA
2 shared publications
Latest Publications
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Navig-AI-tion: Navigation by Contextual AI and Spatial Audio
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessNavig-AI-tion: Navigation by Contextual AI and Spatial Audio
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-12
StylusPort: Investigating Teleportation using Stylus in VR
With a stylus, users can both sweep sketches across models and pinpoint locations with precision. Building on this dual capability, we explore how teleportation can be integrated into stylus interaction without disrupting the flow of common stylus usage. We introduce two key ideas: flipping the stylus as an intuitive mode switch between drawing and teleportation, and using gaze to set orientation while the stylus handles positioning. In a user study that features a teleport-and-orient task, we evaluate six teleportation techniques, covering two mode-switching methods (Button and Flip) and three orientation approaches (StylusRoll, StylusPoint, and GazePoint). The results offer new insights into the relative merits and limitations of each technique. Our work contributes to knowledge about teleportation in VR and fills the gap in seamlessly integrating teleportation with stylus use in 3D.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Open AccessStylusPort: Investigating Teleportation using Stylus in VR
With a stylus, users can both sweep sketches across models and pinpoint locations with precision. Building on this dual capability, we explore how teleportation can be integrated into stylus interaction without disrupting the flow of common stylus usage. We introduce two key ideas: flipping the stylus as an intuitive mode switch between drawing and teleportation, and using gaze to set orientation while the stylus handles positioning. In a user study that features a teleport-and-orient task, we evaluate six teleportation techniques, covering two mode-switching methods (Button and Flip) and three orientation approaches (StylusRoll, StylusPoint, and GazePoint). The results offer new insights into the relative merits and limitations of each technique. Our work contributes to knowledge about teleportation in VR and fills the gap in seamlessly integrating teleportation with stylus use in 3D.
- Open Access
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Hands-on, Hands-off: Gaze-Assisted Bimanual 3D Interaction
Extended Reality (XR) systems with hand-tracking support direct manipulation of objects with both hands. A common interaction in this context is for the non-dominant hand (NDH) to orient an object for input by the dominant hand (DH). We explore bimanual interaction with gaze through three new modes of interaction where the input of the NDH, DH, or both hands is indirect based on Gaze+Pinch. These modes enable a new dynamic interplay between our hands, allowing flexible alternation between and pairing of complementary operations. Through applications, we demonstrate several use cases in the context of 3D modelling, where users exploit occlusion-free, low-effort, and fluid two-handed manipulation. To gain a deeper understanding of each mode, we present a user study on an asymmetric rotate-translate task. Most participants preferred indirect input with both hands for lower physical effort, without a penalty on user performance. Otherwise, they preferred modes where the NDH oriented the object directly, supporting preshaping of the hand, which is more challenging with indirect gestures. The insights gained are of relevance for the design of XR interfaces that aim to leverage eye and hand input in tandem.
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Open AccessHands-on, Hands-off: Gaze-Assisted Bimanual 3D Interaction
Extended Reality (XR) systems with hand-tracking support direct manipulation of objects with both hands. A common interaction in this context is for the non-dominant hand (NDH) to orient an object for input by the dominant hand (DH). We explore bimanual interaction with gaze through three new modes of interaction where the input of the NDH, DH, or both hands is indirect based on Gaze+Pinch. These modes enable a new dynamic interplay between our hands, allowing flexible alternation between and pairing of complementary operations. Through applications, we demonstrate several use cases in the context of 3D modelling, where users exploit occlusion-free, low-effort, and fluid two-handed manipulation. To gain a deeper understanding of each mode, we present a user study on an asymmetric rotate-translate task. Most participants preferred indirect input with both hands for lower physical effort, without a penalty on user performance. Otherwise, they preferred modes where the NDH oriented the object directly, supporting preshaping of the hand, which is more challenging with indirect gestures. The insights gained are of relevance for the design of XR interfaces that aim to leverage eye and hand input in tandem.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Spatial Gaze Markers: Supporting Effective Task Switching in Augmented Reality
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Open AccessSpatial Gaze Markers: Supporting Effective Task Switching in Augmented Reality
- Open Access
- 30 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
GE-Simulator: An Open-Source Tool for Simulating Real-Time Errors for HMD-based Eye Trackers
As eye tracking in augmented and virtual reality (AR/VR) becomes established, it will be used by broader demographics, increasing the likelihood of tracking errors. Therefore, it is important when designing eye tracking applications or interaction techniques to test them at different signal quality levels to ensure they function for as many people as possible. We present GE-Simulator, a novel open-source Unity toolkit that allows the simulation of accuracy, precision, and data loss errors during real-time usage by adding gaze vector errors into the gaze vector from the head-mounted AR/VR eye tracker. The tool is customisable without having to change the source code and changes in eye tracking errors during and in-between usage. Our toolkit allows designers to prototype new applications at different levels of eye tracking in the early phases of design and can be used to evaluate techniques with users at varying signal quality levels.
- 30 May 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessGE-Simulator: An Open-Source Tool for Simulating Real-Time Errors for HMD-based Eye Trackers
As eye tracking in augmented and virtual reality (AR/VR) becomes established, it will be used by broader demographics, increasing the likelihood of tracking errors. Therefore, it is important when designing eye tracking applications or interaction techniques to test them at different signal quality levels to ensure they function for as many people as possible. We present GE-Simulator, a novel open-source Unity toolkit that allows the simulation of accuracy, precision, and data loss errors during real-time usage by adding gaze vector errors into the gaze vector from the head-mounted AR/VR eye tracker. The tool is customisable without having to change the source code and changes in eye tracking errors during and in-between usage. Our toolkit allows designers to prototype new applications at different levels of eye tracking in the early phases of design and can be used to evaluate techniques with users at varying signal quality levels.
- Top Cited PapersOpen Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
A Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Top Cited PapersOpen AccessA Fitts’ Law Study of Gaze-Hand Alignment for Selection in 3D User Interfaces
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Vergence Matching: Inferring Attention to Objects in 3D Environments for Gaze-Assisted Selection
Gaze pointing is the de facto standard to infer attention and interact in 3D environments but is limited by motor and sensor limitations. To circumvent these limitations, we propose a vergence-based motion correlation method to detect visual attention toward very small targets. Smooth depth movements relative to the user are induced on 3D objects, which cause slow vergence eye movements when looked upon. Using the principle of motion correlation, the depth movements of the object and vergence eye movements are matched to determine which object the user is focussing on. In two user studies, we demonstrate how the technique can reliably infer gaze attention on very small targets, systematically explore how different stimulus motions affect attention detection, and show how the technique can be extended to multi-target selection. Finally, we provide example applications using the concept and design guidelines for small target and accuracy-independent attention detection in 3D environments.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-15
Open AccessVergence Matching: Inferring Attention to Objects in 3D Environments for Gaze-Assisted Selection
Gaze pointing is the de facto standard to infer attention and interact in 3D environments but is limited by motor and sensor limitations. To circumvent these limitations, we propose a vergence-based motion correlation method to detect visual attention toward very small targets. Smooth depth movements relative to the user are induced on 3D objects, which cause slow vergence eye movements when looked upon. Using the principle of motion correlation, the depth movements of the object and vergence eye movements are matched to determine which object the user is focussing on. In two user studies, we demonstrate how the technique can reliably infer gaze attention on very small targets, systematically explore how different stimulus motions affect attention detection, and show how the technique can be extended to multi-target selection. Finally, we provide example applications using the concept and design guidelines for small target and accuracy-independent attention detection in 3D environments.