T. Scott Murdison
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
T. Scott Murdison has a total of 46 co-authors. Here are the top co-authors by number of shared publications:
- Michael J. Proulx
Department of Psychology, University of Bath
6 shared publications - Gunnar Blohm
Queen’s University
5 shared publications - Philippe Lefèvre
System and Cognition Division, Institute of Neuroscience, Université catholique de Louvain
4 shared publications - Ajoy Savio Fernandes
Meta Reality Labs Research
3 shared publications - Charlie S. Burlingham
Department of Psychology, New York University
3 shared publications - Naveen Sendhilnathan
Reality Labs Research, Meta Inc., Redmond, Washington, USA
3 shared publications
Latest Publications
- Open Access
- 1 February 2026
- Published by Wiley in Journal of the Society for Information Display
- Vol. 34 (3) , 85-98
Stereoscopic Brightness Roll‐Off in Augmented Reality
The increasing demand for power‐efficient immersive displays has led to a growing need for effective power‐saving strategies. Brightness roll‐off (BRO), a technique that has shown promise in reducing power consumption with minimal impact on perception in desktop and virtual reality (VR) displays, remains largely unexplored in augmented reality (AR). We investigate the effectiveness of BRO as a power‐saving approach in AR under stereoscopic viewing conditions, examining its perceptual impacts and modeled power savings for LED and LCoS displays. Our findings demonstrate that BRO has a negligible effect on perceptual sensitivity in most cases compared to computational metric predictions, highlighting its potential as a perceptually optimized brightness reduction technique in HMDs and the need for psychophysical validation of such metrics. The results provide valuable insights into the acceptable levels of roll‐off in a range of images and additive contrasts, underscoring the potential of BRO as a power‐saving solution in AR.
- 1 February 2026
- Published by Wiley in Journal of the Society for Information Display
- Vol. 34 (3) , 85-98
Open AccessStereoscopic Brightness Roll‐Off in Augmented Reality
The increasing demand for power‐efficient immersive displays has led to a growing need for effective power‐saving strategies. Brightness roll‐off (BRO), a technique that has shown promise in reducing power consumption with minimal impact on perception in desktop and virtual reality (VR) displays, remains largely unexplored in augmented reality (AR). We investigate the effectiveness of BRO as a power‐saving approach in AR under stereoscopic viewing conditions, examining its perceptual impacts and modeled power savings for LED and LCoS displays. Our findings demonstrate that BRO has a negligible effect on perceptual sensitivity in most cases compared to computational metric predictions, highlighting its potential as a perceptually optimized brightness reduction technique in HMDs and the need for psychophysical validation of such metrics. The results provide valuable insights into the acceptable levels of roll‐off in a range of images and additive contrasts, underscoring the potential of BRO as a power‐saving solution in AR.
- Open Access
- 23 May 2025
- Published by Oxford University Press (OUP) in PNAS Nexus
- Vol. 4 (7) , pgaf167
Accurately tracking visual moving stimuli with gaze requires a higher fidelity motion representation than perceptual discrimination
The human visual system evolved to process and interpret continuous visual input. However, visual signals in modern societies increasingly emanate from digital displays, which emulate continuous motion by presenting a series of discrete frames at some fixed temporal frequency. How does noncontinuous, sampled motion influence visual perception and action? We asked participants to complete a combined oculomotor and speed-discrimination task, where they tracked the motion of a stimulus via smooth pursuit eye movements and compared the velocity of the pursuit stimulus with a reference velocity. Motion quality was manipulated by presenting discrete frames at different temporal frequencies (120, 60, 30, and 15 Hz), covering a range of values corresponding to different motion qualia, from quasi-continuous (120 Hz) to highly discontinuous (15 Hz). We found that participants could reliably discriminate velocities, even at low refresh rates. However, measures of pursuit quality declined with decreasing refresh rate and increasing target velocity: a perception–action dissociation. The decline in pursuit accuracy can be explained by a model estimating a proxy for motion quality from the spatiotemporal energy profile of the stimuli. Using this estimate, our model predicts pursuit accuracy for arbitrary combinations of target velocity and refresh rate. Our results highlight the dissociation between perception and action in digital displays with sampled motion; while we may be able to accurately discriminate motion at reduced frame rates, acting on moving stimuli requires a higher fidelity motion representation.
- 23 May 2025
- Published by Oxford University Press (OUP) in PNAS Nexus
- Vol. 4 (7) , pgaf167
Open AccessAccurately tracking visual moving stimuli with gaze requires a higher fidelity motion representation than perceptual discrimination
The human visual system evolved to process and interpret continuous visual input. However, visual signals in modern societies increasingly emanate from digital displays, which emulate continuous motion by presenting a series of discrete frames at some fixed temporal frequency. How does noncontinuous, sampled motion influence visual perception and action? We asked participants to complete a combined oculomotor and speed-discrimination task, where they tracked the motion of a stimulus via smooth pursuit eye movements and compared the velocity of the pursuit stimulus with a reference velocity. Motion quality was manipulated by presenting discrete frames at different temporal frequencies (120, 60, 30, and 15 Hz), covering a range of values corresponding to different motion qualia, from quasi-continuous (120 Hz) to highly discontinuous (15 Hz). We found that participants could reliably discriminate velocities, even at low refresh rates. However, measures of pursuit quality declined with decreasing refresh rate and increasing target velocity: a perception–action dissociation. The decline in pursuit accuracy can be explained by a model estimating a proxy for motion quality from the spatiotemporal energy profile of the stimuli. Using this estimate, our model predicts pursuit accuracy for arbitrary combinations of target velocity and refresh rate. Our results highlight the dissociation between perception and action in digital displays with sampled motion; while we may be able to accurately discriminate motion at reduced frame rates, acting on moving stimuli requires a higher fidelity motion representation.
- 25 March 2025
- Published by SPIE-Intl Soc Optical Eng
- Vol. 13415, 702
Panel discussion: human vision science and the visual experience in AR/VR
How will human vision science shape the future of AR/VR? We will explore key open questions related to the visual experience in AR/VR and how vision science can contribute to answering those questions. Furthermore, we will discuss current developments in vision science (both in academia and industry) that may impact future AR and VR technologies.
- 25 March 2025
- Published by SPIE-Intl Soc Optical Eng
- Vol. 13415, 702
Panel discussion: human vision science and the visual experience in AR/VR
How will human vision science shape the future of AR/VR? We will explore key open questions related to the visual experience in AR/VR and how vision science can contribute to answering those questions. Furthermore, we will discuss current developments in vision science (both in academia and industry) that may impact future AR and VR technologies.
- Open Access
- 5 February 2025
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 41 (19) , 12251-12269
Gaze Inputs for Targeting: The Eyes Have It, Not With a Cursor
- 5 February 2025
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 41 (19) , 12251-12269
Open AccessGaze Inputs for Targeting: The Eyes Have It, Not With a Cursor
- Open Access
- 26 September 2024
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 41 (13) , 7952-7967
Looking in Depth: Targeting by Eye and Controller Input for Multi-Depth Target Placement
- 26 September 2024
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 41 (13) , 7952-7967
Open AccessLooking in Depth: Targeting by Eye and Controller Input for Multi-Depth Target Placement
- Open Access
- 13 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Saccade-Contingent Rendering
Battery-constrained power consumption, compute limitations, and high frame rate requirements in head-mounted displays present unique challenges in the drive to present increasingly immersive and comfortable imagery in virtual reality. However, humans are not equally sensitive to all regions of the visual field, and perceptually-optimized rendering techniques are increasingly utilized to address these bottlenecks. Many of these techniques are gaze-contingent and often render reduced detail away from a user’s fixation. Such techniques are dependent on spatio-temporally-accurate gaze tracking and can result in obvious visual artifacts when eye tracking is inaccurate. In this work we present a gaze-contingent rendering technique which only requires saccade detection, bypassing the need for highly-accurate eye tracking. In our first experiment, we show that visual acuity is reduced for several hundred milliseconds after a saccade. In our second experiment, we use these results to reduce the rendered image resolution after saccades in a controlled psychophysical setup, and find that observers cannot discriminate between saccade-contingent, reduced-resolution rendering and full-resolution rendering under certain conditions identified in Experiment 1. Finally, in our third experiment, we introduce a 90 pixels per degree headset and validate our saccade-contingent rendering method under typical VR viewing conditions.
- 13 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Open AccessSaccade-Contingent Rendering
Battery-constrained power consumption, compute limitations, and high frame rate requirements in head-mounted displays present unique challenges in the drive to present increasingly immersive and comfortable imagery in virtual reality. However, humans are not equally sensitive to all regions of the visual field, and perceptually-optimized rendering techniques are increasingly utilized to address these bottlenecks. Many of these techniques are gaze-contingent and often render reduced detail away from a user’s fixation. Such techniques are dependent on spatio-temporally-accurate gaze tracking and can result in obvious visual artifacts when eye tracking is inaccurate. In this work we present a gaze-contingent rendering technique which only requires saccade detection, bypassing the need for highly-accurate eye tracking. In our first experiment, we show that visual acuity is reduced for several hundred milliseconds after a saccade. In our second experiment, we use these results to reduce the rendered image resolution after saccades in a controlled psychophysical setup, and find that observers cannot discriminate between saccade-contingent, reduced-resolution rendering and full-resolution rendering under certain conditions identified in Experiment 1. Finally, in our third experiment, we introduce a 90 pixels per degree headset and validate our saccade-contingent rendering method under typical VR viewing conditions.
- Open Access
- 26 June 2024
- Published by Center for Open Science in PsyArXiv
Accurately acting on moving stimuli requires a higher fidelity motion representation than perceptual discrimination
The human visual system evolved to process and interpret continuous visual input. However, visual signals in modern societies increasingly emanate from digital displays, which emulate continuous motion by rapidly presenting a series of discrete frames at some fixed temporal frequency. How does such non-continuous, sampled motion influence visual perception and action? We asked participants to complete a combined oculomotor and speed-discrimination task, where they, first, tracked the motion of a stimulus via smooth pursuit eye movements, and second, compared the velocity of the pursuit stimulus to a reference velocity. Motion quality was manipulated by presenting discrete frames at one of four temporal frequencies (120, 60, 30, 15 Hertz), covering a range of values corresponding to different motion qualia, from quasi-continuous (120 Hertz) to highly discontinuous (15 Hertz). We found that participants could reliably discriminate velocities, even at low refresh rates. Pursuit accuracy, however, declined with decreasing refresh rate and increasing target velocity: a perception-action dissociation. The decline in pursuit accuracy can be explained by a model, which estimated a proxy for motion quality from the spatiotemporal energy profile of stimuli. Using this estimate, our model successfully predicts pursuit accuracy for arbitrary combinations of target velocity and refresh rate. Our results highlight the dissociation between perception and action in digital displays with sampled motion; while we may be able to accurately discriminate motion at reduced frame rates, acting on moving stimuli requires a higher fidelity motion representation.
- 26 June 2024
- Published by Center for Open Science in PsyArXiv
Open AccessAccurately acting on moving stimuli requires a higher fidelity motion representation than perceptual discrimination
The human visual system evolved to process and interpret continuous visual input. However, visual signals in modern societies increasingly emanate from digital displays, which emulate continuous motion by rapidly presenting a series of discrete frames at some fixed temporal frequency. How does such non-continuous, sampled motion influence visual perception and action? We asked participants to complete a combined oculomotor and speed-discrimination task, where they, first, tracked the motion of a stimulus via smooth pursuit eye movements, and second, compared the velocity of the pursuit stimulus to a reference velocity. Motion quality was manipulated by presenting discrete frames at one of four temporal frequencies (120, 60, 30, 15 Hertz), covering a range of values corresponding to different motion qualia, from quasi-continuous (120 Hertz) to highly discontinuous (15 Hertz). We found that participants could reliably discriminate velocities, even at low refresh rates. Pursuit accuracy, however, declined with decreasing refresh rate and increasing target velocity: a perception-action dissociation. The decline in pursuit accuracy can be explained by a model, which estimated a proxy for motion quality from the spatiotemporal energy profile of stimuli. Using this estimate, our model successfully predicts pursuit accuracy for arbitrary combinations of target velocity and refresh rate. Our results highlight the dissociation between perception and action in digital displays with sampled motion; while we may be able to accurately discriminate motion at reduced frame rates, acting on moving stimuli requires a higher fidelity motion representation.
- Open Access
- 4 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-7
The Effect of Degraded Eye Tracking Accuracy on Interactions in VR
Gaze-based user interfaces and interactions are becoming more prevalent in augmented and virtual reality (AR/VR). The effectiveness of eye tracking for interaction depends on its quality. Many studies discuss eye tracking as an input and interaction modality but do not provide details about eye tracking quality, making it difficult to compare findings. Here we implement a framework to degrade accuracy error with the user in the loop. We then approximate calibration error, with those degradations applied in each block to provide an “Effective Gaze Error.” Participants selected single targets (3° or 5° diameter) using an eye tracking sampling frequency and display rate of 120 Hz. Higher “Effective Gaze Error” on smaller targets resulted in decreased human performance and subjective evaluations. Our experiment framework and results provide a starting point for future studies assessing how gaze accuracy degradation impacts performance, beyond interactions tasks.
- 4 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessThe Effect of Degraded Eye Tracking Accuracy on Interactions in VR
Gaze-based user interfaces and interactions are becoming more prevalent in augmented and virtual reality (AR/VR). The effectiveness of eye tracking for interaction depends on its quality. Many studies discuss eye tracking as an input and interaction modality but do not provide details about eye tracking quality, making it difficult to compare findings. Here we implement a framework to degrade accuracy error with the user in the loop. We then approximate calibration error, with those degradations applied in each block to provide an “Effective Gaze Error.” Participants selected single targets (3° or 5° diameter) using an eye tracking sampling frequency and display rate of 120 Hz. Higher “Effective Gaze Error” on smaller targets resulted in decreased human performance and subjective evaluations. Our experiment framework and results provide a starting point for future studies assessing how gaze accuracy degradation impacts performance, beyond interactions tasks.
- Open Access
- 4 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Real-World Scanpaths Exhibit Long-Term Temporal Dependencies: Considerations for Contextual AI for AR Applications
All-day augmented reality (AR) requires contextually-aware artificial intelligence (AI) models that excel across diverse daily contexts. Eye tracking could be a key source of information about user context and intention. However, such models using gaze sometimes struggle to outperform egocentric video-based baseline models. We propose that learning representations of scanpath history in a perceptually-relevant state space may solve this problem. However, scanpaths are often assumed to obey a Markovian assumption, i.e., only the current and previous fixation matter. In a user study (30 participants; 26.2 hours total), we analyzed scanpaths during nine everyday tasks and identified long-term temporal dependencies, with an average timescale of four fixations (2 seconds) into the past (i.e., violating the Markovian assumption). We discovered substantial task-specific variations in these dependencies. This confirms that scanpaths contain stereotyped “motifs” with context-dependent lengths/timescales. We discuss the implications for designing contextual AI models for AR applications.
- 4 June 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessReal-World Scanpaths Exhibit Long-Term Temporal Dependencies: Considerations for Contextual AI for AR Applications
All-day augmented reality (AR) requires contextually-aware artificial intelligence (AI) models that excel across diverse daily contexts. Eye tracking could be a key source of information about user context and intention. However, such models using gaze sometimes struggle to outperform egocentric video-based baseline models. We propose that learning representations of scanpath history in a perceptually-relevant state space may solve this problem. However, scanpaths are often assumed to obey a Markovian assumption, i.e., only the current and previous fixation matter. In a user study (30 participants; 26.2 hours total), we analyzed scanpaths during nine everyday tasks and identified long-term temporal dependencies, with an average timescale of four fixations (2 seconds) into the past (i.e., violating the Markovian assumption). We discovered substantial task-specific variations in these dependencies. This confirms that scanpaths contain stereotyped “motifs” with context-dependent lengths/timescales. We discuss the implications for designing contextual AI models for AR applications.
- Open Access
- 12 March 2024
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 121 (12)
Motor “laziness” constrains fixation selection in real-world tasks
Humans coordinate their eye, head, and body movements to gather information from a dynamic environment while maximizing reward and minimizing biomechanical and energetic costs. However, such natural behavior is not possible in traditional experiments employing head/body restraints and artificial, static stimuli. Therefore, it is unclear to what extent mechanisms of fixation selection discovered in lab studies, such as inhibition-of-return (IOR), influence everyday behavior. To address this gap, participants performed nine real-world tasks, including driving, visually searching for an item, and building a Lego set, while wearing a mobile eye tracker (169 recordings; 26.6 h). Surprisingly, in all tasks, participants most often returned to what they just viewed and saccade latencies were shorter preceding return than forward saccades, i.e., consistent with facilitation, rather than inhibition, of return. We hypothesize that conservation of eye and head motor effort (“laziness”) contributes. Correspondingly, we observed center biases in fixation position and duration relative to the head’s orientation. A model that generates scanpaths by randomly sampling these distributions reproduced all return phenomena we observed, including distinct 3-fixation sequences for forward versus return saccades. After controlling for orbital eccentricity, one task (building a Lego set) showed evidence for IOR. This, along with small discrepancies between model and data, indicates that the brain balances minimization of motor costs with maximization of rewards (e.g., accomplished by IOR and other mechanisms) and that the optimal balance varies according to task demands. Supporting this account, the orbital range of motion used in each task traded off lawfully with fixation duration.
- 12 March 2024
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 121 (12)
Open AccessMotor “laziness” constrains fixation selection in real-world tasks
Humans coordinate their eye, head, and body movements to gather information from a dynamic environment while maximizing reward and minimizing biomechanical and energetic costs. However, such natural behavior is not possible in traditional experiments employing head/body restraints and artificial, static stimuli. Therefore, it is unclear to what extent mechanisms of fixation selection discovered in lab studies, such as inhibition-of-return (IOR), influence everyday behavior. To address this gap, participants performed nine real-world tasks, including driving, visually searching for an item, and building a Lego set, while wearing a mobile eye tracker (169 recordings; 26.6 h). Surprisingly, in all tasks, participants most often returned to what they just viewed and saccade latencies were shorter preceding return than forward saccades, i.e., consistent with facilitation, rather than inhibition, of return. We hypothesize that conservation of eye and head motor effort (“laziness”) contributes. Correspondingly, we observed center biases in fixation position and duration relative to the head’s orientation. A model that generates scanpaths by randomly sampling these distributions reproduced all return phenomena we observed, including distinct 3-fixation sequences for forward versus return saccades. After controlling for orbital eccentricity, one task (building a Lego set) showed evidence for IOR. This, along with small discrepancies between model and data, indicates that the brain balances minimization of motor costs with maximization of rewards (e.g., accomplished by IOR and other mechanisms) and that the optimal balance varies according to task demands. Supporting this account, the orbital range of motion used in each task traded off lawfully with fixation duration.