Roy S. Hessels
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Roy S. Hessels has a total of 73 co-authors. Here are the top co-authors by number of shared publications:
Ignace T. C. Hooge
Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
17 shared publications- Diederick C. Niehorster
Lund University Humanities Lab, Lund University, Lund, Sweden
11 shared publications Chantal Kemner
Experimental Psychology, Helmholtz Institute, Utrecht University
10 shared publications- Ignace T. C. Hooge
Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
8 shared publications Marcus Nyström
Lund University Humanities Lab, Lund, Sweden
6 shared publicationsIgnace T.C. Hooge
Helmholtz Institute, Utrecht University
5 shared publications
Latest Publications
- Open Access
- 13 November 2026
- Published by Center for Open Science in PsyArXiv
Face and eye gaze in preterm and full-term preschoolers during face-to-face interactions
Background: Preterm birth has been linked to atypical social development and difficulties with social orientation similar to those observed in autism. A fundamental component of social interaction is adequate gaze toward an interaction partner’s face and eyes. Preterm individuals have been reported to display atypical social gaze patterns, characterized by more frequent but shorter looks toward faces. Methods: We compared looking times to the face, as well as eyes versus mouth during face-to-face interactions in preterm (N = 45) and full-term (N = 29) five-year-olds, using a video-based eye-tracking set-up. Secondary, we examined number of dwells and mean dwell duration. Each child participated in four interaction tasks, including silent looking at their mother, silent looking at a female stranger, and a positive and negative conversation with their mother. Results: No statistically significant group differences were found between preterm and full-term children in percentage of total dwell times to either the face or the eyes, however small differences were observed with preterm children showing less dwells per minute with longer mean durations than full-term children. We observed a marginal effect of interaction partner, with children spending proportionately more time gazing at their mother’s face than at a stranger’s face. Conclusion: Preterm and full-term five-year-olds showed no differences in total social gaze to the face and the eyes of their interaction partner during face-to-face interactions, although subtle differences were observed in other gaze measures. Speculatively, these findings may reflect a developmental catch-up in social orientation following initial delays in infancy. Alternatively, advances in neonatal medical care, including infant-directed interventions in the neonatal intensive care unit, may have been successful in improving social gaze after preterm birth. Given the context-dependent and individual nature of gaze behavior, these findings should be interpreted cautiously. Future longitudinal studies employing consistent methodological approaches are needed to investigate how social gaze develops over time following preterm birth.
- 13 November 2026
- Published by Center for Open Science in PsyArXiv
Open AccessFace and eye gaze in preterm and full-term preschoolers during face-to-face interactions
Background: Preterm birth has been linked to atypical social development and difficulties with social orientation similar to those observed in autism. A fundamental component of social interaction is adequate gaze toward an interaction partner’s face and eyes. Preterm individuals have been reported to display atypical social gaze patterns, characterized by more frequent but shorter looks toward faces. Methods: We compared looking times to the face, as well as eyes versus mouth during face-to-face interactions in preterm (N = 45) and full-term (N = 29) five-year-olds, using a video-based eye-tracking set-up. Secondary, we examined number of dwells and mean dwell duration. Each child participated in four interaction tasks, including silent looking at their mother, silent looking at a female stranger, and a positive and negative conversation with their mother. Results: No statistically significant group differences were found between preterm and full-term children in percentage of total dwell times to either the face or the eyes, however small differences were observed with preterm children showing less dwells per minute with longer mean durations than full-term children. We observed a marginal effect of interaction partner, with children spending proportionately more time gazing at their mother’s face than at a stranger’s face. Conclusion: Preterm and full-term five-year-olds showed no differences in total social gaze to the face and the eyes of their interaction partner during face-to-face interactions, although subtle differences were observed in other gaze measures. Speculatively, these findings may reflect a developmental catch-up in social orientation following initial delays in infancy. Alternatively, advances in neonatal medical care, including infant-directed interventions in the neonatal intensive care unit, may have been successful in improving social gaze after preterm birth. Given the context-dependent and individual nature of gaze behavior, these findings should be interpreted cautiously. Future longitudinal studies employing consistent methodological approaches are needed to investigate how social gaze develops over time following preterm birth.
- Open Access
- 2 April 2026
- Published by Springer Nature in Psychonomic Bulletin & Review
- Vol. 33 (4) , 131
A visual perceptual perspective on gaze in social robotics
Where and when should a robot look during interaction with humans? Intuitively, human–human interaction serves as the blueprint. In such interactions, gaze plays a central role, both in visually guiding action and in signaling communication. Yet, most social robotics research still relies on the oversimplified eye–mind assumption, equating gaze with visual attention, and often implements gaze behaviors without accounting for perceptual limits or individual variability. We identify three core challenges at the intersection of psychology, visual perception, and robotics: (1) disentangling the dual functions of gaze, (2) understanding the visual perceptual mechanisms underlying gaze perception, and (3) adapting to individual, cultural, and clinical variability in gaze behavior. By examining these challenges in both robot interpretation and production of gaze, we argue that social robotics benefits from insights into human gaze and provides a powerful testbed for theory development, enabling controlled, interactive experiments that deepen our understanding of social attention. We conclude by conceptualizing social gaze as a soft-constraints inference and production process under uncertainty, linking visual perceptual mechanisms and social meaning.
- 2 April 2026
- Published by Springer Nature in Psychonomic Bulletin & Review
- Vol. 33 (4) , 131
Open AccessA visual perceptual perspective on gaze in social robotics
Where and when should a robot look during interaction with humans? Intuitively, human–human interaction serves as the blueprint. In such interactions, gaze plays a central role, both in visually guiding action and in signaling communication. Yet, most social robotics research still relies on the oversimplified eye–mind assumption, equating gaze with visual attention, and often implements gaze behaviors without accounting for perceptual limits or individual variability. We identify three core challenges at the intersection of psychology, visual perception, and robotics: (1) disentangling the dual functions of gaze, (2) understanding the visual perceptual mechanisms underlying gaze perception, and (3) adapting to individual, cultural, and clinical variability in gaze behavior. By examining these challenges in both robot interpretation and production of gaze, we argue that social robotics benefits from insights into human gaze and provides a powerful testbed for theory development, enabling controlled, interactive experiments that deepen our understanding of social attention. We conclude by conceptualizing social gaze as a soft-constraints inference and production process under uncertainty, linking visual perceptual mechanisms and social meaning.
- Open Access
- 29 March 2026
- Published by SAGE Publications in Perception
- Vol. 55 (9) , 819-831
Blue or gold? Visual perception and the restoration of a Medieval painting
This study investigates how the background color of the Lindau Crucifixion , a fifteenth-century panel painting by the Master of the Lamentation of Christ in Lindau, affects visual perception. Originally gilded, the painting was later overpainted with a blue paint, raising questions in conservation about whether to preserve the intervention or restore the gold. To assess potential perceptual consequences, we used digital reconstructions of the painting in eye-tracking and gist perception experiments. In the eye-tracking task, participants viewed each version for 6 s among similar medieval paintings. Faces were consistently gazed at, while angels attracted less gaze. However, a slightly reduced likelihood of fixating angels was found for the blue background. In the gist perception task, participants described similar elements across both versions, reporting the central figures regardless of background color. These findings suggest limited perceptual differences under brief viewing, highlighting the potential of perceptual experiments to inform art conservation decisions.
- 29 March 2026
- Published by SAGE Publications in Perception
- Vol. 55 (9) , 819-831
Open AccessBlue or gold? Visual perception and the restoration of a Medieval painting
This study investigates how the background color of the Lindau Crucifixion , a fifteenth-century panel painting by the Master of the Lamentation of Christ in Lindau, affects visual perception. Originally gilded, the painting was later overpainted with a blue paint, raising questions in conservation about whether to preserve the intervention or restore the gold. To assess potential perceptual consequences, we used digital reconstructions of the painting in eye-tracking and gist perception experiments. In the eye-tracking task, participants viewed each version for 6 s among similar medieval paintings. Faces were consistently gazed at, while angels attracted less gaze. However, a slightly reduced likelihood of fixating angels was found for the blue background. In the gist perception task, participants described similar elements across both versions, reporting the central figures regardless of background color. These findings suggest limited perceptual differences under brief viewing, highlighting the potential of perceptual experiments to inform art conservation decisions.
- Open Access
- 19 November 2025
- Published by Springer Nature in Behavior Research Methods
- Vol. 58 (1) , 2
The best fixation target revisited: New insights from retinal eye tracking
In many tasks, participants are instructed to fixate a target. While maintaining fixation, the eyes nonetheless make small fixational eye movements, such as microsaccades and drift. Previous work has examined the effect of fixation point design on fixation stability and the amount and spatial extent of fixational eye movements. However, much of this work used video-based eye trackers, which have insufficient resolution and suffer from artefacts that make them unsuitable for this topic of study. Here, we therefore use a retinal eye tracker, which offers superior resolution and does not suffer from the same artifacts to reexamine what fixation point design minimizes fixational eye movements. Participants were shown five fixation targets in two target polarity conditions, while the overall spatial spread of their gaze position during fixation, as well as their microsaccades and fixational drift, were examined. We found that gaze was more stable for white-on-black than black-on-grey fixation targets. Gaze was also more stable (lower spatial spread, microsaccade, and drift displacement) for fixation targets with a small central feature but these targets also yielded higher microsaccade rates than larger fixation targets without such a small central feature. In conclusion, there is not a single best fixation target that minimizes all aspects of fixational eye movements. Instead, if one wishes to optimize for minimal spatial spread of the gaze position, microsaccade or drift displacements, we recommend using a target with a small central feature. If one instead wishes to optimize for the lowest microsaccade rate, we recommend using a larger target without a small central feature.
- 19 November 2025
- Published by Springer Nature in Behavior Research Methods
- Vol. 58 (1) , 2
Open AccessThe best fixation target revisited: New insights from retinal eye tracking
In many tasks, participants are instructed to fixate a target. While maintaining fixation, the eyes nonetheless make small fixational eye movements, such as microsaccades and drift. Previous work has examined the effect of fixation point design on fixation stability and the amount and spatial extent of fixational eye movements. However, much of this work used video-based eye trackers, which have insufficient resolution and suffer from artefacts that make them unsuitable for this topic of study. Here, we therefore use a retinal eye tracker, which offers superior resolution and does not suffer from the same artifacts to reexamine what fixation point design minimizes fixational eye movements. Participants were shown five fixation targets in two target polarity conditions, while the overall spatial spread of their gaze position during fixation, as well as their microsaccades and fixational drift, were examined. We found that gaze was more stable for white-on-black than black-on-grey fixation targets. Gaze was also more stable (lower spatial spread, microsaccade, and drift displacement) for fixation targets with a small central feature but these targets also yielded higher microsaccade rates than larger fixation targets without such a small central feature. In conclusion, there is not a single best fixation target that minimizes all aspects of fixational eye movements. Instead, if one wishes to optimize for minimal spatial spread of the gaze position, microsaccade or drift displacements, we recommend using a target with a small central feature. If one instead wishes to optimize for the lowest microsaccade rate, we recommend using a larger target without a small central feature.
- Top Cited PapersOpen Access
- 2 July 2025
- Published by Springer Nature in Behavior Research Methods
- Vol. 57 (8) , 1-14
The fundamentals of eye tracking part 5: The importance of piloting
The goal of this article is to demonstrate the importance of pilot studies in empirical eye-tracking research. First, we show what can go wrong when proper pilot experiments are omitted for all phases of an eye-tracking study, from testing an experiment, conducting the data collection, to building, revising, and interpreting the data analysis. Second, we describe a series of eye-tracking studies as a case study, and elaborate on all the pilot experiments that were conducted. We highlight what was learned from each pilot experiment when conceiving, designing, and conducting the research. Finally, we give practical advice for eye-tracking researchers on planning and conducting pilot experiments. This advice can be summarized as (1) take enough time, (2) be problem-oriented, (3) pilots are of an iterative nature, (4) many questions are empirical, and (5) apply the four-eyes principle. We envision that the present article helps early career researchers discover, and more established researchers rediscover, the utility of pilot experiments.
- 2 July 2025
- Published by Springer Nature in Behavior Research Methods
- Vol. 57 (8) , 1-14
Top Cited PapersOpen AccessThe fundamentals of eye tracking part 5: The importance of piloting
The goal of this article is to demonstrate the importance of pilot studies in empirical eye-tracking research. First, we show what can go wrong when proper pilot experiments are omitted for all phases of an eye-tracking study, from testing an experiment, conducting the data collection, to building, revising, and interpreting the data analysis. Second, we describe a series of eye-tracking studies as a case study, and elaborate on all the pilot experiments that were conducted. We highlight what was learned from each pilot experiment when conceiving, designing, and conducting the research. Finally, we give practical advice for eye-tracking researchers on planning and conducting pilot experiments. This advice can be summarized as (1) take enough time, (2) be problem-oriented, (3) pilots are of an iterative nature, (4) many questions are empirical, and (5) apply the four-eyes principle. We envision that the present article helps early career researchers discover, and more established researchers rediscover, the utility of pilot experiments.
- Top Cited PapersOpen Access
Gaze behavior in face-to-face interaction: A cross-cultural investigation between Japan and The Netherlands
Top Cited PapersOpen AccessGaze behavior in face-to-face interaction: A cross-cultural investigation between Japan and The Netherlands
- Top Cited PapersOpen Access
- 12 December 2024
- Published by Springer Nature in Behavior Research Methods
- Vol. 57 (1) , 1-18
The fundamentals of eye tracking part 1: The link between theory and research question
Eye tracking technology has become increasingly prevalent in scientific research, offering unique insights into oculomotor and cognitive processes. The present article explores the relationship between scientific theory, the research question, and the use of eye-tracking technology. It aims to guide readers in determining if eye tracking is suitable for their studies and how to formulate relevant research questions. Examples from research on oculomotor control, reading, scene perception, task execution, visual expertise, and instructional design are used to illustrate the connection between theory and eye-tracking data. These examples may serve as inspiration to researchers new to eye tracking. In summarizing the examples, three important considerations emerge: (1) whether the study focuses on describing eye movements or uses them as a proxy for e.g., perceptual, or cognitive processes, (2) the logical chain from theory to predictions, and (3) whether the study is of an observational or idea-testing nature. We provide a generic scheme and a set of specific questions that may help researchers formulate and explicate their research question using eye tracking.
- 12 December 2024
- Published by Springer Nature in Behavior Research Methods
- Vol. 57 (1) , 1-18
Top Cited PapersOpen AccessThe fundamentals of eye tracking part 1: The link between theory and research question
Eye tracking technology has become increasingly prevalent in scientific research, offering unique insights into oculomotor and cognitive processes. The present article explores the relationship between scientific theory, the research question, and the use of eye-tracking technology. It aims to guide readers in determining if eye tracking is suitable for their studies and how to formulate relevant research questions. Examples from research on oculomotor control, reading, scene perception, task execution, visual expertise, and instructional design are used to illustrate the connection between theory and eye-tracking data. These examples may serve as inspiration to researchers new to eye tracking. In summarizing the examples, three important considerations emerge: (1) whether the study focuses on describing eye movements or uses them as a proxy for e.g., perceptual, or cognitive processes, (2) the logical chain from theory to predictions, and (3) whether the study is of an observational or idea-testing nature. We provide a generic scheme and a set of specific questions that may help researchers formulate and explicate their research question using eye tracking.
- Open Access
- 18 November 2024
- Published by Springer Nature in Attention, Perception, & Psychophysics
- Vol. 86 (8) , 2761-2777
Gaze-action coupling, gaze-gesture coupling, and exogenous attraction of gaze in dyadic interactions
In human interactions, gaze may be used to acquire information for goal-directed actions, to acquire information related to the interacting partner’s actions, and in the context of multimodal communication. At present, there are no models of gaze behavior in the context of vision that adequately incorporate these three components. In this study, we aimed to uncover and quantify patterns of within-person gaze-action coupling, gaze-gesture and gaze-speech coupling, and coupling between one person’s gaze and another person’s manual actions, gestures, or speech (or exogenous attraction of gaze) during dyadic collaboration. We showed that in the context of a collaborative Lego Duplo-model copying task, within-person gaze-action coupling is strongest, followed by within-person gaze-gesture coupling, and coupling between gaze and another person’s actions. When trying to infer gaze location from one’s own manual actions, gestures, or speech or that of the other person, only one’s own manual actions were found to lead to better inference compared to a baseline model. The improvement in inferring gaze location was limited, contrary to what might be expected based on previous research. We suggest that inferring gaze location may be most effective for constrained tasks in which different manual actions follow in a quick sequence, while gaze-gesture and gaze-speech coupling may be stronger in unconstrained conversational settings or when the collaboration requires more negotiation. Our findings may serve as an empirical foundation for future theory and model development, and may further be relevant in the context of action/intention prediction for (social) robotics and effective human–robot interaction.
- 18 November 2024
- Published by Springer Nature in Attention, Perception, & Psychophysics
- Vol. 86 (8) , 2761-2777
Open AccessGaze-action coupling, gaze-gesture coupling, and exogenous attraction of gaze in dyadic interactions
In human interactions, gaze may be used to acquire information for goal-directed actions, to acquire information related to the interacting partner’s actions, and in the context of multimodal communication. At present, there are no models of gaze behavior in the context of vision that adequately incorporate these three components. In this study, we aimed to uncover and quantify patterns of within-person gaze-action coupling, gaze-gesture and gaze-speech coupling, and coupling between one person’s gaze and another person’s manual actions, gestures, or speech (or exogenous attraction of gaze) during dyadic collaboration. We showed that in the context of a collaborative Lego Duplo-model copying task, within-person gaze-action coupling is strongest, followed by within-person gaze-gesture coupling, and coupling between gaze and another person’s actions. When trying to infer gaze location from one’s own manual actions, gestures, or speech or that of the other person, only one’s own manual actions were found to lead to better inference compared to a baseline model. The improvement in inferring gaze location was limited, contrary to what might be expected based on previous research. We suggest that inferring gaze location may be most effective for constrained tasks in which different manual actions follow in a quick sequence, while gaze-gesture and gaze-speech coupling may be stronger in unconstrained conversational settings or when the collaboration requires more negotiation. Our findings may serve as an empirical foundation for future theory and model development, and may further be relevant in the context of action/intention prediction for (social) robotics and effective human–robot interaction.
- Open Access
- 2 July 2024
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 24 (7) , 6
When knowing the activity is not enough to predict gaze
It is reasonable to assume that where people look in the world is largely determined by what they are doing. The reasoning is that the activity determines where it is useful to look at each moment in time. Assuming that it is vital to accurately judge the positions of the steps when navigating a staircase, it is surprising that people differ a lot in the extent to which they look at the steps. Apparently, some people consider the accuracy of peripheral vision, predictability of the step size, and feeling the edges of the steps with their feet to be good enough. If so, occluding part of the view of the staircase and making it more important to place one's feet gently might make it more beneficial to look directly at the steps before stepping onto them, so that people will more consistently look at many steps. We tested this idea by asking people to walk on staircases, either with or without a tray with two cups of water on it. When carrying the tray, people walked more slowly, but they shifted their gaze across steps in much the same way as they did when walking without the tray. They did not look at more steps. There was a clear positive correlation between the fraction of steps that people looked at when walking with and without the tray. Thus, the variability in the extent to which people look at the steps persists when one makes walking on the staircase more challenging.
- 2 July 2024
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 24 (7) , 6
Open AccessWhen knowing the activity is not enough to predict gaze
It is reasonable to assume that where people look in the world is largely determined by what they are doing. The reasoning is that the activity determines where it is useful to look at each moment in time. Assuming that it is vital to accurately judge the positions of the steps when navigating a staircase, it is surprising that people differ a lot in the extent to which they look at the steps. Apparently, some people consider the accuracy of peripheral vision, predictability of the step size, and feeling the edges of the steps with their feet to be good enough. If so, occluding part of the view of the staircase and making it more important to place one's feet gently might make it more beneficial to look directly at the steps before stepping onto them, so that people will more consistently look at many steps. We tested this idea by asking people to walk on staircases, either with or without a tray with two cups of water on it. When carrying the tray, people walked more slowly, but they shifted their gaze across steps in much the same way as they did when walking without the tray. They did not look at more steps. There was a clear positive correlation between the fraction of steps that people looked at when walking with and without the tray. Thus, the variability in the extent to which people look at the steps persists when one makes walking on the staircase more challenging.
- Top Cited PapersOpen Access
- 29 February 2024
- Published by Springer Nature in Behavior Research Methods
- Vol. 56 (4) , 3280-3299
What is a blink? Classifying and characterizing blinks in eye openness signals
Blinks, the closing and opening of the eyelids, are used in a wide array of fields where human function and behavior are studied. In data from video-based eye trackers, blink rate and duration are often estimated from the pupil-size signal. However, blinks and their parameters can be estimated only indirectly from this signal, since it does not explicitly contain information about the eyelid position. We ask whether blinks detected from an eye openness signal that estimates the distance between the eyelids (EO blinks) are comparable to blinks detected with a traditional algorithm using the pupil-size signal (PS blinks) and how robust blink detection is when data quality is low. In terms of rate, there was an almost-perfect overlap between EO and PS blink (F1 score: 0.98) when the head was in the center of the eye tracker’s tracking range where data quality was high and a high overlap (F1 score 0.94) when the head was at the edge of the tracking range where data quality was worse. When there was a difference in blink rate between EO and PS blinks, it was mainly due to data loss in the pupil-size signal. Blink durations were about 60 ms longer in EO blinks compared to PS blinks. Moreover, the dynamics of EO blinks was similar to results from previous literature. We conclude that the eye openness signal together with our proposed blink detection algorithm provides an advantageous method to detect and describe blinks in greater detail.
- 29 February 2024
- Published by Springer Nature in Behavior Research Methods
- Vol. 56 (4) , 3280-3299
Top Cited PapersOpen AccessWhat is a blink? Classifying and characterizing blinks in eye openness signals
Blinks, the closing and opening of the eyelids, are used in a wide array of fields where human function and behavior are studied. In data from video-based eye trackers, blink rate and duration are often estimated from the pupil-size signal. However, blinks and their parameters can be estimated only indirectly from this signal, since it does not explicitly contain information about the eyelid position. We ask whether blinks detected from an eye openness signal that estimates the distance between the eyelids (EO blinks) are comparable to blinks detected with a traditional algorithm using the pupil-size signal (PS blinks) and how robust blink detection is when data quality is low. In terms of rate, there was an almost-perfect overlap between EO and PS blink (F1 score: 0.98) when the head was in the center of the eye tracker’s tracking range where data quality was high and a high overlap (F1 score 0.94) when the head was at the edge of the tracking range where data quality was worse. When there was a difference in blink rate between EO and PS blinks, it was mainly due to data loss in the pupil-size signal. Blink durations were about 60 ms longer in EO blinks compared to PS blinks. Moreover, the dynamics of EO blinks was similar to results from previous literature. We conclude that the eye openness signal together with our proposed blink detection algorithm provides an advantageous method to detect and describe blinks in greater detail.