John M. Henderson
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
John M. Henderson has a total of 36 co-authors. Here are the top co-authors by number of shared publications:
- Taylor R. Hayes
Center for Mind and Brain, University of California, Davis, USA
19 shared publications - Gwendolyn Rehrig
Univ Calif Davis, Dept Psychol, One Shields Ave, Davis, CA 95616 USA
12 shared publications - Candace Elise Peacock
University of Colorado Boulder
9 shared publications Fernanda Ferreira
9 shared publications- Deborah A. Cronin
Drake University
6 shared publications - Michelle M. Ramey
Department of Psychological Science, University of Arkansas, Fayetteville, USA
6 shared publications
Latest Publications
- Open Access
Planning to be incremental: Scene descriptions reveal meaningful clustering in language production
- 4 August 2025
- Published by Springer Nature in Attention, Perception, & Psychophysics
- Vol. 87 (8) , 2332-2343
Scene inversion impairs activation of scene-object semantic bias
Inferences on semantic scene content enable the visual system to efficiently parse complex naturalistic scenes. In the early stages of scene perception, conceptual scene gist activates semantic expectations and relevant scene-object associations that bias the viewer to affirm the presence of semantically consistent objects and to reject the presence of semantically inconsistent objects within the overall scene context. This contextual scene-object bias is crucial to various visual cognitive functions, from object recognition to attentional guidance. Despite its top-down influence, however, few studies have directly investigated the factors that drive the activation of scene-object bias. Here, we tested the role of global scene semantics in the activation of scene-object bias by comparing response bias on briefly presented upright versus inverted scenes. We found that scene inversion not only significantly delayed overall bias activation, but also differentially impacted superordinate-level versus basic-level bias. Hierarchical differences were also highlighted by earlier and more robust activation of superordinate-level bias than basic-level bias. Taken together, the present work provides important characterization to gist-activated scene-object bias, which is an essential and influential top-down mechanism in scene perception and visual cognition.
- 4 August 2025
- Published by Springer Nature in Attention, Perception, & Psychophysics
- Vol. 87 (8) , 2332-2343
Scene inversion impairs activation of scene-object semantic bias
Inferences on semantic scene content enable the visual system to efficiently parse complex naturalistic scenes. In the early stages of scene perception, conceptual scene gist activates semantic expectations and relevant scene-object associations that bias the viewer to affirm the presence of semantically consistent objects and to reject the presence of semantically inconsistent objects within the overall scene context. This contextual scene-object bias is crucial to various visual cognitive functions, from object recognition to attentional guidance. Despite its top-down influence, however, few studies have directly investigated the factors that drive the activation of scene-object bias. Here, we tested the role of global scene semantics in the activation of scene-object bias by comparing response bias on briefly presented upright versus inverted scenes. We found that scene inversion not only significantly delayed overall bias activation, but also differentially impacted superordinate-level versus basic-level bias. Hierarchical differences were also highlighted by earlier and more robust activation of superordinate-level bias than basic-level bias. Taken together, the present work provides important characterization to gist-activated scene-object bias, which is an essential and influential top-down mechanism in scene perception and visual cognition.
- Open Access
DeepMeaning: Estimating and Interpreting Scene Meaning for Attention Using a Vision-Language Transformer
Humans rapidly process and understand real-world scenes with ease. Our stored semantic knowledge gained from experience is thought to be central to this ability by organizing perceptual information into meaningful units to efficiently guide our attention. However, the role stored semantic representations play in attentional guidance remains difficult to study and poorly understood. Here, we apply a state-of-the-art vision-language transformer trained on billions of image-text pairs to help advance our understanding of the role local meaning plays in scene guidance. Specifically, we demonstrate that this transformer-based approach can be used to automatically estimate local scene meaning in indoor and outdoor scenes, predict where people look in these scenes, detect changes in local semantic content, and provide multiple avenues to model interpretation through its language capabilities. Taken together, these findings highlight how multimodal transformers can advance our understanding of the role scene semantics play in scene attention by serving as a representational framework that bridges vision and language.
Open AccessDeepMeaning: Estimating and Interpreting Scene Meaning for Attention Using a Vision-Language Transformer
Humans rapidly process and understand real-world scenes with ease. Our stored semantic knowledge gained from experience is thought to be central to this ability by organizing perceptual information into meaningful units to efficiently guide our attention. However, the role stored semantic representations play in attentional guidance remains difficult to study and poorly understood. Here, we apply a state-of-the-art vision-language transformer trained on billions of image-text pairs to help advance our understanding of the role local meaning plays in scene guidance. Specifically, we demonstrate that this transformer-based approach can be used to automatically estimate local scene meaning in indoor and outdoor scenes, predict where people look in these scenes, detect changes in local semantic content, and provide multiple avenues to model interpretation through its language capabilities. Taken together, these findings highlight how multimodal transformers can advance our understanding of the role scene semantics play in scene attention by serving as a representational framework that bridges vision and language.
- Open Access
- 7 February 2025
- Published by Taylor & Francis in Visual Cognition
- Vol. 33 (2) , 89-104
Meaning maps predict reaction time in change detection
To detect changes in our visual environments, the visual system compares pre-and post-change representations maintained in active working memory. Previous research has suggested that change detection is primarily informed by high-level semantics in naturalistic scenes. Here, across two experiments, we used meaning maps - a data driven method to measure the visual semantic information in naturalistic scenes - to investigate whether semantic features predicted visual change detection in a flicker paradigm. Experiment 1 showed that changes in highly meaningful regions were more easily detected than changes in non-meaningful regions despite controlling for low-level visual saliency. Experiment 2 found that the meaning-driven advantage was significantly reduced by scene inversion, further supporting the role of semantics in change detection. Together, these results demonstrate that the visual system relies on semantic features during change detection.
- 7 February 2025
- Published by Taylor & Francis in Visual Cognition
- Vol. 33 (2) , 89-104
Open AccessMeaning maps predict reaction time in change detection
To detect changes in our visual environments, the visual system compares pre-and post-change representations maintained in active working memory. Previous research has suggested that change detection is primarily informed by high-level semantics in naturalistic scenes. Here, across two experiments, we used meaning maps - a data driven method to measure the visual semantic information in naturalistic scenes - to investigate whether semantic features predicted visual change detection in a flicker paradigm. Experiment 1 showed that changes in highly meaningful regions were more easily detected than changes in non-meaningful regions despite controlling for low-level visual saliency. Experiment 2 found that the meaning-driven advantage was significantly reduced by scene inversion, further supporting the role of semantics in change detection. Together, these results demonstrate that the visual system relies on semantic features during change detection.
- Open Access
- 17 December 2024
- Published by Center for Open Science in PsyArXiv
Objects in focus: How object spatial probability underscores eye movement patterns
In human vision, objects and scenes are fundamentally interconnected elements that play a critical role in shaping our perception and understanding of the visual world. In natural viewing conditions, objects and scenes are seldom encountered in isolation. The visual system has evolved to process the statistical probability of different spatial arrangements, with contextual information offering key insights into object functionality and relevance. One way to elucidate the human visual perceptive process is to track and predict how humans visually explore images through eye movements. Other datasets of eye movements have been shared openly online. However, existing datasets are limited by the range of camera perspectives represented (close-up viewpoints of objects or faces vs. wide-angle perspectives of real-world scenes), and the number of objects segmented within the images. To address this, we developed the Objects in Focus dataset. We semantically segmented 2800 unique objects across the 100 real-world scenes and collected measures of each object's size, eccentricity, semantic significance, and visual saliency, with an average of 28.7 segmented objects in each scene image. We also include analyses comparing the distributions of objects and fixations across scene images and discuss how image size and perspective influence attention dispersion. Finally, we relate our findings considering attention prediction networks and discuss how formal definitions of spatial arrangement probabilities can be used to improve different computer vision models.
- 17 December 2024
- Published by Center for Open Science in PsyArXiv
Open AccessObjects in focus: How object spatial probability underscores eye movement patterns
In human vision, objects and scenes are fundamentally interconnected elements that play a critical role in shaping our perception and understanding of the visual world. In natural viewing conditions, objects and scenes are seldom encountered in isolation. The visual system has evolved to process the statistical probability of different spatial arrangements, with contextual information offering key insights into object functionality and relevance. One way to elucidate the human visual perceptive process is to track and predict how humans visually explore images through eye movements. Other datasets of eye movements have been shared openly online. However, existing datasets are limited by the range of camera perspectives represented (close-up viewpoints of objects or faces vs. wide-angle perspectives of real-world scenes), and the number of objects segmented within the images. To address this, we developed the Objects in Focus dataset. We semantically segmented 2800 unique objects across the 100 real-world scenes and collected measures of each object's size, eccentricity, semantic significance, and visual saliency, with an average of 28.7 segmented objects in each scene image. We also include analyses comparing the distributions of objects and fixations across scene images and discuss how image size and perspective influence attention dispersion. Finally, we relate our findings considering attention prediction networks and discuss how formal definitions of spatial arrangement probabilities can be used to improve different computer vision models.
- Open Access
- 14 December 2023
- Published by Center for Open Science in PsyArXiv
How schema knowledge influences memory in older adults: Filling in the gaps, or leading memory astray?
Age-related declines in episodic memory do not affect all types of mnemonic information equally: when to-be-remembered information is in line with one’s prior knowledge, or schema-congruent, older adults often show no impairments. There are two major accounts of this effect: One proposes that schemas compensate for memory failures in aging, and the other proposes that schemas instead actively impair older adults’ otherwise intact memory for incongruent information. However, the evidence thus far is inconclusive, likely due to methodological constraints in teasing apart these complex underlying dynamics. We developed a paradigm that separately examines the contributions of underlying memory and schema knowledge to a final memory decision, allowing these dynamics to be examined directly. In the present study, healthy older and younger adults first searched for target objects in congruent or incongruent locations within scenes. In a subsequent test, participants indicated where in each scene the target had been located previously, and provided confidence-based recognition memory judgments that indexed underlying memory, in terms of recollection and familiarity, for the background scenes. We found that age-related increases in schema effects on target location spatial recall were predicted and statistically mediated by age-related increases in underlying memory failures, specifically within recollection. We also found that, relative to younger adults, older adults had poorer spatial memory precision within recollected scenes but slightly better precision within familiar scenes—and age increases in schema bias were primarily exhibited within recollected scenes. Interestingly, however, there were also slight age-related increases in schema effects that could not be explained by memory deficits alone, outlining a role for active schema influences as well. Together, these findings support the account that age-related schema effects on memory are compensatory in that they are driven primarily by underlying memory failures, and further suggest that age-related deficits in memory precision may also drive schema effects.
- 14 December 2023
- Published by Center for Open Science in PsyArXiv
Open AccessHow schema knowledge influences memory in older adults: Filling in the gaps, or leading memory astray?
Age-related declines in episodic memory do not affect all types of mnemonic information equally: when to-be-remembered information is in line with one’s prior knowledge, or schema-congruent, older adults often show no impairments. There are two major accounts of this effect: One proposes that schemas compensate for memory failures in aging, and the other proposes that schemas instead actively impair older adults’ otherwise intact memory for incongruent information. However, the evidence thus far is inconclusive, likely due to methodological constraints in teasing apart these complex underlying dynamics. We developed a paradigm that separately examines the contributions of underlying memory and schema knowledge to a final memory decision, allowing these dynamics to be examined directly. In the present study, healthy older and younger adults first searched for target objects in congruent or incongruent locations within scenes. In a subsequent test, participants indicated where in each scene the target had been located previously, and provided confidence-based recognition memory judgments that indexed underlying memory, in terms of recollection and familiarity, for the background scenes. We found that age-related increases in schema effects on target location spatial recall were predicted and statistically mediated by age-related increases in underlying memory failures, specifically within recollection. We also found that, relative to younger adults, older adults had poorer spatial memory precision within recollected scenes but slightly better precision within familiar scenes—and age increases in schema bias were primarily exhibited within recollected scenes. Interestingly, however, there were also slight age-related increases in schema effects that could not be explained by memory deficits alone, outlining a role for active schema influences as well. Together, these findings support the account that age-related schema effects on memory are compensatory in that they are driven primarily by underlying memory failures, and further suggest that age-related deficits in memory precision may also drive schema effects.
- Open Access
- 3 April 2023
- Published by Center for Open Science in PsyArXiv
Scene gist and local meaning guide attention and build memory representations: Evidence from mouse-clicks
Global and local semantic information are thought to influence where attention is allocated in real-world scene images. How the two interact to guide attention and what subsequent effects each has on memory for a viewed scene is unknown. We used the BubbleView paradigm (Kim, Bylinskii, et al., 2017) to monitor movements of attention via participants’ clicks during a scene-viewing task. We manipulated access to scene gist by providing a preview of the BubbleView scene on some trials. ‘Click Maps’ were compiled from participants’ click locations. These were compared to fixation density maps for the same scenes and to meaning maps. Click maps were similar to fixation density maps, suggesting that clicks in the BubbleView paradigm approximate the locus of overt attention. In both a between-subjects (Experiment 1) and a within-subjects comparison (Experiments 2 and 3), access to gist guided attention to locally meaningful scene regions. Local meaning also guided attention, even in the absence of gist. These results support theories describing cognitive guidance of attention in natural scene images. Access to gist and attention to meaning were also important for participants’ memory for the scene images: when participants had access to gist and when they had clicked more meaningful scene regions, they were more likely to remember the image at test. Taken together, our results suggest that global (scene gist) and local scene semantics influence both where we attend in a scene and our subsequent memory for it.
- 3 April 2023
- Published by Center for Open Science in PsyArXiv
Open AccessScene gist and local meaning guide attention and build memory representations: Evidence from mouse-clicks
Global and local semantic information are thought to influence where attention is allocated in real-world scene images. How the two interact to guide attention and what subsequent effects each has on memory for a viewed scene is unknown. We used the BubbleView paradigm (Kim, Bylinskii, et al., 2017) to monitor movements of attention via participants’ clicks during a scene-viewing task. We manipulated access to scene gist by providing a preview of the BubbleView scene on some trials. ‘Click Maps’ were compiled from participants’ click locations. These were compared to fixation density maps for the same scenes and to meaning maps. Click maps were similar to fixation density maps, suggesting that clicks in the BubbleView paradigm approximate the locus of overt attention. In both a between-subjects (Experiment 1) and a within-subjects comparison (Experiments 2 and 3), access to gist guided attention to locally meaningful scene regions. Local meaning also guided attention, even in the absence of gist. These results support theories describing cognitive guidance of attention in natural scene images. Access to gist and attention to meaning were also important for participants’ memory for the scene images: when participants had access to gist and when they had clicked more meaningful scene regions, they were more likely to remember the image at test. Taken together, our results suggest that global (scene gist) and local scene semantics influence both where we attend in a scene and our subsequent memory for it.
- Open Access
- 1 February 2023
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 23 (2) , 13
Spatiotemporal jump detection during continuous film viewing
Prior research on film viewing has demonstrated that participants frequently fail to notice spatiotemporal disruptions, such as scene edits in the movies. Whether such insensitivity to spatiotemporal disruptions extends beyond scene edits in film viewing is not well understood. Across three experiments, we created spatiotemporal disruptions by presenting participants with minute long movie clips, and occasionally jumping the movie clips ahead or backward in time. Participants were instructed to press a button when they noticed any disruptions while watching the clips. The results from experiments 1 and 2 indicate that participants failed to notice the disruptions in continuity about 10% to 30% of the time depending on the magnitude of the jump. In addition, detection rates were lower by approximately 10% when the videos jumped ahead in time compared to the backward jumps across all jump magnitudes, suggesting a role of knowledge about the future affects jump detection. An additional analysis used optic flow similarity during these disruptions. Our findings suggest that insensitivity to spatiotemporal disruptions during film viewing is influenced by knowledge about future states.
- 1 February 2023
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 23 (2) , 13
Open AccessSpatiotemporal jump detection during continuous film viewing
Prior research on film viewing has demonstrated that participants frequently fail to notice spatiotemporal disruptions, such as scene edits in the movies. Whether such insensitivity to spatiotemporal disruptions extends beyond scene edits in film viewing is not well understood. Across three experiments, we created spatiotemporal disruptions by presenting participants with minute long movie clips, and occasionally jumping the movie clips ahead or backward in time. Participants were instructed to press a button when they noticed any disruptions while watching the clips. The results from experiments 1 and 2 indicate that participants failed to notice the disruptions in continuity about 10% to 30% of the time depending on the magnitude of the jump. In addition, detection rates were lower by approximately 10% when the videos jumped ahead in time compared to the backward jumps across all jump magnitudes, suggesting a role of knowledge about the future affects jump detection. An additional analysis used optic flow similarity during these disruptions. Our findings suggest that insensitivity to spatiotemporal disruptions during film viewing is influenced by knowledge about future states.
- 1 February 2023
- Published by American Psychological Association (APA) in Psychology and Aging
- Vol. 38 (1) , 49-66
Visual attention during seeing for speaking in healthy aging.
As we age, we accumulate a wealth of information about the surrounding world. Evidence from visual search suggests that older adults retain intact knowledge for where objects tend to occur in everyday environments (semantic information) that allows them to successfully locate objects in scenes, but may overrely on semantic guidance. We investigated age differences in the allocation of attention to semantically informative and visually salient information in a task in which the eye movements of younger (N = 30, aged 18-24) and older (N = 30, aged 66-82) adults were tracked as they described real-world scenes. We measured the semantic information in scenes based on "meaning map" ratings from a norming sample of young and older adults, and image salience as graph-based visual saliency. Logistic mixed-effects modeling was used to determine whether, controlling for center bias, fixated scene locations differed in semantic informativeness and visual salience from locations that were not fixated, and whether these effects differed for young and older adults. Semantic informativeness predicted fixated locations well overall, as did image salience, although unique variance in the model was better explained by semantic informativeness than image salience. Older adults were less likely to fixate informative locations in scenes than young adults were, though the locations older adults' fixated were independently predicted well by informativeness. These results suggest young and older adults both use semantic information to guide attention in scenes and that older adults do not overrely on semantic information across the board. Public Significance Statement Older adults have more knowledge from lived experience about everyday scenes, such as what might typically be found in the rooms in a house, and past studies have shown that older adults rely more on their scene knowledge (semantic information) than young adults do when searching for objects in photographs of scenes. In our study, we tracked where young and older adults looked in photographs of everyday environments while they talked about the scenes rather than searching for objects in them. We found that semantic information predicted where young adults looked better than it predicted where older adults looked, although the parts of the scene older adults looked at were also predicted well by semantic information independently. Our results suggest that older adults may not leverage their considerable knowledge about the world equally across visual tasks (searching for an object in a photograph vs. deciding what to describe in a photograph) and should not be assumed to do so more than their young adult counterparts across the board. These findings suggest it is important to be cautious when assuming that healthy older adults' greater knowledge base is routinely consulted to compensate for other age-related changes, such as declines in perceptual skills.
- 1 February 2023
- Published by American Psychological Association (APA) in Psychology and Aging
- Vol. 38 (1) , 49-66
Visual attention during seeing for speaking in healthy aging.
As we age, we accumulate a wealth of information about the surrounding world. Evidence from visual search suggests that older adults retain intact knowledge for where objects tend to occur in everyday environments (semantic information) that allows them to successfully locate objects in scenes, but may overrely on semantic guidance. We investigated age differences in the allocation of attention to semantically informative and visually salient information in a task in which the eye movements of younger (N = 30, aged 18-24) and older (N = 30, aged 66-82) adults were tracked as they described real-world scenes. We measured the semantic information in scenes based on "meaning map" ratings from a norming sample of young and older adults, and image salience as graph-based visual saliency. Logistic mixed-effects modeling was used to determine whether, controlling for center bias, fixated scene locations differed in semantic informativeness and visual salience from locations that were not fixated, and whether these effects differed for young and older adults. Semantic informativeness predicted fixated locations well overall, as did image salience, although unique variance in the model was better explained by semantic informativeness than image salience. Older adults were less likely to fixate informative locations in scenes than young adults were, though the locations older adults' fixated were independently predicted well by informativeness. These results suggest young and older adults both use semantic information to guide attention in scenes and that older adults do not overrely on semantic information across the board. Public Significance Statement Older adults have more knowledge from lived experience about everyday scenes, such as what might typically be found in the rooms in a house, and past studies have shown that older adults rely more on their scene knowledge (semantic information) than young adults do when searching for objects in photographs of scenes. In our study, we tracked where young and older adults looked in photographs of everyday environments while they talked about the scenes rather than searching for objects in them. We found that semantic information predicted where young adults looked better than it predicted where older adults looked, although the parts of the scene older adults looked at were also predicted well by semantic information independently. Our results suggest that older adults may not leverage their considerable knowledge about the world equally across visual tasks (searching for an object in a photograph vs. deciding what to describe in a photograph) and should not be assumed to do so more than their young adult counterparts across the board. These findings suggest it is important to be cautious when assuming that healthy older adults' greater knowledge base is routinely consulted to compensate for other age-related changes, such as declines in perceptual skills.
- Open Access
- 27 May 2022
- Published by Center for Open Science in PsyArXiv
Working memory control predicts fixation duration in scene-viewing
When viewing scenes, observers differ in how long they linger at each fixation location and how far they move their eyes between fixations. What factors drive these differences in eye-movement behaviors? Previous work suggests individual differences in working memory capacity may influence fixation durations and saccade amplitudes. In the present study, participants (N = 98) performed two scene-viewing tasks, aesthetic judgement and memorization, while viewing 100 photographs of real-world scenes. Working memory capacity, working memory processing ability, and fluid intelligence were assessed with an operation span task, a memory updating task, and Raven’s Advanced Progressive Matrices respectively. Across participants, we found significant effects of task on both fixation durations and saccade amplitudes. At the level of each individual participant, we also found a significant relationship between memory updating task performance and participants’ fixation duration distributions. However, we found no effect of fluid intelligence and no effect of working memory capacity on fixation duration or saccade amplitude distributions, inconsistent with previous findings. These results suggest that the ability to flexibly maintain and update working memory is strongly related to fixation duration behavior.
- 27 May 2022
- Published by Center for Open Science in PsyArXiv
Open AccessWorking memory control predicts fixation duration in scene-viewing
When viewing scenes, observers differ in how long they linger at each fixation location and how far they move their eyes between fixations. What factors drive these differences in eye-movement behaviors? Previous work suggests individual differences in working memory capacity may influence fixation durations and saccade amplitudes. In the present study, participants (N = 98) performed two scene-viewing tasks, aesthetic judgement and memorization, while viewing 100 photographs of real-world scenes. Working memory capacity, working memory processing ability, and fluid intelligence were assessed with an operation span task, a memory updating task, and Raven’s Advanced Progressive Matrices respectively. Across participants, we found significant effects of task on both fixation durations and saccade amplitudes. At the level of each individual participant, we also found a significant relationship between memory updating task performance and participants’ fixation duration distributions. However, we found no effect of fluid intelligence and no effect of working memory capacity on fixation duration or saccade amplitude distributions, inconsistent with previous findings. These results suggest that the ability to flexibly maintain and update working memory is strongly related to fixation duration behavior.