YXYaoda Xu

Yaoda Xu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Yaoda Xu has a total of 24 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Increased Cognitive Load Expands, Stabilizes, and Aligns Visual Representation Across the Human Brain

    by Shijie Qu, Marvin M. Chun, Yaoda Xu

    Cognitive load refers to the mental effort required to perform a task. While previous research has extensively examined its detrimental effects on neural and behavioral performance, much less is known about how the brain actively adapts to heightened demands. Across two fMRI experiments involving visual n-back tasks, we identified several fundamental properties of this adaptive process. First, higher load enhanced and expanded visual representations beyond localized visual regions, leading to widespread visual coding. At the global scale, heightened load promoted cross-regional coordination by increasing representational alignment and strengthening information encoded in interregional functional connectivity patterns. Beyond facilitating stronger visual representation, increased load also reduced neural pattern variability, which led to more stable information coding. Finally, load was encoded independently of other task-relevant information as a separate brain state, supporting its overarching role in guiding visual processing. Together, these findings revealed that the brain adapts to heightened cognitive demands by globally reorganizing neural processing to support flexible cognition. Highlights: The brain employs multiple neural mechanisms to adapt to heightened cognitive demands. Increased cognitive load strengthens and expands visual representations beyond visual regions. Higher cognitive load enhances cross-regional coordination through increased representational alignment and stronger information coding in interregional connectivity patterns. Neural pattern variability decreases under greater load, promoting more stable representations Load is encoded as a distributed brain state, with minimal interaction with other variables

  • Open Access

    Neural Representations of Ensemble Mean and Variance Across Visual Features

    by Patxi Elosegi, Seyma Takir, Ning Mei, Yaoda Xu, David Soto

    Humans can rapidly extract summary statistics, such as the mean and variance of visual features, to efficiently represent complex visual environments despite limits in attention and working memory. For example, when viewing a field of flowers, we can perceive the average colour and overall variability of the display without individuating each flower. Although ensemble perception is central to visual cognition, two fundamental questions remain unresolved. First, it is unclear whether ensemble statistics for features represented at different levels of the visual hierarchy rely on a common neural system or on separate feature-specific systems. Second, it remains unknown whether different summary statistics, such as mean and variance, rely on shared or dissociable neural mechanisms. Here, we used fMRI and multivariate pattern analysis to examine the neural representation of ensemble mean and variance across three visual features spanning the processing hierarchy: orientation (low-level), shape (mid-level), and animacy (high-level) (N = 24; two fMRI sessions). By combining whole-brain searchlight and ROI-based approaches, we found a graded division of labour between ventral and dorsal visual pathways. Although mean and variance ensemble statistics were distributed across the visual cortex, mean decoding was stronger in ventral regions, whereas variance decoding was stronger in dorsal regions. Ensemble mean representations followed a posterior–anterior gradient within the ventral visual pathway, consistent with increasing abstraction from orientation to shape and animacy, and showed little anatomical overlap suggesting largely feature-specific. By contrast, ensemble variance was weighted toward dorsal parietal and frontoparietal regions, especially superior parietal cortex and intraparietal sulcus, decoding clusters largely overlap across features and generalized robustly across orientation, shape, and animacy. Together, these findings provide a more nuanced account of ensemble perception, showing that feature-specific and feature-independent neural codes can coexist across visual cortex and help reconcile previously conflicting evidence. Significance Statement: This study shows that information about ensemble mean and variance is distributed throughout the visual cortex but weighted differently across visual pathways. Mean-related information was stronger in the ventral visual pathway and showed a largely feature-independent anatomical organization, whereas variance-related information was stronger in dorsal parietal regions and generalized across orientation, shape and animacy. Together, these findings provide clarifying neural evidence for longstanding debates about whether ensemble statistics rely on shared or dissociable mechanisms and whether ensemble representations are feature-specific or generalize across visual features. More broadly, the study offers a nuanced account of ensemble perception in which feature-specific and feature-general neural codes coexist across visual cortex, potentially reconciling previously conflicting evidence.

  • Open Access

    Interactive shape and color representation in visual working memory for colored objects in the human occipitotemporal cortex

    by Yaoda Xu, Benjamin Swinchoski, JohnMark Taylor, Marvin Chun

    Two defining visual features of a real-world object are its shape and color. While previous fMRI pattern decoding studies showed that these features are represented in a largely orthogonal and independent manner in the human occipitotemporal cortex (OTC) during visual perception, how they are coded together in visual working memory (VWM) remains unknown. Here, we asked human participants to retain a real-world object’s shape and color together in VWM. Using fMRI pattern decoding, we trained a linear classifier to decode two object shapes in one color to then decode the same two object shapes either in the same color (within-decoding) or in a different color (cross-decoding). During VWM encoding, replicating prior findings, we found significant cross-decoding and no drop in cross-decoding compared to within-decoding across OTC, indicating orthogonal and independent shape and color coding. During VWM delay, we again found significant cross-decoding, but more critically, a significant cross-decoding drop in OTC shape-selective areas and ventral color areas, indicating interactive shape and color coding in these areas in VWM. To our knowledge, this is the first time that interactive shape and color representations are reported in VWM in the human brain using fMRI pattern decoding. Sensory representations of an object’s shape and color are thus transformed during VWM delay, likely tracking the demand of VWM to enable more efficient information storage.

  • Representing Visual Objects, Attention, and Load in Human Occipito-temporal and Posterior Parietal Cortices

    by Yaoda Xu, Marvin Chun

    Stability and adaptability are two essential components of everyday vision, enabling us to maintain an object's identity as we attend to different features under varying task loads. We hypothesize that these two components of vision are supported by the interactions among object, attention, and load representations, and the interplay between the human occipito-temporal cortex (OTC), given its visual representation invariance, and the posterior parietal cortex (PPC), an adaptive visual processing center. To test this, human participants performed four tasks on the same stream of colored objects with varying attention (attending to color or shape) and load (1-back or 2-back repetition detection). Although the exact neural mechanisms differ in how object, attention, and load modulate neural responses, by placing them as different factors in the same visual representational space using fMRI pattern decoding, we directly compared their effects on visual responses and interactions. We found significant object, attention, and load representations across OTC and PPC, with a gradual transition from more object-sensitive representations in OTC to more attention- and load-sensitive representations in PPC. Notably, object, attention, and load representations showed significant interactions and generalizations across changes with each other in both OTC and PPC. When objects were held constant, attention and load were represented independently of each other, showing their neural separability. Together, the invariant and adaptive nature of object, attention, and load representations in OTC and PPC provides both stability in visual processing and adaptation to the ever-changing visual input and task demands.


  • Open Access

    Using fMRI Representations of Single Objects to Predict Multiple Objects in Working Memory in Human Occipitotemporal and Posterior Parietal Cortices

    by Yaoda Xu, Marvin Chun

    Research in visual perception has shown that in sensory areas, neural responses to a pair of objects presented together can be approximated by the linear average of the responses of each object shown alone. In this study, we ask if such an averaging relationship is unique to perceptual representations or if it also applies to representations maintained in visual working memory (VWM). By examining fMRI response pattern averaging across two experiments in both male and female human participants, we found that after properly accounting for task factors such as load, an averaging relationship also applies to representations formed in VWM. Specifically, VWM representations for two items can be approximated by the linear average of the VWM representations of each component item in both human occipitotemporal cortex (including early visual areas) and posterior parietal cortex. Although response averaging was originally proposed as a mechanism to combat distortion in representation due to neuronal response saturation in perception, the present study shows that even when response amplitudes were much lower in VWM compared with those in visual perception, an averaging relationship is still present for neural representations formed in VWM. This likely stems from the need to reduce interference among the concurrently stored items in VWM to maintain their representational independence. As an experimental method, response averaging may constitute an efficient yet simple tool to probe response independence in the human brain beyond perception and VWM.

  • Open Access

    Transformed Visual Working Memory Representations in Human Occipitotemporal and Posterior Parietal Cortices

    by Yaoda Xu

    Recent fMRI studies reported transformed representations between perception and visual working memory (VWM) in the human early visual cortex (EVC). This is inconsistent with the still widely cited original proposal of the sensory account of VWM, which argues for a shared perception-VWM representation based on successful cross-decoding of the two representations. Although cross-decoding was usually lower than within-VWM decoding and consistent with transformed VWM representations, this has been attributed to experimental differences between perceptual and VWM tasks: once they are equated, the same representation is expected to exist in both. Including human participants of both sexes, this study compared target and distractor representations during the same VWM delay period for the same objects, thereby equating experimental differences. Even with strong VWM representations present throughout the occipitotemporal cortex (OTC, including EVC) and posterior parietal cortex (PPC), fMRI cross-decoding revealed significant representational differences between distractors (perception) and targets (VWM) in both regions. Similar differences existed between target encoding (perception) and delay (VWM), being greater in OTC than PPC, indicating more invariant target representations in PPC than OTC. As only part of the sensory input is usually task-relevant, sustaining sensory input in VWM without selection/refinement/consolidation is both taxing and unnecessary. Transformed representations, mediated by task goals and associative areas coding task-relevant information (e.g., PPC), can easily account for these and other recent findings. A task-driven transformed account of VWM thus better captures the nature of VWM representation in the human brain (including EVC) than the sensory representations originally proposed by the sensory account of VWM.


  • Open Access

    The human posterior parietal cortices orthogonalize the representation of different streams of information concurrently coded in visual working memory

    by Yaoda Xu

    The key to adaptive visual processing lies in the ability to maintain goal-directed visual representation in the face of distraction. In visual working memory (VWM), distraction may come from the coding of distractors or other concurrently retained targets. This fMRI study reveals a common representational geometry that our brain uses to combat both types of distractions in VWM. Specifically, using fMRI pattern decoding, the human posterior parietal cortex is shown to orthogonalize the representations of different streams of information concurrently coded in VWM, whether they are targets and distractors, or different targets concurrently held in VWM. The latter is also seen in the human occipitotemporal cortex. Such a representational geometry provides an elegant and simple solution to enable independent information readout, effectively combating distraction from the different streams of information, while accommodating their concurrent representations. This representational scheme differs from mechanisms that actively suppress or block the encoding of distractors to reduce interference. It is likely a general neural representational principle that supports our ability to represent information beyond VWM in other situations where multiple streams of visual information are tracked and processed simultaneously.


  • Open Access

    Visual event boundaries trigger forgetting despite active maintenance in visual working memory

    by Joan Danielle K. Ongchoco, Yaoda Xu

    The contents of visual perception are inherently dynamic—just as we experience objects in space, so too events in time. The boundaries between these events have downstream consequences. For example, memory for incidentally encountered items is impaired when walking through a doorway, perhaps because event boundaries serve as cues to clear obsolete information from previous events. Although this kind of “memory flushing” can be adaptive, work on visual working memory (VWM) has focused on the opposite function of active maintenance in the face of distraction. How do these two cognitive operations interact? In this study, observers watched animations in which they walked through three-dimensionally rendered rooms with picture frames on the walls. Within the frames, observers either saw images that they had to remember (“encoding”) or recalled images they had seen in the immediately preceding frame (“test”). Half of the time, a doorway was crossed during the delay between encoding and test. Across experiments, there was a consistent memory decrement for the first image encoded in the doorway compared to the no-doorway condition while equating time elapsed, distance traveled, and distractibility of the doorway. This decrement despite top–down VWM efforts highlights the power of event boundaries to structure what and when we forget.


  • Using DNNs to understand the primate vision: A shortcut or a distraction?

    by Yaoda Xu, Maryam Vaziri-Pashkam

    Bowers et al. bring forward critical issues in the current use of deep neural networks (DNNs) to model primate vision. Our own research further reveals fundamentally different algorithms utilized by DNNs for visual processing compared to the brain. It is time to reemphasize the value of basic vision research and put more resources and effort on understanding the primate brain itself.