TKTim Christian Kietzmann

Tim Christian Kietzmann

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Recognitions

Top Cited Scholar (2024)

Tim Christian Kietzmann has a total of 185 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Predicting upcoming visual features during eye movements yields scene representations aligned with human visual cortex

    by Sushrut Thorat, Adrien Doerig, Alexander Kroner, Carmen Amme, Tim C. Kietzmann

    Natural scenes are complex arrangements of objects, surfaces, and backgrounds. For the brain’s visual system to effectively operate, it needs to extract not only what objects are present but also their spatial and semantic relations. We hypothesize that such structures may be learned, in a self-supervised fashion, by exploiting temporal regularities of natural active vision: Each fixation reveals a glimpse that is related to the previous one via co-occurrence and saccade-conditioned spatial regularities. We instantiate this idea with glimpse prediction networks (GPNs), recurrent models trained to predict the embedding of the next glimpse along human-like scanpaths. GPNs are shown to successfully extract complex scene information, including object co-occurrences and spatial object arrangements, and integrate information across glimpses. GPN representations align strongly with human fMRI responses in mid- and higher-level visual cortex and match, often outperform, alternative state-of-the-art ANN models, establishing next-glimpse-prediction as a biologically plausible route toward brain-aligned scene representations.

  • Open Access

    The Umwelt Representation Hypothesis: rethinking Universality

    by Victoria Bosch, Rowan P. Sommers, Adrien Doerig, Tim C. Kietzmann


  • Open Access

    Exploring Neural Signatures of Self-Initiated Saccadic and Blink Events in the Real World

    by Aitana Grasso-Cladera, Debora Nolte, Alina Zaidan, Aziz Muhammed Akkaya, Tim C. Kietzmann, Peter König

    During natural vision, the human brain constantly has to account for self-produced interruptions of visual input, through blinks and saccades, to maintain a stable perception of the world. It remains unclear whether these event-related neural responses are treated similarly due to a common underlying mechanism. To systematically investigate this functional connection, we recorded synchronized mobile EEG and eye-tracking data from freely moving participants as they (visually) explored a city center. Our results replicate prior findings showing that a substantial portion of the neural response is aligned to event onsets in comparison to offset, underscoring the relevance of investigating the beginning and end of these events. Using advanced deconvolution techniques, we disentangled overlapping, time-locked neural contributions associated with the onsets and offsets of saccades and blinks. The results demonstrate that the deconvoluted neural kernels are highly correlated when comparing saccade onset to blink onset, as well as saccade offset to blink offset, for both evoked and induced activity across electrodes. Together, our findings demonstrate that despite their distinct physical profiles, saccades and blinks share a common neural signature that governs both their onset and offset dynamics during unconstrained real-world behavior. Highlights: Co-registration of portable EEG and Eye-Tracking yielded meaningful real world data. We studied blinks and saccades as natural interruptions of visual processes. Aligning EEG data to onset and offset underscored the relevance of both timepoints. We deconvoluted overlapping neural activity for onsets/offsets of saccades/blinks. ERPs and TFRs are highly correlated for onset/offset of blinks and saccades.

  • Open Access

    Fixation duration on natural scenes is explained by memory encoding not processing demand

    by Philip Sulewski, Carmen Amme, Martin N. Hebart, Peter König, Tim C. Kietzmann

    Before each of around 200,000 eye movements we make each day, the brain decides how long to fixate before shifting gaze to new information. Here we investigate this process using a large-scale scene-viewing experiment (4,080 natural scenes, five participants) that combines magnetoencephalography, eye tracking and a semantic captioning task. Using multivariate analysis of magnetoencephalography source-space patterns, behavioral analyses and artificial neural network (ANN) modeling, we show that longer fixations do not reflect prolonged visual processing but relate to downstream memory encoding. First, temporal variability of ventral stream representational dynamics did not explain variability in fixation duration. Second, fixation durations were anticorrelated with ANN-estimated patch classification difficulty. Third, fixation durations correlate positively with ANN-predicted patch memorability and caption-inclusion and co-occur with increased theta–gamma phase–amplitude coupling, particularly in frontal and hippocampal regions. These results indicate that eye-movement timing decisions are shaped by memory-encoding demands rather than by perceptual processing limits.


  • Open Access

    Adopting a human developmental visual diet yields robust and shape-based AI vision

    by Zejin Lu, Sushrut Thorat, Radoslaw M. Cichy, Tim C. Kietzmann

    Despite years of research and the dramatic scaling of artificial intelligence (AI) systems, a striking misalignment between artificial and human vision persists. Contrary to humans, AI relies heavily on texture features rather than shape information, lacks robustness to image distortions, remains highly vulnerable to adversarial attacks, and struggles to recognize simple abstract shapes within complex backgrounds. Here, to close this gap, we take inspiration from how human vision develops from early infancy into adulthood. We quantified visual maturation by synthesizing decades of research into a novel developmental visual diet for AI vision. Guiding AI systems through this human-inspired curriculum, which considers the development of visual acuity, contrast sensitivity and colour, produces models that better align with human behaviour on every hallmark of robust vision tested, yielding strong reliance on shape information, abstract shape recognition beyond the state of the art, and higher resilience to image corruptions and adversarial attacks. Our results thus demonstrate that robust AI vision can be achieved by guiding how a model learns, not merely how much it learns, offering a resource-efficient route towards safer and more human-like artificial visual systems.


  • Top Cited Papers
    Open Access

    High-level visual representations in the human brain are aligned with large language models

    by Adrien Doerig, Tim C. Kietzmann, Emily Allen, Yihan Wu, Thomas Naselaris, Kendrick Kay, Ian Charest

    The human brain extracts complex information from visual inputs, including objects, their spatial and semantic interrelations, and their interactions with the environment. However, a quantitative approach for studying this information remains elusive. Here we test whether the contextual information encoded in large language models (LLMs) is beneficial for modelling the complex visual information extracted by the brain from natural scenes. We show that LLM embeddings of scene captions successfully characterize brain activity evoked by viewing the natural scenes. This mapping captures selectivities of different brain areas and is sufficiently robust that accurate scene captions can be reconstructed from brain activity. Using carefully controlled model comparisons, we then proceed to show that the accuracy with which LLM representations match brain representations derives from the ability of LLMs to integrate complex information contained in scene captions beyond that conveyed by individual words. Finally, we train deep neural network models to transform image inputs into LLM representations. Remarkably, these networks learn representations that are better aligned with brain representations than a large number of state-of-the-art alternative models, despite being trained on orders-of-magnitude less data. Overall, our results suggest that LLM embeddings of scene captions provide a representational format that accounts for complex information extracted by the brain from visual inputs.


  • Open Access

    Why we linger: Memory encoding, rather than visual processing demand, drives fixation timing on natural scenes - evidence from a large-scale MEG dataset

    by Philip Sulewski, Carmen Amme, Martin Hebart, Peter König, Tim Kietzmann

    Prior to each of the ~200k daily eye movements, our brain needs to decide how long to remain fixated at the current location while novel information awaits elsewhere. To elucidate this process, here we report on the results of a large-scale scene-viewing experiment [4,080 natural scenes, 5 participants] that combines magnetoencephalography (MEG), eye tracking, and a semantic scene captioning task. Using multivariate analysis techniques of MEG source-space patterns, behavioural analyses and artificial neural network (ANN) modelling, we demonstrate that longer fixations do not arise from prolonged visual processing, but rather relate to downstream memory encoding. First, the temporal variability of ventral stream representational dynamics does not explain variability in fixation duration. Second, fixation durations are anti-correlated with patch complexity, as estimated from task-trained ANN models. Third, fixation durations correlate positively with ANN-predicted patch memorability and caption-inclusion, and co-occur with increased theta-gamma phase-amplitude coupling, particularly in frontal, and hippocampal regions.

  • Open Access

    End-to-end topographic networks as models of cortical map formation and human visual behaviour

    by Zejin Lu, Adrien Doerig, Victoria Bosch, Bas Krahmer, Daniel Kaiser, Radoslaw M. Cichy, Tim C. Kietzmann

    A prominent feature of the primate visual system is its topographic organization. For understanding its origins, its computational role and its behavioural implications, computational models are of central importance. Yet, vision is commonly modelled using convolutional neural networks, which are hard-wired to learn identical features across space and thus lack topography. Here we overcome this limitation by introducing all-topographic neural networks (All-TNNs). All-TNNs develop several features reminiscent of primate topography, including smooth orientation and category selectivity maps, and enhanced processing of regions with task-relevant information. In addition, All-TNNs operate on a low energy budget, suggesting a metabolic benefit of smooth topographic organization. To test our model against behaviour, we collected a dataset of human spatial biases in object recognition and found that All-TNNs significantly outperform control models. All-TNNs thereby offer a promising candidate for modelling primate visual topography and its role in downstream behaviour.


  • Open Access

    Predictive remapping and allocentric coding as consequences of energy efficiency in recurrent neural network models of active vision

    by Thomas Nortmann, Philip Sulewski, Tim C. Kietzmann

    Despite moving our eyes from one location to another, our perception of the world is stable - an aspect thought to rely on predictive computations that use efference copies to predict the upcoming foveal input. Are these complex computations genetically hard-coded, or can they emerge from simpler principles? Here we consider the organism’s limited energy budget as a potential origin. We expose a recurrent neural network to sequences of fixation patches and saccadic efference copies, training the model to minimise energy consumption (preactivation). We show that targeted inhibitory predictive remapping emerges from this energy efficiency optimization alone. As furthermore demonstrated, this computation relies on the model’s learned ability to re-code egocentric eye-coordinates into an allocentric (imagecentric) reference frame. Together, our findings suggest that both allocentric coding and predictive remapping can emerge from energy efficiency constraints during active vision, demonstrating how complex neural computations can arise from simple physical principles.


  • Open Access

    Sparks of cognitive flexibility: self-guided context inference for flexible stimulus-response mapping by attentional routing

    by Rowan P. Sommers, Sushrut Thorat, Daniel Anthes, Tim C. Kietzmann

    Flexible cognition demands discovering hidden rules to quickly adapt stimulus-response mappings. Standard neural networks struggle in such tasks requiring rapid, context-driven remapping. Recently, Hummos (2023) introduced a fast-and-slow learning algorithm to mitigate this shortcoming, but its scalability to complex, image-computable tasks was unclear. Here, we propose the Wisconsin Neural Network (WiNN), which extends Hummos' fast-and-slow learning to image-computable tasks demanding flexible rule-based behavior. WiNN employs a pretrained convolutional neural network for vision, coupled with an adjustable "context state" that guides attention to relevant features. If WiNN produces an incorrect response, it first iteratively updates its context state to refocus attention on task-relevant cues, then performs minimal parameter updates to attention and readout layers. This strategy preserves generalizable representations in the sensory and attention networks, reducing catastrophic forgetting. We evaluate WiNN on an image-based extension of the Wisconsin Card Sorting Task, revealing several markers of cognitive flexibility: (i) WiNN autonomously infers underlying rules, (ii) requires fewer examples to do so than control models reliant on large-scale parameter updates, (iii) can perform context-based rule inference solely via context-state adjustments-further enhanced by slow updates of attention and readout parameters, and (iv) generalizes to unseen compositional rules through context-state updates alone. By blending fast context inference with targeted attentional guidance, WiNN achieves "sparks" of flexibility. This approach offers a path toward context-sensitive models that retain knowledge while rapidly adapting to complex, rule-based tasks.