Jens Egholm Pedersen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Jens Egholm Pedersen has a total of 60 co-authors. Here are the top co-authors by number of shared publications:
- Jörg Conradt
KTH Royal Institute of Technology
7 shared publications - Dimitrios Korakovounis
KTH Royal Institute of Technology
2 shared publications - Juan Pablo Romero Bermudez
NCS Lab. Royal Institute of Technology, Stockholm, Sweden
2 shared publications - Alice Geminiani
Department of Brain and Behavioral Sciences, University of Pavia
1 shared publication - Alois Saria
Experimental Psychiatry Unit, Department of Psychiatry 1, Medical University Innsbruck, Innsbruck, Austria
1 shared publication - Alper Yegenoglu
SDL Neuroscience, Forschungszentrum Jülich GmbH, Institute for Advanced Simulation, Jülich Supercomputing Centre (JSC)
1 shared publication
Latest Publications
- 17 September 2026
- Published by Springer Nature
- p. 66-78
GERD:Geometric Event Response Data Generation
- 11 March 2026
- Published by Springer Nature in Nature Machine Intelligence
- Vol. 8 (3) , 300-312
A benchmarking framework for embodied neuromorphic agents
- 11 March 2026
- Published by Springer Nature in Nature Machine Intelligence
- Vol. 8 (3) , 300-312
A benchmarking framework for embodied neuromorphic agents
- Open Access
- 5 September 2025
- Published by Springer Nature in Nature Communications
- Vol. 16 (1) , 1-14
Covariant spatio-temporal receptive fields for spiking neural networks
Biological nervous systems constitute important sources of inspiration towards computers that are faster, cheaper, and more energy efficient. Neuromorphic disciplines view the brain as a coevolved system, simultaneously optimizing the hardware and the algorithms running on it. There are clear efficiency gains when bringing the computations into a physical substrate, but we presently lack theories to guide efficient implementations. Here, we present a principled computational model for neuromorphic systems in terms of spatio-temporal receptive fields, based on affine Gaussian kernels over space and leaky-integrator and leaky integrate-and-fire models over time. Our theory is provably covariant to spatial affine and temporal scaling transformations, with close similarities to visual processing in mammalian brains. We use these spatio-temporal receptive fields as a prior in an event-based vision task, and show that this improves the training of spiking networks, which is otherwise known to be problematic for event-based vision. This work combines efforts within scale-space theory and computational neuroscience to identify theoretically well-founded ways to process spatio-temporal signals in neuromorphic systems. Our contributions are immediately relevant for signal processing and event-based vision, and can be extended to other processing tasks over space and time, such as memory and control.
- 5 September 2025
- Published by Springer Nature in Nature Communications
- Vol. 16 (1) , 1-14
Open AccessCovariant spatio-temporal receptive fields for spiking neural networks
Biological nervous systems constitute important sources of inspiration towards computers that are faster, cheaper, and more energy efficient. Neuromorphic disciplines view the brain as a coevolved system, simultaneously optimizing the hardware and the algorithms running on it. There are clear efficiency gains when bringing the computations into a physical substrate, but we presently lack theories to guide efficient implementations. Here, we present a principled computational model for neuromorphic systems in terms of spatio-temporal receptive fields, based on affine Gaussian kernels over space and leaky-integrator and leaky integrate-and-fire models over time. Our theory is provably covariant to spatial affine and temporal scaling transformations, with close similarities to visual processing in mammalian brains. We use these spatio-temporal receptive fields as a prior in an event-based vision task, and show that this improves the training of spiking networks, which is otherwise known to be problematic for event-based vision. This work combines efforts within scale-space theory and computational neuroscience to identify theoretically well-founded ways to process spatio-temporal signals in neuromorphic systems. Our contributions are immediately relevant for signal processing and event-based vision, and can be extended to other processing tasks over space and time, such as memory and control.
- Open Access
- 30 May 2025
- Published by IOP Publishing in Neuromorphic Computing and Engineering
- Vol. 5 (2) , 024014
Low-latency neuromorphic air hockey player
Brains process sensory information to guide behaviour, enabling organisms to adapt to dynamic and unpredictable conditions. Neuromorphic engineering seeks to emulate these neurobiological principles to develop compact, low-power systems capable of real-time sensory-motor integration. This approach addresses some limitations of traditional AI and holds promise for autonomous systems that can interact robustly with the real world. However, most of today’s widely used neuromorphic benchmarks focus primarily on improving accuracy metrics using pre-recorded datasets, often overlooking critical factors such as latency and power consumption. This underscores the need for benchmarks to evaluate real-time performance under noisy, dynamic conditions. To address this need, we developed a system that uses spiking neural networks (SNNs) to control a robotic manipulator in an air-hockey game. In this setup, the automated opponent uses SNNs to process data from an event-based camera, enabling it to track the puck’s movements and respond to the actions of a human player. Our study demonstrates the potential of SNNs to accomplish fast real-time tasks while running on massively parallel hardware. We believe our air-hockey platform provides a versatile testbed for evaluating neuromorphic systems and invites further exploration of advanced algorithms, such as those incorporating trajectory prediction or adaptive learning, which could significantly enhance real-time decision-making and control.
- 30 May 2025
- Published by IOP Publishing in Neuromorphic Computing and Engineering
- Vol. 5 (2) , 024014
Open AccessLow-latency neuromorphic air hockey player
Brains process sensory information to guide behaviour, enabling organisms to adapt to dynamic and unpredictable conditions. Neuromorphic engineering seeks to emulate these neurobiological principles to develop compact, low-power systems capable of real-time sensory-motor integration. This approach addresses some limitations of traditional AI and holds promise for autonomous systems that can interact robustly with the real world. However, most of today’s widely used neuromorphic benchmarks focus primarily on improving accuracy metrics using pre-recorded datasets, often overlooking critical factors such as latency and power consumption. This underscores the need for benchmarks to evaluate real-time performance under noisy, dynamic conditions. To address this need, we developed a system that uses spiking neural networks (SNNs) to control a robotic manipulator in an air-hockey game. In this setup, the automated opponent uses SNNs to process data from an event-based camera, enabling it to track the puck’s movements and respond to the actions of a human player. Our study demonstrates the potential of SNNs to accomplish fast real-time tasks while running on massively parallel hardware. We believe our air-hockey platform provides a versatile testbed for evaluating neuromorphic systems and invites further exploration of advanced algorithms, such as those incorporating trajectory prediction or adaptive learning, which could significantly enhance real-time decision-making and control.
- Open Access
- 1 October 2024
- Published by Springer Nature in Neuroinformatics
- Vol. 22 (4) , 657-678
Interdisciplinary and Collaborative Training in Neuroscience: Insights from the Human Brain Project Education Programme
Neuroscience education is challenged by rapidly evolving technology and the development of interdisciplinary approaches for brain research. The Human Brain Project (HBP) Education Programme aimed to address the need for interdisciplinary expertise in brain research by equipping a new generation of researchers with skills across neuroscience, medicine, and information technology. Over its ten year duration, the programme engaged over 1,300 experts and attracted more than 5,500 participants from various scientific disciplines in its blended learning curriculum, specialised schools and workshops, and events fostering dialogue among early-career researchers. Key principles of the programme’s approach included fostering interdisciplinarity, adaptability to the evolving research landscape and infrastructure, and a collaborative environment with a focus on empowering early-career researchers. Following the programme’s conclusion, we provide here an analysis and in-depth view across a diverse range of educational formats and events. Our results show that the Education Programme achieved success in its wide geographic reach, the diversity of participants, and the establishment of transversal collaborations. Building on these experiences and achievements, we describe how leveraging digital tools and platforms provides accessible and highly specialised training, which can enhance existing education programmes for the next generation of brain researchers working in decentralised European collaborative spaces. Finally, we present the lessons learnt so that similar initiatives may improve upon our experience and incorporate our suggestions into their own programme.
- 1 October 2024
- Published by Springer Nature in Neuroinformatics
- Vol. 22 (4) , 657-678
Open AccessInterdisciplinary and Collaborative Training in Neuroscience: Insights from the Human Brain Project Education Programme
Neuroscience education is challenged by rapidly evolving technology and the development of interdisciplinary approaches for brain research. The Human Brain Project (HBP) Education Programme aimed to address the need for interdisciplinary expertise in brain research by equipping a new generation of researchers with skills across neuroscience, medicine, and information technology. Over its ten year duration, the programme engaged over 1,300 experts and attracted more than 5,500 participants from various scientific disciplines in its blended learning curriculum, specialised schools and workshops, and events fostering dialogue among early-career researchers. Key principles of the programme’s approach included fostering interdisciplinarity, adaptability to the evolving research landscape and infrastructure, and a collaborative environment with a focus on empowering early-career researchers. Following the programme’s conclusion, we provide here an analysis and in-depth view across a diverse range of educational formats and events. Our results show that the Education Programme achieved success in its wide geographic reach, the diversity of participants, and the establishment of transversal collaborations. Building on these experiences and achievements, we describe how leveraging digital tools and platforms provides accessible and highly specialised training, which can enhance existing education programmes for the next generation of brain researchers working in decentralised European collaborative spaces. Finally, we present the lessons learnt so that similar initiatives may improve upon our experience and incorporate our suggestions into their own programme.
- Top Cited PapersOpen Access
- 16 September 2024
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1-15
Neuromorphic intermediate representation: A unified instruction set for interoperable brain-inspired computing
Spiking neural networks and neuromorphic hardware platforms that simulate neuronal dynamics are getting wide attention and are being applied to many relevant problems using Machine Learning. Despite a well-established mathematical foundation for neural dynamics, there exists numerous software and hardware solutions and stacks whose variability makes it difficult to reproduce findings. Here, we establish a common reference frame for computations in digital neuromorphic systems, titled Neuromorphic Intermediate Representation (NIR). NIR defines a set of computational and composable model primitives as hybrid systems combining continuous-time dynamics and discrete events. By abstracting away assumptions around discretization and hardware constraints, NIR faithfully captures the computational model, while bridging differences between the evaluated implementation and the underlying mathematical formalism. NIR supports an unprecedented number of neuromorphic systems, which we demonstrate by reproducing three spiking neural network models of different complexity across 7 neuromorphic simulators and 4 digital hardware platforms. NIR decouples the development of neuromorphic hardware and software, enabling interoperability between platforms and improving accessibility to multiple neuromorphic technologies. We believe that NIR is a key next step in brain-inspired hardware-software co-evolution, enabling research towards the implementation of energy efficient computational principles of nervous systems. NIR is available atneuroir.org
- 16 September 2024
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1-15
Top Cited PapersOpen AccessNeuromorphic intermediate representation: A unified instruction set for interoperable brain-inspired computing
Spiking neural networks and neuromorphic hardware platforms that simulate neuronal dynamics are getting wide attention and are being applied to many relevant problems using Machine Learning. Despite a well-established mathematical foundation for neural dynamics, there exists numerous software and hardware solutions and stacks whose variability makes it difficult to reproduce findings. Here, we establish a common reference frame for computations in digital neuromorphic systems, titled Neuromorphic Intermediate Representation (NIR). NIR defines a set of computational and composable model primitives as hybrid systems combining continuous-time dynamics and discrete events. By abstracting away assumptions around discretization and hardware constraints, NIR faithfully captures the computational model, while bridging differences between the evaluated implementation and the underlying mathematical formalism. NIR supports an unprecedented number of neuromorphic systems, which we demonstrate by reproducing three spiking neural network models of different complexity across 7 neuromorphic simulators and 4 digital hardware platforms. NIR decouples the development of neuromorphic hardware and software, enabling interoperability between platforms and improving accessibility to multiple neuromorphic technologies. We believe that NIR is a key next step in brain-inspired hardware-software co-evolution, enabling research towards the implementation of energy efficient computational principles of nervous systems. NIR is available atneuroir.org
- Open Access
- 28 August 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-8
A High-Throughput Low-Latency Interface Board for SpiNNaker-in-the-loop Real-Time Systems
The Spiking Neural Network Computer Architecture (SpiNNaker) is a massively parallel computing system. As one of the most widespread platforms in the emerging field of neuromorphic engineering, SpiNNaker targets three main areas of research: computational neuroscience, computer science, and robotics. For the latter, the promise of low power computation and the potential for large scale simulations in real-time make SpiNNaker very attractive, especially for autonomous mobile applications. In this context, research groups typically use SpiNNaker's Ethernet interface to inject and extract sensori-motor signals into and from SpiNNaker. However, in cases where the data throughput increases, the on-board Ethernet port constitutes a critical bottleneck. Some groups have overcome such a problem to some extent by developing their own I/O interfaces to connect external devices --- sensors and actuators --- directly to SpiNNaker. However, such custom-developed interfaces allow only limited general applications, and they don't fully exploit the high-speed FPGA-based interconnect offered by the 48-chip SpiNNaker boards. In this manuscript, we present SPIF: a general-purpose FPGA-based SpiNNaker Peripheral Interface board that overcomes SpiNNaker's communication bottleneck by connecting to its native High-Speed Serial Links (HSSLs). We evaluate SPIF's performance in terms of event throughput and latency. Finally, we demonstrate SPIF's capabilities by feeding events from a high-resolution event camera into a real-time spiking convolutional neural network. The system can track the position of a small and extremely fast but salient stimulus in the visual field with negligibly low latency.
- 28 August 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessA High-Throughput Low-Latency Interface Board for SpiNNaker-in-the-loop Real-Time Systems
The Spiking Neural Network Computer Architecture (SpiNNaker) is a massively parallel computing system. As one of the most widespread platforms in the emerging field of neuromorphic engineering, SpiNNaker targets three main areas of research: computational neuroscience, computer science, and robotics. For the latter, the promise of low power computation and the potential for large scale simulations in real-time make SpiNNaker very attractive, especially for autonomous mobile applications. In this context, research groups typically use SpiNNaker's Ethernet interface to inject and extract sensori-motor signals into and from SpiNNaker. However, in cases where the data throughput increases, the on-board Ethernet port constitutes a critical bottleneck. Some groups have overcome such a problem to some extent by developing their own I/O interfaces to connect external devices --- sensors and actuators --- directly to SpiNNaker. However, such custom-developed interfaces allow only limited general applications, and they don't fully exploit the high-speed FPGA-based interconnect offered by the 48-chip SpiNNaker boards. In this manuscript, we present SPIF: a general-purpose FPGA-based SpiNNaker Peripheral Interface board that overcomes SpiNNaker's communication bottleneck by connecting to its native High-Speed Serial Links (HSSLs). We evaluate SPIF's performance in terms of event throughput and latency. Finally, we demonstrate SPIF's capabilities by feeding events from a high-resolution event camera into a real-time spiking convolutional neural network. The system can track the position of a small and extremely fast but salient stimulus in the visual field with negligibly low latency.
- Open Access
- 11 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 86-91
AEStream: Accelerated event-based processing with coroutines
- 11 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 86-91
Open AccessAEStream: Accelerated event-based processing with coroutines
- Open Access
- 11 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 79-85
Translation and Scale Invariance for Event-Based Object tracking
Without temporal averaging, such as rate codes, it remains challenging to train spiking neural networks for temporal regression tasks. In this work, we present a novel method to accurately predict spatial coordinates from event data with a fully spiking convolutional neural network (SCNN) without temporal averaging. Our method performs on-par with artificial neural networks (ANN) of similar complexity. Additionally, we demonstrate faster convergence in half the time using translation- and scale-invariant receptive fields. To permit comparison with conventional frame-based ANNs, we base our results on a simulated event-based dataset with an unrealistic high density. Therefore, we hypothesize that our method significantly outperform ANNs in settings with lower event density, as seen in real-life event-based data. Our model is fully spiking and can be ported directly to neuromorphic hardware.
- 11 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 79-85
Open AccessTranslation and Scale Invariance for Event-Based Object tracking
Without temporal averaging, such as rate codes, it remains challenging to train spiking neural networks for temporal regression tasks. In this work, we present a novel method to accurately predict spatial coordinates from event data with a fully spiking convolutional neural network (SCNN) without temporal averaging. Our method performs on-par with artificial neural networks (ANN) of similar complexity. Additionally, we demonstrate faster convergence in half the time using translation- and scale-invariant receptive fields. To permit comparison with conventional frame-based ANNs, we base our results on a simulated event-based dataset with an unrealistic high density. Therefore, we hypothesize that our method significantly outperform ANNs in settings with lower event density, as seen in real-life event-based data. Our model is fully spiking and can be ported directly to neuromorphic hardware.
- Open Access
AEStream: Accelerated event-based processing with coroutines
Neuromorphic sensors imitate the sparse and event-based communication seen in biological sensory organs and brains. Today's sensors can emit many millions of asynchronous events per second, which is challenging to process on conventional computers. To avoid bottleneck effects, there is a need to apply and improve concurrent and parallel processing of events. We present AEStream: a library to efficiently stream asynchronous events from inputs to outputs on conventional computers. AEStream leverages cooperative multitasking primitives known as coroutines to concurrently process individual events, which dramatically simplifies the integration with event-based peripherals, such as event-based cameras and (neuromorphic) asynchronous hardware. We explore the effects of coroutines in concurrent settings by benchmarking them against conventional threading mechanisms, and find that AEStream provides at least twice the throughput. We then apply AEStream in a real-time edge detection task on a GPU and demonstrate 1.3 times faster processing with 5 times fewer memory operations.
Open AccessAEStream: Accelerated event-based processing with coroutines
Neuromorphic sensors imitate the sparse and event-based communication seen in biological sensory organs and brains. Today's sensors can emit many millions of asynchronous events per second, which is challenging to process on conventional computers. To avoid bottleneck effects, there is a need to apply and improve concurrent and parallel processing of events. We present AEStream: a library to efficiently stream asynchronous events from inputs to outputs on conventional computers. AEStream leverages cooperative multitasking primitives known as coroutines to concurrently process individual events, which dramatically simplifies the integration with event-based peripherals, such as event-based cameras and (neuromorphic) asynchronous hardware. We explore the effects of coroutines in concurrent settings by benchmarking them against conventional threading mechanisms, and find that AEStream provides at least twice the throughput. We then apply AEStream in a real-time edge detection task on a GPU and demonstrate 1.3 times faster processing with 5 times fewer memory operations.