Event-driven figure-ground organisation model for the humanoid robot iCub
Open Access
- 22 February 2025
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 16 (1) , 1-13
Abstract
Figure-ground organisation is a perceptual grouping mechanism for detecting objects and boundaries, essential for an agent interacting with the environment. Current figure-ground segmentation methods rely on classical computer vision or deep learning, requiring extensive computational resources, especially during training. Inspired by the primate visual system, we developed a bio-inspired perception system for the neuromorphic robot iCub. The model uses a hierarchical, biologically plausible architecture and event-driven vision to distinguish foreground objects from the background. Unlike classical approaches, event-driven cameras reduce data redundancy and computation. The system has been qualitatively and quantitatively assessed in simulations and with event-driven cameras on iCub in various scenarios. It successfully segments items in diverse real-world settings, showing comparable results to its frame-based version on simple stimuli and the Berkeley Segmentation dataset. This model enhances hybrid systems, complementing conventional deep learning models by processing only relevant data in Regions of Interest (ROI), enabling low-latency autonomous robotic applications.Keywords
All Related Versions
Funding Information
- EC | Horizon 2020 Framework Programme (HORIZON-MSCA-2023-PF-01-01 - ENDEAVOR No 101149664)
This publication has 60 references indexed in Scilit:
- Spatial and temporal saliency based four-stream network with multi-task learning for action recognitionApplied Soft Computing, 2022
- Motion saliency based hierarchical attention network for action recognitionMultimedia Tools and Applications, 2022
- Computer Vision2022
- A recurrent neural model for proto-object based contour integration and figure-ground segregationJournal of Computational Neuroscience, 2017
- Local spectral anisotropy is a valid cue for figure–ground organization in natural scenesVision Research, 2014
- A model of proto-object based saliencyVision Research, 2014
- Determination of border ownership based on the surround context of contrastNeurocomputing, 2004
- Hierarchical Selectivity for Object-Based Visual AttentionLecture Notes in Computer Science, 2002
- Active Vision and Seeing Robots1996
- NEURAL DYNAMICS OF PERCEPTUAL GROUPING: TEXTURES, BOUNDARIES, AND EMERGENT SEGMENTATIONS1987