MoCom: Motion-Based Inter-MAV Visual Communication Using Event Vision and Spiking Neural Networks
- 24 March 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 42 (15523098) , 1680-1694
Abstract
Reliable communication in Micro Air Vehicle (MAV) swarms is challenging in environments, where conventional radio-based methods suffer from spectrum congestion, jamming, and high power consumption. Inspired by the waggle dance of honeybees, which efficiently communicate the location of food sources without sound or contact, we propose a novel visual communication framework for MAV swarms using motion-based signaling. In this framework, MAVs convey information, such as heading and distance, through deliberate flight patterns, which are passively captured by event cameras and interpreted using a predefined visual codebook of four motion primitives: vertical (up/down), horizontal (left/right), left-to-up-to-right, and left-to-down-to-right, representing control symbols (“start”, “end”, “1”, “0”). To decode these signals, we design an event frame-based segmentation model and a lightweight Spiking Neural Network (SNN) for action recognition. An integrated decoding algorithm then combines segmentation and classification to robustly interpret MAV motion sequences. Experimental results validate the framework's effectiveness, which demonstrates accurate decoding and low power consumption, and highlights its potential as an energy-efficient alternative for MAV communication in constrained environments.Keywords
All Related Versions
Funding Information
- Ministry of Higher Education, Malaysia
- providing the Fundamental Research (FRGS/1/2024/TK04/USM/02/3)
This publication has 56 references indexed in Scilit:
- MobileNetV4: Universal Models for the Mobile Ecosystem2024
- Absolute pose estimation of UAV based on large-scale satellite imageChinese Journal of Aeronautics, 2023
- Neural Architecture Search for Spiking Neural Networks2022
- PSigmoid: Improving squeeze-and-excitation block with parametric sigmoidApplied Intelligence, 2021
- Correlational Convolutional LSTM for human action recognitionNeurocomputing, 2020
- Visual Communication with UAV: Use Cases and AchievementsCommunications in Computer and Information Science, 2019
- Deep learning in spiking neural networksNeural Networks, 2019
- A Leaky‐Integrate‐and‐Fire Neuron Analog Realized with a Mott InsulatorAdvanced Functional Materials, 2017
- A survey of methods for time series change point detectionKnowledge and Information Systems, 2016
- Time Series Analysis2003