Multi-Agent Visual Coordination Using Optical Wireless Communication
Open Access
- 14 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (11) , 7857-7864
Abstract
Communication is a key element in applying multi-agent reinforcement learning to a wide range of real-world scenarios. We focus on optical wireless communication (OWC), which is a practical solution to be used in various real situations where radio communication is not available, such as underwater or in a lot of radio noise environment. OWC is a method of communicating only with other agents in visual range using light, unlike radio wave like communication which is mostly assumed in existing research on multi-agent reinforcement learning. Due to limited communication, when OWC is used, overall performance is generally degraded from the case with full communication. In this paper, we propose a reinforcement learning method that learns visual coordination behavior using OWC. Our proposed visually cooperative behavior enables agents equipped with limited field of view (FOV) cameras to efficiently comprehend and imagine their surrounding environment through cooperative communication. Experimental results in simulation demonstrated that, using the proposed visual coordination method, multi-agents using OWC with general FOV show comparable performance to those with radio wave like full communication. Additionally, it has been demonstrated that this method can improve performance in various multi-agent reinforcement learning algorithms. We also implement OWC devices on real mobile robots and demonstrated the proposed multi-agent operation.Keywords
Funding Information
- JST FOREST Program, Japan (JPMJFR206H)
This publication has 14 references indexed in Scilit:
- Event-Based Vision: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
- When2com: Multi-Agent Perception via Communication Graph Grouping2020
- Cooperative Multi-Robot Navigation in Dynamic Environment with Deep Reinforcement Learning2020
- Who2com: Collaborative Perception via Learnable Handshake Communication2020
- A Novel Visible Light Positioning System With Event-Based Neuromorphic Vision SensorIEEE Sensors Journal, 2020
- Underwater optical wireless communications, networking, and localization: A surveyAd Hoc Networks, 2019
- Underwater-Drone With Panoramic Camera for Automatic Fish Recognition Based on Deep LearningIEEE Access, 2018
- Optical Vehicle-to-Vehicle Communication System Using LED Transmitter and Camera ReceiverIEEE Photonics Journal, 2014
- Image-sensor-based visible light communication for automotive applicationsIEEE Communications Magazine, 2014
- Activity-driven, event-based vision sensors2010