Towards Realizing Intelligent Coordinated Controllers for Multi-USV Systems Using Abstract Training Environments
Open Access
- 22 May 2021
- journal article
- research article
- Published by MDPI AG in Journal of Marine Science and Engineering
- Vol. 9 (6) , 560
Abstract
Unmanned autonomous vehicles for various civilian and military applications have become a particularly interesting research area. Despite their many potential applications, a related technological challenge is realizing realistic coordinated autonomous control and decision making in complex and multi-agent environments. Machine learning approaches have been largely employed in simplified simulations to acquire intelligent control systems in multi-agent settings. However, the complexity of the physical environment, unrealistic assumptions, and lack of abstract physical environments derail the process of transition from simulation to real systems. This work presents a modular framework for automated data acquisition, training, and the evaluation of multiple unmanned surface vehicles controllers that facilitate prior knowledge integration and human-guided learning in a closed-loop. To realize this, we first present a digital maritime environment of multiple unmanned surface vehicles that abstracts the real-world dynamics in our application domain. Then, a behavior-driven artificial immune-inspired fuzzy classifier systems approach that is capable of optimizing agents’ behaviors and action selection in a multi-agent environment is presented. Evaluation scenarios of different combat missions are presented to demonstrate the performance of the system. Simulation results show that the resulting controllers can achieved an average wining rate between and in all test cases, indicating the effectiveness of the proposed approach and its feasibility in realizing adaptive controllers for efficient multiple unmanned systems’ cooperative decision making. We believe that this system can facilitate the simulation, data acquisition, training, and evaluation of practical cooperative unmanned vehicles’ controllers in a closed-loop.
Keywords
Funding Information
- National Natural Science Foundation of China (61370151)
- National Major Science and Technology Projects of China (2015ZX03003012)
This publication has 44 references indexed in Scilit:
- Survey and comparative study of free simulation software for mobile robotsRobotica, 2014
- Modeling and Nonlinear Heading Control of Sailing YachtsIEEE Journal of Oceanic Engineering, 2013
- Unmanned surface vehicles - game changing technology for naval operations2006
- The Danger Model: A Renewed Sense of SelfScience, 2002
- An Introduction to Learning Fuzzy Classifier Systems2000
- Classifier systems in combat: two-sided learning of maneuvers for advanced fighter aircraftComputer Methods in Applied Mechanics and Engineering, 2000
- Neuro-fuzzy rule generation: survey in soft computing frameworkIEEE Transactions on Neural Networks, 2000
- Learning using an artificial immune systemJournal of Network and Computer Applications, 1996
- Classifier systems that learn internal world modelsMachine Learning, 1988
- The immune system, adaptation, and machine learningPhysica D: Nonlinear Phenomena, 1986