A Distributed Actor‐Critic Learning Approach for Affine Formation Control of Multi‐Robots With Unknown Dynamics
- 26 January 2025
- journal article
- research article
- Published by Wiley in International Journal of Adaptive Control and Signal Processing
- Vol. 39 (4) , 803-817
Abstract
Formation maneuverability is particularly important for multi‐robots (MRs), especially when the robots are operating cooperatively in complex and dynamic environments. Although various methods have been developed for affine formation, it is still a difficult problem to design an affine formation controller for MRs with unknown dynamics. In this paper, a distributed actor‐critic learning approach (DACL) in a look‐ahead rollout manner is proposed for the affine formation of MRs under local communication, which improves the online learning efficiency. In the proposed approach, a distributed data‐driven online optimization mechanism is designed via the sparse kernel technique to solve the near‐optimal affine formation control issue of MRs with unknown dynamics as well as improve control performance. The unknown dynamics of MRs are learned offline based on precollected input‐output datasets, and the sparse kernel‐based approach is employed to increase the feature representation capability of the samples. Then, the proposed distributed online actor‐critic algorithm for each robot in the formation includes two neural networks, which are utilized to approximate the costate functions and the near‐optimal policies. Moreover, the convergence analysis of the proposed approach has been conducted. Finally, numerical simulation and KKSwarm‐based experiment studies are performed to verify the effectiveness of the proposed approach.Keywords
This publication has 38 references indexed in Scilit:
- Preview controller synthesis for a class of linear parameter periodic systemsInternational Journal of Adaptive Control and Signal Processing, 2024
- Online reinforcement learning control via discontinuous gradientInternational Journal of Adaptive Control and Signal Processing, 2024
- Two‐layer leader‐follower optimal affine formation maneuver control for networked unmanned surface vessels with input saturationsInternational Journal of Robust and Nonlinear Control, 2023
- Leader‐following consensus of a class of heterogeneous uncertain multi‐agent systems with a distributed model reference adaptive control lawInternational Journal of Adaptive Control and Signal Processing, 2023
- Robust consensus control of nonlinear multi‐agent systems based on convergence rate estimationInternational Journal of Robust and Nonlinear Control, 2022
- Robust tube-based model predictive control with Koopman operatorsAutomatica, 2022
- Consensus in multi-agent systems: a reviewArtificial Intelligence Review, 2021
- Affine formation maneuver control of high-order multi-agent systems over directed networksAutomatica, 2020
- Data‐driven optimal event‐triggered consensus control for unknown nonlinear multiagent systems with control constraintsInternational Journal of Robust and Nonlinear Control, 2019
- A survey of multi-agent formation controlAutomatica, 2015