Autonomous Six-Degree-of-Freedom Spacecraft Docking with Rotating Targets via Reinforcement Learning
- 1 July 2021
- journal article
- research article
- Published by American Institute of Aeronautics and Astronautics (AIAA) in Journal of Aerospace Information Systems
- Vol. 18 (7) , 417-428
Abstract
A policy for six-degree-of-freedom docking maneuvers with rotating targets is developed through reinforcement learning and implemented as a feedback control law. Potential clients for satellite servicing and orbital debris objects are often rotating around a constant axis within their respective Earth orbits. In the context of such missions, reinforcement learning provides an appealing framework for robust, autonomous maneuvers in uncertain environments with low on-board computational cost. This work uses proximal policy optimization to produce a docking policy for rotating or nonrotating targets that is valid over a portion of the six-degree-of-freedom state space while striving to minimize performance and control costs. Experiments using the simulated Apollo transposition and docking maneuver with an induced spin in the lunar module exhibit the policy’s capabilities and provide a comparison with standard optimal control techniques. Furthermore, specific challenges and workarounds, as well as a discussion on the benefits and disadvantages of reinforcement learning for docking policies, are discussed to facilitate future research. As such, this work will serve as a foundation for further investigation of learning-based control laws for spacecraft proximity operations in uncertain environments.Keywords
All Related Versions
Funding Information
- Charles Stark Draper Laboratory
This publication has 10 references indexed in Scilit:
- Adaptive guidance and integrated navigation with reinforcement meta-learningActa Astronautica, 2020
- Deep reinforcement learning for six degree-of-freedom planetary landingAdvances In Space Research, 2020
- Probabilistic Trajectory Optimization Under Uncertain Path Constraints for Close Proximity OperationsJournal of Guidance, Control, and Dynamics, 2018
- Fixed-time rendezvous control of spacecraft with a tumbling target under loss of actuator effectivenessIEEE Transactions on Aerospace and Electronic Systems, 2016
- Model Predictive Control for Spacecraft Rendezvous and Docking: Strategies for Handling Constraints and Case StudiesIEEE Transactions on Control Systems Technology, 2015
- GPOPS-IIACM Transactions on Mathematical Software, 2014
- Optimal Rendezvous Trajectories of a Controlled Spacecraft and a Tumbling ObjectJournal of Guidance, Control, and Dynamics, 2011
- Optimal Control for Proximity Operations and DockingInternational Journal of Aeronautical and Space Sciences, 2010
- Attitude Error Representations for Kalman FilteringJournal of Guidance, Control, and Dynamics, 2003
- On Information and SufficiencyThe Annals of Mathematical Statistics, 1951