Semi-Supervised Imitation Learning with Mixed Qualities of Demonstrations for Autonomous Driving
Authors:
- 27 November 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 20-25
Abstract
In this paper, we consider the problem of autonomous driving using imitation learning in a semi-supervised manner. In particular, both labeled and unlabeled demonstrations are leveraged during training by estimating the quality of each unlabeled demonstration. If the provided demonstrations are corrupted and have a low signal-to-noise ratio, the performance of the imitation learning agent can be degraded significantly. To mitigate this problem, we propose a method called semi-supervised imitation learning (SSIL). SSIL first learns how to discriminate and evaluate each state-action pair’s reliability in unlabeled demonstrations by assigning higher reliability values to demonstrations similar to labeled expert demonstrations. This reliability value is called leverage. After this discrimination process, labeled and unlabeled demonstrations with estimated leverage values are utilized while training the policy in a semi-supervised manner. The experimental results demonstrate the validity of the proposed algorithm using unlabeled trajectories with mixed qualities. Moreover, the hardware experiments using an RC car are conducted to show that the proposed method can be applied to real-world applications.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Rule-based optimal control for autonomous driving2021
- MixGAIL: Autonomous Driving Using Demonstrations with Mixed Qualities2020
- Robust Learning From Demonstrations With Mixed Qualities Using Leveraged Gaussian ProcessesIEEE Transactions on Robotics, 2019
- Uncertainty-Aware Learning from Demonstration Using Mixture Density Networks with Sampling-Free Variance Modeling2018
- Rule-Based Human Motion Tracking for Rehabilitation Exercises: Realtime Assessment, Feedback, and GuidanceIEEE Access, 2017
- Scalable robust learning from demonstration with leveraged deep neural networks2017
- Proximal Policy Optimization AlgorithmsarXiv, 2017
- Robust learning from demonstration using leveraged Gaussian processes and sparse-constrained optimization2016
- Gaussian Processes for Machine Learning2005