Distributed Dynamic Map Fusion via Federated Learning for Intelligent Networked Vehicles
Authors:
- 30 May 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 953-959
Abstract
The technology of dynamic map fusion among networked vehicles has been developed to enlarge sensing ranges and improve sensing accuracies for individual vehicles. This paper proposes a federated learning (FL) based dynamic map fusion framework to achieve high map quality despite unknown numbers of objects in fields of view (FoVs), various sensing and model uncertainties, and missing data labels for online learning. The novelty of this work is threefold: (1) developing a three-stage fusion scheme to predict the number of objects effectively and to fuse multiple local maps with fidelity scores; (2) developing an FL algorithm which fine-tunes feature models (i.e., representation learning networks for feature extraction) distributively by aggregating model parameters; (3) developing a knowledge distillation method to generate FL training labels when data labels are unavailable. The proposed framework is implemented in the CARLA simulation platform. Extensive experimental results are provided to verify the superior performance and robustness of the developed map fusion and FL schemes.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China
This publication has 22 references indexed in Scilit:
- F-cooper2019
- Cooperative Perception in Connected Vehicle Traffic under Field-of-View and Participation Variations2019
- Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic SystemsIEEE Robotics and Automation Letters, 2019
- Cooper: Cooperative Perception for Connected Autonomous Vehicles Based on 3D Point Clouds2019
- Collaborative Automated Driving: A Machine Learning-based Method to Enhance the Accuracy of Shared Information2018
- SECOND: Sparsely Embedded Convolutional DetectionSensors, 2018
- Multimedia Fusion at Semantic Level in Vehicle Cooperactive Perception2018
- Collaborative Perception for Automated Vehicles Leveraging Vehicle-to-Vehicle Communications2018
- Connected Vehicles: Solutions and ChallengesIEEE Internet of Things Journal, 2014
- Vision meets robotics: The KITTI datasetThe International Journal of Robotics Research, 2013