Resource Allocation of Federated Learning for the Metaverse With Mobile Augmented Reality
- 31 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 24 (8) , 6290-6305
Abstract
The Metaverse has received much attention recently. Metaverse applications via mobile augmented reality (MAR) require rapid and accurate object detection to mix digital data with the real world. Federated learning (FL) is an intriguing distributed machine learning approach due to its privacy-preserving characteristics. Due to privacy concerns and the limited computation resources on mobile devices, we incorporate FL into MAR systems of the Metaverse to train a model cooperatively. Besides, to balance the trade-off between energy, execution latency and model accuracy, thereby accommodating different demands and application scenarios, we formulate an optimization problem to minimize a weighted combination of total energy consumption, completion time and model accuracy. Through decomposing the non-convex optimization problem into two subproblems, we devise a resource allocation algorithm to determine the bandwidth allocation, transmission power, CPU frequency and video frame resolution for each participating device. We further present the convergence analysis and computational complexity of the proposed algorithm. Numerical results show that our proposed algorithm has better performance (in terms of energy consumption, completion time and model accuracy) under different weight parameters compared to existing benchmarks.Keywords
All Related Versions
Funding Information
- National Research Foundation, Singapore and Infocomm Media Development Authority under its Trust Tech Funding Initiative and its Strategic Capability Research Centres Funding Initiative
- Singapore Ministry of Education Academic Research Fund (Tier 1 RG90/22, Tier 1 RG97/20, Tier 1 RG24/20, Tier 2 MOE2019-T2-1-176)
- Nanyang Technological University (NTU)-Wallenberg AI, Autonomous Systems and Software Program (WASP) Joint Project
This publication has 46 references indexed in Scilit:
- Resource Allocation and Resolution Control in the Metaverse with Mobile Augmented Reality2022
- Blockchain-based Federated Learning for Industrial Metaverses: Incentive Scheme with Optimal AoI2022
- A Metaverse: Taxonomy, Components, Applications, and Open ChallengesIEEE Access, 2022
- Deep learning-based mobile augmented reality for task assistance using 3D spatial mapping and snapshot-based RGB-D dataComputers & Industrial Engineering, 2020
- Enabling Secure Wireless Communications via Intelligent Reflecting Surfaces2019
- Augmented reality technology in the manufacturing industry: A review of the last decadeIISE Transactions, 2019
- Mobile Augmented Reality Survey: From Where We Are to Where We GoIEEE Access, 2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- Convolutional neural networks at constrained time cost2015
- Microsoft COCO: Common Objects in Context2014