Resource Allocation of Federated Learning for the Metaverse with Mobile Augmented Reality
Authors:
Preprint
Abstract
The Metaverse has received much attention recently. Metaverse applications via mobile augmented reality (MAR) require rapid and accurate object detection to mix digital data with the real world. Federated learning (FL) is an intriguing distributed machine learning approach due to its privacy-preserving characteristics. Due to privacy concerns and the limited computation resources on mobile devices, we incorporate FL into MAR systems of the Metaverse to train a model cooperatively. Besides, to balance the trade-off between energy, execution latency and model accuracy, thereby accommodating different demands and application scenarios, we formulate an optimization problem to minimize a weighted combination of total energy consumption, completion time and model accuracy. Through decomposing the non-convex optimization problem into two subproblems, we devise a resource allocation algorithm to determine the bandwidth allocation, transmission power, CPU frequency and video frame resolution for each participating device. We further present the convergence analysis and computational complexity of the proposed algorithm. Numerical results show that our proposed algorithm has better performance (in terms of energy consumption, completion time and model accuracy) under different weight parameters compared to existing benchmarks.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Resource Allocation and Resolution Control in the Metaverse with Mobile Augmented Reality2022
- A Metaverse: Taxonomy, Components, Applications, and Open ChallengesIEEE Access, 2022
- Wireless Federated Learning (WFL) for 6G Networks⁴Part I: Research Challenges and Future TrendsIEEE Communications Letters, 2021
- QoS-Constrained Federated Learning Empowered by Intelligent Reflecting Surface2021
- Deep learning-based mobile augmented reality for task assistance using 3D spatial mapping and snapshot-based RGB-D dataComputers & Industrial Engineering, 2020
- A Novel Resolution and Power Control Scheme for Energy-Efficient Mobile Augmented Reality Applications in Mobile Edge ComputingIEEE Wireless Communications Letters, 2019
- Augmented reality technology in the manufacturing industry: A review of the last decadeIISE Transactions, 2019
- Dynamic Computation Offloading for Mobile-Edge Computing With Energy Harvesting DevicesIEEE Journal on Selected Areas in Communications, 2016
- Microsoft COCO: Common Objects in Context2014
- Semidefinite Relaxation of Quadratic Optimization ProblemsIEEE Signal Processing Magazine, 2010