Secure Video Offloading in MEC-Enabled IIoT Networks: A Multicell Federated Deep Reinforcement Learning Approach
- 26 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20 (2) , 1618-1629
Abstract
Wireless video offloading in mobile-edge-computing (MEC)-enabled Industrial Internet of Things imposes a risk of exposing users' private data to eavesdroppers. It is difficult for existing secure video offloading schemes to simultaneously guarantee security, reduce latency and energy consumption in privacy-sensitive multicell scenarios where users are unwilling to offload data to other cells. In this article, a secure video offloading scheme based on multicell federated (MCF) deep reinforcement learning (DRL) is proposed to facilitate a secure, real-time, and efficient MEC network by efficient orchestration of limited resources. We formulate a collaborative optimization problem of video frame resolution and resources to minimize latency and energy consumption while maximizing the security rate subject to analytic accuracy and limited resources. To solve the formulated NP-hard problem, a MCF DRL algorithm based on the frameworks of multicell horizontal federated learning (FL) and hierarchical reward function-based twin delayed deep deterministic policy gradient (TD3) is proposed. First of all, hierarchical reward function-based TD3 is employed to solve the collaborative optimization NP-hard problem formulated for each single cell, where the optimal solution can be efficiently approached by the agent under the guidance of the innovatively designed hierarchical reward function. Then, multicell horizontal FL is applied on TD3 to obtain a model with higher model quality by averagely aggregating multiple individual TD3 models. Simulation results reveal that the proposed algorithm outperforms comparison algorithms in terms of utility, cost, latency, energy consumption, and security rate.Keywords
Funding Information
- National Key Research and Development Program of China (2022ZD0115803)
- Natural Science Basic Research Program of Shaanxi Province (2023-JC-JQ-51)
- Fundamental Research Funds for the Central Universities (xzy022022056)
This publication has 48 references indexed in Scilit:
- Security, privacy and trust of different layers in Internet-of-Things (IoTs) frameworkFuture Generation Computer Systems, 2020
- Federated Learning: Challenges, Methods, and Future DirectionsIEEE Signal Processing Magazine, 2020
- Deep Reinforcement Learning Based Intelligent Reflecting Surface Optimization for MISO Communication SystemsIEEE Wireless Communications Letters, 2020
- Offloading Optimization for Low-Latency Secure Mobile Edge Computing SystemsIEEE Wireless Communications Letters, 2019
- Security, privacy & efficiency of sustainable Cloud Computing for Big Data & IoTSustainable Computing: Informatics and Systems, 2018
- Latency Optimization for Resource Allocation in Mobile-Edge Computation OffloadingIEEE Transactions on Wireless Communications, 2018
- Energy-Delay Tradeoff for Dynamic Offloading in Mobile-Edge Computing System With Energy Harvesting DevicesIEEE Transactions on Industrial Informatics, 2018
- Efficient IoT-based sensor BIG Data collection–processing and analysis in smart buildingsFuture Generation Computer Systems, 2018
- Secure integration of IoT and Cloud ComputingFuture Generation Computer Systems, 2018
- Location Privacy in Mobile Edge Clouds: A Chaff-Based ApproachIEEE Journal on Selected Areas in Communications, 2017