Resource Management and Security Challenges for Deploying and Adapting Large Language Models in Fog Computing
Authors:
- 24 August 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 174-179
Abstract
Fog computing is an emerging distributed paradigm that extends cloud services to the network edge, enabling low-latency, context-aware processing for Internet of Things (IoT) applications. By decentralizing computation and storage to fog nodes near end devices, fog architectures significantly enhance real-time responsiveness compared to centralized clouds. As large language models (LLMs) gain prominence in AI-driven services, their deployment in fog environments introduces critical challenges due to their intensive computational and memory requirements. This paper provides a comprehensive analysis of resource management and security challenges associated with deploying and adapting LLMs in fog computing. We review state-of-the-art techniques in task scheduling, load balancing, and virtualization, and examine how these are impacted by the unique heterogeneity and resource constraints of fog infrastructures. Particular attention is given to model partitioning strategies, communication-computation tradeoffs, and adaptive deployment across diverse fog nodes. In addition, we explore key security risks posed by distributed LLM deployment, including data leakage, model theft, gradient inversion, and denial-of-service attacks. We evaluate emerging countermeasures such as differential privacy, homomorphic encryption, encrypted inference, and robust training techniques, assessing their suitability for fog-based learning frameworks. Finally, we highlight open research directions, including dynamic model partitioning, energy-efficient inference, security certification protocols, and the development of standardized benchmarks for evaluating LLM performance and privacy in fog environments. Our findings aim to support researchers and practitioners in addressing the trade-offs between efficiency, scalability, and security in deploying large-scale AI models at the network edge.Keywords
This publication has 16 references indexed in Scilit:
- Advancements and challenges in privacy-preserving split learning: experimental findings and future directionsInternational Journal of Information Security, 2025
- On protecting the data privacy of Large Language Models (LLMs) and LLM agents: A literature reviewHigh-Confidence Computing, 2025
- End-to-end privacy preserving deep learning on multi-institutional medical imagingNature Machine Intelligence, 2021
- All one needs to know about fog computing and related edge computing paradigms: A complete surveyJournal of Systems Architecture, 2019
- Latency-Aware Application Module Management for Fog Computing EnvironmentsACM Transactions on Internet Technology, 2018
- Mobile edge computing, Fog et al.: A survey and analysis of security threats and challengesFuture Generation Computer Systems, 2018
- Fog and IoT: An Overview of Research OpportunitiesIEEE Internet of Things Journal, 2016
- Fog Computing: Platform and Applications2015
- Big Data computing and clouds: Trends and future directionsJournal of Parallel and Distributed Computing, 2015
- Fog computing and its role in the internet of things2012