Joint Deployment and Routing for Hybrid AI Services and Microservices in Edge via Deep Reinforcement Learning
- 19 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 13 (7) , 13455-13471
Abstract
The big data era has accelerated the development of artificial intelligence (AI). The model-as-a-service (MaaS) paradigm has been used to address the substantial challenges associated with the organization and development of AI services. However, the successful delivery of complete AI applications is contingent upon the robust collaboration between microservice architectures and AI services. In this case, hybrid orchestration of AI services and microservices is highly necessary, but it still brings challenges. Furthermore, due to the heterogeneity of servers, resource competition, and multi-instance, the difficulty of hybrid orchestration modeling is increased. When considering intricate service dependencies among AI services and microservices, the tight coupling of deployment and routing leads to complex joint optimization problems, vastly aggravating the pressure of hybrid orchestration. Nonetheless, extant literature largely failed to address the intricate competitive and collaborative relationships between AI services and microservices, and fine-grained latency analysis with multi-instance modeling in the hybrid orchestration problem. Therefore, we study joint deployment and routing for hybrid AI services and microservices in heterogeneous edge. First, we conduct a precise analysis of latency and energy consumption, based on queuing networks and multi-instance models. Second, we propose a reinforcement learning (RL) method based on potential functions and segmented rewards (PS_SAC) to optimize end-to-end latency and system energy consumption, achieving efficient hybrid orchestration. Finally, through extensive simulation experiments, the algorithm demonstrates significant advantages in reducing latency, improving resource utilization, and lowering system energy consumption.Keywords
Funding Information
- National Natural Science Foundation of China (62171189)
- Key Research and Development Program of Hunan Province of China (2025BAB051)
- Key Research and Development Program of Hunan Province of China (2024BAB031)
- Regional Innovation and Development Joint Fund of the National Natural Science Foundation of China (U25A20435)
This publication has 34 references indexed in Scilit:
- Design and Implementation of a Personalized Recommendation System Based on Deep Learning Distributed Collaborative Filtering Algorithm on Social Media Platforms2025
- Advancing Natural Language Processing: Beyond Embeddings2024
- ChainNet: A Customized Graph Neural Network Model for Loss-Aware Edge AI Service Deployment2024
- Model-as-a-Service (MaaS): A Survey2023
- A Distributed Microservice Scheduling Optimization Method2023
- Application Deployment in Mobile Edge Computing Environment Based on Microservice Chain2022
- QoS-Aware Placement of Deep Learning Services on the Edge with Multiple Service Implementations2021
- IoT Microservice Deployment in Edge-Cloud Hybrid Environment Using Reinforcement LearningIEEE Internet of Things Journal, 2020
- Cloud-native Service Function Chaining for 5G based on Network Service Mesh2020
- Service Deployment of C4ISR Based on Genetic Simulated Annealing AlgorithmIEEE Access, 2020