Hybrid Orchestration of AI Services and Microservices in Multi-Edge Collaboration Based on Lagrangian Relaxation Deep Reinforcement Learning
- 7 April 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 13, 8820-8837
Abstract
The rapid development of artificial intelligence has promoted the application of AI services in various fields. The combination of the microservice architecture and the “AI as a Service” (AaaS) to form an intelligent microservice system can realize the orchestration of intelligent applications. In intelligent applications, AI services often require the key functions of accompanying microservices, such as service discovery, data collection, gateway routing, etc., to ensure the stability and efficiency. Otherwise, it will lead to the incompleteness of applications, severely affecting the overall performance of the system. Therefore, fine-grained hybrid orchestration of AI services and microservices is crucial. Nevertheless, it faces major challenges in the resource-constrained edge environment: complex dependencies, frequent data communication, and heterogeneous resource competition between microservices and AI services. Moreover, the tight coupling between deployment and routing leads to complex joint optimization problems. Considering either deployment or routing separately will lead to poor system performance. However, most of the existing studies ignore the above problems.To this end, this paper investigates the hybrid orchestration problem. First, we model intelligent applications as hybrid service invocation chains. Then, based on Jackson queuing networks and multi-instance models, we deeply study the complex dependencies among hybrid services and the heterogeneous resource allocation problem, and conduct an accurate analysis of the request delay and system energy consumption. Furthermore, we innovatively propose Lagrangian Relaxed Deep Deterministic Policy Gradient (LR_DDPG), which introduces a cost mechanism and transforms the constrained hybrid orchestration process into an unconstrained optimization problem by Lagrange relaxation to find the optimal deployment and routing strategy under complex constraints. Finally, the experimental results show that our algorithm achieves significant advantages in terms of latency, energy consumption, and request success rate.Keywords
Funding Information
- Hubei Provincial Technology Innovation Plan (2024BAB016)
- Three Gorges Hi-Tech Information Technology Co. (2025KYXM004)
This publication has 65 references indexed in Scilit:
- A Meta‐Reinforcement Learning Framework Using Deep Q‐Networks and GCNs for Graph Cluster RepresentationSoftware: Practice and Experience, 2025
- Collaborative Task Offloading with Digital Twin in Multi-Vehicle and Multi-Edge Environments2024
- ChainNet: A Customized Graph Neural Network Model for Loss-Aware Edge AI Service Deployment2024
- Efficient Workflow Scheduling and Cost Optimization for Deadline-Constrained Microservice Applications in Mobile Edge Computing2024
- Learning-Based Collaborative Service Placement for AI-oriented Mobile Edge Computing2023
- Model-as-a-Service (MaaS): A Survey2023
- An intelligent Hybrid‐Q Learning clustering approach and resource management within heterogeneous cluster networks based on reinforcement learningTransactions on Emerging Telecommunications Technologies, 2023
- Intelligent Task Offloading Method using Deep Q-Network for Collaborative Edge Computing System2023
- Loading Cost-Aware Model Caching And Request Routing In Edge-enabled Wireless Sensor NetworksThe Computer Journal, 2022
- Multi-objective microservice deployment optimization via a knowledge-driven evolutionary algorithmComplex & Intelligent Systems, 2020