SG-Serve: Efficient Model Serving for Subgraph-based Graph Representation Learning
Open Access
- 2 April 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Management of Data
- Vol. 4 (1) , 1-29
Abstract
Subgraph-based graph representation learning (SGRL) is an emerging class of GNN models that achieve much higher accuracy for various tasks than classical GNN models (e.g., GCN and GAT). However, we observe that serving SGRL models for online applications is challenging due to their irregular request workloads . Specifically, some heavy requests need significantly more computation than regular requests (e.g., 100x), leading to excessively long tail latency in existing systems. As such, we build SG-Serve, which tailors subgraph extraction and model inference (i.e., the two main stages of SGRL models) to handle the irregular request workloads. For subgraph extraction on the CPU, we propose a general API to implement the diverse extraction methods of SGRL models. Beside generality, the API also exposes parallelization opportunities and allows the heavy requests to utilize multiple threads for speedup. To schedule the CPU threads to conduct extraction for concurrent requests, we design a work-stealing policy, which enjoys parallelism while avoiding head-of-line blocking. For model inference on the GPU, we batch the requests according to their workload instead of request count (i.e., as in existing systems) and run two GPU processes to prevent the heavy requests from monopolizing the GPU. Our experiments show that compared with existing systems, SG-Serve can reduce the 99th percentile (P99) latency by over 13x and improve the request throughput by over 33x.Keywords
This publication has 56 references indexed in Scilit:
- GPU-Accelerated Batch-Dynamic Subgraph Matching2024
- InferTurbo: A Scalable System for Boosting Full-graph Inference of Graph Neural Network over Huge Graphs2023
- Locality-aware subgraphs for inductive link prediction in knowledge graphsPattern Recognition Letters, 2023
- VSGM: View-Based GPU-Accelerated Subgraph Matching on Large Graphs2022
- Hybrid Structure Encoding Graph Neural Networks with Attention Mechanism for Link Prediction2022
- Elementary Subgraph Features for Link Prediction With Neural NetworksIEEE Transactions on Knowledge and Data Engineering, 2021
- FeatGraph: A Flexible and Efficient Backend for Graph Neural Network Systems2020
- Defining and evaluating network communities based on ground-truthKnowledge and Information Systems, 2013
- The tail at scaleCommunications of the ACM, 2013
- Pregel2010