TimelyLLM: Time-sensitive LLM Serving System for Physical-I/O Limited Agents
Open Access
- 20 June 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 261-278
Abstract
No abstract availableFunding Information
- National Science Foundation (2112562)
This publication has 14 references indexed in Scilit:
- Pie: A Programmable Serving System for Emerging LLM Applications2025
- GPT-4o: The Cutting-Edge Advancement in Multimodal LLM2025
- BurstGPT: A Real-World Workload Dataset to Optimize LLM Serving Systems2025
- FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models2024
- AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking HeadProceedings of the AAAI Conference on Artificial Intelligence, 2024
- Efficient Memory Management for Large Language Model Serving with PagedAttention2023
- Enhancing Chat Language Models by Scaling High-quality Instructional Conversations2023
- An Evaluation Model for Information Distribution in Multi-Robot Systems2019
- Drone Detection Using Depth Maps2018
- A scheduling algorithm for tasks described by Time Value FunctionReal-Time Systems, 1996