Large Language Model Based Multi-Agent System Augmented Complex Event Processing Pipeline for Internet of Multimedia Things
Authors:
- Abhishek KumarAKAbhishek Kumar
- Sasu TarkomaSTSasu Tarkoma
Preprint
Abstract
This paper presents the development and evaluation of a Large Language Model (LLM), also known as foundation models, based multi-agent system framework for complex event processing (CEP) with a focus on video query processing use cases. The primary goal is to create a proof-of-concept (POC) that integrates state-of-the-art LLM orchestration frameworks with publish/subscribe (pub/sub) tools to address the integration of LLMs with current CEP systems. Utilizing the Autogen framework in conjunction with Kafka message brokers, the system demonstrates an autonomous CEP pipeline capable of handling complex workflows. Extensive experiments evaluate the system's performance across varying configurations, complexities, and video resolutions, revealing the trade-offs between functionality and latency. The results show that while higher agent count and video complexities increase latency, the system maintains high consistency in narrative coherence. This research builds upon and contributes to, existing novel approaches to distributed AI systems, offering detailed insights into integrating such systems into existing infrastructures.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- AgentCoord: Visually exploring coordination strategy for LLM-based multi-agent collaborationComputers & Graphics, 2025
- Towards an understanding of large language models in software engineering tasksEmpirical Software Engineering, 2024
- SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models2024
- Mitigating the OWASP Top 10 For Large Language Models Applications using Intelligent Agents2024
- DesignGPT: Multi-Agent Collaboration in Design2023
- Self-Adaptive Large Language Model (LLM)-Based Multiagent Systems2023
- Towards Autonomous Testing Agents via Conversational Large Language Models2023
- Summary of ChatGPT-Related research and perspective towards the future of large language modelsMeta-Radiology, 2023
- Distributed intelligence on the Edge-to-Cloud Continuum: A systematic literature reviewJournal of Parallel and Distributed Computing, 2022
- Edge and Fog Computing Enabled AI for IoT-An Overview2019