Real-time data integration in information systems using stream processing for medical data
Open Access
- 12 November 2023
- journal article
- research article
- Published by Sofia University "St. Kliment Ohridski" in Annual of Sofia University St. Kliment Ohridski. Faculty of Mathematics and Informatics
- Vol. 110, 101-110
Abstract
Real-time data processing in medical information systems is becoming harder with the increase in data volume. Stream processing is a popular approach for real-time data processing, which can process large volumes of data including medical in a scalable manner. In some cases, medical data may not be available in real time because of privacy and security concerns. In this paper, we will explore the use of stream processing with static medical data using streaming platforms, Kafka, and Apache Spark. We will demonstrate how these platforms can be used to work with static data in streams and discuss the benefits and limitations of the approach. We also present a case study to illustrate the effectiveness and performance.Keywords
This publication has 5 references indexed in Scilit:
- Extending Kafka Streams for Complex Event Recognition2020
- A Distributed Stream Processing Middleware Framework for Real-Time Analysis of Heterogeneous Data on Big Data Platform: Case of Environmental MonitoringSensors, 2020
- Real-Time Healthcare Monitoring System using Online Machine Learning and Spark StreamingInternational Journal of Advanced Computer Science and Applications, 2020
- Streams and Tables2018
- Spark SQL2015