zkStream: a Framework for Trustworthy Stream Processing
Open Access
- 2 December 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 252-265
Abstract
In stream processing, managing sensitive information in a timely manner while ensuring trust remains a significant challenge. When parties without a priori trust cooperate to execute a streaming application, it is difficult to ensure that sensitive data is kept confidential while guaranteeing that every party executes their code honestly. This paper presents zkStream: a framework that leverages signatures and zero-knowledge proofs (ZKP) to add trust to streaming applications that run in the edge cloud, guaranteeing data confidentiality, provenance, and computational integrity. We introduce two optimizations to minimize the computational overhead associated with ZKPs, making our framework suitable for real-world applications. We validated our solution with existing benchmarks for streaming applications. Our method achieves an end-to-end latency that is between 6.5 and 15× faster than a naive implementation, demonstrating its potential for industrial adoption where trust is critical.Keywords
This publication has 52 references indexed in Scilit:
- A Survey of Distributed Data Stream Processing FrameworksIEEE Access, 2019
- Demystifying IoT Security: An Exhaustive Survey on IoT Vulnerabilities and a First Empirical Look on Internet-Scale IoT ExploitationsIEEE Communications Surveys & Tutorials, 2019
- Smart Grid Metering Networks: A Survey on Security, Privacy and Open Research IssuesIEEE Communications Surveys & Tutorials, 2019
- Compact Multi-signatures for Smaller Blockchains2018
- Smart Meter Data Privacy: A SurveyIEEE Communications Surveys & Tutorials, 2017
- Big data analytics on Apache SparkInternational Journal of Data Science and Analytics, 2016
- Smart meter data: Balancing consumer privacy concerns with legitimate applicationsEnergy Policy, 2012
- SmartPrivacy for the Smart Grid: embedding privacy into the design of electricity conservationIdentity in the Information Society, 2010
- Short Signatures from the Weil Pairing2001
- Why and Where: A Characterization of Data Provenance2001