LSM-Raft: Optimizing Raft for LSM-tree Store
Open Access
- 4 December 2025
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Management of Data
- Vol. 3 (6) , 1-27
Abstract
The Raft consensus algorithm ensures strong consistency by replicating a totally ordered log of operations. However, this strict ordering introduces significant redundancy in databases built on Log-Structured Merge (LSM) trees, where follower-side log transmission and compaction often duplicate storage and computation. In this paper, we present LSM-Raft, a generalized extension of Raft that models the replicated log as a sequence of elements-comprising both atomic entries and compacted SSTables. By aligning log semantics and state machine behavior with LSM-tree principles, LSM-Raft enables more compact and efficient replication while preserving correctness. We generalize Raft's core safety properties to accommodate the relaxed log structure and formally verify them using TLA+. Moreover, we propose a cost-aware synchronization strategy that dynamically replaces delayed raw entries with semantically equivalent SSTables, minimizing transmission and compaction overhead. Experimental results show that LSM-Raft improves overall throughput and significantly reduces resource utilization under real-world workloads, demonstrating its practicality in high-ingest, compaction-intensive environments.Keywords
Funding Information
- National Natural Science Foundation of China (62021002,92267203,62232005)
- the National Key Research and Development Plan (2025ZD1601701,2024YFB3311901,2021YFB3300500)
- Beijing National Research Center For Information Science And Technology (BNR2025RC01011)
- Beijing Key Laboratory of Industrial Big Data System and Application
This publication has 30 references indexed in Scilit:
- Aion: Live Migration for In-Memory Databases with Zero Downtime and Reduced Redundant Data TransferData Science and Engineering, 2025
- Orchestrating In-Network Aggregation for Distributed Machine Learning via In-Band Network TelemetryJournal of Computer Science and Technology, 2025
- The Development of a TLA$^{+}$ Verified Correctness Raft Consensus Protocol2024
- Separation or Not: On Handing Out-of-Order Time-Series Data in Leveled LSM-Tree2022
- Edge-IIoTset: A New Comprehensive Realistic Cyber Security Dataset of IoT and IIoT Applications for Centralized and Federated LearningIEEE Access, 2022
- TON_IoT Telemetry Dataset: A New Generation Dataset of IoT and IIoT for Data-Driven Intrusion Detection SystemsIEEE Access, 2020
- Towards the development of realistic botnet dataset in the Internet of Things for network forensic analytics: Bot-IoT datasetFuture Generation Computer Systems, 2019
- LSM-based storage techniques: a surveyThe VLDB Journal, 2019
- Fast PaxosDistributed Computing, 2006
- The log-structured merge-tree (LSM-tree)Acta Informatica, 1996