Scalable Performance Evaluation of Byzantine Fault-Tolerant Systems Using Network Simulation
Preprint
Abstract
Recent Byzantine fault-tolerant (BFT) state machine replication (SMR) protocols increasingly focus on scalability to meet the requirements of distributed ledger technology (DLT). Validating the performance of scalable BFT protocol implementations requires careful evaluation. Our solution uses network simulations to forecast the performance of BFT protocols while experimentally scaling the environment. Our method seamlessly plug-and-plays existing BFT implementations into the simulation without requiring code modification or re-implementation, which is often time-consuming and error-prone. Furthermore, our approach is also significantly cheaper than experiments with real large-scale cloud deployments. In this paper, we first explain our simulation architecture, which enables scalable performance evaluations of BFT systems through high performance network simulations. We validate the accuracy of these simulations for predicting the performance of BFT systems by comparing simulation results with measurements of real systems deployed on cloud infrastructures. We found that simulation results display a reasonable approximation at a larger system scale, because the network eventually becomes the dominating factor limiting system performance. In the second part of our paper, we use our simulation method to evaluate the performance of PBFT and BFT protocols from the blockchain generation, such as HotStuff and Kauri, in large-scale and realistic wide-area network scenarios, as well as under induced faults.Keywords
All Related Versions
This publication has 3 references indexed in Scilit:
- AWARE: Adaptive Wide-Area Replication for Fast and Resilient Byzantine ConsensusIEEE Transactions on Dependable and Secure Computing, 2020
- Short Signatures from the Weil PairingJournal of Cryptology, 2004
- Implementing fault-tolerant services using the state machine approach: a tutorialACM Computing Surveys, 1990