eHotSnap: An Efficient and Hot Distributed Snapshots System for Virtual Machine Cluster
- 1 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 34 (8) , 2433-2447
Abstract
With the popularity of IaaS clouds, many distributed and networked applications are running in virtual machine cluster (VMC). The distributed snapshots of VMC are a practical approach to guarantee system reliability. It rewinds the system to an intermediate state from failures so that the applications can continue execution from a point near the failure. However, the applications running in the VMC suffer from long disruption and significant performance degradation due to the heavy cost distributed snapshots, especially when designed to guarantee global consistency of VMC snapshots. This article presents eHotSnap, which takes distributed snapshots of a VMC efficiently. eHotSnap divides the native snapshot into light cost transient snapshot and heavy cost memory snapshot and then coordinates the VM snapshots immediately after transient snapshots. In this way, it decouples coordination from heavy cost snapshots so that the distributed snapshots are taken (completed in logic) within a second. Then, it performs memory snapshot and optimizes it with a two-layer optimization, which first employs de-duplication to reduce the amount of snapshot data and then leverages priority queue to serve guest write operations preferentially. In addition to presenting eHotSnap, we have implemented a prototype on QEMU/KVM. The experimental results demonstrate the effectiveness and efficiency of the proposed approach.Keywords
Funding Information
- National Natural Science Foundation of China (61972392, 6207245)
- Open Research Fund of the Public Security Behavioral Science Laboratory
- People's Public Security University of China (2020SYS07)
- Fundamental Research Funds for the Central Universities (2021JKF106)
This publication has 38 references indexed in Scilit:
- A Survey Of Architectural Approaches for Data Compression in Cache and Main Memory SystemsIEEE Transactions on Parallel and Distributed Systems, 2015
- HPC Performance and Energy-Efficiency of the OpenStack Cloud Middleware2014
- Fast Wide Area Live Migration with a Low Overhead through Page Cache Teleportation2013
- BlobCR: Virtual disk based checkpoint-restart for HPC applications on IaaS cloudsJournal of Parallel and Distributed Computing, 2013
- VMScatter2013
- Introspection-based memory de-duplication and migration2013
- An integrated experimental environment for distributed systems and networks2002
- An efficient protocol for checkpointing recovery in distributed systemsIEEE Transactions on Parallel and Distributed Systems, 1993
- On distributed snapshotsInformation Processing Letters, 1987
- Distributed snapshotsACM Transactions on Computer Systems, 1985