DVM: A Big Virtual Machine for Cloud Computing
Authors:
- 29 April 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 63 (9) , 2245-2258
Abstract
As cloud-based computation grows to be an increasingly important paradigm, providing a general computational interface to support datacenter-scale programming has become an imperative research agenda. Many cloud systems use existing virtual machine monitor (VMM) technologies, such as Xen, VMware, and Windows Hypervisor, to multiplex a physical host into multiple virtual hosts and isolate computation on the shared cluster platform. However, traditional multiplexing VMMs do not scale beyond one single physical host, and it alone cannot provide the programming interface and cluster-wide computation that a datacenter system requires. We design a new instruction set architecture, DISA, to unify myriads of compute nodes to form a big virtual machine called DVM and present programmers the view of a single computer, where thousands of tasks run concurrently in a large, unified, and snapshotted memory space. The DVM provides a simple yet scalable programming model and mitigates the scalability bottleneck of traditional distributed shared memory systems. Along with an efficient execution engine, the capacity of a DVM can scale up to support large clusters. We have implemented and tested DVM on four platforms, and our evaluation shows that DVM has excellent performance and scalability. On one physical host, the system overhead of DVM is comparable to that of traditional VMMs. On 16 physical hosts, the DVM runs 10 times faster than MapReduce/Hadoop and X10. On 160 compute nodes in the TH-1/GZ supercomputer, the DVM delivers a 12.99× speedup over the computation on 10 compute nodes. The implementation of DVM also allows it to run above traditional VMMs, and we verify that DVM shows linear speedup on a parallelizable workload on 256 large EC2 instances.Keywords
This publication has 28 references indexed in Scilit:
- The TianHe-1A Supercomputer: Its Hardware and SoftwareJournal of Computer Science and Technology, 2011
- Improving Bag-of-Features for Large Scale Image SearchInternational Journal of Computer Vision, 2009
- Toward a cloud computing research agendaACM SIGACT News, 2009
- Parallel Programmability and the Chapel LanguageThe International Journal of High Performance Computing Applications, 2007
- The Google file systemACM SIGOPS Operating Systems Review, 2003
- Memory resource management in VMware ESX serverACM SIGOPS Operating Systems Review, 2002
- Single System ImageThe International Journal of High Performance Computing Applications, 2001
- Shared memory consistency models: a tutorialComputer, 1996
- Compiler optimizations for eliminating barrier synchronizationACM SIGPLAN Notices, 1995
- Memory coherence in shared virtual memory systemsACM Transactions on Computer Systems, 1989