Kai Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Kai Liu has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Chaowei Yang
NSF Spatiotemporal Innovation Center, George Mason University
2 shared publications - Baoxuan Jin
Information Center, Department of Natural Resources of Yunnan Province, Kunming 650224, China
1 shared publication - Chen Xu
George Mason University
1 shared publication - Fei Hu
NSF Spatiotemporal Innovation Center and Department of Geography and GeoInformation Science, George Mason University, Fairfax, VA 22030, USA
1 shared publication - Jizhe Xia
George Mason University
1 shared publication - Manzhu Yu
The Pennsylvania State University
1 shared publication
Latest Publications
- Open Access
- 27 September 2016
- Published by MDPI AG in ISPRS International Journal of Geo-Information
- Vol. 5 (10) , 173
Automatic Scaling Hadoop in the Cloud for Efficient Process of Big Geospatial Data
Efficient processing of big geospatial data is crucial for tackling global and regional challenges such as climate change and natural disasters, but it is challenging not only due to the massive data volume but also due to the intrinsic complexity and high dimensions of the geospatial datasets. While traditional computing infrastructure does not scale well with the rapidly increasing data volume, Hadoop has attracted increasing attention in geoscience communities for handling big geospatial data. Recently, many studies were carried out to investigate adopting Hadoop for processing big geospatial data, but how to adjust the computing resources to efficiently handle the dynamic geoprocessing workload was barely explored. To bridge this gap, we propose a novel framework to automatically scale the Hadoop cluster in the cloud environment to allocate the right amount of computing resources based on the dynamic geoprocessing workload. The framework and auto-scaling algorithms are introduced, and a prototype system was developed to demonstrate the feasibility and efficiency of the proposed scaling mechanism using Digital Elevation Model (DEM) interpolation as an example. Experimental results show that this auto-scaling framework could (1) significantly reduce the computing resource utilization (by 80% in our example) while delivering similar performance as a full-powered cluster; and (2) effectively handle the spike processing workload by automatically increasing the computing resources to ensure the processing is finished within an acceptable time. Such an auto-scaling approach provides a valuable reference to optimize the performance of geospatial applications to address data- and computational-intensity challenges in GIScience in a more cost-efficient manner.
- 27 September 2016
- Published by MDPI AG in ISPRS International Journal of Geo-Information
- Vol. 5 (10) , 173
Open AccessAutomatic Scaling Hadoop in the Cloud for Efficient Process of Big Geospatial Data
Efficient processing of big geospatial data is crucial for tackling global and regional challenges such as climate change and natural disasters, but it is challenging not only due to the massive data volume but also due to the intrinsic complexity and high dimensions of the geospatial datasets. While traditional computing infrastructure does not scale well with the rapidly increasing data volume, Hadoop has attracted increasing attention in geoscience communities for handling big geospatial data. Recently, many studies were carried out to investigate adopting Hadoop for processing big geospatial data, but how to adjust the computing resources to efficiently handle the dynamic geoprocessing workload was barely explored. To bridge this gap, we propose a novel framework to automatically scale the Hadoop cluster in the cloud environment to allocate the right amount of computing resources based on the dynamic geoprocessing workload. The framework and auto-scaling algorithms are introduced, and a prototype system was developed to demonstrate the feasibility and efficiency of the proposed scaling mechanism using Digital Elevation Model (DEM) interpolation as an example. Experimental results show that this auto-scaling framework could (1) significantly reduce the computing resource utilization (by 80% in our example) while delivering similar performance as a full-powered cluster; and (2) effectively handle the spike processing workload by automatically increasing the computing resources to ensure the processing is finished within an acceptable time. Such an auto-scaling approach provides a valuable reference to optimize the performance of geospatial applications to address data- and computational-intensity challenges in GIScience in a more cost-efficient manner.
- 20 June 2014
- Published by Springer Nature
- p. 327-351
Contemporary Computing Technologies for Processing Big Spatiotemporal Data
- 20 June 2014
- Published by Springer Nature
- p. 327-351
Contemporary Computing Technologies for Processing Big Spatiotemporal Data