GRAPLEr: A distributed collaborative environment for lake ecosystem modeling that integrates overlay networks, high‐throughput computing, and WEB services
- 18 April 2017
- journal article
- conference paper
- Published by Wiley in Concurrency and Computation: Practice and Experience
- Vol. 29 (13)
Abstract
Summary: The GLEON Research And PRAGMA Lake Expedition—GRAPLE—is a collaborative effort between computer science and lake ecology researchers. It aims to improve our understanding and predictive capacity of the threats to the water quality of our freshwater resources, including climate change. This paper presents GRAPLEr, a distributed computing system used to address the modeling needs of GRAPLE researchers. GRAPLEr integrates and applies overlay virtual network, high‐throughput computing, and WEB service technologies in a novel way. First, its user‐level IP‐over‐P2P overlay network allows compute and storage resources distributed across independently administered institutions (including private and public clouds) to be aggregated into a common virtual network, despite the presence of firewalls and network address translators. Second, resources aggregated by the IP‐over‐P2P virtual network run unmodified high‐throughput‐computing middleware to enable large numbers of model simulations to be executed concurrently across the distributed computing resources. Third, a WEB service interface allows end users to submit job requests to the system using client libraries that integrate with the R statistical computing environment. The paper presents the GRAPLEr architecture, describes its implementation and reports on its performance for batches of general lake model simulations across 3 cloud infrastructures (University of Florida, CloudLab, and Microsoft Azure).Keywords
All Related Versions
Funding Information
- National Science Foundation (1527415, 1339737, and 1234983)
This publication has 13 references indexed in Scilit:
- Using wavelet analyses to examine variability in phytoplankton seasonal succession and annual periodicityJournal of Plankton Research, 2016
- Predicting the resilience and recovery of aquatic systems: A framework for model evolution within environmental observatoriesWater Resources Research, 2015
- Fish and Phytoplankton Exhibit Contrasting Temporal Species Abundance Patterns in a Dynamic North Temperate LakePLOS ONE, 2015
- The interaction between climate warming and eutrophication to promote cyanobacteria is dependent on trophic state and varies among taxaLimnology and Oceanography, 2014
- THE GLOBAL LAKE ECOLOGICAL OBSERVATORY NETWORK (GLEON): THE EVOLUTION OF GRASSROOTS NETWORK SCIENCELimnology and Oceanography Bulletin, 2013
- Resilience to BloomsScience, 2011
- Blooms Like It HotScience, 2008
- The open science gridJournal of Physics: Conference Series, 2007
- Castles built on sand: dysfunctionality in plankton models and the inadequacy of dialogue between biologists and modellersJournal of Plankton Research, 2005
- Distributed computing in practice: the Condor experienceConcurrency and Computation: Practice and Experience, 2005