Accelerating joint species distribution modelling with Hmsc-HPC by GPU porting
Open Access
- 3 September 2024
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 20 (9) , e1011914
Abstract
Joint species distribution modelling (JSDM) is a widely used statistical method that analyzes combined patterns of all species in a community, linking empirical data to ecological theory and enhancing community-wide prediction tasks. However, fitting JSDMs to large datasets is often computationally demanding and time-consuming. Recent studies have introduced new statistical and machine learning techniques to provide more scalable fitting algorithms, but extending these to complex JSDM structures that account for spatial dependencies or multi-level sampling designs remains challenging. In this study, we aim to enhance JSDM scalability by leveraging high-performance computing (HPC) resources for an existing fitting method. Our work focuses on the Hmsc R-package, a widely used JSDM framework that supports the integration of various dataset types into a single comprehensive model. We developed a GPU-compatible implementation of its model-fitting algorithm using Python and the TensorFlow library. Despite these changes, our enhanced framework retains the original user interface of the Hmsc R-package. We evaluated the performance of the proposed implementation across various model configurations and dataset sizes. Our results show a significant increase in model fitting speed for most models compared to the baseline Hmsc R-package. For the largest datasets, we achieved speed-ups of over 1000 times, demonstrating the substantial potential of GPU porting for previously CPU-bound JSDM software. This advancement opens promising opportunities for better utilizing the rapidly accumulating new biodiversity data resources for inference and prediction.Keywords
Funding Information
- Research Council of Finland (336212)
- Research Council of Finland (345110)
- European Research Council (856506)
- European Research Council (101057437)
This publication has 36 references indexed in Scilit:
- Bayesian Inference on High-Dimensional Multivariate Binary ResponsesJournal of the American Statistical Association, 2023
- Fast Bayesian inference of block Nearest Neighbor Gaussian models for large dataStatistics and Computing, 2023
- Highly Scalable Bayesian Geostatistical Modeling via Meshed Gaussian Processes on Partitioned DomainsJournal of the American Statistical Association, 2020
- Joint Species Distribution Modelling2020
- Computationally efficient joint species distribution modeling of big spatial dataEcology, 2019
- A comprehensive evaluation of predictive performance of 33 species distribution models at species and community levelsEcological Monographs, 2019
- Efficient Algorithms for Bayesian Nearest Neighbor Gaussian ProcessesJournal of Computational and Graphical Statistics, 2019
- GPU-accelerated Gibbs sampling: a case study of the Horseshoe Probit modelStatistics and Computing, 2018
- Hierarchical Nearest-Neighbor Gaussian Process Models for Large Geostatistical DatasetsJournal of the American Statistical Association, 2016
- So Many Variables: Joint Modeling in Community EcologyTrends in Ecology & Evolution, 2015