How to best threshold and validate stacked species assemblages? Community optimisation might hold the answer
- 19 June 2018
- journal article
- research article
- Published by Wiley in Methods in Ecology and Evolution
- Vol. 9 (10) , 2155-2166
Abstract
The popularity of species distribution models (SDMs) and the associated stacked species distribution models (S‐SDMs), as tools for community ecologists, largely increased in recent years. However, while some consensus was reached about the best methods to threshold and evaluate individual SDMs, little agreement exists on how to best assemble individual SDMs into communities, that is, how to build and assess S‐SDM predictions. Here, we used published data of insects and plants collected within the same study region to test (a) if the most established thresholding methods to optimize single species prediction are also the best choice for predicting species assemblage composition, or if community‐based thresholding can be a better alternative, and (b) whether the optimal thresholding method depends on taxa, prevalence distribution and/or species richness. Based on a comparison of different evaluation approaches, we provide guidelines for a robust community cross‐validation framework, to use if spatial or temporal independent data are unavailable. Our results showed that the selection of the “optimal” assembly strategy mostly depends on the evaluation approach rather than taxa, prevalence distribution, regional species pool or species richness. If evaluated with independent data or reliable cross‐validation, community‐based thresholding seems superior compared to single species optimisation. However, many published studies did not evaluate community projections with independent data, often leading to overoptimistic community evaluation metrics based on single species optimisation. The fact that most of the reviewed S‐SDM studies reported over‐fitted community evaluation metrics highlights the importance of developing clear evaluation guidelines for community models. Here, we move a first step in this direction, providing a framework for cross‐validation at the community level.Keywords
Funding Information
- H2020 Marie Skłodowska-Curie Actions
- Seventh Framework Programme (ACONITE, PIEF‐GA‐2013‐622620)
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (31003A‐1528661)
This publication has 73 references indexed in Scilit:
- ecospat: an R package to support spatial analyses and modeling of species niches and distributionsEcography, 2017
- When Climate Reshuffles Competitors: A Call for Experimental MacroecologyTrends in Ecology & Evolution, 2016
- Overcoming limitations of modelling rare species by using ensembles of small modelsMethods in Ecology and Evolution, 2015
- Remote sensing data can improve predictions of species richness by stacked species distribution models: a case study for Mexican pinesJournal of Biogeography, 2013
- Stacking species distribution models and adjusting bias by linking them to macroecological modelsGlobal Ecology and Biogeography, 2013
- Climate Change and the Past, Present, and Future of Biotic InteractionsScience, 2013
- The impact of modelling choices in the predictive performance of richness maps derived from species‐distribution models: guidelines to build better diversity modelsMethods in Ecology and Evolution, 2013
- Assessing the accuracy of species distribution models: prevalence, kappa and the true skill statistic (TSS)Journal of Applied Ecology, 2006
- Random ForestsMachine Learning, 2001
- Population Ecology1996