The devil lies in details: reply to Stuart Hurlbert
Author:
Abstract
As pointed out in Stuart Hurlbert's recent article, ecologists still at times design their experiments sloppily, creating a situation where various forms of ‘non‐demonic intrusion’ could account for the documented contrasts between treatments and controls. If such contrasts are nevertheless presented to the reader as if they were statistically demonstrated treatment effects, then pseudoreplication is not a pseudoissue and the use of a stigmatizing label of is entirely warranted, as pointed out by Hurlbert. The problems with Hurlbert's concepts start in the context of studies, where the scope of the experiment is to provoke a chain of dramatic and a priori extremely unlikely events, which a given conjecture predicts to happen as a consequence of a given manipulation. As the essence of these experiments is to trigger large dynamical responses in a biological system, they often require much space and/or special conditions, allowing for efficient isolation of the experimental system from potential sources of contamination. These constraints can be incompatible with standard designs (randomization, replication and treatment‐control interspersion). In the context of experiments, where it has been necessary to sacrifice randomization, replication or treatment‐control interspersion, the logic of inferring treatment effects is the same as used when interpreting causes of spontaneous events or events triggered by manipulations with practical purposes. The observed contrasts can be reasonably interpreted as effects of the treatment if and only if their magnitudes and the timing of their emergence makes alternative explanations utterly implausible (which is up to the reader to judge). If the logic of inference is clearly explained and no claim of statistically demonstrated treatment effect is made, the use of stigmatizing labels like ‘pseudoreplication’ is unwarranted. However, it might clarify the literature if such imperfectly designed experiments are referred to as experimental events, to be distinguished from perfectly designed experiments, where mechanical interpretation of contrasts between treatments and controls as treatment effects can be regarded as socially acceptable.Keywords
This publication has 33 references indexed in Scilit:
- Predators indirectly protect tundra plants by reducing herbivore abundanceOikos, 2004
- Strong seasonality may attenuate trophic cascades: vertebrate predator exclusion in boreal grasslandOikos, 2002
- Long-Term Exclusion of Folivorous Mammals in Two Arctic-Alpine Plant Communities: A Test of the Hypothesis of Exploitation EcosystemsOikos, 1998
- Food Web Complexity and Community DynamicsThe American Naturalist, 1996
- Grazing by Food-Limited Microtine Rodents on a Productive Experimental Plant Community: Does the "Green Desert" Exist?Oikos, 1993
- Are Trophic Cascades All Wet? Differentiation and Donor‐Control in Speciose EcosystemsEcology, 1992
- Food Webs: Linkage, Interaction Strength and Community InfrastructureJournal of Animal Ecology, 1980
- Algal Zonation in the New England Rocky Intertidal Community: An Experimental AnalysisEcology, 1980
- Giant tortoise and vegetation interactions on aldabra atoll—Part 1: InlandBiological Conservation, 1976
- Competition for Food between Two Intertidal Starfish Species and its Effect on Body Size and FeedingEcology, 1972