Comparison of false-positive rates of 2 hypothesis-test approaches in relation to laboratory toxicity test performance
- 18 February 2019
- journal article
- research article
- Published by Oxford University Press (OUP) in Environmental Toxicology and Chemistry
- Vol. 38 (3) , 511-523
Abstract
We compared 2 statistical hypothesis‐test approaches (no‐observed‐effect concentration [NOEC] and test of significant toxicity [TST]) to determine the influence of laboratory test performance on the false‐positive error rate using the US Environmental Protection Agency's Ceriodaphnia dubia reproduction whole‐effluent toxicity (WET) test endpoint. Simulation and power calculations were used to determine error rates based on observed control coefficients of variation (CV) for 8 laboratories over a range of effect levels. Average C. dubia control reproduction among laboratories was 20 to 40 offspring per female, and the 75th percentile CV was 0.10 to 0.31, reflecting a range in laboratory performance. The 2 approaches behave similarly for CVs of 0.2 to 0.3. At effects CV decreases, TST is less likely to declare toxicity and NOEC is more likely to do so. Laboratory performance affects whether a sample is declared toxic and influences the probability of false‐positive (and −negative) error rates using either approach. At the 75th percentile control CV observed for each laboratory, 4 laboratories would achieve approximately a 5% false‐positive rate using 13 or fewer replicates for this test method. For the remaining 4 laboratories, more replicates would be needed to achieve a 5% false‐positive rate. The present analyses demonstrate how false‐positive rates are influenced by laboratory performance and WET test design. Environ Toxicol Chem 2019;9999:1–13. Published 2019 Wiley Periodicals Inc. on behalf of SETAC. This article is a US government work and, as such, is in the public domain in the United States of America.Keywords
This publication has 20 references indexed in Scilit:
- Well past time to stop using NOELs and LOELsIntegrated Environmental Assessment and Management, 2011
- It is time for changes in the analysis of whole effluent toxicity dataIntegrated Environmental Assessment and Management, 2011
- Test of significant toxicity: A statistical application for assessing whether an effluent or site water is truly toxicEnvironmental Toxicology and Chemistry, 2011
- Evaluation of effluent toxicity as an indicator of aquatic life condition in effluent-dominated streams: A pilot studyIntegrated Environmental Assessment and Management, 2008
- Proof of Hazard and Proof of Safety in Toxicological Studies Using Simultaneous Confidence Intervals for Differences and Ratios to ControlJournal of Biopharmaceutical Statistics, 2008
- The unequal variance t-test is an underused alternative to Student's t-test and the Mann–Whitney U testBehavioral Ecology, 2006
- The Abuse of PowerThe American Statistician, 2001
- Simulation study of characteristics of statistical estimators of inhibition concentrationEnvironmental Toxicology and Chemistry, 2000
- Investigating the Incidence of type i errors for chronic whole effluent toxicity testing usingCeriodaphnia dubiaEnvironmental Toxicology and Chemistry, 2000
- Tests for bioequivalence of control media and test media in studies of toxicityEnvironmental Toxicology and Chemistry, 1995