Assessing the reliability of ecotoxicological studies: An overview of current needs and approaches
Open Access
- 1 November 2016
- journal article
- research article
- Published by Oxford University Press (OUP) in Integrated Environmental Assessment and Management
- Vol. 13 (4) , 640-651
Abstract
In general, reliable studies are well designed and well performed, and enough details on study design and performance are reported to assess the study. For hazard and risk assessment in various legal frameworks, many different types of ecotoxicity studies need to be evaluated for reliability. These studies vary in study design, methodology, quality, and level of detail reported (e.g., reviews, peer-reviewed research papers, or industry-sponsored studies documented under Good Laboratory Practice [GLP] guidelines). Regulators have the responsibility to make sound and verifiable decisions and should evaluate each study for reliability in accordance with scientific principles regardless of whether they were conducted in accordance with GLP and/or standardized methods. Thus, a systematic and transparent approach is needed to evaluate studies for reliability. In this paper, 8 different methods for reliability assessment were compared using a number of attributes: categorical versus numerical scoring methods, use of exclusion and critical criteria, weighting of criteria, whether methods are tested with case studies, domain of applicability, bias toward GLP studies, incorporation of standard guidelines in the evaluation method, number of criteria used, type of criteria considered, and availability of guidance material. Finally, some considerations are given on how to choose a suitable method for assessing reliability of ecotoxicity studies. Integr Environ Assess Manag 2017;13:640–651. © 2016 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals, Inc. on behalf of Society of Environmental Toxicology & Chemistry (SETAC)Keywords
This publication has 19 references indexed in Scilit:
- Bad Reporting or Bad Science? Systematic Data Evaluation as a Means to Improve the Use of Peer-Reviewed Studies in Risk Assessments of ChemicalsHuman and Ecological Risk Assessment: An International Journal, 2014
- Facilitating the use of non‐standard in vivo studies in health risk assessment of chemicals: a proposal to improve evaluation criteria and reportingJournal of Applied Toxicology, 2014
- Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory PracticeEnvironmental Health Perspectives, 2012
- Creative in the kitchenSecEd, 2012
- Comparison of four different methods for reliability evaluation of ecotoxicity data: a case study of non-standard test data used in environmental risk assessments of pharmaceutical substancesEnvironmental Sciences Europe, 2011
- Comparison of Data Used for Setting Occupational Exposure LimitsInternational Journal of Occupational and Environmental Health, 2010
- Good Laboratory Practices Are Not Synonymous with Good Scientific Practices, Accurate Reporting, or Valid DataEnvironmental Health Perspectives, 2010
- “ToxRTool”, a new tool to assess the reliability of toxicological dataToxicology Letters, 2009
- Data Quality Evaluation of Toxicological Studies Used to Derive Ecotoxicological BenchmarksHuman and Ecological Risk Assessment: An International Journal, 2000
- A Systematic Approach for Evaluating the Quality of Experimental Toxicological and Ecotoxicological DataRegulatory Toxicology and Pharmacology, 1997