L H Bruner
Research Subjects
L H Bruner has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
R D Curren
Institute for In Vitro Sciences, Gaithersburg, Maryland, USA
4 shared publicationsG J Carr
The Procter & Gamble Company, Miami Valley Laboratories, Cincinnati, Ohio, USA
3 shared publications- John W. Harbell
JHarbell Consulting LLC, Dallas, USA
3 shared publications - Andrew Paul Worth
European Commission, Joint Research Centre (JRC), Ispra, Italy
1 shared publication D J Esdaile
Rhône-Poulenc, 355 rue Dostoievski, 06903 Sophia Antipolis Cedex, France
1 shared publicationH Spielmann
ZEBET, BgVV, Diedersdorfer Weg 1, 12277 Berlin, Germany
1 shared publication
Latest Publications
- Open Access
- 1 June 2002
- Published by SAGE Publications in Human & Experimental Toxicology
- Vol. 21 (6) , 305-312
An investigation of new toxicity test method performance in validation studies: 1. toxicity test methods that have predictive capacity no greater than chance
An approach commonly used to measure new toxicity test method (NTM) performance in validation studies is to divide toxicity results into positive and negative classifications, and then identify true positive (TP), true negative (TN), false positive (FP) and false negative (FN) results. After this step is completed, the contingent probability statistics (CPS), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) are calculated. Although these statistics are widely used and often the only statistics used to assess the performance of toxicity test methods, there is little specific guidance in the validation literature on what values for these statistics indicate adequate performance. The purpose of this study was to begin developing data-based answers to this question by characterizing the CPS obtained from an NTM whose data have a completely random association with a reference test method (RTM). Determining the CPS of this worst-case scenario is useful because it provides a lower baseline from which the performance of an NTM can be judged in future validation studies. It also provides an indication of relationships in the CPS that help identify random or near-random relationships in the data. The results from this study of randomly associated tests show that the values obtained for the statistics vary significantly depending on the cut-offs chosen, that high values can be obtained for individual statistics, and that the different measures cannot be considered independently when evaluating the performance of an NTM. When the association between results of an NTM and RTM is random the sum of the complementary pairs of statistics (sensitivity+ specificity, NPV+PPV) is approximately 1, and the prevalence (i.e., the proportion of toxic chemicals in the population of chemicals) and PPV are equal. Given that combinations of high sensitivity–low specificity or low specificity–high sensitivity (i.e., the sum of the sensitivity and specificity equal to approximately 1) indicate lack of predictive capacity, an NTM having these performance characteristics should be considered no better for predicting toxicity than by chance alone.
- 1 June 2002
- Published by SAGE Publications in Human & Experimental Toxicology
- Vol. 21 (6) , 305-312
Open AccessAn investigation of new toxicity test method performance in validation studies: 1. toxicity test methods that have predictive capacity no greater than chance
An approach commonly used to measure new toxicity test method (NTM) performance in validation studies is to divide toxicity results into positive and negative classifications, and then identify true positive (TP), true negative (TN), false positive (FP) and false negative (FN) results. After this step is completed, the contingent probability statistics (CPS), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) are calculated. Although these statistics are widely used and often the only statistics used to assess the performance of toxicity test methods, there is little specific guidance in the validation literature on what values for these statistics indicate adequate performance. The purpose of this study was to begin developing data-based answers to this question by characterizing the CPS obtained from an NTM whose data have a completely random association with a reference test method (RTM). Determining the CPS of this worst-case scenario is useful because it provides a lower baseline from which the performance of an NTM can be judged in future validation studies. It also provides an indication of relationships in the CPS that help identify random or near-random relationships in the data. The results from this study of randomly associated tests show that the values obtained for the statistics vary significantly depending on the cut-offs chosen, that high values can be obtained for individual statistics, and that the different measures cannot be considered independently when evaluating the performance of an NTM. When the association between results of an NTM and RTM is random the sum of the complementary pairs of statistics (sensitivity+ specificity, NPV+PPV) is approximately 1, and the prevalence (i.e., the proportion of toxic chemicals in the population of chemicals) and PPV are equal. Given that combinations of high sensitivity–low specificity or low specificity–high sensitivity (i.e., the sum of the sensitivity and specificity equal to approximately 1) indicate lack of predictive capacity, an NTM having these performance characteristics should be considered no better for predicting toxicity than by chance alone.
- 1 June 2002
- Published by SAGE Publications in Human & Experimental Toxicology
- Vol. 21 (6) , 313-323
An investigation of new toxicity test method performance in validation studies: 2. comparison of three measures of toxicity test performance
An area that requires further research is how best to measure test method performance in validation studies and how to set criteria that should be used to judge the adequacy of this performance. The studies reported here were designed to begin an investigation of these questions. Computer simulations were used to generate data sets similar to those that might be obtained from a large validation study. These data were then analysed using three procedures including determination of the 95% prediction interval (PI), calculation of Pearson's correlation coefficient and calculation of the contingent probability statistics (CPS), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). The results of this work suggest that of the three approaches examined, quantitative measurements with calculation of the 95% PI provide the most information to allow discrimination between the performance of several different NTMs. The results also suggest that dividing data sets into positive and negative toxicity classifications followed by the calculation of CPS leads to considerable information loss. This loss of information may be so significant that it is not possible in certain circumstances to distinguish between NTMs that are adequate and those that are not.
- 1 June 2002
- Published by SAGE Publications in Human & Experimental Toxicology
- Vol. 21 (6) , 313-323
An investigation of new toxicity test method performance in validation studies: 2. comparison of three measures of toxicity test performance
An area that requires further research is how best to measure test method performance in validation studies and how to set criteria that should be used to judge the adequacy of this performance. The studies reported here were designed to begin an investigation of these questions. Computer simulations were used to generate data sets similar to those that might be obtained from a large validation study. These data were then analysed using three procedures including determination of the 95% prediction interval (PI), calculation of Pearson's correlation coefficient and calculation of the contingent probability statistics (CPS), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). The results of this work suggest that of the three approaches examined, quantitative measurements with calculation of the 95% PI provide the most information to allow discrimination between the performance of several different NTMs. The results also suggest that dividing data sets into positive and negative toxicity classifications followed by the calculation of CPS leads to considerable information loss. This loss of information may be so significant that it is not possible in certain circumstances to distinguish between NTMs that are adequate and those that are not.
- 1 June 2002
- Published by SAGE Publications in Human & Experimental Toxicology
- Vol. 21 (6) , 325-334
An investigation of new toxicity test method performance in validation studies: 3. sensitivity and specificity are not independent of prevalence or distribution of toxicity
Often, the only measures of toxicity test performance provided in validation studies are the contingent probability statistics (CPS) sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Sensitivity and specificity are generally used in preference to NPV and PPV since NPV and PPV are assumed to vary with changes in prevalence while sensitivity and specificity are assumed to be independent of changes in prevalence. The purpose of the studies reported here was to test whether or not sensitivity and specificity are actually independent of changes in prevalence. Results derived from these studies indicate that sensitivity and specificity vary significantly depending on the prevalence of toxic substances in the set of chemicals being tested. This means sensitivity and specificity should not always be considered constant indicators of toxicity test performance.
- 1 June 2002
- Published by SAGE Publications in Human & Experimental Toxicology
- Vol. 21 (6) , 325-334
An investigation of new toxicity test method performance in validation studies: 3. sensitivity and specificity are not independent of prevalence or distribution of toxicity
Often, the only measures of toxicity test performance provided in validation studies are the contingent probability statistics (CPS) sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Sensitivity and specificity are generally used in preference to NPV and PPV since NPV and PPV are assumed to vary with changes in prevalence while sensitivity and specificity are assumed to be independent of changes in prevalence. The purpose of the studies reported here was to test whether or not sensitivity and specificity are actually independent of changes in prevalence. Results derived from these studies indicate that sensitivity and specificity vary significantly depending on the prevalence of toxic substances in the set of chemicals being tested. This means sensitivity and specificity should not always be considered constant indicators of toxicity test performance.
- 1 January 1999
- Vol. 27 (1) , 53-77
Eye Irritation Testing: The Way Forward. The Report and Recommendations of ECVAM Workshop 34.
This is the report of the thirty-fourth of a series of workshops organised by the European Centre for the Validation of Alternative Methods (ECVAM). ECVAM's main goal, as defined in 1993 by its Scientific Advisory Committee, is to promote the scientific and regulatory acceptance of alternative methods which are of importance to the biosciences and which reduce, refine or replace the use of laboratory animals. One of the first priorities set by ECVAM was the implementation of procedures which would enable it to become well-informed about the state-of-the-art of non-animal test development and validation, and the potential for the possible incorporation of alternative tests into regulatory procedures. It was decided that this would be best achieved by the organisation of ECVAM workshops on specific topics, at which small groups of invited experts would review the current status of various types of in vitro tests and their potential uses, and make recommendations about the best ways forward (1). The workshop on Eye Irritation Testing: The Way Forward was held in Egham, UK, on 15-17 June 1998, under the chairmanship of Michael Balls (ECVAM, Italy). The workshop had two aims, the first of which was to review some of the previous multi-laboratory validation studies on alternatives to the Draize eye test and assess why many promising alternative methods were not successful in these studies. The second aim was to discuss strategies for making progress toward the short-term reduction, refinement, and eventual replacement, of the Draize test, including: a new approach to the validation of in vitro tests for eye irritancy, based on the use of reference standards, which promises to overcome some of the problems encountered in previous studies; the use of stepwise testing strategies which reduce and refine the use of animals in eye irritation testing; the use of multivariate and other statistical techniques for the further analysis of data generated in previous validation studies; and a programme of research aimed at understanding the underlying mechanisms of eye irritation.
- 1 January 1999
- Vol. 27 (1) , 53-77
Eye Irritation Testing: The Way Forward. The Report and Recommendations of ECVAM Workshop 34.
This is the report of the thirty-fourth of a series of workshops organised by the European Centre for the Validation of Alternative Methods (ECVAM). ECVAM's main goal, as defined in 1993 by its Scientific Advisory Committee, is to promote the scientific and regulatory acceptance of alternative methods which are of importance to the biosciences and which reduce, refine or replace the use of laboratory animals. One of the first priorities set by ECVAM was the implementation of procedures which would enable it to become well-informed about the state-of-the-art of non-animal test development and validation, and the potential for the possible incorporation of alternative tests into regulatory procedures. It was decided that this would be best achieved by the organisation of ECVAM workshops on specific topics, at which small groups of invited experts would review the current status of various types of in vitro tests and their potential uses, and make recommendations about the best ways forward (1). The workshop on Eye Irritation Testing: The Way Forward was held in Egham, UK, on 15-17 June 1998, under the chairmanship of Michael Balls (ECVAM, Italy). The workshop had two aims, the first of which was to review some of the previous multi-laboratory validation studies on alternatives to the Draize eye test and assess why many promising alternative methods were not successful in these studies. The second aim was to discuss strategies for making progress toward the short-term reduction, refinement, and eventual replacement, of the Draize test, including: a new approach to the validation of in vitro tests for eye irritancy, based on the use of reference standards, which promises to overcome some of the problems encountered in previous studies; the use of stepwise testing strategies which reduce and refine the use of animals in eye irritation testing; the use of multivariate and other statistical techniques for the further analysis of data generated in previous validation studies; and a programme of research aimed at understanding the underlying mechanisms of eye irritation.