A variant of the student’s t -test for data of varying reliability
Preprint
Abstract
The student’s t -test has been a workhorse of statistical testing and is used to determine if two sets of sampled data are significantly different from one another, in a statistical sense. The samples of the data may be individual samples or the means – or some overall summary statistic – of independently acquired subsets of data (e.g. data from individual observers, neurons, or baseball games). The various subsets of data acquired that go into computing the t-statistic are likely to be of differing reliability on account of either different variances or of different numbers of subsamples corresponding to each subset; while all data are given equal weight in a standard t -test, the variation in data reliability across subsets of data needs to be accounted for. Solutions based on mixed model methods and Monte Carlo simulations exist, which do factor data reliability in computing statistics. However, no such extension exists for the ubiquitous student’s t -test. Our proposal is a novel variant of the students t -test that incorporates these issues and adopts a simple but effective alteration in the design that accounts for differing levels of data reliability. Specifically, we weighted each data subset by the inverse of the variance of the data contained therein, a measure that has been used in studies of Bayesian cue combination, or, in the absence of information about variance, by the relative proportion of the overall data contained in the subset. The changes proposed here extend the applicability of the student’s t -test to a wider array of data sets.Keywords
This publication has 9 references indexed in Scilit:
- Discrimination of behaviorally irrelevant auditory stimuli in stage II sleepNeuroReport, 2009
- The Ventriloquist Effect Results from Near-Optimal Bimodal IntegrationCurrent Biology, 2004
- Combining Sensory Information: Mandatory Fusion Within, but Not Between, SensesScience, 2002
- Humans integrate visual and haptic information in a statistically optimal fashionNature, 2002
- A Unified Approach to Mixed Linear ModelsThe American Statistician, 1991
- Random-Effects Models for Longitudinal Data1982
- THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVEDBiometrika, 1947
- The Generalization of Student's RatioThe Annals of Mathematical Statistics, 1931
- THE PROBABLE ERROR OF A MEANBiometrika, 1908