Psychometrics is Datametrics: the Test is not Reliable
Authors:
Top Cited Papers
- 1 April 2000
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 60 (2) , 174-195
Abstract
The present article responds to selected criticisms of some EPM editorial policies and Vacha-Haase’s “reliability generalization” meta-analytic methods. However, the treatment is more broadly a manifesto regarding the nature of score reliability and what are reasonable expectations for psychometric reporting practices in substantive inquiries. The consequences of misunderstandings of score reliability are explored. It is suggested that paradigmatic misconceptions regarding psychometric issues feed into a spiral of presumptions that measurement training is unnecessary for doctoral students, which then in turn further reinforces misunderstandings of score integrity issues.Keywords
This publication has 25 references indexed in Scilit:
- Psychometrics versus Datametrics: Comment on Vacha-Haase’s “Reliability Generalization” Method and Some Epm Editorial PoliciesEducational and Psychological Measurement, 2000
- Variability in Reliability Coefficients and the Standard Error of Measurement From School District to DistrictApplied Measurement in Education, 1999
- Editorial.Journal of Applied Psychology, 1997
- Mothers' and Fathers' Perceptions of Family Functioning in Families Having Children With DisabilitiesEarly Education and Development, 1994
- The Case Against Statistical Significance Testing, RevisitedThe Journal of Experimental Education, 1993
- Graduate training in statistics, methodology, and measurement in psychology: A survey of PhD programs in North America.American Psychologist, 1990
- Trends in reporting psychometric properties of scales used in counseling psychology research.Journal of Counseling Psychology, 1990
- The Case Against Statistical Significance TestingHarvard Educational Review, 1978
- The language-as-fixed-effect fallacy: A critique of language statistics in psychological researchJournal of Verbal Learning and Verbal Behavior, 1973
- Tests of the Same Length do Have the Same Standard Error of MeasurementEducational and Psychological Measurement, 1959