On the cultural validity of science assessments
- 30 April 2001
- journal article
- research article
- Published by Wiley in Journal of Research in Science Teaching
- Vol. 38 (5) , 553-573
Abstract
We propose the concept of cultural validity as a form of test validity in science assessment. The conceptual relevance of cultural validity is supported by evidence that culture and society shape an individual's mind and thinking. To attain cultural validity, the process of assessment development must consider how the sociocultural context in which students live influences the ways in which they make sense of science items and the ways in which they solve them. These sociocultural influences include the values, beliefs, experiences, communication patterns, teaching and learning styles, and epistemologies inherent in the students' cultural backgrounds, as well as the socioeconomic conditions prevailing in their cultural groups. We contend that current approaches to handling student diversity in assessment (e.g., adapting or translating tests, providing assessment accommodations, estimating test cultural bias) are limited and lack sociocultural perspective. We find that attaining cultural validity may conflict with current basic principles and assumptions in testing, such as item independence and standardization. We discuss the ways in which adopting cultural validity as a criterion for test validity makes it necessary to shift assessment paradigms and adopt new procedures for assessment development. © 2001 John Wiley & Sons, Inc. J Res Sci Teach 38: 553–573, 2001Keywords
This publication has 36 references indexed in Scilit:
- Research news and Comment: Teachers’ Roles in Promoting Science Inquiry With Students From Diverse Language BackgroundsEducational Researcher, 1999
- Science Knowledge, World Views, and Information Sources in Social and Cultural Contexts: Making Sense After a Natural DisasterAmerican Educational Research Journal, 1999
- Investigating the Cognitive Complexity of Science AssessmentsEducational Measurement: Issues and Practice, 1998
- Science for All, Including Students From Non-English-Language BackgroundsEducational Researcher, 1998
- Threats to the validity of science performance assessments for English language learnersJournal of Research in Science Teaching, 1997
- Interview Procedures for Validating Science AssessmentsApplied Measurement in Education, 1997
- Towards an Integrated Analysis of Bias in Cross-Cultural AssessmentEuropean Journal of Psychological Assessment, 1997
- Chapter 8: Assessment and DiversityReview of Research in Education, 1994
- Evaluation of Procedure‐Based Scoring for Hands‐On Science AssessmentJournal of Educational Measurement, 1992
- Toward a Culturally Based Pedagogy: A Case Study of One Yup'ik Eskimo TeacherAnthropology & Education Quarterly, 1991