Using Rasch theory to guide the practice of survey development and survey data analysis in science education and to inform science reform efforts: An exemplar utilizing STEBI self‐efficacy data
- 24 September 2010
- journal article
- research article
- Published by Wiley in Science Education
- Vol. 95 (2) , 258-280
Abstract
Over many decades, science education researchers have developed, validated, and used a wide range of attitudinal instruments. Data from such instruments have been analyzed, results have been published, and public policies have been influenced. Unfortunately, most science education instruments are not developed using a guiding theoretical measurement framework. Moreover, ordinal‐level attitudinal data are routinely analyzed as if these data are equal interval, thereby violating requirements of parametric tests. This paper outlines how researchers can use Rasch analysis to develop higher quality science education instruments and why researchers must use Rasch analysis to prepare appropriate ordinal‐level data for parametric analyses. Detailed recommendations are set forth to help science education researchers increase the rigor of attitudinal instrument development and analysis. Suggestions are also set forth regarding how philosophical and analytical Rasch techniques align with broad goals of the science education research community. © 2010 Wiley Periodicals, Inc. Sci Ed 95:258–280, 2011Keywords
This publication has 21 references indexed in Scilit:
- Measuring knowledge of natural selection: A comparison of the CINS, an open‐response instrument, and an oral interviewJournal of Research in Science Teaching, 2008
- Elementary to High School Students' Growth over an Academic Year in Understanding Concepts of MatterJournal of Chemical Education, 2007
- Biology teachers' attitudes toward and use of Indiana's evolution standardsJournal of Research in Science Teaching, 2006
- Exploring alternative conceptions from Newtonian dynamics and simple DC circuits: Links between item difficulty and item confidenceJournal of Research in Science Teaching, 2005
- A study of science teaching self‐efficacy and outcome expectancy beliefs of teachers in IndiaScience Education, 2004
- Outlier Detection in High‐Stakes Certification TestingJournal of Educational Measurement, 2002
- Applications of the Rasch model to evaluation of survey data qualityNew Directions for Evaluation, 1996
- Complex, Performance-Based Assessment: Expectations and Validation CriteriaEducational Researcher, 1991
- The Distributional Properties of Rasch Item Fit StatisticsEducational and Psychological Measurement, 1991
- Simultaneous conjoint measurement: A new type of fundamental measurementJournal of Mathematical Psychology, 1964