Getting it ‘better’: the importance of improving background questionnaires in international large‐scale assessment
- 14 June 2010
- journal article
- research article
- Published by Taylor & Francis in Journal of Curriculum Studies
- Vol. 42 (3) , 411-430
Abstract
In addition to collecting achievement data, international large‐scale assessment programmes gather auxiliary information from students and schools regarding the context of teaching and learning. In an effort to clarify some of the opacity surrounding international large‐scale assessment programmes and the potential problems associated with less than optimal background questionnaires, this paper outlines how auxiliary student background data influence the black box of achievement score construction. This discussion is supplemented with a number of empirical examples that point to possible threats to accurate achievement estimation, including missing data treatment, poor scale reliability, and questionnaire respondents’ misunderstanding or inaccurate answers to the questions.Keywords
This publication has 16 references indexed in Scilit:
- Governing by numbers: the PISA ‘effect’ in EuropeJournal of Education Policy, 2009
- Maternal education and children's academic achievement during middle childhood.Developmental Psychology, 2007
- The Influence of Parent Education and Family Income on Child Achievement: The Indirect Role of Parental Expectations and the Home Environment.Journal of Family Psychology, 2005
- Cross‐national achievement studies: learning from South Africa's participation in the Trends in International Mathematics and Science Study (TIMSS)Compare: A Journal of Comparative and International Education, 2005
- The Validity of Comparative Educational StudiesEducational Measurement: Issues and Practice, 1999
- The Design of the National Assessment of Educational ProgressJournal of Educational Measurement, 1992
- Scaling Procedures in NAEPJournal of Educational Statistics, 1992
- Overview of the National Assessment of Educational ProgressJournal of Educational Statistics, 1992
- Policy Impact of IEA ResearchComparative Education Review, 1987
- Estimating Norms by Item-SamplingEducational and Psychological Measurement, 1962