Abstract
In addition to collecting achievement data, international large‐scale assessment programmes gather auxiliary information from students and schools regarding the context of teaching and learning. In an effort to clarify some of the opacity surrounding international large‐scale assessment programmes and the potential problems associated with less than optimal background questionnaires, this paper outlines how auxiliary student background data influence the black box of achievement score construction. This discussion is supplemented with a number of empirical examples that point to possible threats to accurate achievement estimation, including missing data treatment, poor scale reliability, and questionnaire respondents’ misunderstanding or inaccurate answers to the questions.

This publication has 16 references indexed in Scilit: