Exploring differential bundle functioning in mathematics by gender: the effect of hierarchical modelling
- 1 February 2013
- journal article
- research article
- Published by Taylor & Francis in International Journal of Research & Method in Education
- Vol. 36 (1) , 82-100
Abstract
Researchers interested in exploring substantive group differences are increasingly attending to bundles of items (or testlets): the aim is to understand how gender differences, for instance, are explained by differential performances on different types or bundles of items, hence differential bundle functioning (DBF). Some previous work has modelled hierarchies in data in this context or considered item responses within persons, but here we model the bundles themselves as explanatory variables at the item level potentially explaining significant intra-class correlation due to gender differences in item difficulty, and thus explaining variation at the second item level. In this study, we analyse DBF using single- and two-level models (the latter modelling random item effects, which models responses at Level 1 and items at Level 2) in a high-stakes National Mathematics test. The models show comparable regression coefficients but the statistical significances of the two-level models are smaller due to the larger values of the estimated standard errors. We discuss the contrasting relevance of this effect for test developers and gender researchers.Keywords
This publication has 32 references indexed in Scilit:
- Exploration of the Validity of Gender Differences in Mathematics Assessment Using Differential Bundle FunctioningInternational Journal of Testing, 2011
- Gender Differences in Large-Scale Math Assessments: PISA Trend 2000 and 2003Applied Measurement in Education, 2009
- Using a Multidimensional Differential Item Functioning Framework to Determine if Reading Ability Affects Student Performance in MathematicsApplied Measurement in Education, 2008
- Examining Sources of Gender DIF in Mathematics Assessments Using a Confirmatory Multidimensional Model ApproachApplied Measurement in Education, 2006
- Working Memory and Children’s Mathematical Skills: Implications for mathematical development and mathematics curriculaEducational Psychology, 2006
- Assessing and Explaining Differential Item Functioning Using Logistic Mixed ModelsJournal of Educational and Behavioral Statistics, 2005
- Identifying Content and Cognitive Skills that Produce Gender Differences in Mathematics: A Demonstration of the Multidimensionality‐Based DIF Analysis ParadigmJournal of Educational Measurement, 2003
- An Empirical Investigation Demonstrating the Multidimensional DIF Paradigm: A Cognitive Explanation for DIFJournal of Educational Measurement, 2001
- Item‐Bundle DIF Hypothesis Testing: Identifying Suspect Bundles and Assessing Their Differential FunctioningJournal of Educational Measurement, 1996
- Gender Differences in Mathematical Achievement at the Norwegian Elementary‐school LevelScandinavian Journal of Educational Research, 1995