Using item response theory to address vulnerabilities in FFQ
Authors:
- 13 September 2017
- journal article
- research article
- Published by Cambridge University Press (CUP) in British Journal of Nutrition
- Vol. 118 (5) , 383-391
Abstract
The limitations for self-reporting of dietary patterns are widely recognised as a major vulnerability of FFQ and the dietary screeners/scales derived from FFQ. Such instruments can yield inconsistent results to produce questionable interpretations. The present article discusses the value of psychometric approaches and standards in addressing these drawbacks for instruments used to estimate dietary habits and nutrient intake. We argue that a FFQ or screener that treats diet as a ‘latent construct’ can be optimised for both internal consistency and the value of the research results. Latent constructs, a foundation for item response theory (IRT)-based scales (e.g. Patient Reported Outcomes Measurement Information System) are typically introduced in the design stage of an instrument to elicit critical factors that cannot be observed or measured directly. We propose an iterative approach that uses such modelling to refine FFQ and similar instruments. To that end, we illustrate the benefits of psychometric modelling by using items and data from a sample of 12 370 Soldiers who completed the 2012 US Army Global Assessment Tool (GAT). We used factor analysis to build the scale incorporating five out of eleven survey items. An IRT-driven assessment of response category properties indicates likely problems in the ordering or wording of several response categories. Group comparisons, examined with differential item functioning (DIF), provided evidence of scale validity across each Army sub-population (sex, service component and officer status). Such an approach holds promise for future FFQ.Keywords
This publication has 39 references indexed in Scilit:
- Biomarkers and surrogate endpoints in clinical trialsStatistics in Medicine, 2012
- Development and use of FFQ among adults in diverse settings across the globeProceedings of the Nutrition Society, 2011
- Can we use biomarkers in combination with self-reports to strengthen the analysis of nutritional epidemiologic studies?Epidemiologic Perspectives & Innovations, 2010
- Need for Technological Innovation in Dietary AssessmentJournal of the American Dietetic Association, 2010
- Comparison of 3 Methods for Identifying Dietary Patterns Associated With Risk of DiseaseAmerican Journal of Epidemiology, 2008
- Testing nutrient profile models in relation to energy density and energy costEuropean Journal of Clinical Nutrition, 2008
- Good Practices for Identifying Differential Item FunctioningMedical Care, 2006
- A Brief History of Item Theory ResponseEducational Measurement: Issues and Practice, 1997
- Local Dependence Indexes for Item Pairs Using Item Response TheoryJournal of Educational and Behavioral Statistics, 1997
- Uses of item response theory and the testlet concept in the measurement of psychopathology.Psychological Methods, 1996