A Novel Indicator to Correct for Individual Reported Heterogeneity. An Application to Self-Evaluation of Later-Life Depression
- 8 May 2023
- journal article
- research article
- Published by SAGE Publications in Evaluation Review
- Vol. 48 (2) , 221-250
Abstract
Program evaluations often investigate complex or multi-dimensional constructs, such as individual opinions or attitudes, by means of ratings. A different interpretation of the same question may affect cross-country comparability, leading to the Differential Item Functioning problem. Anchoring vignettes were introduced in the literature as a way to adjust self-evaluations from this interpersonal incomparability. In this paper, we first introduce a new nonparametric solution to analyse anchoring vignette data, recoding a variable based on a rating scale to a new corrected-variable that guarantees comparability in any cross-country analysis. Then, we exploit the flexibility of a mixture model introduced to account for uncertainty in the response process (the CUP model) to test if the proposed solution is effectively able to remove this reported heterogeneity. This solution is easy to construct and has important advantages compared with the original nonparametric solution adopted with anchoring vignette data. The novel indicator is applied to investigate self-reported depression in an old population. Data that will be analysed come from the second wave of the Survey of Health, Ageing and Retirement in Europe, collected in 2006/2007. Results highlight the need of correcting for reported heterogeneity comparing individual self-evaluations. Once interpersonal incomparability resulting from the different uses of response scales is removed from the self-assessments, some estimates are reversed in magnitude and signs with respect to the analysis of the collected data.Keywords
This publication has 58 references indexed in Scilit:
- Is the Anchoring Vignette Method Sensitive to the Domain and Choice of the Vignette?Journal of the Royal Statistical Society Series A: Statistics in Society, 2011
- Can Reporting Heterogeneity Explain Differences in Depressive Symptoms Across Europe?Social Indicators Research, 2011
- Using Anchoring Vignettes to Assess Group Differences in General Self-Rated HealthJournal of Health and Social Behavior, 2011
- Validating the use of Anchoring Vignettes for the Correction of Response Scale Differences in Subjective QuestionsJournal of the Royal Statistical Society Series A: Statistics in Society, 2011
- Late-life depression in Peru, Mexico and Venezuela: the 10/66 population-based studyThe British Journal of Psychiatry, 2009
- Differential Item Functioning Between Ethnic Groups in the Epidemiological Assessment of DepressionJournal of Nervous & Mental Disease, 2008
- Association between obesity and depression in middle-aged womenGeneral Hospital Psychiatry, 2008
- Prospective association between obesity and depression: evidence from the Alameda County StudyInternational Journal of Obesity, 2003
- Development of the EURO–D scale – a European Union initiative to compare symptoms of depression in 14 European centresThe British Journal of Psychiatry, 1999
- The CES-D ScaleApplied Psychological Measurement, 1977