Evaluating Guidelines For Test Adaptations
Authors:
- Yongwei YangYYYongwei Yang
- James HarterJHJames Harter
- 1 September 2006
- journal article
- Published by SAGE Publications in Journal of Cross-Cultural Psychology
- Vol. 37 (5) , 557-567
Abstract
Guidelines for translating educational and psychological assessments for use across different languages and cultures have been developed by the International Test Commission and the Joint Committee on Standards for Educational and Psychological Testing. Common themes in these guidelines and standards are when translating items both judgmental and statistical techniques should be used to ensure item comparability across languages, and rigorous quality-control steps should be included in the translation process. In this study, the authors use differential item functioning methodology to evaluate the comparability of translated items at two different points in time—after the initial translation and 4 years later after the translations were revisited using a more rigorous translation model. The results indicated that the revised translations led to improvements in some but not all items. Improvements in the process of translating survey items, even when based on accepted professional standards, should be statistically evaluated. This methodology illustrates how evaluations can be conducted on translated survey items.Keywords
This publication has 12 references indexed in Scilit:
- Evaluating the Equivalence of an Employee Attitude Survey Across Languages, Cultures, and Administration FormatsInternational Journal of Testing, 2003
- Business-unit-level relationship between employee satisfaction, employee engagement, and business outcomes: A meta-analysis.Journal of Applied Psychology, 2002
- Evaluating Type I Error and Power Rates Using an Effect Size Measure With the Logistic Regression Procedure for DIF DetectionApplied Measurement in Education, 2001
- The Next Generation of the ITC Test Translation and Adaptation GuidelinesEuropean Journal of Psychological Assessment, 2001
- The Validity of Comparative Educational StudiesEducational Measurement: Issues and Practice, 1999
- Adapting Tests for Use in Multiple Languages and CulturesSocial Indicators Research, 1998
- Problems and Issues in Linking Assessments Across LanguagesEducational Measurement: Issues and Practice, 1997
- Towards an Integrated Analysis of Bias in Cross-Cultural AssessmentEuropean Journal of Psychological Assessment, 1997
- Increasing the Validity of Cross-Cultural Assessments: Use of Improved Methods for Test Adaptations 1Laboratory of Psychometric and Evaluative Research Report No.275. Amherst, MA: University of Massachusetts, School of Education. Paper presented at the 23rd International Congress of Applied Psychology, Madrid, 1994.European Journal of Psychological Assessment, 1995
- Back-Translation for Cross-Cultural ResearchJournal of Cross-Cultural Psychology, 1970