The problem of ensuring authenticity and reliability of LSP tests within the framework of an integrative validation model: A thematic review.
Authors:
- Moscow State University of Psychology and EducationMEMoscow State University of Psychology and Education
- Elena Anatolyevna BalyginaEBElena Anatolyevna Balygina
- Yulia Vladimirovna YarovikovaYYYulia Vladimirovna Yarovikova
- Alexandra Victorovna GuzovaAGAlexandra Victorovna Guzova
Open Access
- 30 August 2025
- journal article
- Published by Novosibirsk State Pedagogical University in Science for Education Today
- Vol. 15 (4) , 246-272
Abstract
Introduction. The article presents a review of Scholarly literature on the problem of ensuring the authenticity and reliability of LSP tests (Language for Specific Purposes) within the framework of the integrative validation model. The study examines current issues of LSP test validation, identifies the main problems associated with their low validity, and emphasizes the importance of integrating the requirements of the professional context into the testing process. The purpose of the article is to systematize the theoretical and methodological foundations of the integrative validation model and identify the conditions for overcoming the key contradiction between the authenticity and reliability of LSP tests. Materials and Methods. The study is of a review nature and is based on a systematic analysis of Russian and international works devoted to the validation of LSP tests. The methods of comparative analysis, synthesis and generalization of data are used. Results. The outcomes of the study are as follows: the basic principles of the integrative approach to the validation of LSP tests (contextual embeddedness of validity, socially determined nature of the test construct and continuity of the validation process) have been established; the key advantage of the integrative approach has been revealed, which consists in flexibility and adaptability, allowing to take into account the dynamics of the professional environment; the limitations have been identified, such as the vagueness of the construct, subjectivity of assessment and high resource intensity. In order to overcome the contradiction between authenticity and reliability, the following methodological conditions have been proposed: a clear definition of the boundaries of the construct, the development of empirically substantiated assessment criteria and standardization of the assessment procedure taking into account the requirement of adaptability to the professional context. The authors note that the unification of an empirically confirmed system of descriptors within the context-oriented approach creates conditions for overcoming the contradiction between the requirements of authenticity and stability of measurements. Conclusions. The study concludes that the integrative validation model provides a theoretical and methodological basis for creating LSP tests that combine high reliability with authenticity. This opens up new prospects for developing assessment tools that meet the modern requirements of professional communication.Keywords
This publication has 24 references indexed in Scilit:
- Structural relationship between learners’ perceptions of a test, learning practices, and learning outcomes: A study on the washback mechanism of a high-stakes testStudies in Educational Evaluation, 2020
- The B2 Level and the Dream of a Common StandardLanguage Assessment Quarterly, 2017
- Interrogating the construct of communicative competence in language assessment contexts: What the non-language specialist can tell usLanguage & Communication, 2017
- Evaluating test validity: reprise and progressAssessment in Education: Principles, Policy & Practice, 2016
- Explicating validityAssessment in Education: Principles, Policy & Practice, 2015
- Results From Three Performance Validity Tests in Children With Intellectual DisabilityApplied Neuropsychology: Child, 2014
- The Common European Framework of Reference for LanguagesITL - International Journal of Applied Linguistics, 2014
- Operational Rater Types in Writing Assessment: Linking Rater Cognition to Rater BehaviorLanguage Assessment Quarterly, 2012
- The Shaky Ground Beneath the CEFR: Quantitative and Qualitative Dimensions of Language Proficiency1The Modern Language Journal, 2007
- Validating TOEFL® iBT Speaking and Setting Score Requirements for ITA ScreeningLanguage Assessment Quarterly, 2007