Development and Validity Evaluation of a National Digital Entrance Examination Test for Higher Education Student Selection
- 18 January 2025
- journal article
- research article
- Published by Wiley in Higher Education Quarterly
- Vol. 79 (1)
Abstract
Higher education institutions need to develop valid, fair, and objective selection methods. Current literature reporting the development and validation of new national large‐scale selection tests is scarce. This two‐phased study aimed to (1) develop and (2) evaluate the validity of the Finnish digital Universities of Applied Sciences Entrance Examination (UAS Exam). In phase 1 (years 2018–2019), the UAS exam sections were constructed using scoping reviews, document analysis, and expert evaluations. Pilot tests were performed for item analysis using Item Response Theory (IRT). In phase 2, validity evaluation was conducted in a cross‐sectional design (October–November 2019) using classical test theory and IRT. The applicants' (n = 13,048) exam scores and the difficulty levels of the exam questions varied in all the exam sections. Psychometrics supported the structure and the use of several exam sections. The usability of the digital exam was evaluated as acceptable. Item analysis revealed development needs in the exam sections.Keywords
This publication has 10 references indexed in Scilit:
- Full Information Optimal ScoringJournal of Educational and Behavioral Statistics, 2019
- TestGardener: A Program for Optimal Scoring and Graphical Analysis2019
- A Typology of Admission Systems Across Europe and Their Impact on the Equity of Access, Progression and Completion in Higher Education2018
- Developing, Analyzing, and Using Distractors for Multiple-Choice Tests in Education: A Comprehensive ReviewReview of Educational Research, 2017
- A Strategy for Replacing Sum ScoringJournal of Educational and Behavioral Statistics, 2016
- Signal detection theory as a tool for successful student selectionAssessment & Evaluation in Higher Education, 2016
- High-stakes Entrance Examinations: A View from BrazilInternational Higher Education, 2016
- Higher Education Entrance Qualifications and Exams in Europe: A Comparison2014
- High-stakes testing – value, fairness and consequencesAssessment in Education: Principles, Policy & Practice, 2012
- Hearing the voices of general staff: a Delphi study of the contributions of general staff to student outcomesJournal of Higher Education Policy and Management, 2010