A Signal Detection Approach in a Multiple Cohort Study: Different Admission Tools Uniquely Select Different Successful Students
Open Access
- 1 May 2018
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Education
- Vol. 3
Abstract
Using multiple admission tools in university admission procedures is common practice. This is particularly useful if different admission tools uniquely select different subgroups of students who will be successful in university programs. A signal-detection approach was used to investigate the accuracy of Secondary School grade point average (SSGPA), an admission test score (ACS), and a non-cognitive score (NCS) in uniquely selecting successful students. This was done for three consecutive first year cohorts of a broad psychology program. Each applicant's score on SSGPA, ACS, or NCS alone—and on seven combinations of these scores, all considered separate “admission tools”—was compared at two different (medium and high) cut-off scores (criterion levels). Each of the tools selected successful students who were not selected by any of the other tools. Both sensitivity and specificity were enhanced by implementing multiple tools. The signal-detection approach distinctively provided useful information for decisions on admission instruments and cut-off scores.Keywords
This publication has 32 references indexed in Scilit:
- On the Use of Broadened Admission Criteria in Higher EducationPerspectives on Psychological Science, 2017
- Measuring non-cognitive predictors in high-stakes contexts: The effect of self-presentation on self-report instruments used in admission to higher educationPersonality and Individual Differences, 2017
- The predictive validity of using admissions testing and multiple mini-interviews in undergraduate university admissionsHigher Education Research & Development, 2016
- Predicting Performance in Higher Education Using Proximal PredictorsPLOS ONE, 2016
- Same admissions tools, different outcomes: a critical perspective on predictive validity in three undergraduate medical schoolsBMC Medical Education, 2013
- Admission criteria and diversity in medical schoolMedical Education, 2013
- Dropout prevention measures in the Netherlands, an explorative evaluationEducational Review, 2013
- Profile in Action: Linking Admission and RetentionNew Directions for Higher Education, 2013
- Fact and Fiction in Cognitive Ability Testing for Admissions and Hiring DecisionsCurrent Directions in Psychological Science, 2010
- Do logistic regression and signal detection identify different subgroups at risk? Implications for the design of tailored interventionsPsychological Methods, 2001