Ilse P. Peringa
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ilse P. Peringa has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Rob R. Meijer
University of Groningen
6 shared publications - A. Susan M. Niessen
University of Groningen
4 shared publications - Ruud. J. R. Den Hartigh
Department of Psychology, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands
3 shared publications - Eline G. M. Cox
Department of Intensive Care Medicine, Maastricht University Medical Centre+, Maastricht, The Netherlands
2 shared publications - Felix Kerscher
Department of Psychometrics and Statistics, Faculty of Behavioral and Social Sciences, University of Groningen, The Netherlands; Department of Critical Care, University Medical Center Groningen, University of Groningen, The Netherlands
2 shared publications - Iwan Cornelis Clemens van der Horst
Albert Schweitzer Hospital, Dordrecht, the Netherlands
2 shared publications
Latest Publications
- Open Access
- 20 October 2026
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 201, 112572
When clinical prediction models meet clinical judgment: a framework for classifying prediction approaches
- 20 October 2026
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 201, 112572
Open AccessWhen clinical prediction models meet clinical judgment: a framework for classifying prediction approaches
- Open Access
- 19 October 2026
- Published by Wiley in International Journal of Selection and Assessment
- Vol. 34 (4)
Building on Shaky Foundations: A Critical Review of Criterion Validity Evidence in Personnel Selection
We reviewed the most recent meta‐analytic literature on the criterion validity of predictors of job performance used in personnel selection. The overreliance on concurrent incumbent studies leads to meta‐analytic estimates based on data collected in conditions with non‐representative stakes and an inability to estimate and correct for range restriction based on credible information, obstructing the estimation of operational validity in actual selection contexts. Therefore, we argue that we do not need more meta‐analyses. First, we need primary studies that actually provide estimates of operational criterion validity. On a positive note, we observed increasing attention in meta‐analyses to heterogeneity of results, publication bias and open science. There is room for improvement in terms of attention to the quality and operationalization of predictor and performance measures, and reflection on the quality of the evidence. Given these issues, our stance is that the current body of research does not allow drawing firm conclusions about the criterion validity of predictors of job performance in actual, operational selection settings. To move forward, we provide recommendations for reviewers, editors, and authors of primary studies and meta‐analyses on predictors used in personnel selection.
- 19 October 2026
- Published by Wiley in International Journal of Selection and Assessment
- Vol. 34 (4)
Open AccessBuilding on Shaky Foundations: A Critical Review of Criterion Validity Evidence in Personnel Selection
We reviewed the most recent meta‐analytic literature on the criterion validity of predictors of job performance used in personnel selection. The overreliance on concurrent incumbent studies leads to meta‐analytic estimates based on data collected in conditions with non‐representative stakes and an inability to estimate and correct for range restriction based on credible information, obstructing the estimation of operational validity in actual selection contexts. Therefore, we argue that we do not need more meta‐analyses. First, we need primary studies that actually provide estimates of operational criterion validity. On a positive note, we observed increasing attention in meta‐analyses to heterogeneity of results, publication bias and open science. There is room for improvement in terms of attention to the quality and operationalization of predictor and performance measures, and reflection on the quality of the evidence. Given these issues, our stance is that the current body of research does not allow drawing firm conclusions about the criterion validity of predictors of job performance in actual, operational selection settings. To move forward, we provide recommendations for reviewers, editors, and authors of primary studies and meta‐analyses on predictors used in personnel selection.
- Open Access
- 18 March 2026
- Published by SAGE Publications in International Journal of Sports Science & Coaching
- Vol. 21 (3) , 1614-1620
Rubrics on the pitch: Exploring the reliability of soccer scouts' assessments
Soccer clubs use rubrics to guide scouts and coaches toward uniform rating standards, yet empirical evidence on their reliability remains limited. Therefore, this exploratory field study examined the inter-rater reliability of scouts’ assessments during an 11v11 live match using a rubric. We focused on current and potential performance, information combination methods, and scouts’ confidence and perceived difficulty. Sixteen male scouts ( Mage = 55 years, Mexperience = 6 years) each evaluated three to four under-13 players (yielding 23 unique players in total), rating seven rubric performance indicators on both current and potential performance: motoric/physical, technical execution, attacking on the ball, attacking positioning, defensive duels, defending positioning, and transitioning. Overall current and potential performance scores were established in two different ways: based on the scouts’ judgments (i.e., clinical combination), and by calculating the mean of their indicator ratings (i.e., actuarial combination). Across both these combination methods, inter-rater reliability was moderate for overall current performance (ICC = .61 clinical, ICC = .61 actuarial), but poor for overall potential performance (ICC = .37 clinical, ICC = .42 actuarial). Clinical versus actuarial combination made little difference in reliability. Moreover, scouts reported similar confidence assessing potential but greater difficulty compared to current performance. The findings suggest that evaluations of potential are especially prone to unreliability and highlight the need to further examine reliability in soccer scouting.
- 18 March 2026
- Published by SAGE Publications in International Journal of Sports Science & Coaching
- Vol. 21 (3) , 1614-1620
Open AccessRubrics on the pitch: Exploring the reliability of soccer scouts' assessments
Soccer clubs use rubrics to guide scouts and coaches toward uniform rating standards, yet empirical evidence on their reliability remains limited. Therefore, this exploratory field study examined the inter-rater reliability of scouts’ assessments during an 11v11 live match using a rubric. We focused on current and potential performance, information combination methods, and scouts’ confidence and perceived difficulty. Sixteen male scouts ( Mage = 55 years, Mexperience = 6 years) each evaluated three to four under-13 players (yielding 23 unique players in total), rating seven rubric performance indicators on both current and potential performance: motoric/physical, technical execution, attacking on the ball, attacking positioning, defensive duels, defending positioning, and transitioning. Overall current and potential performance scores were established in two different ways: based on the scouts’ judgments (i.e., clinical combination), and by calculating the mean of their indicator ratings (i.e., actuarial combination). Across both these combination methods, inter-rater reliability was moderate for overall current performance (ICC = .61 clinical, ICC = .61 actuarial), but poor for overall potential performance (ICC = .37 clinical, ICC = .42 actuarial). Clinical versus actuarial combination made little difference in reliability. Moreover, scouts reported similar confidence assessing potential but greater difficulty compared to current performance. The findings suggest that evaluations of potential are especially prone to unreliability and highlight the need to further examine reliability in soccer scouting.
- Open Access
- 12 November 2025
- Published by Elsevier in Psychology of Sport and Exercise
- Vol. 82, 103022
Why experience fails to foster expertise in athlete selection
- 12 November 2025
- Published by Elsevier in Psychology of Sport and Exercise
- Vol. 82, 103022
Open AccessWhy experience fails to foster expertise in athlete selection
- Open Access
- 24 February 2025
- Published by Springer Nature in Critical Care
- Vol. 29 (1) , 1-6
Human judgment error in the intensive care unit: a perspective on bias and noise
In the Intensive Care Unit (ICU), clinicians frequently make complex, high-stakes judgments, where inaccuracies can profoundly affect patient outcomes. This perspective examines human judgment error in ICU settings, specifically bias (systematic error) and noise (random error). While past research has emphasized bias, we explore the role of noise in clinical decision making and its mitigation. System noise refers to unwanted variability in judgments that should ideally be identical. This variability stems from level noise (variability in clinicians’ average judgments), stable pattern noise (variability in clinicians’ responses to specific patient characteristics), and occasion noise (random, within-clinician variability). Two strategies to reduce noise are the use of algorithms and the averaging of independent judgments. Recognizing and addressing noise in clinical decision making is essential to enhancing judgment accuracy in critical care. By implementing effective noise reduction strategies, clinicians can reduce errors and improve patient outcomes, ultimately advancing the quality of care delivered in ICU settings.
- 24 February 2025
- Published by Springer Nature in Critical Care
- Vol. 29 (1) , 1-6
Open AccessHuman judgment error in the intensive care unit: a perspective on bias and noise
In the Intensive Care Unit (ICU), clinicians frequently make complex, high-stakes judgments, where inaccuracies can profoundly affect patient outcomes. This perspective examines human judgment error in ICU settings, specifically bias (systematic error) and noise (random error). While past research has emphasized bias, we explore the role of noise in clinical decision making and its mitigation. System noise refers to unwanted variability in judgments that should ideally be identical. This variability stems from level noise (variability in clinicians’ average judgments), stable pattern noise (variability in clinicians’ responses to specific patient characteristics), and occasion noise (random, within-clinician variability). Two strategies to reduce noise are the use of algorithms and the averaging of independent judgments. Recognizing and addressing noise in clinical decision making is essential to enhancing judgment accuracy in critical care. By implementing effective noise reduction strategies, clinicians can reduce errors and improve patient outcomes, ultimately advancing the quality of care delivered in ICU settings.
- Open Access
- 14 September 2024
- Published by Elsevier in Psychology of Sport and Exercise
- Vol. 76, 102732
A uniform approach for advancing athlete assessment: A tutorial on the Lens Model
- 14 September 2024
- Published by Elsevier in Psychology of Sport and Exercise
- Vol. 76, 102732
Open AccessA uniform approach for advancing athlete assessment: A tutorial on the Lens Model