Dominik Weber
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Dominik Weber has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Frank M. Spinath
Department of Individual Differences & Psychodiagnostics, Saarland University, 66123 Saarbrücken, Germany
3 shared publications - Florian Krieger
Department of Methods of Educational Research, TU Dortmund University, Emil-Figge-Straße 50, D-44227 Dortmund, Germany
2 shared publications - Marco Koch
Department of Individual Differences & Psychodiagnostics, Saarland University, 66123 Saarbrücken, Germany
2 shared publications - Nicolas Becker
Department of Individual Differences & Psychodiagnostics, Saarland University, 66123 Saarbrücken, Germany
2 shared publications - Anke Maria Weber
Department of Behavioural and Cognitive Sciences, University of Luxembourg, Esch-sur-Alzette, Luxembourg
1 shared publication Frank M. Spinath
Department of Individual Differences & Psychodiagnostics, Saarland University, Germany
1 shared publication
Latest Publications
- Open Access
- 1 July 2026
- Published by MDPI AG in Journal of Intelligence
- Vol. 14 (7) , 122
Beyond Simple Averaging: Combining Scores, Reliabilities, and Validities of Multiple Intelligence Tests
In applied diagnostics, scores from multiple intelligence tests are often combined by simple arithmetic averaging. Although convenient, this practice is statistically imprecise: it neglects (a) that tests are positively correlated but not identical, each capturing somewhat different aspects of intelligence, and (b) that combining correlated measures reduces variance. Consequently, arithmetic means underestimate intelligence above the IQ scale center and overestimate it below the center. Such distortions can lead to serious misjudgments in high-stakes assessment, such as in educational placement or forensic evaluations of legal culpability. To obtain exploratory evidence on the prevalence of simple averaging practice, we surveyed n = 75 psychologically educated individuals familiar with IQ metrics. In response to a case vignette requiring the combination of several IQ scores, 58 participants (77.33%) applied simple averaging, and none considered intercorrelations and variance reduction. Therefore, the aim of this article was to propose the application of a more valid method for combining scores (as well as corresponding reliabilities and validities) of multiple tests. To validate the method, we performed Monte Carlo simulations, covering a wide range of test characteristics. Results showed virtually perfect accuracy (r = 1.00, p < .001), and the outcomes were robust against variations in the number of tests to be combined, score distributions, and intercorrelations. To facilitate adoption in practical diagnostics, we developed and introduced an open-source R package and an accompanying open-access Shiny web application.
- 1 July 2026
- Published by MDPI AG in Journal of Intelligence
- Vol. 14 (7) , 122
Open AccessBeyond Simple Averaging: Combining Scores, Reliabilities, and Validities of Multiple Intelligence Tests
In applied diagnostics, scores from multiple intelligence tests are often combined by simple arithmetic averaging. Although convenient, this practice is statistically imprecise: it neglects (a) that tests are positively correlated but not identical, each capturing somewhat different aspects of intelligence, and (b) that combining correlated measures reduces variance. Consequently, arithmetic means underestimate intelligence above the IQ scale center and overestimate it below the center. Such distortions can lead to serious misjudgments in high-stakes assessment, such as in educational placement or forensic evaluations of legal culpability. To obtain exploratory evidence on the prevalence of simple averaging practice, we surveyed n = 75 psychologically educated individuals familiar with IQ metrics. In response to a case vignette requiring the combination of several IQ scores, 58 participants (77.33%) applied simple averaging, and none considered intercorrelations and variance reduction. Therefore, the aim of this article was to propose the application of a more valid method for combining scores (as well as corresponding reliabilities and validities) of multiple tests. To validate the method, we performed Monte Carlo simulations, covering a wide range of test characteristics. Results showed virtually perfect accuracy (r = 1.00, p < .001), and the outcomes were robust against variations in the number of tests to be combined, score distributions, and intercorrelations. To facilitate adoption in practical diagnostics, we developed and introduced an open-source R package and an accompanying open-access Shiny web application.
- Open Access
- 12 January 2026
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 16, 1652341
The stability of IRT parameters under several test equating conditions
Introduction: It is crucial for researchers and test developers to compare results from different test sets (e. g., re-testing, parallel test forms). To ensure comparability, test sets are often linked using anchor items as a common denominator alongside distinct items. To date, most studies on test equating have been limited in scope, typically comparing only absolute numbers of anchor items or focusing on a single IRT model or equating method. Furthermore, previous research has primarily evaluated the absolute deviation of estimated parameters from true parameters. However, in diagnostic contexts, the correlation between these values is often more relevant for ensuring validity and test fairness. Therefore, the aim of this simulation study was to examine the impact of a broad range of key factors on test equating. Methods: We evaluated correlations and recovery indices between predefined true values and values estimated through test equating for three IRT parameters (discrimination, difficulty, and ability). To this end, we varied the equating method (MS, MM, MGM, IRF, TRF), the IRT model (2PL vs. 3PL), guessing probability (0.000–0.250), anchor item proportion (5–25%), test set size (20–80 items), and the discrimination parameters of the anchor items. In addition, we used samples of 25–100 individuals to assess equating quality under challenging conditions as well as samples of 500 and 1,000 individuals to reflect adequate modeling conditions. Results: Low guessing probabilities and high anchor item discrimination parameters strongly improved test equating quality for all three IRT parameters. Recovery of discrimination and ability parameters increased logarithmically with larger test set sizes and higher anchor item proportions, with each of these two factors partially compensating for reductions in the other. While sample sizes below 100 individuals produced inadequate parameter recovery, samples of 100 or 500 individuals were justifiable under certain conditions. However, samples of only 100 individuals carried a slight risk of non-convergence. The choice of the equating method had rather minor effects and the impact of the IRT model was ambivalent. Discussion: These findings highlight the importance of using distractor-free response formats without any guessing probability, anchor items with high discrimination parameters, and large samples to ensure valid test equating. For individual research and test application purposes, we provide a comprehensive data set covering multiple factor levels and a step-by-step simulation guide.
- 12 January 2026
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 16, 1652341
Open AccessThe stability of IRT parameters under several test equating conditions
Introduction: It is crucial for researchers and test developers to compare results from different test sets (e. g., re-testing, parallel test forms). To ensure comparability, test sets are often linked using anchor items as a common denominator alongside distinct items. To date, most studies on test equating have been limited in scope, typically comparing only absolute numbers of anchor items or focusing on a single IRT model or equating method. Furthermore, previous research has primarily evaluated the absolute deviation of estimated parameters from true parameters. However, in diagnostic contexts, the correlation between these values is often more relevant for ensuring validity and test fairness. Therefore, the aim of this simulation study was to examine the impact of a broad range of key factors on test equating. Methods: We evaluated correlations and recovery indices between predefined true values and values estimated through test equating for three IRT parameters (discrimination, difficulty, and ability). To this end, we varied the equating method (MS, MM, MGM, IRF, TRF), the IRT model (2PL vs. 3PL), guessing probability (0.000–0.250), anchor item proportion (5–25%), test set size (20–80 items), and the discrimination parameters of the anchor items. In addition, we used samples of 25–100 individuals to assess equating quality under challenging conditions as well as samples of 500 and 1,000 individuals to reflect adequate modeling conditions. Results: Low guessing probabilities and high anchor item discrimination parameters strongly improved test equating quality for all three IRT parameters. Recovery of discrimination and ability parameters increased logarithmically with larger test set sizes and higher anchor item proportions, with each of these two factors partially compensating for reductions in the other. While sample sizes below 100 individuals produced inadequate parameter recovery, samples of 100 or 500 individuals were justifiable under certain conditions. However, samples of only 100 individuals carried a slight risk of non-convergence. The choice of the equating method had rather minor effects and the impact of the IRT model was ambivalent. Discussion: These findings highlight the importance of using distractor-free response formats without any guessing probability, anchor items with high discrimination parameters, and large samples to ensure valid test equating. For individual research and test application purposes, we provide a comprehensive data set covering multiple factor levels and a step-by-step simulation guide.
- Open Access
- 28 May 2025
- Published by MDPI AG in Journal of Intelligence
- Vol. 13 (6) , 63
Log File Times as Indicators of Structured Figural Matrix Processing
Previous research has shown individual differences in (a) time on task (ToT) and (b) the degree of structuredness in processing figural matrices. The goal of this article was to integrate these two lines of research by analyzing log files from a computer-based assessment (N = 198) to examine the role of three ToT sub-components: onset times (before engaging with the first matrix rule), interrule times (between the rules), and intrarule times (within a single rule). We tested three clues that support the assumptions that the interrule times reflect the cognitive construction of a rule-specific solution plan, while the onset times represent a global orientation reaction, and the intrarule times capture the behavioral execution of the plan: (1) based on the interrule times, we identified two clusters of participants, of which one processed the matrices in a more structured fashion; (2) only the accelerating effect of the interrule times across the test was associated with test performance, indicating higher reasoning saturation; (3) a mediated path analysis revealed that faster interrule times propagate in faster intrarule times and more structured processing of matrix rules, resulting in better performance. Confirming internal validity, the three log file times accounted for an incremental 24.30% of test performance variance beyond the traditional ToT. Confirming external validity, two clusters were also identified based on the interrule times from the first test and performance scores from a second matrix test.
- 28 May 2025
- Published by MDPI AG in Journal of Intelligence
- Vol. 13 (6) , 63
Open AccessLog File Times as Indicators of Structured Figural Matrix Processing
Previous research has shown individual differences in (a) time on task (ToT) and (b) the degree of structuredness in processing figural matrices. The goal of this article was to integrate these two lines of research by analyzing log files from a computer-based assessment (N = 198) to examine the role of three ToT sub-components: onset times (before engaging with the first matrix rule), interrule times (between the rules), and intrarule times (within a single rule). We tested three clues that support the assumptions that the interrule times reflect the cognitive construction of a rule-specific solution plan, while the onset times represent a global orientation reaction, and the intrarule times capture the behavioral execution of the plan: (1) based on the interrule times, we identified two clusters of participants, of which one processed the matrices in a more structured fashion; (2) only the accelerating effect of the interrule times across the test was associated with test performance, indicating higher reasoning saturation; (3) a mediated path analysis revealed that faster interrule times propagate in faster intrarule times and more structured processing of matrix rules, resulting in better performance. Confirming internal validity, the three log file times accounted for an incremental 24.30% of test performance variance beyond the traditional ToT. Confirming external validity, two clusters were also identified based on the interrule times from the first test and performance scores from a second matrix test.
- Open Access
- 11 July 2023
- Published by Taylor & Francis in Early Education and Development
- Vol. 35 (7) , 1501-1523
First Insights into Preschool Teachers’ Instructional Quality in Block Play and Its Associations with Children’s Knowledge, Interest, Academic Self-Concept and Cognitive Aspects
- 11 July 2023
- Published by Taylor & Francis in Early Education and Development
- Vol. 35 (7) , 1501-1523
Open AccessFirst Insights into Preschool Teachers’ Instructional Quality in Block Play and Its Associations with Children’s Knowledge, Interest, Academic Self-Concept and Cognitive Aspects
- Open Access
- 16 February 2023
- Published by MDPI AG in Journal of Intelligence
- Vol. 11 (2) , 37
A Log File Analysis on the Validity of Partial Solutions in Figural Matrices Tests
As a component of many intelligence test batteries, figural matrices tests are an effective way to assess reasoning, which is considered a core ability of intelligence. Traditionally, the sum of correct items is used as a performance indicator (total solution procedure). However, recent advances in the development of computer-based figural matrices tests allow additional indicators to be considered for scoring. In two studies, we focused on the added value of a partial solution procedure employing log file analyses from a computer-based figural matrices test. In the first study (n = 198), we explored the internal validity of this procedure by applying both an exploratory bottom-up approach (using sequence analyses) and a complementary top-down approach (using rule jumps, an indicator taken from relevant studies). Both approaches confirmed that higher scores in the partial solution procedure were associated with higher structuredness in participants’ response behavior. In the second study (n = 169), we examined the external validity by correlating the partial solution procedure in addition to the total solution procedure with a Grade Point Average (GPA) criterion. The partial solution procedure showed an advantage over the total solution procedure in predicting GPA, especially at lower ability levels. The implications of the results and their applicability to other tests are discussed.
- 16 February 2023
- Published by MDPI AG in Journal of Intelligence
- Vol. 11 (2) , 37
Open AccessA Log File Analysis on the Validity of Partial Solutions in Figural Matrices Tests
As a component of many intelligence test batteries, figural matrices tests are an effective way to assess reasoning, which is considered a core ability of intelligence. Traditionally, the sum of correct items is used as a performance indicator (total solution procedure). However, recent advances in the development of computer-based figural matrices tests allow additional indicators to be considered for scoring. In two studies, we focused on the added value of a partial solution procedure employing log file analyses from a computer-based figural matrices test. In the first study (n = 198), we explored the internal validity of this procedure by applying both an exploratory bottom-up approach (using sequence analyses) and a complementary top-down approach (using rule jumps, an indicator taken from relevant studies). Both approaches confirmed that higher scores in the partial solution procedure were associated with higher structuredness in participants’ response behavior. In the second study (n = 169), we examined the external validity by correlating the partial solution procedure in addition to the total solution procedure with a Grade Point Average (GPA) criterion. The partial solution procedure showed an advantage over the total solution procedure in predicting GPA, especially at lower ability levels. The implications of the results and their applicability to other tests are discussed.