Open Access
- 8 October 2024
- journal article
- research article
- Published by Hogrefe Publishing Group in European Journal of Psychological Assessment
- Vol. 42 (3) , 298-307
Abstract
Building on the long common history of board games and intelligence research, we developed a new deductive reasoning test based on the popular game Mastermind. The research questions of this registered report were: (a) Is a psychometrically sound measurement of the ability to solve Mastermind items possible (i.e., a reliable, uni-dimensional measurement with a good coverage of difficulty)? (b) Is the ability to solve Mastermind items substantially related to other measures of cognitive ability (i.e., matrix test, knowledge test) and need for cognition? (c) Can item difficulty be predicted by the number of colors, positions, premises, and a newly proposed entropy-based index? Based on the results of a pilot study, we developed 30 items and administered them to 351 participants in the preregistered main study using a multiple matrix sampling design. The deductive Mastermind test proved to be (a) a reliable and efficient measure of reasoning across a wide ability range, and (b) showed expectation-consistent patterns for the convergent and divergent measures. (c) The entropy-based index allowed for the prediction of item difficulty to a considerable degree ( R2 = .47). We discuss the ideas of information theory, including entropy, as constructing principles for the rational test development of reasoning tests.Keywords
This publication has 35 references indexed in Scilit:
- A black-box model for predicting difficulty of word puzzle games: a case study of WordleKnowledge and Information Systems, 2023
- Latin square tasks: A multi-study evaluationIntelligence, 2022
- On the dimensionality of crystallized intelligence: A smartphone-based assessmentIntelligence, 2019
- Differentiating between static and complex problems: A theoretical framework and its empirical validationIntelligence, 2019
- The international cognitive ability resource: Development and initial validation of a public-domain measureIntelligence, 2014
- An Analytic Tableaux Model for Deductive Mastermind Empirically Tested with a Massively Used Online Learning SystemJournal of Logic, Language and Information, 2013
- Relational Reasoning and Its Manifestations in the Educational Context: a Systematic Review of the LiteratureEducational Psychology Review, 2013
- Efficient solutions for Mastermind using genetic algorithmsComputers & Operations Research, 2009
- Strategy optimization for deductive gamesEuropean Journal of Operational Research, 2007
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948