Development and validation of a two-tier test instrument on simple electric circuits
Open Access
- 21 January 2026
- journal article
- Published by American Physical Society (APS) in Physical Review Physics Education Research
- Vol. 22 (1)
Abstract
In this article, we report the development and validation of a new two-tier concept inventory, the Basic Electricity Assessment of Students’ Thinking (BEAST), designed to assess common conceptual difficulties (“student ideas,” such as current consumption and sequential reasoning) and the understanding of fundamental electric circuit concepts (e.g., current, voltage, and resistance) among undergraduate students. The final version of the BEAST covers six student ideas, each linked to a distinct physical concept. Each student idea is assessed using three two-tier single-choice items. To refine the items and evaluate their content validity, including the correctness of answers and the intended categorization of student ideas based on response patterns, feedback and ratings from five experts were incorporated. The test was administered to a sample of N = 176 students enrolled in introductory physics courses across six different German universities. Quantitative evaluation using classical test theory and structural analyses demonstrated strong evidence supporting the test’s content and construct validity. Confirmatory factor analysis utilizing parsimonious bifactor models showed a good fit of the model to the data.Keywords
Funding Information
- Eberhard Karls Universität Tübingen
- Eberhard Karls Universität Tübingen
This publication has 33 references indexed in Scilit:
- Modellbasierte Methoden der Reliabilitätsschätzung2020
- Deskriptivstatistische Itemanalyse und Testwertbestimmung2020
- Schülervorstellungen zum elektrischen Stromkreis2018
- An Analytic Framework for Evaluating the Validity of Concept Inventory ClaimsJournal of Engineering Education, 2015
- Development and application of a two-tier diagnostic instrument to assess middle-years students’ proportional reasoningMathematics Education Research Journal, 2013
- Conceptual Change from the Framework Theory Side of the FenceScience & Education, 2013
- The development of a two-tier multiple-choice diagnostic instrument for evaluating secondary school students’ ability to describe and explain chemical reactions using multiple levels of representationChemistry Education Research and Practice, 2007
- Alltagsvorstellungen und Physik lernen2006
- Teaching Electric Circuit Concepts Using Microcomputer-Based Current/Voltage Probes1996
- Conceptions of french pupils concerning electric circuits: Structure and evolutionJournal of Research in Science Teaching, 1987