TLTobias Lieberei

Tobias Lieberei

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Tobias Lieberei has a total of 9 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Considering Multiple Sources of Validity Evidence Can Help to Address Challenges in the Development of Pedagogical Content Knowledge (PCK) Multiple-Choice Items

    by Tobias Lieberei, Leroy Großmann, Virginia Deborah Elaine Welter, Dirk Krüger, Moritz Krell

    The use of multiple-choice (MC) instruments to assess pedagogical content knowledge (PCK) has advantages in terms of test economy and objectivity, but it also poses challenges, for example, in terms of adequately capturing the intended construct. To help address these challenges, we developed and evaluated a new instrument to assess science teachers’ PCK of scientific reasoning in biology contexts (PCKSR-bio), considering multiple sources of validity evidence. First, 12 MC items were developed to assess crucial PCK components for three scientific reasoning skills. Subsequently, the correlation of corresponding content knowledge (CK) with the PCKSR-bio score was tested with 67 master’s students. In addition, the instrument was used in a cross-sectional study with 165 students (n = 29 bachelor, n = 115 master, n = 21 school-based preservice teachers), and the internal consistency as well as the correlation of the test score with the educational level was determined. An analysis of the response processes of 10 bachelor’s students showed that they more often referred to PCK when selecting an attractor and more often (rather intuitively) to other knowledge when selecting a distractor. In the cross-sectional study, the internal consistency was relatively low but increased with higher educational level. A correlation was found between the test score and CK but not between the test score and the educational level. Our results show that considering multiple sources of validity evidence can help to address common challenges in developing MC–PCK instruments. The results and limitations are discussed, and recommendations are made for the development of MC instruments to assess PCK in general.


  • Erkenntnisgewinnungskompetenzen im naturwissenschaftlichen Unterricht fördern

    by Richard Sannert, Verena Petermann, Tobias Lieberei, Virginia Deborah Elaine Welter, Moritz Krell


  • Open Access

    Findings from the expert-novice paradigm on differential response behavior among multiple-choice items of a pedagogical content knowledge test – implications for test development

    by Tobias Lieberei, Virginia Deborah Elaine Welter, Leroy Großmann, Moritz Krell

    Pedagogical content knowledge (PCK) is one core dimension of teachers’ professional knowledge and comprises knowledge about conceptual ideas of learners and appropriate instructions. However, several challenges regarding the assessment of PCK are discussed in the literature: For example, PCK is a topic-specific construct and contains differentiable subdomains, which must be considered during test development. In addition, the choice of test type needs to be considered. While open-ended instruments can capture a broader range of cognitions, they often require a high level of interpretation; in contrast, multiple-choice instruments have advantages in terms of objectivity and test economy. Some challenges of assessing PCK are particularly related to multiple-choice instruments, such as an insufficient focus on specific components or the accidental assessment of teachers’ beliefs instead of PCK. To better understand and explain these challenges in developing multiple-choice PCK instruments, we exemparly used an instrument to assess PCK about scientific reasoning and considered the assumptions of the expert-novice paradigm to analyze differential response behavior betweenn = 10 researchers in the field of biology education (experts) andn = 10 undergraduate pre-service biology teachers (novices). As expected, experts scored significantly higher than novices. At the same time, experts answered the items more consistently than novices, i.e., showed less variance. However, the difference found was statistically insignificant. Regarding the explanations for choosing a response option, experts more often correctly identified the quintessence of the items, which means that they more often understand the items as intended and argued based on their PCK. On the other hand, novices focused more on surface characteristics, i.e., they argued rather with surface knowledge like intuition or personal experience, than choosing the response option based on their PCK. These crucial differences in how experts and novices understand the items of the used PCK instrument and how they respond based on their understanding affect different test characteristics. In conclusion, we recommend ensuring that instruments address only a few, specific PCK aspects, considering the target group of a test, and take into account that target groups with larger variability among their responses require a higher number of items to achieve satisfactory discrimination and reliability indices.