Jana Jungjohann

Internationally, teachers use oral reading fluency (ORF) measurements to monitor learning progress in reading and adapt instruction to the individual needs of students. In ORF measures, the child reads aloud single syllables, words, or short passages, and the teacher rates in parallel at which items the child makes a mistake. Since administering paper-based ORF requires increased effort on the part of teachers, computer-based test administration is available. However, there are still concerns about the comparability of paper-based and computer-based test modes. In our study, we examine mode effects between paper-based and computer-based test scores for both reading speed and reading accuracy using a German-language ORF assessment for progress monitoring. 2nd- and 3rd-year-students (N = 359) with and without special education needs participated in the study. Results show comparable and high reliability (r > 0.76) and no differential item functioning for both test modes. Furthermore, students showed significantly higher reading speed on the paper-based test, while no differences were found in reading accuracy. In the absence of differential item functioning, we discuss how mean differences can be accounted for, how teachers can be trained to use the different test modes, and how computer-based tests can be safeguarded in practice.

Inclusive education aims to provide learning progress for all. It requires assessments to identify learning levels and progress and to adapt and evaluate instruction. We extend the classroom-based assessment (CBA) approach and argue that CBA in inclusive schools consists of the four dimensions of Instructional Decision-Making, Educational Assessment, Identification of Students with Special Educational Needs, and Progress Monitoring. For this paper, we developed both a framework of CBA for research interests and individual scales for each dimension (6 to 9 items per scale) in order to identify the four dimensions in which teachers need further training. To create a more manageable instrument for education and training practice, we tested a combined model as a questionnaire. In a survey of 110 teachers and 152 pre-service special education teachers (N = 252), the individual scales had good internal consistency (α = .92, .82, .92, .93). Using Confirmatory Factor Analysis, an initial combined model, consisting of the revised individual scales, showed acceptable fit values (CFI = 0.94, TLI = 0.89, RMSEA = 0.07, SRMR = 0.06) almost everywhere. The further development of the questionnaire and its significance and relevance for inclusive educational practice will be discussed.

In the educational context, graph literacy describes the competence to read, comprehend and interpret formative assessment data in terms of data-based decision-making (DBDM) in order to derive and justify individual adaptations of instruction based on them. Since misconceptions may arise in predicting a future learning progress due to the characteristics of the database as well as the approach to graph literacy, effective supports are needed, especially for inexperienced teachers. We present two interrelated studies to broaden the field of support in graph literacy. In Study I, graph literacy procedures are collected from N = 196 university student teachers using an online survey that includes six case vignettes with learning progress prediction tasks. Results show that both regular and special education student teachers intuitively neglect important data points in interpretation and they do not use a consistent strategy in prediction across the case vignettes (Fleiss’ κ = .071; p < .001). Building on the results of Study I, a three-minute video intervention for linear trend identification using Tukey Tri-Split was developed. Study II tested the efficacy of the video intervention on the accuracy of future learning progress among pre-service and in-service teachers (N = 198) using randomized group assignment compared to a brief text hint. With a large effect size of Cohens' f = .39, the video instruction shows high efficacy compared to the text hint. The increasing importance of DBDM in inclusive and special education is discussed.

In this study, poor readers in second school year were selected from three schools (n = 32). Their reading skills were surveyed weekly using a CBM instrument over one school semester. Furthermore, they were supported by a five-week reading fluency instruction. The majority of students increased their weekly learning growth in regular teaching and in the phase with the additive instruction. The weekly learning growth was higher in the phase with the additive instruction in reading syllables (b = 0.69), reading words (b = 0.44) and reading comprehension at sentence level (b = 0.45) than without (reading syllables: b = 0.49; reading words: b = 0.18; reading comprehension: b = 0.30). Based on the results of this study, the benefit of CBM for adaptive reading instruction will be discussed.

Direct Behavior Rating (DBR) as a behavioral progress monitoring tool can be designed as longitudinal assessment with only short intervals between measurement points. The reliability of these instruments has been mostly evaluated in observational studies with small samples based on generalizability theory. However, for a standardized use in the pedagogical field, a larger and broader sample is required in order to assess measurement invariance between different participant groups and over time. Therefore, we constructed a DBR, the Questionnaire for Monitoring Behavior in Schools (QMBS) with multiple items to measure the occurrence of specific externalizing and internalizing student classroom behaviors on a Likert scale (1 = never to 7 = always). In a pilot study, two trained raters observed 16 primary education students and rated the student behavior over all items with a satisfactory reliability. In the main study, 108 regular primary school students, 97 regular secondary students, and 14 students in a clinical setting were rated daily over one week (five measurement points). Item response theory (IRT) analyses confirmed the technical adequacy of the instrument and latent growth models demonstrated the instrument’s stability over time. Further development of the instrument and study designs to implement DBRs is discussed.

Reading comprehension at sentence level is a core component in the students' comprehension development, but there is a lack of comprehension assessments at the sentence level, which respect the theory of reading comprehension. In this article, a new web-based sentence-comprehension assessment for German primary school students is developed and evaluated using a curriculum-based measurement (CBM) framework. The test focuses on sentence level reading comprehension as an intermediary between word and text comprehension. The construction builds upon the theory of reading comprehension using CBM-Maze techniques. It is consistent on all tasks and contains different syntactic and semantic structures within the items. This paper presents the test development, a description of the item performance, an analysis of its factor structure, and tests of measurement invariance, and group comparisons (i.e., across gender, immigration background, over two measurement points, and the presence of special educational needs; SEN). Third grade students (n = 761) with and without SEN finished two CBM tests over 3 weeks. Results reveal that items had good technical adequacy, the constructed test is unidimensional, and it is valid for students both with and without SEN. Similarly, it is valid for both sexes, and results are valid across both measurement points. We discuss our method for creating a unidimensional test based on multiple item difficulties and make recommendations for future test construction.

The inclusion of pupils with special educational needs ( SEN ) in schools is an ongoing challenge – it demands the development of an adapted teaching and learning environment, which, in turn, requires a corresponding teacher education programme. Studies indicate that personal characteristics of the respective teachers are one of the main influencing factors on the classroom environment. This article reports on a study of the role of teacher‐related factors, attitudes, concerns and efficacy in inclusion by testing existing survey instruments of 909 pre‐service teachers in Germany. A confirmatory factor analysis was applied to new German translations of four instruments: Attitudes Towards Inclusion Scale , Intention to Teach in Inclusive Classroom Scale , Concerns about Inclusive Education Scale , and the Teacher Efficacy for Inclusive Practices . With minor modifications, models demonstrated good fit measures and partial measurement invariance between special school pre‐service teachers and general pre‐service teachers. A combined model of all four scales confirmed that lower concerns were related to attitudes that are more positive, greater self‐efficacy and stronger intentions to teaching inclusively. Implications for teacher‐training and comparisons to other international samples are discussed.

Our paper introduces and assesses the Levumi platform’s web-based assessment of reading fluency. One challenges of inclusive education is meeting the needs of the learners with special education needs (SEN). Children with SEN and other risk factors face an increased risk of failing in schools and manifesting academic and social problems over the time. Web-based curriculum-based measurement (CBM) can provide an effective tool to track progress of learners and limit such risks. In particular, it can ease the challenges of test administration in inclusive classrooms through automation and providing multiple difficulty levels without the need of different paper-forms. Furthermore, Levumi can help educators track children and thus provide support for learners. Levumi takes advantage of the strengths of web-based CBM to assess reading fluency in primary school students. We confirmed the reading fluency test’s test-retest reliability (n = 334), its ability to measure learning over time in individual learners with SEN (n = 8, across 14 MPs), and its applicability to learners with SEN (n = 300, including n = 46 with SEN). We evaluate Levumi’s overall usefulness in assessing different types of learners, and discuss its contributions to CBM research.