Julian M. Siebert
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Julian M. Siebert has a total of 64 co-authors. Here are the top co-authors by number of shared publications:
- Mónica Zegers
Universidad de los Andes, Santiago, Chile
10 shared publications Lillian Durán
University of Oregon, Eugene, OR, USA
6 shared publications- Carrie Townley-Flores
Institute of Education Sciences Fellow, Center for Education Policy Analysis, Stanford University, Stanford, CA
5 shared publications Gorno Tempini Maria Luisa
5 shared publicationsMaria Luisa Gorno-Tempini
University of California-San Francisco, San Francisco, CA, USA
5 shared publicationsFrancesca Pei
University of California-San Francisco, San Francisco, CA, USA
4 shared publications
Latest Publications
- Open Access
- 13 October 2026
- Published by SAGE Publications in Assessment for Effective Intervention
- Vol. 52 (1) , 32-41
The Development of a Spanish-English Bilingual Narrative Story Production Measure: A Proof-of-Concept Study
Language samples derived from narrative tasks, traditionally used in clinical settings, also provide valuable insight into the natural language abilities of both monolingual and multilingual children. This study describes the early development and initial testing of a narrative production measure designed for use in school settings serving linguistically diverse kindergarten and first-grade students. The measure was developed with attention to scalability, prioritizing a macrostructure-focused scoring protocol that could be administered and scored efficiently in educational contexts. Four wordless animated videos were created to elicit narratives, each depicting familiar situations with a clear story structure, with a problem and a solution. During piloting, the measure was administered to 1,246 Spanish-English bilingual students in the U.S. state of California. Narratives were scored live using an initial eight-component dichotomous scheme targeting macrostructural elements. Evaluation of central tendencies confirmed that the measure was sensitive to variability in both English and Spanish. Psychometric evaluation refined the scoring system from eight to five reliable components, with sum scores demonstrating moderate to high within-language correlations. Cross-language correlations were weak ( r = .23), suggesting partially distinct linguistic constructs. Overall, findings support the development of a scalable narrative production measure appropriate for large-scale bilingual language screening in school settings.
- 13 October 2026
- Published by SAGE Publications in Assessment for Effective Intervention
- Vol. 52 (1) , 32-41
Open AccessThe Development of a Spanish-English Bilingual Narrative Story Production Measure: A Proof-of-Concept Study
Language samples derived from narrative tasks, traditionally used in clinical settings, also provide valuable insight into the natural language abilities of both monolingual and multilingual children. This study describes the early development and initial testing of a narrative production measure designed for use in school settings serving linguistically diverse kindergarten and first-grade students. The measure was developed with attention to scalability, prioritizing a macrostructure-focused scoring protocol that could be administered and scored efficiently in educational contexts. Four wordless animated videos were created to elicit narratives, each depicting familiar situations with a clear story structure, with a problem and a solution. During piloting, the measure was administered to 1,246 Spanish-English bilingual students in the U.S. state of California. Narratives were scored live using an initial eight-component dichotomous scheme targeting macrostructural elements. Evaluation of central tendencies confirmed that the measure was sensitive to variability in both English and Spanish. Psychometric evaluation refined the scoring system from eight to five reliable components, with sum scores demonstrating moderate to high within-language correlations. Cross-language correlations were weak ( r = .23), suggesting partially distinct linguistic constructs. Overall, findings support the development of a scalable narrative production measure appropriate for large-scale bilingual language screening in school settings.
- Open Access
- 29 September 2026
- Published by Cambridge University Press (CUP) in Applied Psycholinguistics
- Vol. 47, e54
Features predicting item difficulty in English and Spanish elision task
Phonological awareness (PA) is a foundational skill in early literacy acquisition across languages, including English and Spanish. While previous research has explored how factors such as word structure, phoneme characteristics, syllable stress, and syllable complexity influence PA item difficulty, the relative impact of these features—and how they may operate similarly or differently across languages—remains insufficiently understood. This study investigated the linguistic and task-format features that contribute to item difficulty in an elision task and compares these effects in English and Spanish. Using adaptive LASSO regression and dominance analysis, the study identified three significant predictors of item difficulty in English and six in Spanish. In both languages, the medial position of the deleted segment and the use of expressive response formats are the strongest predictors of increased item difficulty. In Spanish, items that produce nonwords involve longer phonological structures or require syllable deletion are associated with higher difficulty, whereas initial segment deletion tends to be easier. For English, word-level elision is associated with lower difficulty. Together, these findings highlight important considerations for designing more linguistically sensitive PA assessments in both English and Spanish.
- 29 September 2026
- Published by Cambridge University Press (CUP) in Applied Psycholinguistics
- Vol. 47, e54
Open AccessFeatures predicting item difficulty in English and Spanish elision task
Phonological awareness (PA) is a foundational skill in early literacy acquisition across languages, including English and Spanish. While previous research has explored how factors such as word structure, phoneme characteristics, syllable stress, and syllable complexity influence PA item difficulty, the relative impact of these features—and how they may operate similarly or differently across languages—remains insufficiently understood. This study investigated the linguistic and task-format features that contribute to item difficulty in an elision task and compares these effects in English and Spanish. Using adaptive LASSO regression and dominance analysis, the study identified three significant predictors of item difficulty in English and six in Spanish. In both languages, the medial position of the deleted segment and the use of expressive response formats are the strongest predictors of increased item difficulty. In Spanish, items that produce nonwords involve longer phonological structures or require syllable deletion are associated with higher difficulty, whereas initial segment deletion tends to be easier. For English, word-level elision is associated with lower difficulty. Together, these findings highlight important considerations for designing more linguistically sensitive PA assessments in both English and Spanish.
- 3 September 2026
- Published by Wiley in Journal of Research in Reading
- Vol. 49 (4)
Reversing the Decline: Evidence From a Quasiexperimental Study on How Classroom Practices Support Adolescents' Reading Motivation and Amount
Background: Reading for pleasure has been declining worldwide, with significant drops in reading motivation and frequency among adolescents. In Chile, national assessments indicate that students' reading motivation and frequency decrease as they progress through school. This study examines the effects of a school‐based reading intervention aimed at increasing intrinsic reading motivation and reading amount among Chilean eighth‐grade students. Methods: A quasiexperimental design was implemented with 574 eighth‐grade students (45% female), aged 13–14 years, from schools with a predominantly medium‐low socioeconomic status. The intervention included three groups: full intervention, books only and control. The full intervention included initial teacher training in motivationally oriented practices: self‐selected independent reading of popular books, peer recommendations and discussions, absence of summative grading for reading activities, teacher‐kept reading records and monthly teacher support meetings. The books‐only condition provided book access without additional motivational components. Intrinsic reading motivation and reading amount were the outcomes. Print exposure, language arts grades and home literacy environment were included as covariates. Results: The full intervention produced significant gains in intrinsic reading motivation relative to control; gains in reading amount relative to control were positive but did not reach significance. The books‐only condition did not differ from control on either outcome. The full intervention produced significantly greater gains in reading amount than books only; the difference in motivation between intervention groups was not significant. Conclusions: Combining book access with motivationally oriented classroom practices can effectively increase students' intrinsic reading motivation and reading amount. Book access alone was insufficient to produce significant gains, highlighting the importance of comprehensive, motivation‐focused strategies to promote leisure reading among adolescents.
- 3 September 2026
- Published by Wiley in Journal of Research in Reading
- Vol. 49 (4)
Reversing the Decline: Evidence From a Quasiexperimental Study on How Classroom Practices Support Adolescents' Reading Motivation and Amount
Background: Reading for pleasure has been declining worldwide, with significant drops in reading motivation and frequency among adolescents. In Chile, national assessments indicate that students' reading motivation and frequency decrease as they progress through school. This study examines the effects of a school‐based reading intervention aimed at increasing intrinsic reading motivation and reading amount among Chilean eighth‐grade students. Methods: A quasiexperimental design was implemented with 574 eighth‐grade students (45% female), aged 13–14 years, from schools with a predominantly medium‐low socioeconomic status. The intervention included three groups: full intervention, books only and control. The full intervention included initial teacher training in motivationally oriented practices: self‐selected independent reading of popular books, peer recommendations and discussions, absence of summative grading for reading activities, teacher‐kept reading records and monthly teacher support meetings. The books‐only condition provided book access without additional motivational components. Intrinsic reading motivation and reading amount were the outcomes. Print exposure, language arts grades and home literacy environment were included as covariates. Results: The full intervention produced significant gains in intrinsic reading motivation relative to control; gains in reading amount relative to control were positive but did not reach significance. The books‐only condition did not differ from control on either outcome. The full intervention produced significantly greater gains in reading amount than books only; the difference in motivation between intervention groups was not significant. Conclusions: Combining book access with motivationally oriented classroom practices can effectively increase students' intrinsic reading motivation and reading amount. Book access alone was insufficient to produce significant gains, highlighting the importance of comprehensive, motivation‐focused strategies to promote leisure reading among adolescents.
- Open Access
- 17 July 2026
- Published by Center for Open Science in PsyArXiv
Predicting Bilinguals' End-of-year Reading Using A Best-Language Approach: Efficacy Depends on Grade and Outcome Language
Spanish-English bilinguals are the largest bilingual group in U.S. schools, yet the frameworks used to predict their reading from early screening data were developed on largely monolingual samples, leaving open the question of which language(s) to assess. This study compared three approaches to predicting end-of-year (EOY) reading from beginning-of-year (BOY) early-literacy and language skills in 553 Spanish-English bilingual kindergarten and first-grade students: English-only, Spanish-only, and a derived best-language score (the higher of a child's two single-language scores per task). Linear mixed-effects models, controlling for school clustering, compared these approaches separately by grade, outcome language (English/Spanish), and instructional context (bilingual vs. English-only). Best-language scoring did not uniformly improve prediction; benefits diminished with grade. In kindergarten, it matched or modestly exceeded the best single-language approach (marginal R² = .35 for English outcomes, .35 for Spanish outcomes) and explained the most variance for Spanish outcomes. By first grade, once target-language word reading emerged as a dominant proximal predictor, best-language scores offered no advantage over English-only assessment for English outcomes (R² = .57 vs. .43). English-only assessment predicted Spanish reading poorly, especially in kindergarten, while Spanish and best-language approaches predicted both outcome languages reasonably well throughout. Findings align with a distributed-knowledge account: decoding-related skills transfer across languages and benefit from best-language scoring, while language-comprehension skills are language-specific and gain little from it. Practically, assessment language should be matched to the skill, grade, and outcome of interest rather than defaulting to one language for all children.
- 17 July 2026
- Published by Center for Open Science in PsyArXiv
Open AccessPredicting Bilinguals' End-of-year Reading Using A Best-Language Approach: Efficacy Depends on Grade and Outcome Language
Spanish-English bilinguals are the largest bilingual group in U.S. schools, yet the frameworks used to predict their reading from early screening data were developed on largely monolingual samples, leaving open the question of which language(s) to assess. This study compared three approaches to predicting end-of-year (EOY) reading from beginning-of-year (BOY) early-literacy and language skills in 553 Spanish-English bilingual kindergarten and first-grade students: English-only, Spanish-only, and a derived best-language score (the higher of a child's two single-language scores per task). Linear mixed-effects models, controlling for school clustering, compared these approaches separately by grade, outcome language (English/Spanish), and instructional context (bilingual vs. English-only). Best-language scoring did not uniformly improve prediction; benefits diminished with grade. In kindergarten, it matched or modestly exceeded the best single-language approach (marginal R² = .35 for English outcomes, .35 for Spanish outcomes) and explained the most variance for Spanish outcomes. By first grade, once target-language word reading emerged as a dominant proximal predictor, best-language scores offered no advantage over English-only assessment for English outcomes (R² = .57 vs. .43). English-only assessment predicted Spanish reading poorly, especially in kindergarten, while Spanish and best-language approaches predicted both outcome languages reasonably well throughout. Findings align with a distributed-knowledge account: decoding-related skills transfer across languages and benefit from best-language scoring, while language-comprehension skills are language-specific and gain little from it. Practically, assessment language should be matched to the skill, grade, and outcome of interest rather than defaulting to one language for all children.
- Open Access
Data-driven Cognitive Clusters in Persistent Developmental Dyslexia
Developmental dyslexia is a neurodevelopmental condition characterized by persistent reading difficulties despite adequate intelligence and educational opportunities. The cognitive underpinnings of dyslexia remain incompletely understood. Although multiple causal pathways have been proposed, there is a gap in studies that can reliably identify dyslexia subtypes based on comprehensive evaluations that go beyond measures of reading and phonology. We employed one of the largest detailed samples of children with developmental dyslexia resistant to intervention, consisting of 147 extensively phenotyped school-age children aged 7-14 years who were recruited from specialized schools for students with learning differences. We implemented data-driven analyses leveraging a comprehensive neuropsychological assessment to delineate cognitive subdomains and characterize the heterogeneity in the sample. Hierarchical clustering of 24 cognitive measures aided in constructing a framework to subsequently interpret emerging clusters. Four clusters emerged, predominantly associated with: Processing Speed & Executive Function, Visuospatial & Mathematical Reasoning, Phonological Manipulation, and Verbal Short-term Memory & Word Retrieval. Subsequent latent profile analysis identified two distinct dyslexia profiles: one characterized by marked difficulties in executive functioning and processing speed, and another displaying impairments primarily in verbal short-term memory and word retrieval relative to the other profile. Importantly, both profiles exhibited comparable severity of persistent reading difficulties despite their divergent cognitive profiles. These findings show that phenotypically similar reading impairments can arise from distinct underlying cognitive factors, emphasizing the role of comprehensive neuropsychological evaluation in developing tailored interventions for affected children.
Open AccessData-driven Cognitive Clusters in Persistent Developmental Dyslexia
Developmental dyslexia is a neurodevelopmental condition characterized by persistent reading difficulties despite adequate intelligence and educational opportunities. The cognitive underpinnings of dyslexia remain incompletely understood. Although multiple causal pathways have been proposed, there is a gap in studies that can reliably identify dyslexia subtypes based on comprehensive evaluations that go beyond measures of reading and phonology. We employed one of the largest detailed samples of children with developmental dyslexia resistant to intervention, consisting of 147 extensively phenotyped school-age children aged 7-14 years who were recruited from specialized schools for students with learning differences. We implemented data-driven analyses leveraging a comprehensive neuropsychological assessment to delineate cognitive subdomains and characterize the heterogeneity in the sample. Hierarchical clustering of 24 cognitive measures aided in constructing a framework to subsequently interpret emerging clusters. Four clusters emerged, predominantly associated with: Processing Speed & Executive Function, Visuospatial & Mathematical Reasoning, Phonological Manipulation, and Verbal Short-term Memory & Word Retrieval. Subsequent latent profile analysis identified two distinct dyslexia profiles: one characterized by marked difficulties in executive functioning and processing speed, and another displaying impairments primarily in verbal short-term memory and word retrieval relative to the other profile. Importantly, both profiles exhibited comparable severity of persistent reading difficulties despite their divergent cognitive profiles. These findings show that phenotypically similar reading impairments can arise from distinct underlying cognitive factors, emphasizing the role of comprehensive neuropsychological evaluation in developing tailored interventions for affected children.
- Open Access
- 6 November 2025
- Published by Wiley in Reading Research Quarterly
- Vol. 61 (1)
Differences in Reading Screening Accuracy by Percentile Cutoff and English Proficiency: Feature Selection and Group‐Wise Prediction Evaluation
This exploratory predictive study investigates our capacity to equitably predict the risk of developing reading difficulties based on a battery of tasks tapping into commonly used reading screening constructs. A key question pertains to the extent to which we can make predictions with equal accuracy for native English speakers (EO) and emerging multilinguals (English learners [ELs] with sufficient English proficiency to participate in English screening). This prediction exercise takes place in a linguistically diverse sample, over different prediction intervals (end of the same and subsequent academic year), and across a range of percentile cutoffs (1st–25th) defining reading difficulty. Specifically, using a sample of 1692 kindergarteners and first graders from 24 schools across 13 Californian public school districts, we (a) identified the most important reading screening tasks for a range of percentile cutoffs defining “risk” using random forest feature selection; (b) built a series of logistic regression classifiers; and (c) evaluated these models' performances for ELs and EO students separately. When risk is defined as performance below the tenth percentile or higher, the same tasks generally surface as the most important predictors of later word reading difficulty (letter naming and sounds for kindergarten; word and non‐word reading for first graders), though with different relative importance for EO versus EL students and for the different prediction intervals. Phonological skills (blending, deletion) also show to be more predictive for ELs. Though most models can be optimized to exceed sensitivity and specificity values of 0.80, classification accuracy is higher for EO students, especially for 2‐year predictions. Though models meeting conventionally used minimum accuracy requirements for both the EO and EL groups can be produced, more work is needed to achieve truly linguistically equitable (i.e., equally accurate) screening. We discuss the equity implications and feasibility of universal reading screening using English screening tasks in linguistically diverse populations.
- 6 November 2025
- Published by Wiley in Reading Research Quarterly
- Vol. 61 (1)
Open AccessDifferences in Reading Screening Accuracy by Percentile Cutoff and English Proficiency: Feature Selection and Group‐Wise Prediction Evaluation
This exploratory predictive study investigates our capacity to equitably predict the risk of developing reading difficulties based on a battery of tasks tapping into commonly used reading screening constructs. A key question pertains to the extent to which we can make predictions with equal accuracy for native English speakers (EO) and emerging multilinguals (English learners [ELs] with sufficient English proficiency to participate in English screening). This prediction exercise takes place in a linguistically diverse sample, over different prediction intervals (end of the same and subsequent academic year), and across a range of percentile cutoffs (1st–25th) defining reading difficulty. Specifically, using a sample of 1692 kindergarteners and first graders from 24 schools across 13 Californian public school districts, we (a) identified the most important reading screening tasks for a range of percentile cutoffs defining “risk” using random forest feature selection; (b) built a series of logistic regression classifiers; and (c) evaluated these models' performances for ELs and EO students separately. When risk is defined as performance below the tenth percentile or higher, the same tasks generally surface as the most important predictors of later word reading difficulty (letter naming and sounds for kindergarten; word and non‐word reading for first graders), though with different relative importance for EO versus EL students and for the different prediction intervals. Phonological skills (blending, deletion) also show to be more predictive for ELs. Though most models can be optimized to exceed sensitivity and specificity values of 0.80, classification accuracy is higher for EO students, especially for 2‐year predictions. Though models meeting conventionally used minimum accuracy requirements for both the EO and EL groups can be produced, more work is needed to achieve truly linguistically equitable (i.e., equally accurate) screening. We discuss the equity implications and feasibility of universal reading screening using English screening tasks in linguistically diverse populations.
- Open Access
- 29 October 2025
- Published by Center for Open Science in PsyArXiv
A Comprehensive Framework for the Development and Evaluation of Linguistically Fair Universal Reading Screening in Educational Settings
Early and accurate identification of students who struggle with learning to read is essential for providing timely and effective interventions. This requires universal screening tools that not only produce reliable and valid results across linguistically diverse student populations but also support scalability and allow teachers and clinicians to interpret the results meaningfully. In this study, we present a comprehensive framework for the development and evaluation of linguistically fair universal reading screening tools for use in educational settings. As part of this framework, we consider (i) classification accuracy, (ii) instructional relevance, (iii) clinical utility, and (iv) operational feasibility. We apply this framework and propose a series of reading screening algorithms that accurately predict end-of-year reading risk in English, with sensitivity exceeding 80% in kindergarten and grade 1, and 90% in grade 2. The Spanish algorithm achieves similar sensitivity levels, though kindergarten screening remains more challenging for bilingual students. Notably, the inclusion of oral language and expressive vocabulary measures enhances specificity when administered in students' first language, while these same measures may introduce systematic bias (in the form of reduced specificity) when administered in English to students classified as English learners. While very promising, these findings underscore the critical need for developing and validating reading screeners in languages beyond English, as well as creating comprehensive multilingual screening protocols that leverage students' full linguistic repertoires across all their languages.
- 29 October 2025
- Published by Center for Open Science in PsyArXiv
Open AccessA Comprehensive Framework for the Development and Evaluation of Linguistically Fair Universal Reading Screening in Educational Settings
Early and accurate identification of students who struggle with learning to read is essential for providing timely and effective interventions. This requires universal screening tools that not only produce reliable and valid results across linguistically diverse student populations but also support scalability and allow teachers and clinicians to interpret the results meaningfully. In this study, we present a comprehensive framework for the development and evaluation of linguistically fair universal reading screening tools for use in educational settings. As part of this framework, we consider (i) classification accuracy, (ii) instructional relevance, (iii) clinical utility, and (iv) operational feasibility. We apply this framework and propose a series of reading screening algorithms that accurately predict end-of-year reading risk in English, with sensitivity exceeding 80% in kindergarten and grade 1, and 90% in grade 2. The Spanish algorithm achieves similar sensitivity levels, though kindergarten screening remains more challenging for bilingual students. Notably, the inclusion of oral language and expressive vocabulary measures enhances specificity when administered in students' first language, while these same measures may introduce systematic bias (in the form of reduced specificity) when administered in English to students classified as English learners. While very promising, these findings underscore the critical need for developing and validating reading screeners in languages beyond English, as well as creating comprehensive multilingual screening protocols that leverage students' full linguistic repertoires across all their languages.
- Open Access
- 5 June 2025
- Published by Center for Open Science in PsyArXiv
Improving Validity and Efficiency of Digital Dyslexia Screening through Trial By Trial Feedback
Trial-by-trial feedback is a powerful tool across scientific disciplines, offering real-time information that shapes learning, attention, and behavioral adjustment. However, its role in large-scale educational and psychological assessments remains underexplored. This study examines whether providing trial-by-trial performance feedback during a digital dyslexia screening task enhances engagement while preserving the validity and interpretability of the scores it produces. Engagement is a critical threat to validity in assessments—particularly among young children in digital universal screening contexts. We conducted two large-scale experiments involving 6,610 students from Grade 1 to 12 in Colombia and the United States in which students were randomly assigned to one of two conditions: (1) informative feedback (auditory cues indicating correct/incorrect) or (2) neutral feedback (non-informative sound). The assessment was administered in two formats: an adaptively ordered English version and a randomly ordered Spanish version. We evaluated differences in response behaviors, item response theory (IRT) model fit, and concurrent validity between conditions. Results indicate that informative feedback significantly increased compliance and reduced disengagement. Reading scores and IRT model fit were comparable across conditions. Notably, informative feedback improved the concurrent validity of scores and was associated with shorter completion times. These findings suggest that trial-by-trial feedback can enhance engagement without degrading score interpretability thus leading to improvements in assessment efficiency and validity in a universal screening context.
- 5 June 2025
- Published by Center for Open Science in PsyArXiv
Open AccessImproving Validity and Efficiency of Digital Dyslexia Screening through Trial By Trial Feedback
Trial-by-trial feedback is a powerful tool across scientific disciplines, offering real-time information that shapes learning, attention, and behavioral adjustment. However, its role in large-scale educational and psychological assessments remains underexplored. This study examines whether providing trial-by-trial performance feedback during a digital dyslexia screening task enhances engagement while preserving the validity and interpretability of the scores it produces. Engagement is a critical threat to validity in assessments—particularly among young children in digital universal screening contexts. We conducted two large-scale experiments involving 6,610 students from Grade 1 to 12 in Colombia and the United States in which students were randomly assigned to one of two conditions: (1) informative feedback (auditory cues indicating correct/incorrect) or (2) neutral feedback (non-informative sound). The assessment was administered in two formats: an adaptively ordered English version and a randomly ordered Spanish version. We evaluated differences in response behaviors, item response theory (IRT) model fit, and concurrent validity between conditions. Results indicate that informative feedback significantly increased compliance and reduced disengagement. Reading scores and IRT model fit were comparable across conditions. Notably, informative feedback improved the concurrent validity of scores and was associated with shorter completion times. These findings suggest that trial-by-trial feedback can enhance engagement without degrading score interpretability thus leading to improvements in assessment efficiency and validity in a universal screening context.