Reza Norouzian
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Reza Norouzian has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Zhouhan Jin
University of Macau
3 shared publications - Gavin Bui
The Hang Seng University of Hong Kong
2 shared publications - Stuart Webb
University of Western Ontario
1 shared publication - Zohreh R. Eslami
Texas A&M University
1 shared publication
Latest Publications
- 20 August 2026
- Published by John Benjamins Publishing Company
- p. 115-133
Lessons from a modern meta-analysis
This chapter provides a reflective exploration of conducting a meta-analysis by revisiting Norouzian et al. (2025) . Norouzian et al. (2025) looked at the effectiveness of note taking through exposure to L2 input, improving on an earlier study conducted by Jin and Webb (2024) . The study retrieved 55 effect sizes from 27 studies to examine how various factors (e.g., time, note-taking treatment type, proficiency) moderate the effect of note taking. It utilized a multivariate multilevel meta-analysis (3M) approach to account for dependencies across studies while incorporating three methodological confounds. This chapter details the methodological dilemmas we anticipated and those we encountered, the alternative approaches we considered, and the resolutions we adopted. We also emphasize our commitment to open science by sharing reproducible code and data. By summarizing the lessons learned from managing these methodological challenges, this chapter aims to provide practical guidance for researchers seeking more transparent, rigorous, and reproducible meta-analyse, and foster discussions on improving research methodologies in the field of second language acquisition.
- 20 August 2026
- Published by John Benjamins Publishing Company
- p. 115-133
Lessons from a modern meta-analysis
This chapter provides a reflective exploration of conducting a meta-analysis by revisiting Norouzian et al. (2025) . Norouzian et al. (2025) looked at the effectiveness of note taking through exposure to L2 input, improving on an earlier study conducted by Jin and Webb (2024) . The study retrieved 55 effect sizes from 27 studies to examine how various factors (e.g., time, note-taking treatment type, proficiency) moderate the effect of note taking. It utilized a multivariate multilevel meta-analysis (3M) approach to account for dependencies across studies while incorporating three methodological confounds. This chapter details the methodological dilemmas we anticipated and those we encountered, the alternative approaches we considered, and the resolutions we adopted. We also emphasize our commitment to open science by sharing reproducible code and data. By summarizing the lessons learned from managing these methodological challenges, this chapter aims to provide practical guidance for researchers seeking more transparent, rigorous, and reproducible meta-analyse, and foster discussions on improving research methodologies in the field of second language acquisition.
- 20 August 2026
- Published by John Benjamins Publishing Company
- p. 112-114
Section overview
- 9 February 2025
- Published by Wiley in The Modern Language Journal
- Vol. 109 (1) , 171-193
Increasing meta‐analytic quality: A multivariate multilevel meta‐analysis of note‐taking through exposure to L2 input
Meta‐analytic studies of second language (L2) learning typically employ a classic approach to meta‐analysis. Although the classic approach can clarify findings, a multivariate, multilevel meta‐analysis (3M) approach increases transparency by accounting for (a) dependencies in the evidence presented by primary studies, (b) methodological differences confounding the effectiveness of interventions, (c) differences in research designs, and (d) enhancing the accessibility of findings by using percentages. This reproducible study ( https://rnorouzian.github.io/m/p.html ) employed a 3M approach and used the (M)UTOS framework to examine the effect of note‐taking on learning through exposure to L2 input. Retrieving 55 effect sizes from 27 studies, the 3M approach found that there was at least a 63% likelihood for note‐taking treatments to produce a meaningfully positive benefit (≥0.2 gain on the effect‐size scale) on learning outcomes and revealed that the type of note‐taking treatment, measurement type, input mode, and learners’ proficiency levels were particularly influential.
- 9 February 2025
- Published by Wiley in The Modern Language Journal
- Vol. 109 (1) , 171-193
Increasing meta‐analytic quality: A multivariate multilevel meta‐analysis of note‐taking through exposure to L2 input
Meta‐analytic studies of second language (L2) learning typically employ a classic approach to meta‐analysis. Although the classic approach can clarify findings, a multivariate, multilevel meta‐analysis (3M) approach increases transparency by accounting for (a) dependencies in the evidence presented by primary studies, (b) methodological differences confounding the effectiveness of interventions, (c) differences in research designs, and (d) enhancing the accessibility of findings by using percentages. This reproducible study ( https://rnorouzian.github.io/m/p.html ) employed a 3M approach and used the (M)UTOS framework to examine the effect of note‐taking on learning through exposure to L2 input. Retrieving 55 effect sizes from 27 studies, the 3M approach found that there was at least a 63% likelihood for note‐taking treatments to produce a meaningfully positive benefit (≥0.2 gain on the effect‐size scale) on learning outcomes and revealed that the type of note‐taking treatment, measurement type, input mode, and learners’ proficiency levels were particularly influential.
- 31 July 2023
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 46 (1) , 277
Meta-analysis of second language research with complex research designs – ADDENDUM
- 31 July 2023
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 46 (1) , 277
Meta-analysis of second language research with complex research designs – ADDENDUM
- Top Cited Papers
- 19 July 2023
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 46 (1) , 251-276
Meta-analysis of second language research with complex research designs
Meta-analyses play an instrumental role in informing second language (L2) theory and practice. However, current (i.e., classic) approaches to meta-analysis are limited in their ability to do so because they often fail to capture the complexity inherent in primary studies’ research designs. As we argue in this article, when complex L2 studies are represented by simplistic meta-analyses, the latter cannot reach its potential to contribute to the development of cumulative knowledge. To mitigate this issue, we first discuss the fundamental problems of the classic approaches to meta-analysis of complex L2 research. Second, we introduce an alternative meta-analytic framework that will address those problems. Third, we apply the meta-analytic framework discussed to a complex L2 domain. Fourth, we offer free software to facilitate the conduct of the alternative meta-analytic approach described. Finally, we discuss the implications of this alternative framework for making evidence-based recommendations to the relevant stakeholders.
- 19 July 2023
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 46 (1) , 251-276
Top Cited PapersMeta-analysis of second language research with complex research designs
Meta-analyses play an instrumental role in informing second language (L2) theory and practice. However, current (i.e., classic) approaches to meta-analysis are limited in their ability to do so because they often fail to capture the complexity inherent in primary studies’ research designs. As we argue in this article, when complex L2 studies are represented by simplistic meta-analyses, the latter cannot reach its potential to contribute to the development of cumulative knowledge. To mitigate this issue, we first discuss the fundamental problems of the classic approaches to meta-analysis of complex L2 research. Second, we introduce an alternative meta-analytic framework that will address those problems. Third, we apply the meta-analytic framework discussed to a complex L2 domain. Fourth, we offer free software to facilitate the conduct of the alternative meta-analytic approach described. Finally, we discuss the implications of this alternative framework for making evidence-based recommendations to the relevant stakeholders.
- Open Access
- 8 April 2021
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 43 (4) , 896-915
INTERRATER RELIABILITY IN SECOND LANGUAGE META-ANALYSES
There has recently been a surge of interest in improving the replicability of second language (L2) research. However, less attention is paid to replicability in the context of L2 meta-analyses. I argue that conducting interrater reliability (IRR) analyses is a key step toward improving the replicability of L2 meta-analyses. To that end, I first discuss the foundation of IRR in the context of meta-analytic research. Second, I introduce two IRR measures,S indexandSpecific Agreement, which aid in improving the replicability of meta-analytic research. Third, I offer a flexible R program,meta_rate, to facilitate the conduct of IRR analyses for L2 meta-analyses. Fourth, I apply the R program to an actual meta-analytic L2 coding sheet to demonstrate the practical use of the IRR methods discussed. Finally, I provide interpretive guidelines to assist both L2 meta-analysts and journals with the transparent reporting of the IRR findings.
- 8 April 2021
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 43 (4) , 896-915
Open AccessINTERRATER RELIABILITY IN SECOND LANGUAGE META-ANALYSES
There has recently been a surge of interest in improving the replicability of second language (L2) research. However, less attention is paid to replicability in the context of L2 meta-analyses. I argue that conducting interrater reliability (IRR) analyses is a key step toward improving the replicability of L2 meta-analyses. To that end, I first discuss the foundation of IRR in the context of meta-analytic research. Second, I introduce two IRR measures,S indexandSpecific Agreement, which aid in improving the replicability of meta-analytic research. Third, I offer a flexible R program,meta_rate, to facilitate the conduct of IRR analyses for L2 meta-analyses. Fourth, I apply the R program to an actual meta-analytic L2 coding sheet to demonstrate the practical use of the IRR methods discussed. Finally, I provide interpretive guidelines to assist both L2 meta-analysts and journals with the transparent reporting of the IRR findings.
- 6 April 2020
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 42 (4) , 849-870
SAMPLE SIZE PLANNING IN QUANTITATIVE L2 RESEARCH
Researchers are traditionally advised to plan for their required sample size such that achieving a sufficient level of statistical power is ensured (Cohen, 1988). While this method helps distinguishing statistically significant effects from the nonsignificant ones, it does not help achieving the higher goal of accurately estimating the actual size of those effects in an intended study. Adopting an open-science approach, this article presents an alternative approach,accuracy in effect size estimation(AESE), to sample size planning that ensures that researchers obtain adequately narrow confidence intervals (CI) for their effect sizes of interest thereby ensuring accuracy in estimating the actual size of those effects. Specifically, I (a) compare the underpinnings of power-analytic and AESE methods, (b) provide a practical definition of narrow CIs, (c) apply the AESE method to various research studies from L2 literature, and (d) offer several flexible R programs to implement the methods discussed in this article.
- 6 April 2020
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 42 (4) , 849-870
SAMPLE SIZE PLANNING IN QUANTITATIVE L2 RESEARCH
Researchers are traditionally advised to plan for their required sample size such that achieving a sufficient level of statistical power is ensured (Cohen, 1988). While this method helps distinguishing statistically significant effects from the nonsignificant ones, it does not help achieving the higher goal of accurately estimating the actual size of those effects in an intended study. Adopting an open-science approach, this article presents an alternative approach,accuracy in effect size estimation(AESE), to sample size planning that ensures that researchers obtain adequately narrow confidence intervals (CI) for their effect sizes of interest thereby ensuring accuracy in estimating the actual size of those effects. Specifically, I (a) compare the underpinnings of power-analytic and AESE methods, (b) provide a practical definition of narrow CIs, (c) apply the AESE method to various research studies from L2 literature, and (d) offer several flexible R programs to implement the methods discussed in this article.
- 14 March 2016
- Published by California Digital Library (CDL) in Issues in Applied Linguistics
- Vol. 20 (1)
Critical Perspectives on Interlanguage Pragmatic Development: An Agenda for Research
Research on L2 pragmatic development forms the mainstay of many interlanguage pragmatic (ILP) inquiries. Yet promoting L2 pragmatic competence becomes an exceedingly demanding task when different constraints are brought to bear. This dilemma is due in large part to contrasting theories on interlanguage pragmatics development. From exposure to instruction, ILP research has long wrestled with the practical problems in the way of such development. Adding these together, the field is in dire need of practically meaningful research to address the full spectrum of both the pragmatic construct and the factors to foster its development. Intent on piecing together disparate sources of theory and data, this review synthesizes research regarding key considerations in L2 pragmatic development from cognitive, sociocultural, psycholinguistic and independent vantage points. Meanwhile, it summarizes the current knowledge on ILP development and draws out critical questions in connection with the past research. It is argued that there is a dearth of an integrative model for the acquisition of pragmatic competence, which renders several controversies surrounding L2 pragmatic development, especially that of the relationship between grammar and pragmatic development patterns, implausible. To serve that purpose then, a model for the acquisition of L2 pragmatic competence is expounded. In conclusion, a research agenda involving two prime research questions is outlined for future directions.
- 14 March 2016
- Published by California Digital Library (CDL) in Issues in Applied Linguistics
- Vol. 20 (1)
Critical Perspectives on Interlanguage Pragmatic Development: An Agenda for Research
Research on L2 pragmatic development forms the mainstay of many interlanguage pragmatic (ILP) inquiries. Yet promoting L2 pragmatic competence becomes an exceedingly demanding task when different constraints are brought to bear. This dilemma is due in large part to contrasting theories on interlanguage pragmatics development. From exposure to instruction, ILP research has long wrestled with the practical problems in the way of such development. Adding these together, the field is in dire need of practically meaningful research to address the full spectrum of both the pragmatic construct and the factors to foster its development. Intent on piecing together disparate sources of theory and data, this review synthesizes research regarding key considerations in L2 pragmatic development from cognitive, sociocultural, psycholinguistic and independent vantage points. Meanwhile, it summarizes the current knowledge on ILP development and draws out critical questions in connection with the past research. It is argued that there is a dearth of an integrative model for the acquisition of pragmatic competence, which renders several controversies surrounding L2 pragmatic development, especially that of the relationship between grammar and pragmatic development patterns, implausible. To serve that purpose then, a model for the acquisition of L2 pragmatic competence is expounded. In conclusion, a research agenda involving two prime research questions is outlined for future directions.