Carole A. Chapelle
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Carole A. Chapelle has a total of 27 co-authors. Here are the top co-authors by number of shared publications:
Erik Voss
NU Global, Northeastern University
2 shared publicationsJoan Jamieson
Northern Arizona University
2 shared publicationsVolker Hegelheimer
Iowa State University, USA
2 shared publications- Yoo-Ree Chung
Iowa State University, USA
2 shared publications Ahmet Dursun
Iowa State University Ames IA
1 shared publicationAlexis Lopez
Educational Testing Service Princeton NJ
1 shared publication
Latest Publications
- 30 July 2026
- Published by SAGE Publications in Language Testing
- Vol. 43 (4) , 424-456
Evaluating the Validity of a Spoken Dialog System-Mediated Role-Play Test for Assessing Second Language Oral Communication
Generative AI offers new opportunities for interactive oral communication assessment for specific purposes by building on past research investigating test takers’ oral interaction with spoken dialog systems (SDSs). Performing as automated conversational agents, SDSs can address logistical challenges in classroom-based oral assessments where interactive tasks are difficult to implement. This study investigated the validity of interpretations of a prototype SDS-mediated Tourism English Speaking Test (SDS-TEST) developed using evidence-centered design. Guided by the interpretation/use argument framework, this study focused on supporting the generalization and explanation inferences. Thirty Turkish English as a Foreign Language (EFL) students in a Tourism and Hotel Management program completed three SDS tasks, each rated by four trained raters. The generalization inference was supported using a univariate generalizability study (G-study) with a fully crossed, two-facet design on 360 composite scores, while a decision study (D-study) informed optimal task and rater configurations for future designs. The explanation inference was supported through correlational analyses with related assessments and qualitative insights from participants’ strategy use gathered via stimulated recalls. Findings support the inferences in the validity argument for the SDS-TEST, highlighting the potential of SDSs in English for Specific Purposes oral assessment and offering a model for exploring validity in the next generation of oral communication assessment.
- 30 July 2026
- Published by SAGE Publications in Language Testing
- Vol. 43 (4) , 424-456
Evaluating the Validity of a Spoken Dialog System-Mediated Role-Play Test for Assessing Second Language Oral Communication
Generative AI offers new opportunities for interactive oral communication assessment for specific purposes by building on past research investigating test takers’ oral interaction with spoken dialog systems (SDSs). Performing as automated conversational agents, SDSs can address logistical challenges in classroom-based oral assessments where interactive tasks are difficult to implement. This study investigated the validity of interpretations of a prototype SDS-mediated Tourism English Speaking Test (SDS-TEST) developed using evidence-centered design. Guided by the interpretation/use argument framework, this study focused on supporting the generalization and explanation inferences. Thirty Turkish English as a Foreign Language (EFL) students in a Tourism and Hotel Management program completed three SDS tasks, each rated by four trained raters. The generalization inference was supported using a univariate generalizability study (G-study) with a fully crossed, two-facet design on 360 composite scores, while a decision study (D-study) informed optimal task and rater configurations for future designs. The explanation inference was supported through correlational analyses with related assessments and qualitative insights from participants’ strategy use gathered via stimulated recalls. Findings support the inferences in the validity argument for the SDS-TEST, highlighting the potential of SDSs in English for Specific Purposes oral assessment and offering a model for exploring validity in the next generation of oral communication assessment.
- 1 December 2025
- Published by EUROKD Egitm Danismanlik Group in Language Teaching Research Quarterly
- Vol. 51, 432-477
A Systematic Review of Carol A. Chapelle’s 45-Year Contribution to Language Assessment and Education
The present systematic review examines Carol A. Chapelle’s contributions to language assessment and education. The data include the review and analysis of all of her published research works (with some exceptions) relevant to language assessment, applied linguistics, and technology literacy from the 1980s to the present. To accomplish the objectives of the study, it was outlined and tackled in six sections including background, methodology, themes and overall achievements, exclusion and inclusion rules, systematic review and Carol Chapelle’s personal reflection. First, in procedural terms, we struggled to access her all research works. Then, three macro-themes (Language Assessment, Applied Linguistics and Technology Literacy) and five micro-themes were derived from her whole research works. Next, a subjective methodology was developed for the purpose of the study, with reference to which some exclusion and inclusion rules were coined and then applied to the decision regarding the types of research works to review and analyze, i.e., journal articles, books and book chapters. After that, the systematic analysis was conducted and finally, Carol A. Chapelle provided her own personal discussion and reflection of this systematic review.
- 1 December 2025
- Published by EUROKD Egitm Danismanlik Group in Language Teaching Research Quarterly
- Vol. 51, 432-477
A Systematic Review of Carol A. Chapelle’s 45-Year Contribution to Language Assessment and Education
The present systematic review examines Carol A. Chapelle’s contributions to language assessment and education. The data include the review and analysis of all of her published research works (with some exceptions) relevant to language assessment, applied linguistics, and technology literacy from the 1980s to the present. To accomplish the objectives of the study, it was outlined and tackled in six sections including background, methodology, themes and overall achievements, exclusion and inclusion rules, systematic review and Carol Chapelle’s personal reflection. First, in procedural terms, we struggled to access her all research works. Then, three macro-themes (Language Assessment, Applied Linguistics and Technology Literacy) and five micro-themes were derived from her whole research works. Next, a subjective methodology was developed for the purpose of the study, with reference to which some exclusion and inclusion rules were coined and then applied to the decision regarding the types of research works to review and analyze, i.e., journal articles, books and book chapters. After that, the systematic analysis was conducted and finally, Carol A. Chapelle provided her own personal discussion and reflection of this systematic review.
- 7 August 2024
- Published by SAGE Publications in Language Testing
- Vol. 41 (4) , 882-885
Open Science in language assessment research contexts: A reply to Winke
- 7 August 2024
- Published by SAGE Publications in Language Testing
- Vol. 41 (4) , 882-885
Open Science in language assessment research contexts: A reply to Winke
- Open Access
- 8 May 2024
- Published by Wiley in The Modern Language Journal
- Vol. 108 (2) , 534-540
Open generative AI changes a lot, but not everything
- 8 May 2024
- Published by Wiley in The Modern Language Journal
- Vol. 108 (2) , 534-540
Open AccessOpen generative AI changes a lot, but not everything
- 12 June 2020
- Published by SAGE Publications in Language Testing
- Vol. 37 (4) , 638-645
An introduction to Language Testing’s first Virtual Special Issue: Investigating consequences of language test use
Virtual Special Issues are a new resource for Language Testing readers. The Virtual Special Issues will highlight important topics and trends in the field by curating previously published articles that have contributed to defining important and influential issues, methods, and findings on the topics and trends. This Virtual Special Issue presents selected articles from Language Testing on the topic of the consequences, also referred to as washback and impact, of language assessments and tests. The authors of the articles report their investigations of the social functions of tests in teaching and learning as well as in broader structures for attaining opportunities in society. In particular, the articles encompass the examples of social functions that Messick (1989) identified as potentially important in investigating the validity of test use. They also demonstrate a variety of research methods for the study of the consequences of language assessment use in a range of contexts. They vary in the extent to which they interpret results with respect to validity, but the more recent two articles engage explicitly with issues of consequences and validity. Regardless of the role assumed for consequences in validity arguments, these articles demonstrate the importance of investigating consequences in language testing and illustrate methods for doing so.
- 12 June 2020
- Published by SAGE Publications in Language Testing
- Vol. 37 (4) , 638-645
An introduction to Language Testing’s first Virtual Special Issue: Investigating consequences of language test use
Virtual Special Issues are a new resource for Language Testing readers. The Virtual Special Issues will highlight important topics and trends in the field by curating previously published articles that have contributed to defining important and influential issues, methods, and findings on the topics and trends. This Virtual Special Issue presents selected articles from Language Testing on the topic of the consequences, also referred to as washback and impact, of language assessments and tests. The authors of the articles report their investigations of the social functions of tests in teaching and learning as well as in broader structures for attaining opportunities in society. In particular, the articles encompass the examples of social functions that Messick (1989) identified as potentially important in investigating the validity of test use. They also demonstrate a variety of research methods for the study of the consequences of language assessment use in a range of contexts. They vary in the extent to which they interpret results with respect to validity, but the more recent two articles engage explicitly with issues of consequences and validity. Regardless of the role assumed for consequences in validity arguments, these articles demonstrate the importance of investigating consequences in language testing and illustrate methods for doing so.
- 1 March 2020
- Published by Cambridge University Press (CUP) in Annual Review of Applied Linguistics
- Vol. 40, 113-118
Reflect, Revisit, Reimagine: Language Assessment inARAL
This 40th anniversary of ARAL also marks the 40-year anniversary of a significant uptick in research on language assessment, and hence there is much to reflect on and revisit within this period—and still scope for imagining the future. Pre-1980, language assessment had a long history, but Spolsky (1995) designated the late 1940s as a time of professionalization, which continued through the following decades. By the 1970s, language testers were gradually organizing into an academic community with an annual international conference, regional conferences, journals, and scholarly books. The new academic community not only developed and used language tests but also investigated the validity of their interpretations and uses. Canale's (1987) paper in ARAL provides an enduring frame of reference for reflection on the concerns of the academic community, which he introduced as the what, how, and why of language assessment.
- 1 March 2020
- Published by Cambridge University Press (CUP) in Annual Review of Applied Linguistics
- Vol. 40, 113-118
Reflect, Revisit, Reimagine: Language Assessment inARAL
This 40th anniversary of ARAL also marks the 40-year anniversary of a significant uptick in research on language assessment, and hence there is much to reflect on and revisit within this period—and still scope for imagining the future. Pre-1980, language assessment had a long history, but Spolsky (1995) designated the late 1940s as a time of professionalization, which continued through the following decades. By the 1970s, language testers were gradually organizing into an academic community with an annual international conference, regional conferences, journals, and scholarly books. The new academic community not only developed and used language tests but also investigated the validity of their interpretations and uses. Canale's (1987) paper in ARAL provides an enduring frame of reference for reflection on the concerns of the academic community, which he introduced as the what, how, and why of language assessment.
- 1 January 2020
- Published by Springer Nature
- p. 43-67
Linguistic Landscape Images and Québec’s Cultural Narrative in French Textbooks
- 1 January 2020
- Published by Springer Nature
- p. 43-67
Linguistic Landscape Images and Québec’s Cultural Narrative in French Textbooks
- Open Access
- 21 December 2018
- Published by Wiley in ETS Research Report Series
- Vol. 2018 (1) , 1-55
Designing a Prototype Tablet‐Based Learning‐Oriented Assessment for Middle School English Learners: An Evidence‐Centered Design Approach
The tablet project was undertaken in 2013 to explore the creation of an assessment to reveal English language learners' (ELLs') language capabilities in content area classes such as science. Such assessments could ideally be useful in multiple phases of the instructional process by providing information to learners, teachers, and other stakeholders because the technologies allow for efficiencies of task presentation, response gathering, scoring, storing data, and returning results. With the goal of understanding the development costs required to achieve such benefits, the project used an evidence‐centered design (ECD) framework to create a prototype assessment for ELL middle school students. In addition to describing the ECD process, the report describes how the project mandate helped to focus the complex processes of ECD and how the activities of ECD came into play in sketching plans for the validity argument.The ECD process of domain analysis uncovered perspectives on tablet use in middle schools as well as theoretical perspectives for conceptualizing the tablet users' abilities and learning. Findings included a range of uses of mobile technologies in middle school classrooms in 2013, with little uniformity in practices. Based on analysis of common elements in tablet‐based communication and learning, a framework for characterizing the relevant strategies and abilities was developed. Findings served in the domain modeling process of defining task design patterns, which in turn provided the basis for planning the conceptual assessment framework (CAF). The CAF also drew upon domain analysis findings, which suggested the concepts required for defining a student model (what is to be inferred about the test taker), an evidence model (the basis for making the inference), and the task model (the features of tasks required for eliciting relevant performance). The assessment implementation process produced a working prototype that served in usability testing and gathering feedback from middle school teachers.The report describes how ECD guides the design of tablet‐based formative assessment tasks that take into account the constructs to be measured and the learning that should result from test taking. The evaluation of the project is undertaken in view of the goal of ECD to design test tasks in a manner that serves in the argument for their use. Success is therefore evaluated in part by an analysis of the quality of content it supplied for an interpretation/use argument for the assessment. Overall, the project highlights include (a) the demonstration of how a mandate delimits the ECD processes; (b) the construct framework encompassing both the linguistic and nonlinguistic resources used to create meaning in a digital environment; (c) the approach used for analysis of a domain with emerging, shifting, and variously used technologies; and (d) the use of an interpretation/use argument in the appraisal of an ECD test design.
- 21 December 2018
- Published by Wiley in ETS Research Report Series
- Vol. 2018 (1) , 1-55
Open AccessDesigning a Prototype Tablet‐Based Learning‐Oriented Assessment for Middle School English Learners: An Evidence‐Centered Design Approach
The tablet project was undertaken in 2013 to explore the creation of an assessment to reveal English language learners' (ELLs') language capabilities in content area classes such as science. Such assessments could ideally be useful in multiple phases of the instructional process by providing information to learners, teachers, and other stakeholders because the technologies allow for efficiencies of task presentation, response gathering, scoring, storing data, and returning results. With the goal of understanding the development costs required to achieve such benefits, the project used an evidence‐centered design (ECD) framework to create a prototype assessment for ELL middle school students. In addition to describing the ECD process, the report describes how the project mandate helped to focus the complex processes of ECD and how the activities of ECD came into play in sketching plans for the validity argument.The ECD process of domain analysis uncovered perspectives on tablet use in middle schools as well as theoretical perspectives for conceptualizing the tablet users' abilities and learning. Findings included a range of uses of mobile technologies in middle school classrooms in 2013, with little uniformity in practices. Based on analysis of common elements in tablet‐based communication and learning, a framework for characterizing the relevant strategies and abilities was developed. Findings served in the domain modeling process of defining task design patterns, which in turn provided the basis for planning the conceptual assessment framework (CAF). The CAF also drew upon domain analysis findings, which suggested the concepts required for defining a student model (what is to be inferred about the test taker), an evidence model (the basis for making the inference), and the task model (the features of tasks required for eliciting relevant performance). The assessment implementation process produced a working prototype that served in usability testing and gathering feedback from middle school teachers.The report describes how ECD guides the design of tablet‐based formative assessment tasks that take into account the constructs to be measured and the learning that should result from test taking. The evaluation of the project is undertaken in view of the goal of ECD to design test tasks in a manner that serves in the argument for their use. Success is therefore evaluated in part by an analysis of the quality of content it supplied for an interpretation/use argument for the assessment. Overall, the project highlights include (a) the demonstration of how a mandate delimits the ECD processes; (b) the construct framework encompassing both the linguistic and nonlinguistic resources used to create meaning in a digital environment; (c) the approach used for analysis of a domain with emerging, shifting, and variously used technologies; and (d) the use of an interpretation/use argument in the appraisal of an ECD test design.