Zeynep Bilki
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zeynep Bilki has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Aysel Saricaoglu
Social Sciences University of Ankara
2 shared publications - Mehmet Sak
Department of Foreign Language Education TED University Ankara Turkey
2 shared publications - Müge Satar
Newcastle University
2 shared publications - Aliye Karabulut-Ilgu
College of Veterinary Medicine, Iowa State University, 2256 Patterson Hall, 1800 Christensen Drive, Ames, IA 50011, USA
1 shared publication - Amine Hatun Ataş
Galatasaray University
1 shared publication Aysel Saricaoglu
Social Sciences University of Ankara
1 shared publication
Latest Publications
- Top Cited Papers
Exploring second language writers’ engagement with ChatGPT feedback: Revision behaviors and perceptions
- Top Cited PapersOpen Access
- 31 July 2025
- Published by Cambridge University Press (CUP) in Annual Review of Applied Linguistics
- Vol. 45, 253-273
The capacity of ChatGPT-4 for L2 writing assessment: A closer look at accuracy, specificity, and relevance
This study examined the capacity of ChatGPT-4 to assess L2 writing in an accurate, specific, and relevant way. Based on 35 argumentative essays written by upper-intermediate L2 writers in higher education, we evaluated ChatGPT-4’s assessment capacity across four L2 writing dimensions: (1) Task Response, (2) Coherence and Cohesion, (3) Lexical Resource, and (4) Grammatical Range and Accuracy. The main findings were (a) ChatGPT-4 was exceptionally accurate in identifying the issues across the four dimensions; (b) ChatGPT-4 demonstrated more variability in feedback specificity, with more specific feedback in Grammatical Range and Accuracy and Lexical Resource, but more general feedback in Task Response and Coherence and Cohesion; and (c) ChatGPT-4’s feedback was highly relevant to the criteria in the Task Response and Coherence and Cohesion dimensions, but it occasionally misclassified errors in the Grammatical Range and Accuracy and Lexical Resource dimensions. Our findings contribute to a better understanding of ChatGPT-4 as an assessment tool, informing future research and practical applications in L2 writing assessment.
- 31 July 2025
- Published by Cambridge University Press (CUP) in Annual Review of Applied Linguistics
- Vol. 45, 253-273
Top Cited PapersOpen AccessThe capacity of ChatGPT-4 for L2 writing assessment: A closer look at accuracy, specificity, and relevance
This study examined the capacity of ChatGPT-4 to assess L2 writing in an accurate, specific, and relevant way. Based on 35 argumentative essays written by upper-intermediate L2 writers in higher education, we evaluated ChatGPT-4’s assessment capacity across four L2 writing dimensions: (1) Task Response, (2) Coherence and Cohesion, (3) Lexical Resource, and (4) Grammatical Range and Accuracy. The main findings were (a) ChatGPT-4 was exceptionally accurate in identifying the issues across the four dimensions; (b) ChatGPT-4 demonstrated more variability in feedback specificity, with more specific feedback in Grammatical Range and Accuracy and Lexical Resource, but more general feedback in Task Response and Coherence and Cohesion; and (c) ChatGPT-4’s feedback was highly relevant to the criteria in the Task Response and Coherence and Cohesion dimensions, but it occasionally misclassified errors in the Grammatical Range and Accuracy and Lexical Resource dimensions. Our findings contribute to a better understanding of ChatGPT-4 as an assessment tool, informing future research and practical applications in L2 writing assessment.
- 1 May 2024
- Published by Taylor & Francis
- p. 244-260
The Use of AWE in Non-English Majors
While student responses to automated feedback have been largely explored in the L2 writing literature, current understanding is limited to the instructor-led/required use of automated writing evaluation (AWE) in language classes. Voluntary use of AWE by students in non-English majors is one area that remains understudied in the AWE literature. This chapter presents a quantitative study examining how Turkish-L1 learners of English as a Foreign Language (n = 34) responded to automated feedback from Criterion when using it on a voluntary basis for their Introduction to Education and Introduction to Sociology course assignments. In such a context where the main focus is on content learning, the error detection capacity of AWE systems carries more importance as a less error-prone AWE system is desired. Thus, this study also examined if the accuracy of feedback features of Criterion (i.e., detection of errors, identification of error types, and suggestion for revision) impacted students’ revision success. Criterion’s performance reports for the students’ first and revised submissions (n = 68) were collected, and the errors detected by Criterion (n = 890) and students’ revisions (n = 312) were analyzed. Findings showed that students revised 39% of their errors, with 90% correct and 86% relevant revisions. Among the feedback features, it was the identification of error type that had a significant influence on the success of students’ revisions. Pedagogical implications for voluntary use of AWE by non-English major students are addressed.
- 1 May 2024
- Published by Taylor & Francis
- p. 244-260
The Use of AWE in Non-English Majors
While student responses to automated feedback have been largely explored in the L2 writing literature, current understanding is limited to the instructor-led/required use of automated writing evaluation (AWE) in language classes. Voluntary use of AWE by students in non-English majors is one area that remains understudied in the AWE literature. This chapter presents a quantitative study examining how Turkish-L1 learners of English as a Foreign Language (n = 34) responded to automated feedback from Criterion when using it on a voluntary basis for their Introduction to Education and Introduction to Sociology course assignments. In such a context where the main focus is on content learning, the error detection capacity of AWE systems carries more importance as a less error-prone AWE system is desired. Thus, this study also examined if the accuracy of feedback features of Criterion (i.e., detection of errors, identification of error types, and suggestion for revision) impacted students’ revision success. Criterion’s performance reports for the students’ first and revised submissions (n = 68) were collected, and the errors detected by Criterion (n = 890) and students’ revisions (n = 312) were analyzed. Findings showed that students revised 39% of their errors, with 90% correct and 86% relevant revisions. Among the feedback features, it was the identification of error type that had a significant influence on the success of students’ revisions. Pedagogical implications for voluntary use of AWE by non-English major students are addressed.
- Open Access
- 21 February 2023
- Published by RumeliDE Dil ve Edebiyat Arastirmalari Dergisi in Rumelide Dil Ve Edebiyat Araştırmaları Dergisi
- No. 32,p. 1387-1401
Developing a reading course model for pre-service English language teachers within the framework of critical pedagogy
Today’s global world brought significant changes to our learning and teaching habits, skills, and competencies we need to gain to deal with and make decisions on challenging global issues. One of these essential skills we need to improve is critical thinking skills. Enhancing critical thinking skills and developing an in-depth critical consciousness on challenging issues can be achieved through the improvement of two essential literacy skills, reading and writing. This paper presents a reading course model developed to improve pre-service English language teachers’ critical reading skills within the framework of critical pedagogy. Many English reading courses in higher education level are designed with traditional approaches that aim to improve the basic reading comprehension skills of second language (L2) readers. Unlike these courses, the course model reported in this paper aims to develop pre-service English language teachers’ critical reading skills as well as consciousness on critical global issues by creating a context they experience reading in English as a social act by having a deeper level of engagement with critical global issues such as social justice, gender equality, refugee problems, human rights, and environmental challenges. The paper first provides a detailed description of the theoretical framework behind the design of the course and then presents the course with a focus on learning objectives, course procedure, reading text selection and assessment of students’ works. The pedagogical considerations and implications are provided in the conclusion for instructors who are interested in implementing a reading course enriched with critical pedagogy.
- 21 February 2023
- Published by RumeliDE Dil ve Edebiyat Arastirmalari Dergisi in Rumelide Dil Ve Edebiyat Araştırmaları Dergisi
- No. 32,p. 1387-1401
Open AccessDeveloping a reading course model for pre-service English language teachers within the framework of critical pedagogy
Today’s global world brought significant changes to our learning and teaching habits, skills, and competencies we need to gain to deal with and make decisions on challenging global issues. One of these essential skills we need to improve is critical thinking skills. Enhancing critical thinking skills and developing an in-depth critical consciousness on challenging issues can be achieved through the improvement of two essential literacy skills, reading and writing. This paper presents a reading course model developed to improve pre-service English language teachers’ critical reading skills within the framework of critical pedagogy. Many English reading courses in higher education level are designed with traditional approaches that aim to improve the basic reading comprehension skills of second language (L2) readers. Unlike these courses, the course model reported in this paper aims to develop pre-service English language teachers’ critical reading skills as well as consciousness on critical global issues by creating a context they experience reading in English as a social act by having a deeper level of engagement with critical global issues such as social justice, gender equality, refugee problems, human rights, and environmental challenges. The paper first provides a detailed description of the theoretical framework behind the design of the course and then presents the course with a focus on learning objectives, course procedure, reading text selection and assessment of students’ works. The pedagogical considerations and implications are provided in the conclusion for instructors who are interested in implementing a reading course enriched with critical pedagogy.
- Top Cited PapersOpen Access
- 13 February 2023
- Published by National Foreign Language Resource Center in Language Learning & Technology
- Vol. 27 (2) , 72-96
Multimodal representation in virtual exchange: A social semiotic approach to critical digital literacy
For agentive and influential involvement in online communities, language learners and teachers need to develop critical digital literacy (CDL), conceptualized by Darvin (2017) as an awareness of “how meanings are represented in ways that maintain and reproduce relations of power” (p. 5) and thus privilege some and marginalize others online. Virtual exchange (VE) provides an ideal socio-cultural and socio-semiotic context for fostering CDL (Hauck, 2019) as it is an educational intervention that is—by default—digitally mediated. In this contribution, we examine the employment of semiotic practices for multimodal representation and how they “shape power relations with others” (Bezemer & Jewitt, 2009, p. 1), thereby drawing on a social semiotic approach (Bezemer & Kress, 2016) to CDL (Bilki et al., 2023). Our insights stem from a six-week VE between two higher education institutions in Turkey and the UK, which brought together 48 future English as a Foreign Language (EFL) teachers. The task-based exchanges yielded a rich dataset which allows us to illustrate how CDL is materially achieved through transformative processes observed in multicultural, multilingual, and multimodal interactions. Our findings speak to Kern’s (2014, 2015) appeal for a relational pedagogy and highlight the need to promote CDL in EFL teaching and teacher education to foster critical reflection on meaning-making conventions while exercising agency to establish powerful online relations with others.
- 13 February 2023
- Published by National Foreign Language Resource Center in Language Learning & Technology
- Vol. 27 (2) , 72-96
Top Cited PapersOpen AccessMultimodal representation in virtual exchange: A social semiotic approach to critical digital literacy
For agentive and influential involvement in online communities, language learners and teachers need to develop critical digital literacy (CDL), conceptualized by Darvin (2017) as an awareness of “how meanings are represented in ways that maintain and reproduce relations of power” (p. 5) and thus privilege some and marginalize others online. Virtual exchange (VE) provides an ideal socio-cultural and socio-semiotic context for fostering CDL (Hauck, 2019) as it is an educational intervention that is—by default—digitally mediated. In this contribution, we examine the employment of semiotic practices for multimodal representation and how they “shape power relations with others” (Bezemer & Jewitt, 2009, p. 1), thereby drawing on a social semiotic approach (Bezemer & Kress, 2016) to CDL (Bilki et al., 2023). Our insights stem from a six-week VE between two higher education institutions in Turkey and the UK, which brought together 48 future English as a Foreign Language (EFL) teachers. The task-based exchanges yielded a rich dataset which allows us to illustrate how CDL is materially achieved through transformative processes observed in multicultural, multilingual, and multimodal interactions. Our findings speak to Kern’s (2014, 2015) appeal for a relational pedagogy and highlight the need to promote CDL in EFL teaching and teacher education to foster critical reflection on meaning-making conventions while exercising agency to establish powerful online relations with others.
- Open Access
- 14 June 2022
- Published by Cambridge University Press (CUP) in ReCALL
- Vol. 35 (1) , 58-73
Critical digital literacy in virtual exchange for ELT teacher education: An interpretivist methodology
Virtual exchange (VE) is an ideal venue for digital literacy skills development (Fuchs, Hauck & Müller-Hartmann, 2012) and for critical digital literacy (CDL) (Hauck, 2019). Yet literacy is a fluid, deictic term, the meaning of which is context dependent, and digital literacies need to be defined and conceptualised within a specific context. Recent CALL literature highlights the interest in CDL from various perspectives, but how CDL is conceptualised by the VE participants themselves is not explored. Participants of this study were 37 trainee English language teachers in the UK and Turkey who joined a 6-week VE. Their ongoing reflections on CDL were captured through reflective e-portfolio entries following each VE task. Thematic analysis revealed four components of CDL in this specific VE: (1) participants’ awareness of digital affordances for self-expression, (2) semiotic and interactional means to build connections, (3) ensuring inclusiveness of all community members, and (4) implications of socio-political contexts of each participant for meaning-making and interaction. We conclude that in future pedagogical implementations of VE, facilitators can foster trainee teachers’ CDL development through more closely guided and informed reflection on the four themes presented in this paper. As such, this study makes a novel contribution to our understanding of CDL in VE settings for ELT teacher education by offering a social semiotic second language acquisition orientation within an interpretivist paradigm.
- 14 June 2022
- Published by Cambridge University Press (CUP) in ReCALL
- Vol. 35 (1) , 58-73
Open AccessCritical digital literacy in virtual exchange for ELT teacher education: An interpretivist methodology
Virtual exchange (VE) is an ideal venue for digital literacy skills development (Fuchs, Hauck & Müller-Hartmann, 2012) and for critical digital literacy (CDL) (Hauck, 2019). Yet literacy is a fluid, deictic term, the meaning of which is context dependent, and digital literacies need to be defined and conceptualised within a specific context. Recent CALL literature highlights the interest in CDL from various perspectives, but how CDL is conceptualised by the VE participants themselves is not explored. Participants of this study were 37 trainee English language teachers in the UK and Turkey who joined a 6-week VE. Their ongoing reflections on CDL were captured through reflective e-portfolio entries following each VE task. Thematic analysis revealed four components of CDL in this specific VE: (1) participants’ awareness of digital affordances for self-expression, (2) semiotic and interactional means to build connections, (3) ensuring inclusiveness of all community members, and (4) implications of socio-political contexts of each participant for meaning-making and interaction. We conclude that in future pedagogical implementations of VE, facilitators can foster trainee teachers’ CDL development through more closely guided and informed reflection on the four themes presented in this paper. As such, this study makes a novel contribution to our understanding of CDL in VE settings for ELT teacher education by offering a social semiotic second language acquisition orientation within an interpretivist paradigm.
- 17 March 2022
- Published by Wiley in TESOL Journal
- Vol. 13 (3)
Levels of textual cohesion and the meaning‐construction process of advanced second language readers
Academic reading in English requires processing of challenging advanced texts for comprehension. Highly proficient second language (L2) readers, such as graduate students, are expected to interpret complex texts fluently and efficiently for academic success, yet the field has little evidence on how these readers process texts. Through two think‐aloud reading sessions and pre‐ and postreading interviews, this study closely examined nine graduate students' interactions with texts that had low and high levels of discourse cohesion. The focus was on the readers' meaning‐construction process in relation to the texts' cohesion. The researchers analyzed these data qualitatively using a grounded theory approach that revealed text‐processing activities of proficient L2 readers grouped at local and global levels. Although all readers experienced these two levels with both texts, some differences were found in their processing between two texts, especially in reading the low‐cohesive text. The findings of the study provide implications for reading instructors and teacher researchers in understanding how advanced L2 readers construct meaning and draw on text discourse as they read texts in English and potentially in conceptualizing what novice L2 readers must do to progress.
- 17 March 2022
- Published by Wiley in TESOL Journal
- Vol. 13 (3)
Levels of textual cohesion and the meaning‐construction process of advanced second language readers
Academic reading in English requires processing of challenging advanced texts for comprehension. Highly proficient second language (L2) readers, such as graduate students, are expected to interpret complex texts fluently and efficiently for academic success, yet the field has little evidence on how these readers process texts. Through two think‐aloud reading sessions and pre‐ and postreading interviews, this study closely examined nine graduate students' interactions with texts that had low and high levels of discourse cohesion. The focus was on the readers' meaning‐construction process in relation to the texts' cohesion. The researchers analyzed these data qualitatively using a grounded theory approach that revealed text‐processing activities of proficient L2 readers grouped at local and global levels. Although all readers experienced these two levels with both texts, some differences were found in their processing between two texts, especially in reading the low‐cohesive text. The findings of the study provide implications for reading instructors and teacher researchers in understanding how advanced L2 readers construct meaning and draw on text discourse as they read texts in English and potentially in conceptualizing what novice L2 readers must do to progress.
- 1 January 2022
- Published by Springer Nature
- p. 297-316
Blogging to Build Collaborative Evaluation in L2 Writing
- 1 January 2022
- Published by Springer Nature
- p. 297-316
Blogging to Build Collaborative Evaluation in L2 Writing
- Open Access
- 31 March 2021
- Published by Cambridge University Press (CUP) in ReCALL
- Vol. 33 (3) , 265-277
Voluntary use of automated writing evaluation by content course students
Automated writing evaluation (AWE) technologies are common supplementary tools for helping students improve their language accuracy using automated feedback. In most existing studies, AWE has been implemented as a class activity or an assignment requirement in English or academic writing classes. The potential of AWE as a voluntary language learning tool is unknown. This study reports on the voluntary use of Criterion by English as a foreign language students in two content courses for two assignments. We investigated (a) to what extent students used Criterion and (b) to what extent their revisions based on automated feedback increased the accuracy of their writing from the first submitted draft to the last in both assignments. We analyzed students’ performance summary reports from Criterion using descriptive statistics and non-parametric statistical tests. The findings showed that not all students used Criterion or resubmitted a revised draft. However, the findings also showed that engagement with automated feedback significantly reduced users’ errors from the first draft to the last in 11 error categories in total for the two assignments.
- 31 March 2021
- Published by Cambridge University Press (CUP) in ReCALL
- Vol. 33 (3) , 265-277
Open AccessVoluntary use of automated writing evaluation by content course students
Automated writing evaluation (AWE) technologies are common supplementary tools for helping students improve their language accuracy using automated feedback. In most existing studies, AWE has been implemented as a class activity or an assignment requirement in English or academic writing classes. The potential of AWE as a voluntary language learning tool is unknown. This study reports on the voluntary use of Criterion by English as a foreign language students in two content courses for two assignments. We investigated (a) to what extent students used Criterion and (b) to what extent their revisions based on automated feedback increased the accuracy of their writing from the first submitted draft to the last in both assignments. We analyzed students’ performance summary reports from Criterion using descriptive statistics and non-parametric statistical tests. The findings showed that not all students used Criterion or resubmitted a revised draft. However, the findings also showed that engagement with automated feedback significantly reduced users’ errors from the first draft to the last in 11 error categories in total for the two assignments.