Meltem Acar Güvendir
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Meltem Acar Güvendir has a total of 20 co-authors. Here are the top co-authors by number of shared publications:
- Yeşim Özer Özkan
Gaziantep Üniversitesi, Gaziantep Eğitim Fakültesi
7 shared publications - Abdullah Faruk Kılıç
Trakya Universitesi
3 shared publications - Elif Bektaş
TRAKYA ÜNİVERSİTESİ, SOSYAL BİLİMLER ENSTİTÜSÜ
2 shared publications - Emre Guvendi̇r
Trakya University
2 shared publications - Emre Güvendir
Trakya University, Edirne, Türkiye
2 shared publications - Seda Donat Bacıoğlu
Trakya University
2 shared publications
Latest Publications
- Top Cited PapersOpen Access
- 17 March 2026
- Published by Springer Nature in Education and Information Technologies
- Vol. 31 (11) , 3781-3804
Bridging minds and machines: a comparative study of AI and human rater agreement and reliability in educational assessment
Building on cognitive theories, this study investigates interrater reliability (IRR) and interrater agreement (IRA) between human raters and artificial intelligence (AI) models (ChatGPT-4 and Gemini) in scoring open-ended (constructed response) and single best answer questions. The study involved 73 third-year undergraduate students from the Department of Primary School Education, enrolled in the Measurement and Evaluation course. Of these, 46 students answered the open-ended question, and 69 answered the single best answer question. The analysis focused on comparing IRR and IRA between human raters and AI models, as well as between the AI models themselves. Results indicated that AI models demonstrated higher IRR and IRA than human raters for the open-ended question, characterized by less structured responses and multidimensional scoring criteria, while human raters performed slightly better for the single best answer question. AI models showed relatively consistent scoring performance across task types, whereas human raters exhibited greater variability, particularly for the open-ended task. These findings highlight task-dependent differences in scoring consistency that are interpretable through cognitive theories, contributing to ongoing debates about the appropriate role of AI in educational assessment.
- 17 March 2026
- Published by Springer Nature in Education and Information Technologies
- Vol. 31 (11) , 3781-3804
Top Cited PapersOpen AccessBridging minds and machines: a comparative study of AI and human rater agreement and reliability in educational assessment
Building on cognitive theories, this study investigates interrater reliability (IRR) and interrater agreement (IRA) between human raters and artificial intelligence (AI) models (ChatGPT-4 and Gemini) in scoring open-ended (constructed response) and single best answer questions. The study involved 73 third-year undergraduate students from the Department of Primary School Education, enrolled in the Measurement and Evaluation course. Of these, 46 students answered the open-ended question, and 69 answered the single best answer question. The analysis focused on comparing IRR and IRA between human raters and AI models, as well as between the AI models themselves. Results indicated that AI models demonstrated higher IRR and IRA than human raters for the open-ended question, characterized by less structured responses and multidimensional scoring criteria, while human raters performed slightly better for the single best answer question. AI models showed relatively consistent scoring performance across task types, whereas human raters exhibited greater variability, particularly for the open-ended task. These findings highlight task-dependent differences in scoring consistency that are interpretable through cognitive theories, contributing to ongoing debates about the appropriate role of AI in educational assessment.
- Open Access
- 31 January 2026
- Published by Turkish Journal of Education in Turkish Journal of Education
- Vol. 15 (1) , 65-85
Multilevel predictors of middle school mathematics anxiety: Roles of students, teachers, and parents
This study investigates how student and teacher characteristics predict students’ mathematics anxiety using a predictive correlational design and multilevel analysis through Hierarchical Linear Modeling (HLM). The sample consisted of 413 middle school students, their mathematics teachers (n=12) and the parents of these students (n = 413). Mathematics anxiety was measured using validated anxiety scales administered to students, their mathematics teachers, and parents. The results of the HLM analysis indicated that 94% of the variance in mathematics anxiety was at the student level. At the student level, higher parental mathematics anxiety, fewer social opportunities, and lower self-efficacy were significant predictors of higher student mathematics anxiety. At the teacher level, higher teacher mathematics anxiety, male gender and marital status were associated with increased student mathematics anxiety. These findings highlight the multi-layered nature of mathematics anxiety and emphasize the need for interventions addressing both student and teacher influences.
- 31 January 2026
- Published by Turkish Journal of Education in Turkish Journal of Education
- Vol. 15 (1) , 65-85
Open AccessMultilevel predictors of middle school mathematics anxiety: Roles of students, teachers, and parents
This study investigates how student and teacher characteristics predict students’ mathematics anxiety using a predictive correlational design and multilevel analysis through Hierarchical Linear Modeling (HLM). The sample consisted of 413 middle school students, their mathematics teachers (n=12) and the parents of these students (n = 413). Mathematics anxiety was measured using validated anxiety scales administered to students, their mathematics teachers, and parents. The results of the HLM analysis indicated that 94% of the variance in mathematics anxiety was at the student level. At the student level, higher parental mathematics anxiety, fewer social opportunities, and lower self-efficacy were significant predictors of higher student mathematics anxiety. At the teacher level, higher teacher mathematics anxiety, male gender and marital status were associated with increased student mathematics anxiety. These findings highlight the multi-layered nature of mathematics anxiety and emphasize the need for interventions addressing both student and teacher influences.
- Open Access
- 19 May 2025
- Published by Pamukkale University in Pamukkale University Journal of Education
- No. 64,p. 338-373
Ölçek Seçiminde Arayış: Doğru Ölçeği Bulma Yolculuğu
Bu çalışmanın amacı, geliştirilmiş ya da uyarlanmış bir ölçek kullanacak araştırmacılara rehberlik edecek kontrol listesi geliştirmektir. Bu amaçla araştırmacılar tarafından alanyazına dayalı olarak ölçek geliştirme ve uyarlama adımları hazırlanmış ve tüm adımların ağırlıkları tanımlanmıştır. Hazırlanmış olan adımlar ve ağırlıkları eğitimde ölçme ve değerlendirme alanında doktora derecesine sahip olan 10 akademisyene gönderilmiştir. Akademisyenlerden hem adımlara yönelik görüşleri hem de takdir ettikleri ağırlıklar istenmiştir. Gelen dönütlere göre düzenlemeler yapılarak ölçek geliştirme ve uyarlama adımlarının ağırlıkları tanımlanmış, adımların ağırlıklarına göre elde edilecek toplam puan göz önüne alınarak bir ölçüt belirlenmiştir. Hâlihazırda geliştirilmiş/uyarlanmış bir ölçeği seçecek araştırmacılara önerilen ölçüt temel alınarak bu ölçekleri seçip seçmeme konusunda bir referans sunulmuştur. Bu yönüyle çalışmanın geliştirilmiş ya da uyarlanmış ölçeklerin seçiminde rehber oluşturması açısından önemli katkıları olacağı düşünülmektedir.
- 19 May 2025
- Published by Pamukkale University in Pamukkale University Journal of Education
- No. 64,p. 338-373
Open AccessÖlçek Seçiminde Arayış: Doğru Ölçeği Bulma Yolculuğu
Bu çalışmanın amacı, geliştirilmiş ya da uyarlanmış bir ölçek kullanacak araştırmacılara rehberlik edecek kontrol listesi geliştirmektir. Bu amaçla araştırmacılar tarafından alanyazına dayalı olarak ölçek geliştirme ve uyarlama adımları hazırlanmış ve tüm adımların ağırlıkları tanımlanmıştır. Hazırlanmış olan adımlar ve ağırlıkları eğitimde ölçme ve değerlendirme alanında doktora derecesine sahip olan 10 akademisyene gönderilmiştir. Akademisyenlerden hem adımlara yönelik görüşleri hem de takdir ettikleri ağırlıklar istenmiştir. Gelen dönütlere göre düzenlemeler yapılarak ölçek geliştirme ve uyarlama adımlarının ağırlıkları tanımlanmış, adımların ağırlıklarına göre elde edilecek toplam puan göz önüne alınarak bir ölçüt belirlenmiştir. Hâlihazırda geliştirilmiş/uyarlanmış bir ölçeği seçecek araştırmacılara önerilen ölçüt temel alınarak bu ölçekleri seçip seçmeme konusunda bir referans sunulmuştur. Bu yönüyle çalışmanın geliştirilmiş ya da uyarlanmış ölçeklerin seçiminde rehber oluşturması açısından önemli katkıları olacağı düşünülmektedir.
- Open Access
- 14 April 2025
- Published by Bilge Akademi in International Journal of Psychology and Educational Studies
- Vol. 12 (2) , 154-168
Measuring Test Anxiety Using Physiological Markers: A Comparative Study of Multiple-Choice and Open-Ended Tests
Different types of test items influence students' test anxiety, and physiological measures such as heart rate provide a means of measuring this anxiety. This study aimed to explore the connection between test anxiety and examination item formats. It centered on 20 junior university students in Western Türkiye. The research monitored students' heart rate changes during assessments, encompassing both multiple-choice and open-ended formats. Using a relational survey model, the study focused on statistically significant differences in mean rank scores for students' state and trait-based test anxiety, assessed through the Friedman test. Additionally, it examined heart rate variance, a physiological stress indicator, shedding light on heart rate fluctuations experienced by students during and outside exams. Participants exhibited higher levels of trait test anxiety. Moreover, heart rate changes during multiple-choice items exceeded those during open-ended items. These findings imply that multiple-choice items may trigger elevated anxiety in students, whereas open-ended items may elicit less anxiety, encouraging flexible thinking skills utilization.
- 14 April 2025
- Published by Bilge Akademi in International Journal of Psychology and Educational Studies
- Vol. 12 (2) , 154-168
Open AccessMeasuring Test Anxiety Using Physiological Markers: A Comparative Study of Multiple-Choice and Open-Ended Tests
Different types of test items influence students' test anxiety, and physiological measures such as heart rate provide a means of measuring this anxiety. This study aimed to explore the connection between test anxiety and examination item formats. It centered on 20 junior university students in Western Türkiye. The research monitored students' heart rate changes during assessments, encompassing both multiple-choice and open-ended formats. Using a relational survey model, the study focused on statistically significant differences in mean rank scores for students' state and trait-based test anxiety, assessed through the Friedman test. Additionally, it examined heart rate variance, a physiological stress indicator, shedding light on heart rate fluctuations experienced by students during and outside exams. Participants exhibited higher levels of trait test anxiety. Moreover, heart rate changes during multiple-choice items exceeded those during open-ended items. These findings imply that multiple-choice items may trigger elevated anxiety in students, whereas open-ended items may elicit less anxiety, encouraging flexible thinking skills utilization.
- Open Access
- 27 September 2024
- Published by Afyon Kocatepe Universitesi Sosyal Bilimler Dergisi in Afyon Kocatepe Üniversitesi Sosyal Bilimler Dergisi
- Vol. 26 (3) , 923-944
Okul Öncesi Alanındaki Aday Öğretmenlerin Aday Öğretmen Yetiştirme Sürecine Yönelik Görüşlerinin İncelenmesi
Bu çalışmanın amacı, okul öncesi alanındaki aday öğretmenlerin aday öğretmen yetiştirme sürecine yönelik görüşlerinin incelenmesidir. Çalışmanın amacına yönelik olarak betimsel araştırma modeli kullanılmıştır. Çalışma grubunu İstanbul ili Arnavutköy ilçesinde görev yapan okul öncesi alanındaki 15 aday öğretmen oluşturmuştur. Verilerin toplanmasında çalışma dâhilinde geliştirilen yarı yapılandırılmış görüşme formundan yararlanılmıştır. Çalışmanın kavramsal yapısı ve analizine temel oluşturacak kod ve kategoriler önceden belirlendiği için betimsel analiz yöntemi uygulanmıştır. Uzaktan eğitim kurs ve seminerlerinin aday öğretmenlerin mesleki gelişimlerine katkısı olmadığı; danışman öğretmen uygulamasının, programın geliştirilmesi gereken yönleri arasında olduğu sonucuna ulaşılmıştır. Ayrıca aday öğretmenler ders planlama sürecine yönelik doldurulan formların gereksiz olduğu; ders uygulama ve değerlendirme sürecinde doldurulan formların gerçekçi olmadığını dile getirmişlerdir. Aday performans değerlendirme sisteminin adil olmadığı; yüzeysel, mantıksız ve iş yükü olduğunu; strese yol açtığını ifade etmişlerdir. Çalışmaya katılan öğretmenlere göre aday performans değerlendirme sistemi olmamalıdır.
- 27 September 2024
- Published by Afyon Kocatepe Universitesi Sosyal Bilimler Dergisi in Afyon Kocatepe Üniversitesi Sosyal Bilimler Dergisi
- Vol. 26 (3) , 923-944
Open AccessOkul Öncesi Alanındaki Aday Öğretmenlerin Aday Öğretmen Yetiştirme Sürecine Yönelik Görüşlerinin İncelenmesi
Bu çalışmanın amacı, okul öncesi alanındaki aday öğretmenlerin aday öğretmen yetiştirme sürecine yönelik görüşlerinin incelenmesidir. Çalışmanın amacına yönelik olarak betimsel araştırma modeli kullanılmıştır. Çalışma grubunu İstanbul ili Arnavutköy ilçesinde görev yapan okul öncesi alanındaki 15 aday öğretmen oluşturmuştur. Verilerin toplanmasında çalışma dâhilinde geliştirilen yarı yapılandırılmış görüşme formundan yararlanılmıştır. Çalışmanın kavramsal yapısı ve analizine temel oluşturacak kod ve kategoriler önceden belirlendiği için betimsel analiz yöntemi uygulanmıştır. Uzaktan eğitim kurs ve seminerlerinin aday öğretmenlerin mesleki gelişimlerine katkısı olmadığı; danışman öğretmen uygulamasının, programın geliştirilmesi gereken yönleri arasında olduğu sonucuna ulaşılmıştır. Ayrıca aday öğretmenler ders planlama sürecine yönelik doldurulan formların gereksiz olduğu; ders uygulama ve değerlendirme sürecinde doldurulan formların gerçekçi olmadığını dile getirmişlerdir. Aday performans değerlendirme sisteminin adil olmadığı; yüzeysel, mantıksız ve iş yükü olduğunu; strese yol açtığını ifade etmişlerdir. Çalışmaya katılan öğretmenlere göre aday performans değerlendirme sistemi olmamalıdır.
- 3 April 2024
- Published by Taylor & Francis in Measurement: Interdisciplinary Research and Perspectives
- Vol. 23 (2) , 172-188
Examining the Wording Effect: What Are We Measuring?
- 3 April 2024
- Published by Taylor & Francis in Measurement: Interdisciplinary Research and Perspectives
- Vol. 23 (2) , 172-188
Examining the Wording Effect: What Are We Measuring?
- Open Access
- 29 November 2022
- Published by International Journal of Assessment Tools in Education in International Journal of Assessment Tools in Education
- Vol. 9 (Special ) , 300-316
Adaptation of Teachers' Perceptions of Grading Practices Scale to Turkish and Examination of Measurement Invariance
Grading is a complicated decision-making process that needs teachers to make value judgements on the learning, accomplishment, and development of their students. When assigning grades, teachers tend to examine a variety of criteria, including students' efforts, work habits, and accomplishments. Grades are a reflection of the value judgements made about students based on the evaluation of their academic performance. Consequently, describing how to reach a value judgment utilizing general measures will contribute to a better understanding of the difficulties encountered throughout the grading process. The purpose of this research is to adapt the Teacher Perceptions of Grading Practices Scale into Turkish and to examine the measurement invariance. This scale, which examines teachers' perceptions of grading methods, has six components: importance, usefulness, student effort, student ability, teacher's grading patterns, and perceived self-efficacy of the grading process. Before adapting the scale, permission was first acquired from the researcher who developed it. To ensure linguistic comparability, bilingual translators were recruited in the second phase. The semantic, experiential, conceptual, and idiomatic equivalence between the two variants of the scale were evaluated. The original and adapted scales were administered to a group of English teachers twice at a predetermined interval, and the consistency between the two applications was analyzed due to the fact that the language employed in the original test was a widely spoken group. Confirmatory Factor Analysis (CFA) was used to examine the factor structure of the original scale. Cronbach's alpha and Omega coefficients were calculated for the reliability of the data obtained from the scale. Finally, the measurement invariance of the scale according to gender was examined by using Multiple Group Confirmatory Factor Analysis (MGCFA), and it was determined that the measurement model fulfilled the criteria of complete gender-group invariance.
- 29 November 2022
- Published by International Journal of Assessment Tools in Education in International Journal of Assessment Tools in Education
- Vol. 9 (Special ) , 300-316
Open AccessAdaptation of Teachers' Perceptions of Grading Practices Scale to Turkish and Examination of Measurement Invariance
Grading is a complicated decision-making process that needs teachers to make value judgements on the learning, accomplishment, and development of their students. When assigning grades, teachers tend to examine a variety of criteria, including students' efforts, work habits, and accomplishments. Grades are a reflection of the value judgements made about students based on the evaluation of their academic performance. Consequently, describing how to reach a value judgment utilizing general measures will contribute to a better understanding of the difficulties encountered throughout the grading process. The purpose of this research is to adapt the Teacher Perceptions of Grading Practices Scale into Turkish and to examine the measurement invariance. This scale, which examines teachers' perceptions of grading methods, has six components: importance, usefulness, student effort, student ability, teacher's grading patterns, and perceived self-efficacy of the grading process. Before adapting the scale, permission was first acquired from the researcher who developed it. To ensure linguistic comparability, bilingual translators were recruited in the second phase. The semantic, experiential, conceptual, and idiomatic equivalence between the two variants of the scale were evaluated. The original and adapted scales were administered to a group of English teachers twice at a predetermined interval, and the consistency between the two applications was analyzed due to the fact that the language employed in the original test was a widely spoken group. Confirmatory Factor Analysis (CFA) was used to examine the factor structure of the original scale. Cronbach's alpha and Omega coefficients were calculated for the reliability of the data obtained from the scale. Finally, the measurement invariance of the scale according to gender was examined by using Multiple Group Confirmatory Factor Analysis (MGCFA), and it was determined that the measurement model fulfilled the criteria of complete gender-group invariance.
- Top Cited Papers
- 10 March 2022
- Published by International Journal of Assessment Tools in Education in International Journal of Assessment Tools in Education
- Vol. 9 (1) , 165-180
Item Removal Strategies Conducted in Exploratory Factor Analysis: A Comparative Study
The aim of this study is to examine how the practice of different item removal strategies during exploratory factor analysis (EFA) phase of scale development change the number of factors, factor loadings, explained variance ratio, and reliability values (α and ω) explained. In the study, data obtained from 379 university students were used for the development of a 46-item scale. As the first item removal strategy, crossloading items on two factors and where the difference between factor loadings was less than .10 were identified. Then, items were removed one by one, starting with the item with the least difference between the loadings on the factors. As the second strategy, the items that loaded on two factors and where the difference between factor loadings was less than .10 were found, and these items were removed from the scale as a whole. As the third strategy, the items that gave high loading on more than two factors and where the difference between these factors was less than .10 were identified. The item removal process was started with these items. The study results show that the factor numbers obtained using three different strategies during the item removal process of EFA were the same; however, the number of items on the scale, the explained variance ratio, and the total scale, and reliability values differed. Furthermore, the items in the factors were not all the same. The study results underscore the importance of theoretical competence in the scale development process.
- 10 March 2022
- Published by International Journal of Assessment Tools in Education in International Journal of Assessment Tools in Education
- Vol. 9 (1) , 165-180
Top Cited PapersItem Removal Strategies Conducted in Exploratory Factor Analysis: A Comparative Study
The aim of this study is to examine how the practice of different item removal strategies during exploratory factor analysis (EFA) phase of scale development change the number of factors, factor loadings, explained variance ratio, and reliability values (α and ω) explained. In the study, data obtained from 379 university students were used for the development of a 46-item scale. As the first item removal strategy, crossloading items on two factors and where the difference between factor loadings was less than .10 were identified. Then, items were removed one by one, starting with the item with the least difference between the loadings on the factors. As the second strategy, the items that loaded on two factors and where the difference between factor loadings was less than .10 were found, and these items were removed from the scale as a whole. As the third strategy, the items that gave high loading on more than two factors and where the difference between these factors was less than .10 were identified. The item removal process was started with these items. The study results show that the factor numbers obtained using three different strategies during the item removal process of EFA were the same; however, the number of items on the scale, the explained variance ratio, and the total scale, and reliability values differed. Furthermore, the items in the factors were not all the same. The study results underscore the importance of theoretical competence in the scale development process.
- 1 January 2021
- Published by ASOS Yayinevi in Uluslararası İnovatif Eğitim Araştırmacısı
- Vol. 1 (Cilt 1 Say) , 107-117
THE ROLE OF ACHIEVEMENT IN THE CORRELATION BETWEEN TEACHER CANDIDATES' MEASUREMENT AND EVALUATION COMMON COMPETENCY PERCEPTIONS AND ASSESSMENT LITERACY
The aim of this study is to examine the role of achievement in the relationship between teacher candidates' perceptions of general measurement and evaluation abilities and their literacy. The model was used in the research to ensure that the mediator variable predicted by the model was targeted. The study sampled 126 pre-service teachers who were enrolled in a third-grade measurement and evaluation course. The "Measurement and Evaluation General Efficiency Perception Scale for Teacher Candidates," the "Assessment Evaluation Literacy Inventory," and the evaluation course's final grades were used for the study. It demonstrates that the relationship between this perception of bullying, which he assumes the position of a full mediator variable in the relationship, and appraisal and evaluation literacy will be fully realized.
- 1 January 2021
- Published by ASOS Yayinevi in Uluslararası İnovatif Eğitim Araştırmacısı
- Vol. 1 (Cilt 1 Say) , 107-117
THE ROLE OF ACHIEVEMENT IN THE CORRELATION BETWEEN TEACHER CANDIDATES' MEASUREMENT AND EVALUATION COMMON COMPETENCY PERCEPTIONS AND ASSESSMENT LITERACY
The aim of this study is to examine the role of achievement in the relationship between teacher candidates' perceptions of general measurement and evaluation abilities and their literacy. The model was used in the research to ensure that the mediator variable predicted by the model was targeted. The study sampled 126 pre-service teachers who were enrolled in a third-grade measurement and evaluation course. The "Measurement and Evaluation General Efficiency Perception Scale for Teacher Candidates," the "Assessment Evaluation Literacy Inventory," and the evaluation course's final grades were used for the study. It demonstrates that the relationship between this perception of bullying, which he assumes the position of a full mediator variable in the relationship, and appraisal and evaluation literacy will be fully realized.