MŞMurat Doğan Şahin

Murat Doğan Şahin

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Murat Doğan Şahin has a total of 26 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Puanlama Yöntemleri

    by Murat Doğan Şahin

    This chapter examines scoring methods used in educational assessment from an epistemological perspective that focuses on how scores are generated. Accordingly, the methods are organized into three main categories: process-based scoring approaches, automated scoring, and comparative judgement. The first section discusses manual and digital scoring, dichotomous and partial-credit scoring, and weighted scoring approaches in terms of their applications, advantages, limitations, and psychometric properties. It also examines how scoring procedures vary according to the purpose of assessment, the construct being measured, and the conditions under which the assessment is administered. The second section explains the historical development of automated scoring systems, tracing their evolution from traditional rule-based and feature-based models to deep learning and generative artificial intelligence-based approaches. It summarizes the operating principles of rule-based, machine learning, neural network, and ontology-based methods, and discusses the roles of CNN, LSTM, and Transformer architectures in the evaluation of written performances. The opportunities provided by large language models for automated scoring are examined within the context of zero-shot, few-shot, and fine-tuning approaches. In addition, the chapter discusses the metrics used to evaluate automated scoring performance —particularly the QWK — and the limitations associated with interpreting these metrics. The final section introduces the comparative judgement approach to scoring and explains its theoretical foundations as an alternative to absolute scoring, in which performances are evaluated through pairwise comparisons. Overall, the chapter provides a comprehensive perspective on contemporary scoring methods, ranging from traditional human scoring to AI-assisted systems and comparative judgement approaches. It offers both a theoretical and practical framework for selecting appropriate scoring methods for different assessment purposes and implementation contexts.

  • Editorial for the Special Issue on Large Scale Assessment: Challenges and Innovations

    by Ummugul Bezirhan, Murat Doğan Şahin

    This editorial introduces the IEJEE’s Special Issue on Large Scale Assessment: Challenges and Innovations, highlighting emerging themes and methodological advancements in educational measurement. The selected studies focus on process data utilization to examine test-taker behavior, innovations in psychometric modeling for assessment, classification, and the influence of social-emotional learning on academic achievement. This editorial discusses the contributions of the included studies, their implications for future research, and the evolving role of AI, machine learning, and digital assessment technologies in shaping the future of large-scale assessments.

  • Open Access

    Adaptive Selection Algorithm and Standard Error Termination Rule in Comparative Judgement: An Application for Assessing Writing Skills

    by Sungur Gürel, Murat Doğan Şahin, İbRahim Uysal, Ali İhsan İbileme, Tuba Gündüz

    This study aims to examine the scoring reliability of comparative judgement under different sample sizes and standard error termination rule conditions. For this purpose, a Monte Carlo simulation study with 9 conditions and 82 iterations was conducted with sample sizes of 250, 500 and 1000 and standard error termination rules of 0.40, 0.35 and 0.30. In addition, a application for assessing writing skills was conducted with a sample of 50 students using the standard error termination rule of 0.40 and a maximum number of comparisons of 40. In the simulation study, scoring reliability was determined by true reliability, rank order accuracy and scale separation reliability. In the application, the correlation between scores that are obtained with a holistic rubric and ability estimates that are obtained with adaptive comparative judgement as well as the correlation between scores that are obtained using an analytic rubric and ability estimates that are obtained with adaptive comparative judgement were examined. In addition, scale separation reliability was calculated to obtain ability estimates using adaptive comparative judgement. The simulation results showed a high level of reliability in all conditions. Moreover, reliability was high, independent of the sample size. We conclude that stricter standard error termination rules lead to higher levels of reliability, but this requires performances to be subjected to a higher number of pairwise comparisons. The application results showed high scale separation reliability of .89 and correlations of over 0.70 with the scores obtained by using both holistic and analytic rubrics. Overall, the results of the study suggest that adaptive comparative judgement can be used in both classroom and large-scale assessment applications. In addition, adaptive comparative judgement is considered advantageous because it is easier to administer, does not require a difference in the testing process, and places the abilities on a continuous scale.


  • Open Access

    Investigation of the relationship between socioeconomic status and literacy in PISA Türkiye data

    by Mehmet Can Demir, Kübra Atalay Kabasakal, Murat Doğan Şahin

    Previous researchers have identified socioeconomic status as a significant predictor of achievement/literacy. However, it is important to recognize that the influence of socioeconomic status on literacy may vary at different levels of socioeconomic status. Thus, this study analyzes the relationship between socioeconomic status and literacy scores for all domains in PISA Türkiye data from 2003 to 2022 through the Classification and Regression Trees and linear regression methods. Upon examining the results, separate investigations carried out for the lower and upper socioeconomic status groups indicate that R2 values were found to be equal to or greater than .80 in 37 out of the 42 analyses. From 2003 to 2009, the R2 values in both groups were considerably high; however, there has been a notable decline in subsequent periods. The year 2009 demonstrated particularly high R2 values by ESCS in all domains for both upper and lower groups. Consequently, socioeconomic status exhibited a greater predictive power on literacy scores across all domains in the lower socioeconomic group than upper socioeconomic group.


  • Open Access

    Unveiling the relationships between eco-anxiety, psychological symptoms and anthropocentric narcissism: The psychometric properties of the Turkish version of the Hogg eco-anxiety scale

    by Elif Çimşir, Murat Doğan Şahin, Ramazan Akdoğan

    The increasing number of losses and damages caused by the climate crisis has rendered the psychometric assessment of the climate crisis more important than ever, specifically in developing countries, such as Turkey. The aim of this study was to examine the psychometric properties of the Turkish version of the Hogg Eco-Anxiety Scale (HEAS-13), using exploratory structural equation modeling (ESEM) on the cross-sectional data collected from 445 adults (286 females and 159 males; Mage = 29.76, range 18–65). The results supported the four-factor solution of the original version in the Turkish sample. Further analysis confirmed the invariance of the HEAS-13 across genders. The results demonstrated significant correlations of the HEAS-13 subscales with the Brief Symptom Inventory (BSI) and the Anthropocentric Narcissism Scale (ANS), except for that between the behavioral symptoms subscale of the HEAS-13 and the ANS. Both the total and the subscale scores of the HEAS-13 were also found to be reliable, given the internal consistency and test–retest reliability values. The Turkish version of the HEAS-13 can expand the scientific understanding of eco-anxiety, which can help develop mental health services to mitigate the negative mental health impacts of the environmental crisis.


  • Open Access

    Effects of gender norms on intelligence tests: Evidence from ASIS

    by Deniz Arslan, Ömer Faruk Tamul, Murat Doğan Şahin, Ugur Sak

    An examination of gender-related differential item functioning was conducted on the verbal subtests of the Anadolu-Sak Intelligence Scale. Analyses were conducted using the scale standardization data (N = 4641). A Mantel-Haenszel statistic was used to detect differential item functioning (DIF). A total of 58 verbal analogical reasoning items, 20 verbal short-term memory items, and 70 vocabulary items were analyzed. Initially, items displaying DIF in different age groups were determined, and then experts were consulted to determine whether these items were biased. There were three items with item effects on the Verbal Analogical Reasoning subtest and five items on the Vocabulary subtest. Short-term Memory subtests did not reveal any bias. Several implications regarding cognitive development, gender perceptions, and cultural factors were discussed.


  • Open Access

    Mixed Method Research: Theoretical Foundations, Designs and Its Use in Educational Research

    by Murat Doğan Şahin, Gokhan Ozturk

    In educational sciences, 90s were the scene of the paradigmatic wars, as the researchers of quantitative or qualitative research only defended the ideas of the type of research they used and they constantly criticized the counter-paradigm. While this struggle is going on, mixed method research has emerged, a pragmatist approach that believes both methods of research are necessary and useful, and that these two methods can be used together when the research problem requires. In the 2000s, numerous studies on mixed method research have led this approach to be accepted as a third paradigm. From this history to the present, many studies have been carried out on this topic, from the philosophy of the mixed method to the genres, from the methodological substructure to the stages. Presenting a theoretical perspective, this study aims to scrutinize mixed method research with a special emphasis on its philosophical development and models. The weaknesses and strengths of mixed method as a research paradigm are also touched upon. Finally, its use in educational sciences and future directions regarding the development of this research method are discussed.


  • Adaptation and psychometric evaluation of the COVID-19 stress scales in Turkish sample

    by Murat Doğan ŞAHİN, Sedat Şen, Deniz Güler

    This study aimed to adapt the COVID-19 Stress Scales (CSS) into Turkish and provide evidence for construct validity. For this purpose, firstly, Confirmatory factor analysis (CFA) was applied for the 5-factor model obtained during the development of CSS and the theoretically expected 6-factor model with total of 546 respondents. The findings revealed that the 6-factor model of CSS had a better fit in the Turkish sample. Factor loadings varied between .62 - .95 and correlations between subscales were between .44 - .76. Cronbach's Alpha and McDonald’s ω coefficients for each subscale indicated good-to-excellent internal consistency. To evaluate the criterion-related validity, the Turkish version of The Fear of COVID-19 Scale (FCV-19S) was administered to the participants and the correlation coefficients between this scale and the six subscale of CSS were calculated. We also conducted the Rasch analysis with related items to provide psychometric evidence for their unidimensional structure of each of the six subscales. Lastly, Differential item functioning (DIF) analysis was performed across subgroups by gender, having COVID-19, and being a student. Overall, the results of both CFA and Rasch analyses provided evidence to support the substantive aspect of validity and the appropriateness of the CSS as a measure of COVID-19 stress level in a Turkish sample.


  • Open Access

    Modeling skill-based foreign language learning anxieties as a single construct and testing its predictive aspect on foreign language classroom anxiety

    by Gökhan Öztürk, Murat Doğan Şahin, Elçin Ölmezer Öztürk, Belgin Elmas

    The aim of the current study was two-fold: i) to investigate whether four skill-based foreign language anxiety scales used in the literature can be confirmed as a single construct, and ii) to explore to what extent this potential single construct can explain foreign language classroom anxiety. The participants included 385 Turkish EFL learners in a university context and data collection instruments were four skill-based anxiety scales and the foreign language classroom anxiety scale (FLCAS). The results of the correlated traits and second order analysis revealed that four skill-based anxieties were confirmed as a single scale, referred to here as the skill-based foreign language learning anxiety scale (SB-FLLAS), measuring a latent variable, foreign language learning anxiety (FLLA). In addition, the SB-FLLAS explained these four anxieties with a high predictive degree on the FLCAS at 88%, demonstrated through structural equation modelling. The current study presents this new practical scale, which could be used in the measurement of skill-based anxieties, and suggests several practical and research implications for foreign language anxiety.


  • Yükseköğretimde Uzaktan Ölçme ve Değerlendirme Deneyimleri: Üç Devlet Üniversitesinden Bir Örnek

    by Beyza Aksu Dünya, Eren Can Aybek, Murat Doğan ŞAHİN

    Yüz yüze verilen derslerin salgından dolayı uzaktan eğitime aktarılması, iyi planlanmış, zamana yayılmış uzaktan eğitim uygulamalarından farklıdır. Bu nedenle, paydaş deneyimlerin iyi anlaşılmasının ve gereken sonuçların çıkarılarak, ders, bölüm ve kurum bazında ileriye dönük planlamaların yapılmasının faydalı olacağı düşünülmektedir. Bu planlamalar yapılırken, deneyimi dinlenilmesi gereken en önemli paydaşlar ise öğrencilerdir. Bu araştırmada betimsel tarama yöntemi ile öğrencilerin acil uzaktan eğitimle yürütülen Ölçme ve Değerlendirme derslerine dair deneyimleri incelenmiştir. Veri toplama basamağında, üç farklı devlet üniversitesinde, acil uzaktan eğitimle yürütülen Ölçme ve Değerlendirme derslerine kayıtlı lisans öğrencilerine, deneyimlerini anlamak amacıyla, anket uygulanmıştır. Analizler, anket maddelerine yanıt veren 144 öğrenciden elde edilen veriler üzerinde yürütülmüştür. Veriler analiz edilirken betimsel istatistiklerden ve parametrik olmayan testlerden yararlanılmıştır. Ayrıca ankette yer alan bir adet açık uçlu maddeye verilen öğrenci yanıtları da betimsel analiz yoluyla incelenmiştir. Buna göre, öğrencilerin çoğunlukla, dersteki ölçme ve değerlendirme uygulamalarının objektifliği ve uygunluğu konusunda olumlu görüş bildirdiği, ancak uzaktan sınav süresinin yeterliliği, elektronik kaynaklara erişim imkanları ve uzaktan sınavlara hazırlanma motivasyonu gibi başlıklarda ortalama olarak, daha düşük memnuniyete sahip oldukları saptanmıştır. Ayrıca öğrencilerin önemli bir kısmının uygulanan uzaktan ölçme değerlendirme yöntemlerinin derse uygunluğu ile ilgili olumlu deneyimlere sahip olduğu, olumsuz görüş bildirenlerin, ödevlerin sayıca fazlalığı ve ayrılan sürenin yetersizliğine ilişkin vurgular yaptığı görülmüştür.