Neşe GÜLER

This research aimed to exemplify the use of the Rasch model in the analysis of data on ranking judgments. To this end, in the study, we delineated in detail all the processes related to the Rasch analysis, from the preparation of the data file to the interpretation of the analysis outputs. Besides, we compered the Rasch analysis results with the outputs obtained from traditional method. We conducted our study on 261 secondary school students. We collected the research data by employing an instrument containing five stimuli regarding the positive aspects and limitations of the mathematics homework. We asked students to rank the positive aspects of the homework by coding the most prominent advantage with 1 and the last advantage with 5. Similarly, we requested them to put in order the limitations of the homework by coding the foremost limitation with 1 and the last limitation with 5. We analyzed the research data according to both the Rasch model and traditional method. Research results revealed that the agreement between the stimuli’s scale values obtained from the Rasch analysis and from the traditional method was high. Considering this result and that the Rasch model is a more practical option in terms of the analysis process, we can suggested researchers to prefer Rasch model instead of the traditional method in the analysis of data based on ranking judgments.

This study aimed to examine the effects of reverse items created with different strategies on psychometric properties and respondents’ scale scores. To this end, three versions of a 10-item scale in the research were developed: 10 positive items were integrated in the first form (Form-P) and five positive and five reverse items in the other two forms. The reverse items in the second and third forms were crafted using antonyms (Form-RA) and negations (Form-RN), respectively. Based on the research results, Form-P was unidimensional, while other forms were two-dimensional. Moreover, although reliability coefficients of all forms were obtained as above .80, the lowest one was acquired for Form-RN. There were strong-positive relationships between students’ scores in the three scale forms. However, the lowest one was estimated between Form-P and Form-RN. Finally, there was a significant difference between the students’ mean scores obtained from Form–RN and other two versions, but the effect size of the said difference was small. In conclusion, all these results indicate that different types of reverse items influence psychometric properties and respondents’ scale scores differently.

This study has two main purposes. Firstly, to compare the different item selection methods and stopping rules used in Computerized Adaptive Testing (CAT) applications with simulative data generated based on the item parameters of the Vocational Maturity Scale. Secondly, to test the validity of CAT application scores. For the first purpose, simulative data produced based on Vocational Maturity Scale item parameters were analyzed under different item selection methods (Maximum Fisher Information [MFI],Maximum Likelihood Weighted Information [MLWI] Maximum Posterior Weighted Information [MPWI] Maximum Expected Information [MEI] Minimum Expected Posterior Variance [MEPV] Maximum Expected Posterior Weighted Information [MEPWI]) and stopping rules (Standard Error [SE]<0.30, SE<0.50, SE <0.70, Number of Item [NI]=10, NI=20) by calculating the average number of items, standard error averages, correlation coefficients, bias, and RMSE statistics. For all the conditions of the item selection methods, standard error averages, correlation coefficients, bias, and RMSE statistics showed similar results. When the average number of items is considered, MFI and SE<0.30 were found as most appropriate methods to be used in CAT application. For the second purpose of the study, the paper-pencil form of the Vocational Maturity scale and CAT version were administered to 33 students. A moderate, positive, and statistically significant relationship was found between the CAT application scores and the paper-pencil form scores on the vocational maturity scale. As a result, it can be said that the vocational maturity scale can be applied as a computerized adaptive test and can be used in career guidance processes.

Bu araştırmada, çoktan seçmeli maddeler için uzmanlarca öngörülen ve ampirik olarak hesaplanan güçlük indekslerinin karşılaştırılması amaçlanmıştır. Araştırmanın katılımcıları; ölçme ve değerlendirme alanından 10 uzman ile Türkiye’de bir devlet üniversitesinin eğitim fakültesinde öğrenim gören 222 öğretmen adayından oluşmuştur. Çalışmanın verileri araştırmacılar tarafından geliştirilen ve çoktan seçmeli 25 madde içeren ölçme değerlendirme başarı testi ile toplanmıştır. Araştırma sonuçları, uzman kanılarına dayalı madde güçlükleri ile ampirik olarak hesaplanan güçlük indeksleri arasında .25 ile .71 arasında değişen pozitif yönlü korelasyonlar bulunduğunu ortaya koymuştur. Fakat elde edilen korelasyon katsayıları arasında uzmanların unvanlarına ya da daha önce ilgili dersi yürütüp yürütmemelerine bağlanabilecek net bir örüntü gözlenmemiştir.

This study analyses teachers’ viewpoints on the potential undesirable influences of high stake exams. Seven stimulants related to undesirable influences of high stake exams on education were given to 191 teachers in a pairwise comparisons format. The participating teachers in this study were asked to choose one undesirable influence by comparing the stimulants given to them in pairwise and to determine the more prominent problem stemming from high stake exams. Data were analyzed via many-facet Rasch model. As a result, it was found that teachers considered the stimulant “school assessments turn into secondary importance in the eyes of students and parents” as the foremost problem stemming from high stake exams. On the other hand, the stimulant “administors focus on policies for increasing exam scores instead of policies for improving the learning–teaching process” ranked the last in the undesirable influences of high stake exams.

Bir bilimsel çalışmanın içeriği kadar o çalışmanın nasıl yapıldığı da önemli bir husustur. Özellikle bir bilimsel çalışmanın kuramsal yapısı,hangi yöntemle yapıldığı, o çalışma için gerekli olan verilerin nasıl toplandığı,verilerin nasıl analiz edildiği ve yoruml

In this study, it was aimed to adapt the Statistical Anxiety Scale (SAS) developed for graduate students by Faber, Drexler, Stappert and Eichhorn to Turkish. The research was carried out on 375 students attending graduate education in any field in Turkey. In the study, construct validity of the SAS was investigated via exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Parallel analysis method was also used in making decision about factor number of the scale. In the EFA and parallel analysis, a unidimensional structure was obtained in line with the results acquired in the factor analysis of the original form of the SAS. However; since the original form of the SAS was designed by foreseeing a three-dimensional structure of worry, avoidance and emotionality, both unidimensional and three-dimensional structures were tested in CFA. The fit indices reported in CFA were found to be within acceptable limits for both models. In the reliability analysis, Cronbach Alpha internal consistency coefficient was calculated as .91 for the whole scale, and it was found to be .91, .83, and .91 for worry, avoidance and emotionality dimensions, respectively. It was determined that item correlations exceed the lower limit of .30 for all items in the scale. Ferguson Delta statistic, which provide evidence for the discriminatory power of the entire scale, was determined as .98. These results suggest that the Turkish form of the SAS yields valid and reliable measures.

One of the important theories in education and psychology is Generalizability (G) Theory and various properties distinguish it from the other measurement theories. To better understand methodological trends of G theory, a thematic content analysis was conducted. This study analyzes the studies using generalizability theory in the field of education in Turkey by using the method of thematic content analysis. It reviews 60 studies, including 31 articles and 29 theses published from 2004 to 2017. The selected studies underwent thematic content analysis using parameters including tagged information, aim, G Theory type, number of facets used in the study, Turkish word for “facet,” object of measurement, sample size, design type, mixed-design availability, shared results of G and D studies, computer programs, method of calculating negative variance, availability of fixed facets, and design balance. The data were interpreted on the basis of frequencies; both table and figures are included in the study. According to the results, there is an increase in the number of studies conducted by using G theory by years. Of these, many compare theories; most of them applying univariate G Theory and consider two-faceted measurement situations. While a small subset of studies features mixed design, a large group features crossed design, with individuals as the object of measurement. The computer program most commonly used in analyses is EduG. The majority of studies use balanced design. Recommendations are provided accordingly with the results.

Bu araştırmanın amacı, altıncı sınıf fen bilimleri ders kitabında yer alan sekiz ünitenin içerisinde bulunan etkinliklerin çok yüzeyli Rasch ölçme modeli ile incelenmesidir. Araştırmada yapılandırmacı eğitimin, öğrenciyi merkeze alma ve üründen çok süreci değerlendirmeye yönelik tutumunun etkin kullanım alanı olan etkinliklere odaklanılmıştır. Araştırmada fen bilimleri dersi 6. sınıf ders kitabında yer alan sekiz etkinlik; üçü fen bilimleri, üçü program geliştirme ve üçü ölçme ve değerlendirme olmak üzere toplam dokuz alan uzmanından oluşan puanlayıcılar tarafından incelenmiştir. Puanlayıcılar etkinlikleri 13 ölçütten oluşan etkinlik değerlendirme formu ile değerlendirmişlerdir. Elde edilen bulgulara göre puanlayıcılar etkinlikleri tutarlı olarak puanlamışlardır. Etkinliklerin, değerlendirme ölçütlerine göre benzer özelliklere sahip olduğu ve ölçütlerin ise güçlük düzeyleri açısında farklılık gösterdikleri bulguları elde edilmiştir. Ayrıca, ölçütlerin kategori düzeylerinin yeterli ve uygun işlev gösterdikleri belirlenmiştir. Çalışmadan elde edilen tüm bulgulara göre; birden fazla yüzeyin yer aldığı ve tüm yüzeylerin ayrıntılı olarak incelenmek istendiği çalışmalarda çok yüzeyli Rasch ölçme modelinin oldukça açıklayıcı ve faydalı sonuçlar sağladığı sonucuna varılmıştır.

Problem Durumu: Klasik test kuramı (KTK) ve çok yüzeyli Rasch modeli (ÇYRM) arasındaki kuramsal farklılıklar alanyazında geniş bir yer tutmasına rağmen bu