A Multilevel Factor Analysis of Students’ Evaluations of Teaching
- 1 April 2005
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 65 (2) , 272-296
Abstract
This study examined the factorial validity of scores on the newly developed Students’ Evaluation of Teaching Effectiveness Rating Scale (SETERS) through a series of confirmatory and multilevel structures. Conventional confirmatory factor analyses using the total covariance and pooled within-covariance matrices from two midwestern universities indicated that a reduced 25-item SETERS fit the data better than the original 34-item SETERS. Furthermore, multilevel factor analysis was conducted on the combined samples. This analysis suggested that one or three factors at the between and within levels were a plausible representation of SETERS scores. Pearson's correlations between individual scores on the SETERS and the Students’Evaluation of Educational Quality questionnaire provided additional validity evidence for the two measures. The need for additional empirical research on the SETERS before widespread use is discussed.Keywords
This publication has 18 references indexed in Scilit:
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Structural equation modeling: Back to basicsStructural Equation Modeling: A Multidisciplinary Journal, 1997
- A didactic example of multilevel structural equation modeling applicable to the study of organizationsStructural Equation Modeling: A Multidisciplinary Journal, 1997
- Multilevel Covariance Structure AnalysisSociological Methods & Research, 1994
- Multilevel Factor Analysis of Class and Student Achievement ComponentsJournal of Educational Measurement, 1991
- Measuring Student's Perceptions of Teaching: Dimensions of EvaluationEducational and Psychological Measurement, 1986
- The Factorial Invariance of Student Evaluations of College TeachingAmerican Educational Research Journal, 1984
- Multidimensional ratings of teaching effectiveness by students from different academic settings and their relation to student/course/instructor characteristics.Journal of Educational Psychology, 1983
- The Validity of Students’ Evaluations: Classroom Evaluations of Instructors Independently Nominated As Best and Worst Teachers by Graduating SeniorsAmerican Educational Research Journal, 1977
- Validity and usefulness of student evaluations of instructional quality.Journal of Educational Psychology, 1975