Validation Of An Observation Instrument For Measuring Student Engagement In Health Professions Settings
Authors:
- Charles L. SeidelCSCharles L. Seidel
- Robert O. MorganRMRobert O. Morgan
- 1 March 2003
- journal article
- research article
- Published by SAGE Publications in Evaluation & the Health Professions
- Vol. 26 (1) , 86-103
Abstract
Documenting student engagement has received increased emphasis in medical schools, as teaching strategies are changing to include more student-to-student interactions. The purpose of this study was to develop and evaluate a measure of student engagement completed by independent observers that would not interfere with student learning time. Data from 3,182 observations completed by nine observers in 32 educational classroom settings with 23 different instructors were used to evaluate the interobserver reliability and gather validity evidence for our observational instrument, named the STROBE. Results indicated that interobserver agreement was good to excellent when observations were conducted simultaneously on randomly selected students in the same classroom (84% average agreement and 0.79 average kappa coefficient) and when observations were conducted on different randomly selected students (79% average agreement). Results also provided strong evidence for validity. Overall, findings indicate that the STROBE demonstrates promise for educational research and evaluation by documenting student engagement in medical education settings.Keywords
This publication has 11 references indexed in Scilit:
- An Initial Experience with “Team Learning” in Medical EducationAcademic Medicine, 2002
- Self-directed learning in population healthAmerican Journal of Preventive Medicine, 2002
- Application of Team Learning in a Medical Physiology CourseAcademic Medicine, 2001
- Effectiveness of Problem-based Learning CurriculaAcademic Medicine, 2000
- Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year.Journal of Educational Psychology, 1993
- Assessing the reliability of clinical scales when the data have both nominal and ordinal features: Proposed guidelines for neuropsychological assessmentsJournal of Clinical and Experimental Neuropsychology, 1992
- A study of the relationship among type and quality of implementation of science teaching strategy, student formal reasoning ability, and student engagementJournal of Research in Science Teaching, 1985
- The relationship among teacher classroom management behavior, student engagement, and student achievement of middle and high school science students of varying aptitudeJournal of Research in Science Teaching, 1984
- A Study of Engaged Student Behavior within Classroom Activities during Mathematics ClassThe Journal of Educational Research, 1983
- Behavioral Observation for the School Psychologist: Responsive-Discrepancy ModelSchool Psychology Review, 1980