Availability of cookies during an academic course session affects evaluation of teaching
- 29 June 2018
- journal article
- research article
- Published by Wiley in Medical Education
- Vol. 52 (10) , 1064-1072
Abstract
Objectives: Results from end‐of‐course student evaluations of teaching ( SET s) are taken seriously by faculties and form part of a decision base for the recruitment of academic staff, the distribution of funds and changes to curricula. However, there is some doubt as to whether these evaluation instruments accurately measure the quality of course content, teaching and knowledge transfer. We investigated whether the provision of chocolate cookies as a content‐unrelated intervention influences SET results. Methods: We performed a randomised controlled trial in the setting of a curricular emergency medicine course. Participants were 118 third‐year medical students. Participants were randomly allocated into 20 groups, 10 of which had free access to 500 g of chocolate cookies during an emergency medicine course session (cookie group) and 10 of which did not (control group). All groups were taught by the same teachers. Educational content and course material were the same for both groups. After the course, all students were asked to complete a 38‐question evaluation form. Results: A total of 112 students completed the evaluation form. The cookie group evaluated teachers significantly better than the control group (113.4 ± 4.9 versus 109.2 ± 7.3; p = 0.001, effect size 0.68). Course material was considered better (10.1 ± 2.3 versus 8.4 ± 2.8; p = 0.001, effect size 0.66) and summation scores evaluating the course overall were significantly higher (224.5 ± 12.5 versus 217.2 ± 16.1; p = 0.008, effect size 0.51) in the cookie group. Conclusions: The provision of chocolate cookies had a significant effect on course evaluation. These findings question the validity of SET s and their use in making widespread decisions within a faculty.Keywords
Funding Information
- Department of Anaesthesiology
- Intensive Care and Pain Medicine
- University Hospital of Münster
- Ethics Committee of the University of Münster
- German Clinical Trials Register (DRKS00012353)
This publication has 26 references indexed in Scilit:
- Everyday Eating Experiences of Chocolate and Non-Chocolate Snacks Impact Postprandial Anxiety, Energy and Emotional StatesNutrients, 2012
- What Factors Affect Studentsʼ Overall Ratings of a Course?Academic Medicine, 2011
- Extraneous factors in judicial decisionsProceedings of the National Academy of Sciences, 2011
- Analgesia Accompanying Food Consumption Requires Ingestion of Hedonic FoodsJournal of Neuroscience, 2009
- Attractiveness, easiness and other issues: student evaluations of professors on Ratemyprofessors.comAssessment & Evaluation in Higher Education, 2007
- How Do Student Ratings Measure Up to a New Validity Framework?New Directions for Institutional Research, 2001
- Is There Gender Bias in Student Evaluations of Teaching?The Journal of Higher Education, 2000
- Grades and student evaluations of teachersEconomics of Education Review, 1999
- Correlation between student satisfaction and grades: A case of mistaken causation?Journal of Educational Psychology, 1980
- Coefficient Alpha and the Internal Structure of TestsPsychometrika, 1951