Cherdsak Iramaneerat

An Objective Structured Clinical Examination (OSCE) is an effective method for evaluating competencies. However, scores obtained from an OSCE are vulnerable to many potential measurement errors that cases, items, or standardized patients (SPs) can introduce. Monitoring these sources of errors is an important quality control mechanism to ensure valid interpretations of the scores. We describe how one can use generalizability theory (GT) and many-faceted Rasch measurement (MFRM) approaches in quality control monitoring of an OSCE. We examined the communication skills OSCE of 79 residents from one Midwestern university in the United States. Each resident performed six communication tasks with SPs, who rated the performance of each resident using 18 5-category rating scale items. We analyzed their ratings with generalizability and MFRM studies. The generalizability study revealed that the largest source of error variance besides the residual error variance was SPs/cases. The MFRM study identified specific SPs/cases and items that introduced measurement errors and suggested the nature of the errors. SPs/cases were significantly different in their levels of severity/difficulty. Two SPs gave inconsistent ratings, which suggested problems related to the ways they portrayed the case, their understanding of the rating scale, and/or the case content. SPs interpreted two of the items inconsistently, and the rating scales for two items did not function as 5-category scales. We concluded that generalizability and MFRM analyses provided useful complementary information for monitoring and improving the quality of an OSCE.

The present report summarizes challenges in teaching medical ethics, defines its goals, describes theoretical frameworks for moral education, and reviews strategies for teaching medical ethics to serve as guidelines in developing medical ethics instruction. Medical teachers should clarify the instructional goals in cognitive, attitudinal, and behavioral domains. The cognitive developmental and behavior-analytic theories called for ethical instruction using a series of discussions based on real-life ethical dilemmas while pointing out all the basic rules related to medical practice. Ethical courses for medical students should be student-centered, problem-based, and integrative. Ethical instruction should be systematically taught to every student, but additional elective courses could also be used. Moral education for residents should be more focused to issues specific to their specialties. Medical researchers need both formal ethical training and informal teaching, and role modeling. Finally, experienced staff could use small group discussions of shared ethical problems to maintain their ethical knowledge and skills.

The present study investigated whether high school grades can predict medical school grades after controlling for the effects of demographics and entrance examination scores. The authors used hierarchical multiple regression analyses to predict medical school grades of 223 medical students in the 1997 entering class of the Faculty of Medicine Siriraj Hospital, Thailand, using age, gender, entrance examination scores, and high school grades as predictors. After controlling for demographics and entrance examination scores, high school grades provided significant prediction only for premedical grades. The type of entrance examination that students took and the type of high school curriculum that the students studied were significant predictors of medical school grades in every level. Measures of cognitive abilities in academic content were good in predicting short-term academic achievement. Long-term academic achievement in the medical school could be better predicted from academic orientation, commitment to the medical study, and demographic traits.