Written Comments Made by Anesthesia Residents When Providing Below Average Scores for the Supervision Provided by the Faculty Anesthesiologist
- 1 June 2016
- journal article
- Published by Wolters Kluwer Health in Anesthesia & Analgesia
- Vol. 122 (6) , 2000-2006
Abstract
BACKGROUND: Anesthesia residents in our department evaluate the supervision provided by the faculty anesthesiologist with whom they worked the previous day. What advice managers can best provide to the faculty who receive below-average supervision scores is unknown. METHODS: The residents provided numerical answers (1 “never,” 2 “rarely,” 3 “frequently,” or 4 “always”) to each of the 9 supervision questions, resulting in a total supervision score. A written comment could also be provided. RESULTS: Over 2.5 years, the response rate to requests for evaluation was 99.1%. There were 13,664 evaluations of 76 faculty including 1387 comments. There were 25 evaluations with a comment of disrespectful behavior. For all 25, the question evaluating whether “the faculty treated me respectfully” was answered P < 0.0001). Each increase in the faculty’s number of comments of being disrespectful was associated with a lesser mean score (P = 0.0002). A low supervision score (P < 0.0001). The predictive value of the supervision score not being low for absence of a comment of disrespectful behavior was 99%. That finding was especially useful because 94% of scores below average (P < 0.0001). The 6 faculty with 1 such comment had lesser mean scores than the other faculty (P = 0.0071). There were 34 evaluations with a comment about poor-quality teaching. The evaluations related to poor teaching had lesser scores than the other evaluations with comments (P < 0.0001). The faculty who each received such a comment had lesser mean scores than the other faculty (P < 0.0001). Each increase in the faculty’s number of comments of poor-quality teaching was associated with a lesser mean score (P = 0.0002). The 9 supervision questions were internally consistent (Cronbach α = 0.948). A faculty with a comment about poor-quality teaching had significant odds of also having a comment about insufficient presence (P = 0.0044). A comment with negative sentiment had significant odds of being about poor-quality teaching rather than being about insufficient presence (odds ratio, 6.00; P < 0.0001). CONCLUSIONS: A faculty who has insufficient presence cannot be providing good teaching. Furthermore, there was negligible correlation between supervision scores and faculty clinical assignments. Thus, insufficient faculty presence accounted for a small proportion of below-average supervision scores and low-quality supervision. Furthermore, scores ≥3 have a predictive value for the absence of disrespectful behavior ≅99%. Approximately 94% of the faculty supervision scores that were below average were still ≥3. Consequently, for the vast majority of the faculty-resident-days, quality of teaching distinguished between below- versus above-average supervision scores. This result is consistent with our prior finding of a strong correlation between 6-month supervision scores and assessments of teaching effectiveness. Taken together, when individual faculty anesthesiologists are counseled about their clinical supervision scores, the attribute to emphasize is quality of clinical teaching.Keywords
This publication has 20 references indexed in Scilit:
- Quality of Supervision as an Independent Contributor to an Anesthesiologist’s Individual Clinical ValueAnesthesia & Analgesia, 2015
- Reliability and Validity of the Anesthesiologist Supervision Instrument When Certified Registered Nurse Anesthetists Provide ScoresAnesthesia & Analgesia, 2015
- Reliability and Validity of Assessing Subspecialty Level of Faculty Anesthesiologists’ Supervision of Anesthesiology ResidentsAnesthesia & Analgesia, 2015
- Anesthesia Residents’ Global (Departmental) Evaluation of Faculty Anesthesiologists’ Supervision Can Be Less Than Their Average Evaluations of Individual AnesthesiologistsAnesthesia & Analgesia, 2015
- Bernoulli Cumulative Sum (CUSUM) Control Charts for Monitoring of Anesthesiologists’ Performance in Supervising Anesthesia Residents and Nurse AnesthetistsAnesthesia & Analgesia, 2014
- Influence of Provider Type (Nurse Anesthetist or Resident Physician), Staff Assignments, and Other Covariates on Daily Evaluations of Anesthesiologists’ Quality of SupervisionAnesthesia & Analgesia, 2014
- Anesthesiology Residents’ and Nurse Anesthetists’ Perceptions of Effective Clinical Faculty Supervision by AnesthesiologistsAnesthesia & Analgesia, 2013
- Determinants, Associations, and Psychometric Properties of Resident Assessments of Anesthesiologist Operating Room SupervisionAnesthesia & Analgesia, 2013
- The Association Between Frequency of Self-Reported Medical Errors and Anesthesia Trainee SupervisionAnesthesia & Analgesia, 2013
- An Instrument Designed for Faculty Supervision Evaluation by Anesthesia Residents and Its Psychometric PropertiesAnesthesia & Analgesia, 2008