Abstract
BACKGROUND Information gathering is the foundational skill of clinical reasoning. However, residents and attending physicians have no objective insights into the competencies of residents in developing skills in information gathering in the electronic health record (EHR). The EHR audit logs, time stamped records of user activities, can provide a wealth of information about how residents gather information about patients at the time of admissions and throughout daily rounding. OBJECTIVE In this study, our goals were to: 1. Understand and delineate attending physician expectations of residents’ EHR-based information gathering activities at different stages of residency, 2. Develop a system, referred to as the Trainee Digital Growth Chart (a.k.a Growth Chart), using the EHR audit logs to audit and feed back information gathering performance to residents and their attending physicians, and 3. Pilot the Growth Chart among pediatric residents on pediatric hospital medicine (PHM) rotations to understand whether audit and feedback data on EHR-based information gathering is helpful in supporting resident learning and assessment. METHODS We convened a focus group of PHM attending physicians to establish information gathering benchmarks for residents at each stage of their training. Residents and attendings were involved in the co-design of an information gathering performance electronic dashboard called the Trainee Digital Growth Chart. This dashboard was piloted in an observational cohort study among PHM residents and attending physicians during the 2023-24 academic year. RESULTS Considerable variability was observed as focus group attendings established training-stage specific benchmarks. During the pilot, resident and attending logged into the Growth Chart to observe performance at moderate to high rates. However, despite their involvement in its co-design, most participants did not find great value in the Growth Chart. However, as an intervention, viewing prior Growth Chart information gathering performance had a positive impact on future information gathering performance among first year residents on daily rounds when that performance was also discussed with an attending physician. CONCLUSIONS Information gathering is at the foundation of clinical reasoning. However, no competency-based benchmarks for information gathering in the EHR exist. Opportunities to leverage the EHR audit logs exist to feed back performance information to trainees, thereby influencing future information gathering behaviors. This is particularly powerful when done early in training before habits become formed, and when done in conjunction with verbal review with an attending physician. Such tools must find their way into routine clinical workflows and be capable of providing real time or near real time feedback before perceived educational value will be realized. Nevertheless, these approaches have broad potential to scale across specialties and allied health disciplines.