DTDario M. Torre

Dario M. Torre

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Dario M. Torre has a total of 47 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Gathering Validity Evidence on an Internal Medicine Clerkship Multistep Exam to Assess Medical Student Analytic Ability

    by Dario M. Torre, Paul A. Hemmer, Steven J. Durning, Ting Dong, Kimberly Swygert, Deanna Schreiber-Gregory, William F. Kelly, Louis N. Pangaro

    Construct: The definition of clinical reasoning may vary among health profession educators. However, for the purpose of this paper, clinical reasoning is defined as the cognitive processes that are involved in the steps of information gathering, problem representation, generating a differential diagnosis, providing a diagnostic justification to arrive at a leading diagnosis, and formulating diagnostic and management plans. Background: Expert performance in clinical reasoning is essential for success as a physician, and has been difficult for clerkship directors to observe and quantify in a way that fosters the instruction and assessment of clinical reasoning. The purpose of this study was to gather validity evidence for the Multistep exam (MSX) format used by our medicine clerkship to assess analytical clinical reasoning abilities; we did this by examining the relationship between scores on the MSX and other external measures of clinical reasoning abilities. This analysis used dual process theory as the main theoretical framework of clinical reasoning, as well as aspects of Kane's validity framework to guide the selection of validity evidence for the investigation. We hypothesized that there would be an association between the MSX (a three-step clinical reasoning tool developed locally), and the USMLE Step 2 CS, as they share similar concepts in assessing the clinical reasoning of students. We examined the relationship between overall scores on the MSX and the Step 2 CS Integrated Clinical Encounter (ICE) score, in which the student articulates their reasoning for simulated patient cases, while controlling for examinee's internal medicine clerkship performance measures such as the NBME subject exam score and the Medicine clerkship OSCE score. Approach: A total 477 of 487 (97.9%) medical students, representing the graduating classes of 2015, 2016, 2017, who took the MSX at the end of each medicine clerkship (2012-2016), and Step 2 CS (2013-2017) were included in this study. Correlation analysis and multiple linear regression analysis were used to examine the impact of the primary explanatory variables of interest (MSX) onto the outcome variable (ICE score) when controlling for baseline variables (Medicine OSCE and NBME Medicine subject exam). Findings: The overall MSX score had a significant, positive correlation with the Step 2 CS ICE score (r = .26, P < .01). The overall MSX score was a significant predictor of Step 2 CS ICE score (ss = .19, P < .001), explaining an additional 4% of the variance of ICE beyond the NBME Medicine subject score and the Medicine OSCE score (Adjusted R-2 = 13%). Conclusion: The stepwise format of the MSX provides a tool to observe clinical reasoning performance, which can be used in an assessment system to provide feedback to students on their analytical clinical reasoning. Future studies should focus on gaining additional validity evidence across different learners and multiple medical schools.


  • Understanding context specificity: the effect of contextual factors on clinical reasoning

    by Abigail Konopasky, Anthony R. Artino, Alexis Battista, Megan Ohmer, Paul A. Hemmer, Dario Torre, Divya Ramani, Jeroen van Merrienboer, Pim W. Teunissen, Elexis McBee, et al.

    Background: Situated cognition theory argues that thinking is inextricably situated in a context. In clinical reasoning, this can lead to context specificity : a physician arriving at two different diagnoses for two patients with the same symptoms, findings, and diagnosis but different contextual factors (something beyond case content potentially influencing reasoning). This paper experimentally investigates the presence of and mechanisms behind context specificity by measuring differences in clinical reasoning performance in cases with and without contextual factors. Methods: An experimental study was conducted in 2018–2019 with 39 resident and attending physicians in internal medicine. Participants viewed two outpatient clinic video cases (unstable angina and diabetes mellitus), one with distracting contextual factors and one without. After viewing each case, participants responded to six open-ended diagnostic items (e.g. problem list, leading diagnosis) and rated their cognitive load. Results: Multivariate analysis of covariance (MANCOVA) results revealed significant differences in angina case performance with and without contextual factors [Pillai’s trace = 0.72, F = 12.4, df =(6, 29), p  <  0.001, η p 2 = 0.72 $\eta _{\rm p}^2 = 0.72$ ], with follow-up univariate analyses indicating that participants performed statistically significantly worse in cases with contextual factors on five of six items. There were no significant differences in diabetes cases between conditions. There was no statistically significant difference in cognitive load between conditions. Conclusions: Using typical presentations of common diagnoses, and contextual factors typical for clinical practice, we provide ecologically valid evidence for the theoretically predicted negative effects of context specificity (i.e. for the angina case), with large effect sizes, offering insight into the persistence of diagnostic error.


  • Open Access

    Situativity: a family of social cognitive theories for understanding clinical reasoning and diagnostic error

    by Jerusalem Merkebu, Michael Battistone, Kevin McMains, Kathrine McOwen, Catherine Witkop, Abigail Konopasky, Dario Torre, Eric Holmboe, Steven J. Durning

    The diagnostic error crisis suggests a shift in how we view clinical reasoning and may be vital for transforming how we view clinical encounters. Building upon the literature, we propose clinical reasoning and error are context-specific and proceed to advance a family of theories that represent a model outlining the complex interplay of physician, patient, and environmental factors driving clinical reasoning and error. These contemporary social cognitive theories (i.e. embedded cognition, ecological psychology, situated cognition, and distributed cognition) can emphasize the dynamic interactions occurring amongst participants in particular settings. The situational determinants that contribute to diagnostic error are also explored.


  • Widening the lens on teaching and assessing clinical reasoning: from “in the head” to “out in the world”

    by Dario Torre, Steven J. Durning, Joseph Rencic, Valerie Lang, Eric Holmboe, Michelle Daniel

    Traditional teaching and assessment of clinical reasoning has focused on the individual clinician because of the preeminence of the information processing (IP) theory perspective. The clinician’s mind has been viewed as the main source of effective or ineffective reasoning, and other participants, the environment and their interactions have been largely ignored. A social cognitive theoretical lens could enhance our understanding of how reasoning and error and the environment are linked. Therefore, a new approach in which the clinical reasoning process is situated and examined within the context may be required. The theories of embodied cognition, ecological psychology, situated cognition (SitCog) and distributed cognition (DCog) offer new insights to help the teacher and assessor enhance the quality of clinical reasoning instruction and assessment. We describe the teaching and assessment implications of clinical reasoning and error through the lens of this family of theories. Direct observation in different contexts focused on individual and team performance, simulation (with or without enhancement of technology), stimulated recall, think-aloud, and modeling are examples of teaching and assessment strategies grounded in this family of social cognitive theories. Educators may consider the instructional design of learning environments and educational tools that promote a situated educational approach to the teaching and assessment of clinical reasoning.


  • Exploring the Predictors of Post-Clerkship USMLE Step 1 Scores

    by Dario M. Torre, Ting Dong, Deanna Schreiber-Gregory, Steven J. Durning, Louis Pangaro, Arnyce Pock, Paul A. Hemmer

    Theory: We used two theoretical frameworks for this study: a) experiential learning, whereby learners construct new knowledge based on prior experience, and learning grows out of a continuous process of reconstructing experience, and b) deliberate practice, whereby the use of testing (test-enhanced learning) promotes learning and produces better long-term retention. Hypothesis: We hypothesized that moving the USMLE Step 1 exam to follow the clerkship year would provide students with a context for basic science learning that may enhance exam performance. We also hypothesized that examination performance variables, specifically National Board of Medical Examiners (NBME) Customized Basic Science Examinations and NBME subject examinations in clinical disciplines would account for a moderate to large amount of the variance in Step 1 scores. Thus we examined predictors of USMLE Step 1 scores when taken after the core clerkship year. Method: In 2011, we revised our medical school curriculum and moved the timing of Step 1 to follow the clerkship year. We performed descriptive statistics, an ANCOVA to compare Step 1 mean scores for three graduating classes of medical students before and after the curriculum changes, and stepwise linear regression to investigate the association between independent variables and the primary outcome measure after curriculum changes. Results: 993 students took the Step 1 exam, which included graduating classes before (2012-2014, N = 491) and after (2015-2017, N = 502) the curriculum change. Step 1 scores increased significantly following curricular revision (mean 218, SD 18.2, vs. 228, SD 16.7, p < 0.01) after controlling for MCAT and undergraduate GPA. Overall, 66.4% of the variance in Step 1 scores after the clerkship year was explained by: the mean score on fourteen pre-clerkship customized NBME exams (p < 0.01, 57.0% R2); performance on the surgery NBME subject exam (p < 0.01, 3.0% R2); the pediatrics NBME subject exam (p < 0.01, 2.0% R2); the Comprehensive Basic Science Self-Assessment (p < .01, 2.0% R2) ; the internal medicine NBME subject exam (p < 0.01, 0.03% R2), pre-clerkship Integrated Clinical Skills score (p < 0.01, 0.05% R2), and the pre-matriculation MCAT (p < 0.01, 0.01% R2). Conclusion: In our institution, nearly two-thirds of the variance in performance on Step 1 taken after the clerkship year was explained mainly by pre-clerkship variables, with a smaller contribution emanating from clerkship measures. Further study is needed to uncover the specific aspects of the clerkship experience that might contribute to success on high stakes licensing exam performance.


  • Theoretical considerations on programmatic assessment

    by Dario M. Torre, L. W. T. Schuwirth, C. P. M. Van der Vleuten

    Introduction: Programmatic assessment (PA) is an approach to assessment aimed at optimizing learning which continues to gain educational momentum. However, the theoretical underpinnings of PA have not been clearly described. An explanation of the theoretical underpinnings of PA will allow educators to gain a better understanding of this approach and, perhaps, facilitate its use and effective implementation. The purpose of this article is twofold: first, to describe salient theoretical perspectives on PA; second to examine how theory may help educators to develop effective PA programs, helping to overcome challenges around PA. Results: We outline a number of learning theories that underpin key educational principles of PA: constructivist and social constructivist theory supporting meaning making, and longitudinality; cognitivist and cognitive development orientation scaffolding the practice of a continuous feedback process; theory of instructional design underpinning assessment as learning; self-determination theory (SDT), self-regulation learning theory (SRL), and principles of deliberate practice providing theoretical tenets for student agency and accountability. Conclusion: The construction of a plausible and coherent link between key educational principles of PA and learning theories should enable educators to pose new and important inquiries, reflect on their assessment practices and help overcome future challenges in the development and implementation of PA in their programs.


  • Open Access

    Trust in Group Decisions: a scoping review

    by Jason E. Sapp, Dario M. Torre, Kelsey L. Larsen, Eric S. Holmboe, Steven J. Durning

    Trust is a critical component of competency committees given their high-stakes decisions. Research from outside of medicine on group trust has not focused on trust in group decisions, and “group trust” has not been clearly defined. The purpose was twofold: to examine the definition of trust in the context of group decisions and to explore what factors may influence trust from the perspective of those who rely on competency committees through a proposed group trust model. The authors conducted a literature search of four online databases, seeking articles published on trust in group settings. Reviewers extracted, coded, and analyzed key data including definitions of trust and factors pertaining to group trust. The authors selected 42 articles for full text review. Although reviewers found multiple general definitions of trust, they were unable to find a clear definition of group trust and propose the following: a group-directed willingness to accept vulnerability to actions of the members based on the expectation that members will perform a particular action important to the group, encompassing social exchange, collective perceptions, and interpersonal trust. Additionally, the authors propose a model encompassing individual level factors (trustor and trustee), interpersonal interactions, group level factors (structure and processes), and environmental factors. Higher degrees of trust at the individual and group levels have been associated with attitudinal and performance outcomes, such as quality of group decisions. Developing a deeper understanding of trust in competency committees may help these committees implement more effective and meaningful processes to make collective decisions.


  • Open Access

    The Clinical Reasoning Mapping Exercise (CResME): a new tool for exploring clinical reasoning

    by Dario M. Torre, Caridad A. Hernandez, Analia Castiglioni, Steven J. Durning, Barbara J. Daley, Paul A. Hemmer, Jeffrey LaRochelle

    Introduction National organizations have identified a need for the creation of novel approaches to teach clinical reasoning throughout medical education. The aim of this project was to develop, implement and evaluate a novel clinical reasoning mapping exercise (CResME). Methods Participants included a convenience sample of first and second year medical students at two US medical schools: University of Central Florida (UCF) and Uniformed Services University of Health Sciences (USUHS). The authors describe the creation and implementation of the CResME. The CResME uses clinical information for multiple disease entities as nodes in different domains (history, physical exam, imaging, laboratory results, etc.), requiring learners to connect these nodes of information in an accurate and meaningful way to develop diagnostic and/or management plans in the process. Results The majority of medical students at both institutions felt that the CResME promoted their understanding of the differential diagnosis and was a valuable tool to compare and contrast elements of a differential diagnosis. Students at both institutions recommended using the CResME for future sessions. Discussion The CResME is a promising tool to foster students’ clinical reasoning early in medical school. Research is needed on the implementation of the CResME as an instructional and assessment strategy for clinical reasoning throughout medical school training.


  • Open Access

    Untying the Gordian knot: remediation problems in medical schools that need remediation

    by Layne D. Bennion, Steven J. Durning, Jeffrey LaRochelle, Michelle Yoon, Deanna Schreiber-Gregory, Brian V. Reamy, Dario Torre

    This position paper discusses on-going academic remediation challenges within the field of medical education. More specifically, we identify three common contemporary problems and propose four recommendations to strengthen remediation efforts. Selecting or determining what type of remediation is needed for a particular student is akin to analyzing a Gordian knot with individual, institutional and systemic contributors. More emphasis, including multi-institutional projects and research funding is needed. Recommendations regarding language use and marketing of such programs are given.


  • Open Access

    Learning at large conferences: from the ‘sage on the stage’ to contemporary models of learning

    by Dario Torre, Annalisa Manca, Steven Durning, Janusz Janczukowicz, David Taylor, Jennifer Cleland

    Aim To explore and evaluate the affordances of a flipped classroom model applied to a research paper session within the professional development opportunity of a large conference setting. Method Authors were invited to present their research papers in a flipped classroom presentation format at two large, multi-national conferences. Before the session, authors and moderators met online to clarify features of the session, and preparation of the material. The research material was then posted online before the conference, to allow access by meeting attendees. During the sessions, moderators encouraged the audience to actively participate. An evaluation form was collected from the audience at the end of each session. Results Participants found the session valuable, and appreciated the opportunity to engage in a meaningful dialogue with colleagues. However, the majority of the audience did not access the materials in advance. Lack of time, or technology-related issues were mentioned as potential challenges to such format. Conclusion In the context of a large conference, a ‘flipped session’ format can facilitate active learning and a participatory culture of inquiry. However, to change the nature of how individuals learn collaboratively at large conferences means a change in the culture of continuous professional learning.