ZLZach Landis-Lewis

Zach Landis-Lewis

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Zach Landis-Lewis has a total of 117 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Integrating Artificial Intelligence and Machine Learning into Palliative and End-of-Life Care

    by Patrick Wilson, Janice Firn, Zach Landis-Lewis, John Donnelly, Jacob Strand

    Palliative care is an interdisciplinary approach to specialized care focused on improving quality of life for patients with serious illness. Once concentrated on end-of-life, the field has evolved to address multidimensional needs across multiple disease trajectories, care settings, and patient populations. Artificial intelligence/machine learning (AI/ML) algorithms represent a promising approach to scaling this expanded vision by identifying patients with unmet palliative needs earlier and more consistently than traditional screening methods. This chapter examines AI/ML applications across three algorithmic domains: mortality prediction, modeling specific palliative needs such as symptom burden, and modeling goal-concordant care. We trace a conceptual progression from “Who will die soon?” to “Who is suffering now?” to “Is this patient receiving care aligned with what matters most to them?” and argue that the field's concentration on mortality prediction reflects technical accessibility rather than alignment with palliative care's broadened scope. Despite this mismatch, emerging work in symptom modeling and preference extraction demonstrates movement toward more clinically meaningful targets. Finally, we examine the growing body of implementation and evaluation studies, which represent the definitive test of whether these algorithms improve care delivery. Findings show improvements in process measures such as consultation rates, but evidence of patient-centered outcomes remains sparse, and challenges around model trust, generalizability, and long-term monitoring persist. Addressing these gaps will require reorienting algorithmic targets toward contemporary palliative needs, equitable deployment across diverse settings, and rigorous evaluation of outcomes that matter to patients and families.

  • Open Access

    Design of Learner-Created Electronic Flashcards in Undergraduate Medical Education: Implications for Knowledge and Skill Development

    by Asavari Rajpurkar, Philip D Barrison, Kirsten Fiestan, Pratik S Vadlamudi, Matthew Sparling, Zach Landis-Lewis, Alexandra H Vinson, Emily A Balczewski

    EFs are an increasingly popular active learning tool among medical learners. Many learners use EFs created by other learners—the content and quality of which may go unchecked by experts and educators. Of central concern is whether learner-created flashcards adequately support competency and skill development in addition to facilitating knowledge acquisition. Our qualitative study applied an inductively and deductively developed framework for EF design to a random sample of 1,179 flashcards from popular learner-created EF decks for undergraduate medical education (UME). We categorized each flashcard across four different dimensions: Content Area (e.g., flashcard is relevant to clinical vs. basic science fields), Clinical Reasoning Domain (e.g., flashcard supports reasoning like diagnosis), Knowledge Domain (e.g., flashcard tests procedural vs. informational knowledge), and Cognitive Process (e.g., flashcard involves recalling vs. applying knowledge). EFs in our sample tested a wide variety of knowledge in a variety of ways beyond simple factual recall. We report learner-created EFs can likely elicit higher-order thinking skills and test clinically relevant knowledge which may support clinical reasoning and procedural skill development. However, while Step 2 decks contained more clinically relevant and complex flashcards than Step 1 or preclinical decks, overall clinical relevance and complexity in learner-created EFs was limited. EFs have the potential to support learners in both knowledge acquisition and development of critical skills and competencies. However, learner-created EF decks may benefit from oversight by expert-educators to ensure their content and quality aligns with educational goals.

  • Open Access

    Unboxing Electronic Flashcards: An Introduction to the Design Elements of Anki for Medical Education (DEAME) Framework

    by Emily A. Balczewski, Philip D. Barrison, Asavari Rajpurkar, Kirsten Fiestan, Pratik S. Vadlamudi, Matthew Sparling, Zach Landis-Lewis, Alexandra H. Vinson

    Electronic flashcards (EFs) have rapidly ascended in popularity as an active learning resource among medical learners. Despite their significant popularity, no unifying terminologies exist to support clear practices and communication about the design of EFs between learners, educators, and researchers. This study proposes a framework extending The New Taxonomy of Educational Objectives ( NT ) to offer a robust terminology for describing EF design. Thirteen hundred EFs from six popular undergraduate medical education decks were sampled and qualitatively analyzed using a multi-phase design and flexible approach to thematic analysis. Through an iterative process of induction, deduction, and reconciliation, general design dimensions (“categories”) and specific design elements (“codes”) of EFs were identified. These categories and codes were organized into a unifying framework with accompanying definitions, examples, and possible implications for student-centered design. The Design Elements of Anki for Medical Education (DEAME) Framework contains seven categories and 48 codes that provide a robust foundation for conceptualizing EF design. Two categories describe the multimedia and metadata elements in EFs. Three categories describe how EFs formulate questions and answers. Two categories extend the NT to describe the types of knowledge and ways of thinking EFs can elicit. The DEAME Framework provides a much-needed terminology to describe the significant design variety in EFs for medical education. This terminology enables future educators, researchers, and learners to better develop and communicate best practices for creating high-quality EFs that align with medical curricula.


  • Open Access

    Design of Learner-Created Electronic Flashcards in Undergraduate Medical Education: Implications for Knowledge and Skill Development

    by Asavari Rajpurkar, Philip D Barrison, Kirsten Fiestan, Pratik S Vadlamudi, Matthew Sparling, Zach Landis-Lewis, Alexandra H Vinson, Emily A Balczewski

    EFs are an increasingly popular active learning tool among medical learners. Many learners use EFs created by other learners—the content and quality of which may go unchecked by experts and educators. Of central concern is whether learner-created flashcards adequately support competency and skill development in addition to facilitating knowledge acquisition. Our mixed-methods study applied an inductively and deductively developed framework for EF design to a random sample of 1,179 flashcards from popular learner-created EF decks for undergraduate medical education (UME). We categorized each flashcard across four different dimensions: Content Area (e.g., flashcard is relevant to clinical vs. basic science fields), Clinical Reasoning Domain (e.g., flashcard supports reasoning like diagnosis), Knowledge Domain (e.g., flashcard tests procedural vs. informational knowledge), and Cognitive Process (e.g., flashcard involves recalling vs. applying knowledge). EFs in our sample tested a wide variety of knowledge in a variety of ways beyond simple factual recall. We report learner-created EFs can likely elicit higher-order thinking skills and test clinically relevant knowledge which may support clinical reasoning and procedural skill development. However, while Step 2 decks contained more clinically relevant and complex flashcards than Step 1 or preclinical decks, overall clinical relevance and complexity in learner-created EFs was limited. EFs have the potential to support learners in both knowledge acquisition and development of critical skills and competencies. However, learner-created EF decks may benefit from oversight by expert-educators to ensure their content and quality aligns with educational goals.

  • Open Access

    Scalable Coaching and Appreciation Feedback for Optimal Learning and Decision-Making (SCAFFOLD)

    by Zach Landis-Lewis, Peter Boisvert, Farid Seifi, Anjana Deep Renji, Yidan Cao, Hana Chung, Allison Janda, Nirav Shah, Allen Flynn

    Clinical performance feedback is one of the most effective quality improvement strategies, but evidence about its effectiveness is highly variable. A key barrier to improving the effect of feedback is a lack of engagement by healthcare professionals. We developed Scalable Coaching and Appreciation Feedback For Optimal Learning and Decision-making (SCAFFOLD), a precision feedback system, that enhances performance feedback reports and dashboards to improve provider engagement and feedback effectiveness. We introduce SCAFFOLD and its key functions for generating messages with high motivational potential, and report on its function over a six-month period in a national-scale perioperative quality improvement consortium. The system was used to generate 21,776 messages for 4,550 anesthesia providers, producing 20,391 (94%) coaching messages and 1,385 (6%) appreciation messages. SCAFFOLD appears to demonstrate a feasible approach for large-scale generation of coaching and appreciation feedback messages that enhance feedback emails, reports, and dashboards.


  • Open Access

    A Conceptual Model for Precision Feedback on Screening and Referral for Health-Related Social Needs in US Primary Care Settings

    by Yidan Cao, Zach Landis-Lewis

    Unmet health-related social needs (HRSNs) can significantly limit healthcare teams’ abilities to address the root causes of patients’ poor health. Detecting and addressing HRSNs early in primary care offers an opportunity for improving health outcomes and advancing equity across a healthcare system’s patient population. In the US, effective screening and referral for HRSNs remains low in many primary care settings, and primary care teams lack feedback about their screening and referral practices to improve care. Precision feedback, an informatics-enabled approach to generating coaching and appreciation messages, has the potential to enhance the value of feedback interventions on HRSNs screening and referrals. We iteratively developed a conceptual model of precision feedback to primary care professionals and teams in the US about HRSNs screening and referral practices, through a series of literature review, modeling, discussions, and reflection. Our proposed conceptual model contains six essential information domains: 1) performance data, 2) feedback recipient, 3) resources for referrals, 4) message influence, 5) message templates, and 6) algorithms. This model aligns with leading theories of feedback and behavior change interventions. We plan to evaluate this model in US pediatric primary care settings.

  • Electronic Flashcards in Health Professions Education: A Scoping Review

    by Philip D. Barrison, Emily A Balczewski, Emily Mlis Capellari, Zach PhD Landis-Lewis, Alexandra H. Vinson

    Purpose Electronic flashcards (EFs) are a widely used learning resource in medical education. This scoping review provides a comprehensive overview of the existing empirical research on EFs and a direction for future research on EF interventions. The authors organized the reviewed articles into 4 nonmutually exclusive categories: development, delivery, utilization, and associated outcomes. Method In this scoping review, search queries were composed for 6 databases (PubMed, Embase, Education Resource Information Center, Web of Science, PsychInfo, and the Cumulative Index to Nursing and Allied Health Literature). The database search was conducted on April 12, 2024, for articles published before this date using the following keywords (as well as other keywords): anki, quizlet, firecracker, osmosis, flashcard, spaced repetition, spaced interval training, spaced interval learning, spaced test, and parallel curriculum. Two reviewers screened the studies for eligibility and performed data extraction between August 12, 2024, and September 26, 2024. Results Sixty-four studies were included in the review. Most articles were published in the last 6 years (2019-2024) (49 [77%]), in the United States (45 [7%]), and in the context of undergraduate medical education (42 [66%]). The studies predominantly focused on the utilization (51 [78%]) and associated outcomes (38 [59%]) of EFs. In contrast, EF development (12 [19%]) and delivery methods (16 [25%]) were less frequently examined. Conclusions This review of the rapidly increasing body of research on EFs suggests broad use and satisfaction among health professions learners; however, much work remains to be done to systematically understand EF development and delivery. Future research directions may consider more systematic investigations of how decisions made during the development and delivery of EFs affect downstream use and learning outcomes. Addressing these gaps will deepen the understanding of how EFs affect medical education pedagogy and facilitate the informed integration and refinement of these tools within curricula.


  • Open Access

    Development, Implementation, and Evaluation Methods for Dashboards in Health Care: Scoping Review

    by Danielle Helminski, Jeremy B Sussman, Paul N Pfeiffer, Alex N Kokaly, Allison Ranusch, Anjana Deep Renji, Laura J Damschroder, Zach Landis-Lewis, Jacob E Kurlander

    Background: Dashboards have become ubiquitous in health care settings, but to achieve their goals, they must be developed, implemented, and evaluated using methods that help ensure they meet the needs of end users and are suited to the barriers and facilitators of the local context. Objective: This scoping review aimed to explore published literature on health care dashboards to characterize the methods used to identify factors affecting uptake, strategies used to increase dashboard uptake, and evaluation methods, as well as dashboard characteristics and context. Methods: MEDLINE, Embase, Web of Science, and the Cochrane Library were searched from inception through July 2020. Studies were included if they described the development or evaluation of a health care dashboard with publication from 2018‐2020. Clinical setting, purpose (categorized as clinical, administrative, or both), end user, design characteristics, methods used to identify factors affecting uptake, strategies to increase uptake, and evaluation methods were extracted. Results: From 116 publications, we extracted data for 118 dashboards. Inpatient (45/118, 38.1%) and outpatient (42/118, 35.6%) settings were most common. Most dashboards had ≥2 stated purposes (84/118, 71.2%); of these, 54 of 118 (45.8%) were administrative, 43 of 118 (36.4%) were clinical, and 20 of 118 (16.9%) had both purposes. Most dashboards included frontline clinical staff as end users (97/118, 82.2%). To identify factors affecting dashboard uptake, half involved end users in the design process (59/118, 50%); fewer described formative usability testing (26/118, 22%) or use of any theory or framework to guide development, implementation, or evaluation (24/118, 20.3%). The most common strategies used to increase uptake included education (60/118, 50.8%); audit and feedback (59/118, 50%); and advisory boards (54/118, 45.8%). Evaluations of dashboards (84/118, 71.2%) were mostly quantitative (60/118, 50.8%), with fewer using only qualitative methods (6/118, 5.1%) or a combination of quantitative and qualitative methods (18/118, 15.2%). Conclusions: Most dashboards forego steps during development to ensure they suit the needs of end users and the clinical context; qualitative evaluation—which can provide insight into ways to improve dashboard effectiveness—is uncommon. Education and audit and feedback are frequently used to increase uptake. These findings illustrate the need for promulgation of best practices in dashboard development and will be useful to dashboard planners.


  • Open Access

    Exploring Anesthesia Provider Preferences for Precision Feedback: Preference Elicitation Study

    by Zach Landis-Lewis, Chris A Andrews, Colin A Gross, Charles P Friedman, Nirav J Shah

    Background: Health care professionals must learn continuously as a core part of their work. As the rate of knowledge production in biomedicine increases, better support for health care professionals’ continuous learning is needed. In health systems, feedback is pervasive and is widely considered to be essential for learning that drives improvement. Clinical quality dashboards are one widely deployed approach to delivering feedback, but engagement with these systems is commonly low, reflecting a limited understanding of how to improve the effectiveness of feedback about health care. When coaches and facilitators deliver feedback for improving performance, they aim to be responsive to the recipient’s motivations, information needs, and preferences. However, such functionality is largely missing from dashboards and feedback reports. Precision feedback is the delivery of high-value, motivating performance information that is prioritized based on its motivational potential for a specific recipient, including their needs and preferences. Anesthesia care offers a clinical domain with high-quality performance data and an abundance of evidence-based quality metrics. Objective: The objective of this study is to explore anesthesia provider preferences for precision feedback. Methods: We developed a test set of precision feedback messages with balanced characteristics across 4 performance scenarios. We created an experimental design to expose participants to contrasting message versions. We recruited anesthesia providers and elicited their preferences through analysis of the content of preferred messages. Participants additionally rated their perceived benefit of preferred messages to clinical practice on a 5-point Likert scale. Results: We elicited preferences and feedback message benefit ratings from 35 participants. Preferences were diverse across participants but largely consistent within participants. Participants’ preferences were consistent for message temporality (α=.85) and display format (α=.80). Ratings of participants’ perceived benefit to clinical practice of preferred messages were high (mean rating 4.27, SD 0.77). Conclusions: Health care professionals exhibited diverse yet internally consistent preferences for precision feedback across a set of performance scenarios, while also giving messages high ratings of perceived benefit. A “one-size-fits-most approach” to performance feedback delivery would not appear to satisfy these preferences. Precision feedback systems may hold potential to improve support for health care professionals’ continuous learning by accommodating feedback preferences.


  • Open Access

    Scoping review of dashboards in health care: why, how, and for whom they have been developed, implemented, and evaluated (Preprint)

    by Danielle Helminski, Jeremy B Sussman, Paul N Pfeiffer, Alex N Kokaly, Allison Ranusch, Anjana Deep Renji, Laura J Damschroder, Zach Landis-Lewis, Jacob E Kurlander

    BACKGROUND While dashboards are frequently used by health systems to monitor and improve performance, little is known about their characteristics and the processes used to incorporate them into practice. OBJECTIVE This scoping review aimed to explore published literature on health care dashboards to summarize why, how, and for whom they have been developed, implemented, and evaluated. METHODS MEDLINE, EMBASE, Web of Science and the Cochrane Library were searched from inception through July 2020. Studies were included if they described the development or evaluation of a health care dashboard with publication since 2015. Clinical setting, purpose (categorized as clinical, administrative, or both), and end-user were extracted for all studies. Data on dashboard development, design characteristics, implementation strategies, and evaluation were extracted only for studies published from 2018-2020. RESULTS Data was extracted for 199 dashboards described in 193 publications. The most common settings in which dashboards were used were inpatient (n=81/199, 40.7%) and outpatient clinics (n=68/199, 34.2%). Most dashboards had ≥2 stated purposes (n=142/199, 71.4%); of these, 97/199 (48.7%) were administrative, 68/199 (34.2%) were clinical, and 31/199 (15.6%) met both criteria. Most dashboards included front-line clinical staff as end-users (n=154/199, 77.4%). In the 118 dashboards published from 2018-2020, half involved end-users in the design process (n=59/118, 50.0%); fewer described formative usability testing (n=26/118, 22.0%) or use of any theory or framework to guide development, implementation, or evaluation (n=24/118, 20.3%). Dashboards tended to be web-based (n=41/118, 34.7%) or embedded directly into the electronic health record (n=17/118, 14.4%). Common implementation strategies used alongside dashboards included education (n=60/118, 50.8%), audit and feedback (n=59/118, 50.0%), and advisory boards (n=54/118, 45.8%). Evaluations of dashboards (n=84/118, 71.2%) were mostly quantitative (n=60/118, 50.8%), or mixed methods, combining dashboard or health record data with qualitative findings (n=18/118, 15.2%). CONCLUSIONS Dashboards in health care have been used in diverse settings, for multiple purposes and varied end users. The complexity of many dashboards – serving many purposes and end users at once – and the frequent expectation that clinicians will use them underscores the importance of systematic design and evaluation to ensure they are having the intended outcomes. Future work is needed to identify best practices for the development, implementation, and evaluation of health care dashboards. INTERNATIONAL REGISTERED REPORT RR2-10.2196/34894