Anna C. Davis
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Anna C. Davis has a total of 61 co-authors. Here are the top co-authors by number of shared publications:
- Andrew Schmidt
Centre for Hip Health and Mobility
2 shared publications - Elizabeth A. McGlynn
Kaiser Permanente Research and Quality Measurement, Pasadena, CA, USA
2 shared publications - Heather A. Prentice
Medical Device Surveillance and Assessment, Kaiser Permanente, San Diego, CA, USA
2 shared publications John Chen
Department of Internal Medicine, Kaiser Permanente Northwest, Portland, Oregon, USA
2 shared publicationsMichael K. Gould
Department of Health Systems Science, Kaiser Permanente Bernard J. Tyson School of Medicine, Pasadena, California, USA
2 shared publications- Ronald Anthony Navarro
Kaiser Permanente Bernard J. Tyson School of Medicine, Pasadena, CA, USA
2 shared publications
Latest Publications
- Open Access
- 1 May 2026
- Published by Elsevier in Journal of Shoulder and Elbow Arthroplasty
- Vol. 10 (3)
Trends in opioid prescribing after shoulder arthroplasty in an integrated health system: an analysis across racial and ethnic groups
- 1 May 2026
- Published by Elsevier in Journal of Shoulder and Elbow Arthroplasty
- Vol. 10 (3)
Open AccessTrends in opioid prescribing after shoulder arthroplasty in an integrated health system: an analysis across racial and ethnic groups
- 27 March 2025
- Published by Massachusetts Medical Society in NEJM AI
- Vol. 2 (4)
Quality Assurance during the Rapid Implementation of an AI-Assisted Clinical Documentation Support Tool
- 27 March 2025
- Published by Massachusetts Medical Society in NEJM AI
- Vol. 2 (4)
Quality Assurance during the Rapid Implementation of an AI-Assisted Clinical Documentation Support Tool
- Open Access
- 12 July 2023
- Published by Wiley in Journal of Evaluation in Clinical Practice
- Vol. 30 (1) , 101-104
Speaking truth about power: Are underpowered trials undercutting evaluation of new care models?
- 12 July 2023
- Published by Wiley in Journal of Evaluation in Clinical Practice
- Vol. 30 (1) , 101-104
Open AccessSpeaking truth about power: Are underpowered trials undercutting evaluation of new care models?
- Top Cited PapersOpen Access
- 15 June 2023
- Published by The Permanente Federation in The Permanente Journal
- Vol. 27 (2) , 87-98
Comparing Kaiser Permanente Members to the General Population: Implications for Generalizability of Research
Introduction Insight into the characteristics of populations from which research samples are drawn is essential to understanding the generalizability of research findings. This study characterizes the membership of Kaiser Permanente and compares members to the population of the communities in which they live. Methods This study is a descriptive comparison of population distributions for Kaiser Permanente members vs the general population within counties in which Kaiser Permanente operates. Kaiser Permanente data on demographics, membership, geographically linked census data, and chronic condition prevalence were compared with community data drawn from the US Census and the Behavioral Risk Factor Surveillance System. Results Overall, Kaiser Permanente members were older (50% aged 40 or older compared to 45.8% of the general population) and more likely to be female (51.8% vs 50.5% of the general population). Distribution by race and ethnicity was similar for all Regions combined but varied somewhat within Regions. Distribution by neighborhood-linked income, education, and social vulnerability was similar between Kaiser Permanente and the community. Prevalence of 6 of 7 chronic conditions was higher in the community than in Kaiser Permanente, with differences ranging from 0.5% for depression to 7.7% for hyperlipidemia. Conclusion The demographic characteristics of Kaiser Permanente members are similar to the general population within each of the Kaiser Permanente Regions. Overall, the size and diversity of the Kaiser Permanente membership offers an effective platform for research. This approach to comparing health system members with the larger community provides valuable context for interpreting real-world evidence, including understanding the generalizability of research and of measures of system performance.
- 15 June 2023
- Published by The Permanente Federation in The Permanente Journal
- Vol. 27 (2) , 87-98
Top Cited PapersOpen AccessComparing Kaiser Permanente Members to the General Population: Implications for Generalizability of Research
Introduction Insight into the characteristics of populations from which research samples are drawn is essential to understanding the generalizability of research findings. This study characterizes the membership of Kaiser Permanente and compares members to the population of the communities in which they live. Methods This study is a descriptive comparison of population distributions for Kaiser Permanente members vs the general population within counties in which Kaiser Permanente operates. Kaiser Permanente data on demographics, membership, geographically linked census data, and chronic condition prevalence were compared with community data drawn from the US Census and the Behavioral Risk Factor Surveillance System. Results Overall, Kaiser Permanente members were older (50% aged 40 or older compared to 45.8% of the general population) and more likely to be female (51.8% vs 50.5% of the general population). Distribution by race and ethnicity was similar for all Regions combined but varied somewhat within Regions. Distribution by neighborhood-linked income, education, and social vulnerability was similar between Kaiser Permanente and the community. Prevalence of 6 of 7 chronic conditions was higher in the community than in Kaiser Permanente, with differences ranging from 0.5% for depression to 7.7% for hyperlipidemia. Conclusion The demographic characteristics of Kaiser Permanente members are similar to the general population within each of the Kaiser Permanente Regions. Overall, the size and diversity of the Kaiser Permanente membership offers an effective platform for research. This approach to comparing health system members with the larger community provides valuable context for interpreting real-world evidence, including understanding the generalizability of research and of measures of system performance.
- Open Access
- 19 July 2022
- Published by Wiley in Health Services Research
- Vol. 57 (6) , 1361-1369
The distillation method: A novel approach for analyzing randomized trials when exposure to the intervention is diluted
Objective To introduce a novel analytical approach for randomized controlled trials that are underpowered because of low participant enrollment or engagement. Data Sources Reanalysis of data for 805 patients randomized as part of a pilot complex care intervention in 2015-2016 in a large delivery system. In the pilot randomized trial, only 64.6% of patients assigned to the intervention group participated. Study Design A case study and simulation. The "Distillation Method" capitalizes on the frequently observed correlation between the probability of subjects' participation or engagement in the intervention and the magnitude of benefit they experience. The novel method involves three stages: first, it uses baseline covariates to generate predicted probabilities of participation. Next, these are used to produce nested subsamples of the randomized intervention and control groups that are more concentrated with subjects who were likely to participate/engage. Finally, for the outcomes of interest, standard statistical methods are used to re-evaluate intervention effectiveness in these concentrated subsets. Data Extraction Methods We assembled secondary data on patients who were randomized to the pilot intervention for one year prior to randomization and two follow-up years. Data included program enrollment status, membership data, demographics, utilization, costs, and clinical data. Principal Findings Using baseline covariates only, Generalized Boosted Regression Models predicting program enrollment performed well (AUC 0.884). We then distilled the full randomized sample to increasing levels of concentration and reanalyzed program outcomes. We found statistically significant differences in outpatient utilization and emergency department utilization (both follow-up years), and in total costs (follow-up year two only) at select levels of population concentration. Conclusions By offering an internally valid analytic framework, the Distillation Method can increase the power to detect effects by redefining the estimand to subpopulations with higher enrollment probabilities and stronger average treatment effects while maintaining the original randomization.
- 19 July 2022
- Published by Wiley in Health Services Research
- Vol. 57 (6) , 1361-1369
Open AccessThe distillation method: A novel approach for analyzing randomized trials when exposure to the intervention is diluted
Objective To introduce a novel analytical approach for randomized controlled trials that are underpowered because of low participant enrollment or engagement. Data Sources Reanalysis of data for 805 patients randomized as part of a pilot complex care intervention in 2015-2016 in a large delivery system. In the pilot randomized trial, only 64.6% of patients assigned to the intervention group participated. Study Design A case study and simulation. The "Distillation Method" capitalizes on the frequently observed correlation between the probability of subjects' participation or engagement in the intervention and the magnitude of benefit they experience. The novel method involves three stages: first, it uses baseline covariates to generate predicted probabilities of participation. Next, these are used to produce nested subsamples of the randomized intervention and control groups that are more concentrated with subjects who were likely to participate/engage. Finally, for the outcomes of interest, standard statistical methods are used to re-evaluate intervention effectiveness in these concentrated subsets. Data Extraction Methods We assembled secondary data on patients who were randomized to the pilot intervention for one year prior to randomization and two follow-up years. Data included program enrollment status, membership data, demographics, utilization, costs, and clinical data. Principal Findings Using baseline covariates only, Generalized Boosted Regression Models predicting program enrollment performed well (AUC 0.884). We then distilled the full randomized sample to increasing levels of concentration and reanalyzed program outcomes. We found statistically significant differences in outpatient utilization and emergency department utilization (both follow-up years), and in total costs (follow-up year two only) at select levels of population concentration. Conclusions By offering an internally valid analytic framework, the Distillation Method can increase the power to detect effects by redefining the estimand to subpopulations with higher enrollment probabilities and stronger average treatment effects while maintaining the original randomization.
- Open Access
- 16 September 2021
- Published by Springer Nature in Sports Medicine - Open
- Vol. 7 (1) , 1-14
The Effectiveness of Neuromuscular Warmups for Lower Extremity Injury Prevention in Basketball: A Systematic Review
Background: Neuromuscular warmups have gained increasing attention as a means of preventing sports-related injuries, but data on effectiveness in basketball are sparse. The objective of this systematic review was to evaluate evidence of the effectiveness of neuromuscular warmup-based strategies for preventing lower extremity injuries among basketball athletes.Methods: PubMed and Cochrane Library databases were searched in February 2019. Studies were included if they were English-language randomized controlled, non-randomized comparative, or prospective cohort trials, tested neuromuscular and/or balance-focused warmup interventions among basketball players, and assessed at least one type of lower extremity injury as a primary outcome. Criteria developed by the USPSTF were used to appraise study quality, and GRADE was used to appraise the body of evidence for each outcome. Due to heterogeneity in the included studies, meta-analyses could not be performed.Results: In total, 825 titles and abstracts were identified. Of the 13 studies which met inclusion criteria for this review, five were balance interventions (3 randomized controlled trials) and eight were multicomponent interventions involving multiple categories of dynamic neuromuscular warmup (5 randomized controlled trials). Authors of four of the studies were contacted to obtain outcome data specific to basketball athletes. Basketball specific results from the studies suggest significant protective effects for the following lower extremity injuries: ankle injuries (significant in 4 out of the 9 studies that assessed this outcome); ACL injuries (2 of 4 studies); knee injuries generally (1 of 5 studies); and overall lower extremity injuries (5 of 7 studies). All but one of the non-significant results were directionally favorable. Evidence was moderate for the effect of multicomponent interventions on lower extremity injuries generally. For all other outcomes, and for balance-based interventions, the quality of evidence was rated as low.Conclusion: Overall, the evidence is supportive of neuromuscular warmups for lower extremity injury prevention among basketball players. However, most studies are underpowered, some used lower-quality research study designs, and outcome and exposure definitions varied. Due to the nature of the study designs, effects could not be attributed to specific intervention components. More research is needed to identify the most effective bundle of warmup activities.
- 16 September 2021
- Published by Springer Nature in Sports Medicine - Open
- Vol. 7 (1) , 1-14
Open AccessThe Effectiveness of Neuromuscular Warmups for Lower Extremity Injury Prevention in Basketball: A Systematic Review
Background: Neuromuscular warmups have gained increasing attention as a means of preventing sports-related injuries, but data on effectiveness in basketball are sparse. The objective of this systematic review was to evaluate evidence of the effectiveness of neuromuscular warmup-based strategies for preventing lower extremity injuries among basketball athletes.Methods: PubMed and Cochrane Library databases were searched in February 2019. Studies were included if they were English-language randomized controlled, non-randomized comparative, or prospective cohort trials, tested neuromuscular and/or balance-focused warmup interventions among basketball players, and assessed at least one type of lower extremity injury as a primary outcome. Criteria developed by the USPSTF were used to appraise study quality, and GRADE was used to appraise the body of evidence for each outcome. Due to heterogeneity in the included studies, meta-analyses could not be performed.Results: In total, 825 titles and abstracts were identified. Of the 13 studies which met inclusion criteria for this review, five were balance interventions (3 randomized controlled trials) and eight were multicomponent interventions involving multiple categories of dynamic neuromuscular warmup (5 randomized controlled trials). Authors of four of the studies were contacted to obtain outcome data specific to basketball athletes. Basketball specific results from the studies suggest significant protective effects for the following lower extremity injuries: ankle injuries (significant in 4 out of the 9 studies that assessed this outcome); ACL injuries (2 of 4 studies); knee injuries generally (1 of 5 studies); and overall lower extremity injuries (5 of 7 studies). All but one of the non-significant results were directionally favorable. Evidence was moderate for the effect of multicomponent interventions on lower extremity injuries generally. For all other outcomes, and for balance-based interventions, the quality of evidence was rated as low.Conclusion: Overall, the evidence is supportive of neuromuscular warmups for lower extremity injury prevention among basketball players. However, most studies are underpowered, some used lower-quality research study designs, and outcome and exposure definitions varied. Due to the nature of the study designs, effects could not be attributed to specific intervention components. More research is needed to identify the most effective bundle of warmup activities.
- 8 June 2021
- Published by SAGE Publications in Population Health Management
- Vol. 24 (3) , 393-402
Identifying Populations with Complex Needs: Variation in Approaches Used to Select Complex Patient Populations
Interventions to support patients with complex needs are proliferating. However, little attention has been paid to methods for identifying complex patients. This study aims to summarize approaches used to define populations with complex needs in practice, by cataloging specific population criteria and organizing them into a taxonomy. The authors conducted a pragmatic review of literature published January 2000-December 2018 using PubMed. Search results were limited to English-language studies of adults that specified a set of objective criteria to identify a population with complex needs. The authors abstracted data from each article on population parameters, and conducted thematic analysis guided by deductive coding. The review identified 70 studies reflecting 90 unique complex population definitions. Complex populations criteria reflected 3 approaches: stratification, segmentation, and targeting. Six domains of population criteria were found within, including age-based criteria (59 populations); income (12); health care costs (45); health care utilization (39); health conditions (35); and subjective criteria (15). Criteria from multiple domains were frequently used in combination, and exact specifications were highly variable within each domain. Overall, 83% of the 90 population definitions included at least 1 cost- or utilization-based criterion. Nearly every study in the review presented a unique approach to identifying patients with complex needs but a limited number of “schools of thought” were found. Variability in definitions and inconsistent terminology are potential sources of ambiguity between stakeholders. Greater specificity and transparency in complex population definition would be a substantial contribution to the emerging field of complex care.
- 8 June 2021
- Published by SAGE Publications in Population Health Management
- Vol. 24 (3) , 393-402
Identifying Populations with Complex Needs: Variation in Approaches Used to Select Complex Patient Populations
Interventions to support patients with complex needs are proliferating. However, little attention has been paid to methods for identifying complex patients. This study aims to summarize approaches used to define populations with complex needs in practice, by cataloging specific population criteria and organizing them into a taxonomy. The authors conducted a pragmatic review of literature published January 2000-December 2018 using PubMed. Search results were limited to English-language studies of adults that specified a set of objective criteria to identify a population with complex needs. The authors abstracted data from each article on population parameters, and conducted thematic analysis guided by deductive coding. The review identified 70 studies reflecting 90 unique complex population definitions. Complex populations criteria reflected 3 approaches: stratification, segmentation, and targeting. Six domains of population criteria were found within, including age-based criteria (59 populations); income (12); health care costs (45); health care utilization (39); health conditions (35); and subjective criteria (15). Criteria from multiple domains were frequently used in combination, and exact specifications were highly variable within each domain. Overall, 83% of the 90 population definitions included at least 1 cost- or utilization-based criterion. Nearly every study in the review presented a unique approach to identifying patients with complex needs but a limited number of “schools of thought” were found. Variability in definitions and inconsistent terminology are potential sources of ambiguity between stakeholders. Greater specificity and transparency in complex population definition would be a substantial contribution to the emerging field of complex care.
- 2 June 2021
- Published by Springer Nature in Journal of General Internal Medicine
- Vol. 37 (2) , 351-358
Defining Complex Patient Populations: Implications for Population Size, Composition, Utilization, and Costs
Background Interventions to support patients with complex needs have proliferated in recent years, but the question of how to identify patients with complex needs has received relatively little attention. There are innumerable ways to structure inclusion and exclusion criteria for complex care interventions, and little is known about the implications of choices made in designing patient selection criteria. Objective To provide insights into the design of patient selection criteria for interventions, by implementing criteria sets within a large health plan member population and comparing the characteristics of the resulting complex patient cohorts. Design Retrospective observational descriptive study. Subjects Patients identified as having complex needs, within the membership population of Kaiser Permanente Southern California, a large, population-based health plan with more than 4 million members. We characterize five commonly used archetypes of complex needs: high-cost patients, patients with multiple chronic conditions, frail elders, emergency department high-utilizers, and inpatient high-utilizers. Measures We selected an initial set of criteria for identifying patients in each of the archetypical complex populations, based on available administrative data. We then tested multiple variants of each definition. We compared the resulting patient cohorts using univariate and bivariate descriptive statistics. Key Results Overall, 32.7% of the 3,112,797 adults in our population-based sample were selected by at least one of the 25 definitions of complexity we tested. Across definitions the total number of patients identified as complex ranged from 622,560 to 1583 and complex patient cohorts varied widely in demographic characteristics, chronic conditions, healthcare utilization, spending, and survival. Conclusions Choice of patient population is critical to the design of complex care programs. Exploratory analyses of population criteria can provide useful information for program planning in the setting of limited resources for interventions. Data such as these should be generated as a key step in program design.
- 2 June 2021
- Published by Springer Nature in Journal of General Internal Medicine
- Vol. 37 (2) , 351-358
Defining Complex Patient Populations: Implications for Population Size, Composition, Utilization, and Costs
Background Interventions to support patients with complex needs have proliferated in recent years, but the question of how to identify patients with complex needs has received relatively little attention. There are innumerable ways to structure inclusion and exclusion criteria for complex care interventions, and little is known about the implications of choices made in designing patient selection criteria. Objective To provide insights into the design of patient selection criteria for interventions, by implementing criteria sets within a large health plan member population and comparing the characteristics of the resulting complex patient cohorts. Design Retrospective observational descriptive study. Subjects Patients identified as having complex needs, within the membership population of Kaiser Permanente Southern California, a large, population-based health plan with more than 4 million members. We characterize five commonly used archetypes of complex needs: high-cost patients, patients with multiple chronic conditions, frail elders, emergency department high-utilizers, and inpatient high-utilizers. Measures We selected an initial set of criteria for identifying patients in each of the archetypical complex populations, based on available administrative data. We then tested multiple variants of each definition. We compared the resulting patient cohorts using univariate and bivariate descriptive statistics. Key Results Overall, 32.7% of the 3,112,797 adults in our population-based sample were selected by at least one of the 25 definitions of complexity we tested. Across definitions the total number of patients identified as complex ranged from 622,560 to 1583 and complex patient cohorts varied widely in demographic characteristics, chronic conditions, healthcare utilization, spending, and survival. Conclusions Choice of patient population is critical to the design of complex care programs. Exploratory analyses of population criteria can provide useful information for program planning in the setting of limited resources for interventions. Data such as these should be generated as a key step in program design.
- 20 August 2020
- Published by Wiley in Health Services Research
- Vol. 55 (S1) , 75
High Cost, High Need Populations Data‐Driven Decision Making for Interventions with Complex Needs’ Patients: Identifying the Right Target Population
Research Objective: While existing taxonomies describe the major groups of complex patients (prominently, the National Academy of Medicine [NAM] taxonomy), these are often at a conceptual level. Healthcare organizations often select patients for CN interventions using structured criteria based on administrative data, and program designers must make critical decisions in defining target populations. Our study aimed to provide insights to inform decisions about selecting CN populations for interventions, by conducting a review of approaches being used to operationalize CN populations in practice, and implementing various definitions in a large health plan member population to compare the characteristics of the resulting patient cohorts.Study Design: Our study involved multiple methods to identify and implement data‐driven definitions of CN patients. We interviewed internal and external subject matter experts to inform our research approach. We conducted a pragmatic literature review of studies published 2000‐2018 which used data‐driven definitions of CN populations. We conducted thematic analysis of the results to identify core concepts and variations in criteria used to define CN populations. We implemented variations of the core concepts and calculated descriptive statistics to understand the characteristics of patients within each of the resulting CN populations, including size of the population, demographics, chronic illness, health care utilization, spending, and survival.Population Studied: Patients with complex needs defined using criteria applied to the membership population of Kaiser Permanente Southern California (KPSC), a large, population‐based health plan with more than 4 million members.Principal Findings: Our literature review yielded 90 examples of CN populations; we cataloged population criteria for each. We grouped observed criteria into domains: age (reflected in 59 CN population definitions), income (12), costs (45), utilization (39), health status (35), and subjective criteria (15). We constructed a framework for classifying approaches to selecting CN populations (Figure 1). We then used KPSC data to assemble populations representing five CN patient concepts (high cost, high emergency department utilization, high inpatient utilization, multiple chronic conditions, and frail elderly); in each concept, we compared multiple population specifications. We observed within‐ and across‐concept differences in the characteristics of the resulting populations. Data presented during the session will include CN population size, demographics, utilization, comorbidity, costs, and survival.Conclusions: Our results illustrate tremendous variation in how CN populations are defined. Nearly every CN population identified through our literature review was unique in the criteria used to select patients. Furthermore, when we implemented a variety of definitional approaches in our membership, we found substantial variation in the cohorts that resulted from different approaches to patient selection. These findings have important implications for both research and health care operations. In a world of limited resources, it is imperative that we use available data to identify, understand, and target resources to the right CN populations.Implications for Policy or Practice: These findings offer important considerations for intervention planning and implementation. Program planners should select population criteria after exploring the impact of their draft criteria and comparing alternate approaches to understand the implications of those decisions.Primary Funding Source: The Garfield Memorial Fund.
- 20 August 2020
- Published by Wiley in Health Services Research
- Vol. 55 (S1) , 75
High Cost, High Need Populations Data‐Driven Decision Making for Interventions with Complex Needs’ Patients: Identifying the Right Target Population
Research Objective: While existing taxonomies describe the major groups of complex patients (prominently, the National Academy of Medicine [NAM] taxonomy), these are often at a conceptual level. Healthcare organizations often select patients for CN interventions using structured criteria based on administrative data, and program designers must make critical decisions in defining target populations. Our study aimed to provide insights to inform decisions about selecting CN populations for interventions, by conducting a review of approaches being used to operationalize CN populations in practice, and implementing various definitions in a large health plan member population to compare the characteristics of the resulting patient cohorts.Study Design: Our study involved multiple methods to identify and implement data‐driven definitions of CN patients. We interviewed internal and external subject matter experts to inform our research approach. We conducted a pragmatic literature review of studies published 2000‐2018 which used data‐driven definitions of CN populations. We conducted thematic analysis of the results to identify core concepts and variations in criteria used to define CN populations. We implemented variations of the core concepts and calculated descriptive statistics to understand the characteristics of patients within each of the resulting CN populations, including size of the population, demographics, chronic illness, health care utilization, spending, and survival.Population Studied: Patients with complex needs defined using criteria applied to the membership population of Kaiser Permanente Southern California (KPSC), a large, population‐based health plan with more than 4 million members.Principal Findings: Our literature review yielded 90 examples of CN populations; we cataloged population criteria for each. We grouped observed criteria into domains: age (reflected in 59 CN population definitions), income (12), costs (45), utilization (39), health status (35), and subjective criteria (15). We constructed a framework for classifying approaches to selecting CN populations (Figure 1). We then used KPSC data to assemble populations representing five CN patient concepts (high cost, high emergency department utilization, high inpatient utilization, multiple chronic conditions, and frail elderly); in each concept, we compared multiple population specifications. We observed within‐ and across‐concept differences in the characteristics of the resulting populations. Data presented during the session will include CN population size, demographics, utilization, comorbidity, costs, and survival.Conclusions: Our results illustrate tremendous variation in how CN populations are defined. Nearly every CN population identified through our literature review was unique in the criteria used to select patients. Furthermore, when we implemented a variety of definitional approaches in our membership, we found substantial variation in the cohorts that resulted from different approaches to patient selection. These findings have important implications for both research and health care operations. In a world of limited resources, it is imperative that we use available data to identify, understand, and target resources to the right CN populations.Implications for Policy or Practice: These findings offer important considerations for intervention planning and implementation. Program planners should select population criteria after exploring the impact of their draft criteria and comparing alternate approaches to understand the implications of those decisions.Primary Funding Source: The Garfield Memorial Fund.