Performance indicators for evaluating and optimising hospital services during COVID-19: a scoping review
Open Access
Abstract
Objectives: To identify which logistical and clinical healthcare key performance indicators (KPIs) were applied in hospitals during the COVID-19 pandemic and how frequently they were used when evaluating and optimising hospital care services. Design: Scoping review reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) framework. Data sources: The search was performed in PubMed, CINAHL, EMBASE, Scopus and Web of Science and included articles published from the beginning of the COVID-19 pandemic, that is, 1 January 2020, until 11 November 2024, the date of the final search. The search strategy combined terms related to (1) COVID-19/pandemic, (2) performance and (3) hospital care. Eligibility criteria: Eligible studies were peer-reviewed, English-language publications that reported measurable performance indicators evaluating or optimising hospital care services during the COVID-19 pandemic. Studies had to explicitly define or evaluate KPIs and focus on inpatient hospital settings (≥1 overnight stay) in countries within the European Union, the European Economic Area, the Schengen area or the UK. Multicountry or global studies were included when they contained relevant European data or when the geographical context was not determinant (eg, modelling studies). Exclusion criteria included non-peer-reviewed publications, conference abstracts, organisational reports, literature reviews, studies without original results, studies without accessible full text and non-English publications. Data extraction and synthesis: Titles, abstracts and full texts were screened independently by three reviewers. Disagreements were resolved through discussion and consultation with two additional reviewers. Relevant study characteristics and KPI-related information were extracted using a predefined data extraction form. KPIs were categorised inductively into thematic categories. Structured data were analysed at both the study and KPI-category level. Data without a predefined structure, such as KPI definitions and key findings, were analysed manually at the KPI-category level. Results: Across 94 included studies, 459 distinct KPIs were extracted. Given substantial heterogeneity, KPIs were grouped inductively into six main categories: (1) clinical outcomes, (2) resources and capacity, (3) care delivery volumes, (4) care delivery performance, (5) access time and sojourn time and (6) other indicators. KPIs were reported in diverse formats, including volumes, percentages, scores, scales, characteristics and binary outcomes. Identical KPIs were sometimes defined differently across studies, while similar measures were reported under different terminology. The most common reason for KPI use was for the comparison between pre-COVID-19 and COVID-19 periods, followed by supporting optimisation and exploring quality of care during the pandemic. Most studies emphasised either clinical or logistical indicators, with limited integration of both perspectives within a single performance assessment. The majority of KPIs were not pandemic-specific but reflected indicators already used in routine hospital performance monitoring. Conclusions: Hospital performance during COVID-19 was evaluated using a wide range of heterogeneous KPIs, with substantial variation in definitions and reporting practices. Greater transparency and standardisation in KPI definitions may improve comparability, reproducibility and preparedness for future health crises. Integrating clinical and logistical performance perspectives may provide a broader view of hospital performance and support decision-making during pandemics.Keywords
Funding Information
- European Union / RAPIDE (101136348)
This publication has 66 references indexed in Scilit:
- Measuring hospital care resilience: a systematic literature reviewThe European Journal of Health Economics, 2025
- Performance analysis of English hospitals during the first and second waves of the coronavirus pandemicHealth Care Management Science, 2023
- Highly specialized Breast Centers did not experience delay of care during COVID-19 pandemic in Italy: the Senonetwork experienceBreast Cancer Research and Treatment, 2022
- Does the length of stay in hospital affect healthcare outcomes of patients without COVID-19 who were admitted during the pandemic? A retrospective monocentric studyInternal and Emergency Medicine, 2022
- The presentations/physician ratio predicts door-to-physician time but not global length of stay in the emergency department: an Italian multicenter study during the SARS-CoV-2 pandemicInternal and Emergency Medicine, 2021
- Balancing scarce hospital resources during the COVID-19 pandemic using discrete-event simulationHealth Care Management Science, 2021
- Effect of the COVID-19 pandemic and the lockdown measures on the local stroke networkNeurological Sciences, 2021
- Operating room efficiency and timing during coronavirus disease 2019 outbreak in a referral orthopaedic hospital in Northern ItalyInternational Orthopaedics, 2020
- Impact of COVID-19 outbreak on regional STEMI care in GermanyClinical Research in Cardiology, 2020
- Effect of lockdown on the management of ischemic stroke: an Italian experience from a COVID hospitalNeurological Sciences, 2020