Patricia Rios

Background: While the volume of virtual visits increased with the COVID-19 pandemic, little is still known regarding the quality of virtual visits. Furthermore, there is limited guidance on how best to evaluate the quality of virtual care initiatives. Objective: The objective of this study was to curate a balanced set of quality indicators grounded in the Quintuple Aim quality framework and the National Academy of Medicine domains of quality, including sustainability, to monitor the quality of virtual care in ambulatory environments. Methods: Phase 1 involved curating a list of ambulatory virtual care quality indicators from published and grey literature, along with knowledge user feedback generated through a pre-Delphi survey; these indicators were mapped and categorized to the Quintuple Aim and National Academy of Medicine (NAM) Quality Domains. In phase 2, a 19-member pan-Canadian panel was convened as part of a 3-round modified Delphi panel process to rate and rank the quality indicators. The panel included clinicians, individuals with lived experience with the health care system, policy makers, academics, and administrators. Panelists rated indicators using the Agency for Healthcare Research and Quality measure attributes on a 9-point Likert scale in round 1, followed by a virtual Delphi panel meeting to discuss indicators before round 2 of re-rating, then a final round 3 of ranking which assessed the importance of indicators within each quality domain and subdomain. To address gaps in the literature, novel quality indicators of virtual care were identified and discussed in panel discussions, patient group consultations, and a pre-Delphi survey. For indicator advancement during the rating exercises, 75% or more of the panelists’ responses in the top tertile (scores of 7-9) with a median composite score of 7 or greater was required. Results: There were 140 quality indicators identified in the literature which progressed through the 3 Delphi panel rounds. There was minimal attrition among Delphi panel members (17/19, 89% participated in all 3 rounds). After round 3, 25 indicators were included in the final scorecard. Aligned with the Quintuple Aim, there are 13 quality indicators on patient experience, 6 on provider experience, 2 on population health, 2 on health equity, and 2 on health system costs. Conclusions: A balanced set of 25 quality indicators of ambulatory virtual care was developed based on literature and consensus building from knowledge users across the health system. This curated set of indicators will support more comprehensive evaluations of virtual care. Organizations can use the set of indicators as part of a scorecard to compare across jurisdictions, identify priority areas, and ensure their virtual care initiatives are delivering high-quality care based on multiple domains of quality.

BACKGROUND While the volume of virtual visits increased with the COVID-19 pandemic, little is still known regarding the quality of virtual visits. Furthermore, there is limited guidance on how best to evaluate the quality of virtual care initiatives. OBJECTIVE The objective of this study was to curate a balanced set of quality indicators grounded in the Quintuple Aim quality framework and the National Academy of Medicine domains of quality, including sustainability, to monitor the quality of virtual care in ambulatory environments. METHODS Phase 1 involved curating a list of ambulatory virtual care quality indicators from published and grey literature, along with knowledge user feedback generated through a pre-Delphi survey; these indicators were mapped and categorized to the Quintuple Aim and National Academy of Medicine (NAM) Quality Domains. In phase 2, a 19-member pan-Canadian panel was convened as part of a 3-round modified Delphi panel process to rate and rank the quality indicators. The panel included clinicians, individuals with lived experience with the health care system, policy makers, academics, and administrators. Panelists rated indicators using the Agency for Healthcare Research and Quality measure attributes on a 9-point Likert scale in round 1, followed by a virtual Delphi panel meeting to discuss indicators before round 2 of re-rating, then a final round 3 of ranking which assessed the importance of indicators within each quality domain and subdomain. To address gaps in the literature, novel quality indicators of virtual care were identified and discussed in panel discussions, patient group consultations, and a pre-Delphi survey. For indicator advancement during the rating exercises, 75% or more of the panelists’ responses in the top tertile (scores of 7-9) with a median composite score of 7 or greater was required. RESULTS There were 140 quality indicators identified in the literature which progressed through the 3 Delphi panel rounds. There was minimal attrition among Delphi panel members (17/19, 89% participated in all 3 rounds). After round 3, 25 indicators were included in the final scorecard. Aligned with the Quintuple Aim, there are 13 quality indicators on patient experience, 6 on provider experience, 2 on population health, 2 on health equity, and 2 on health system costs. CONCLUSIONS A balanced set of 25 quality indicators of ambulatory virtual care was developed based on literature and consensus building from knowledge users across the health system. This curated set of indicators will support more comprehensive evaluations of virtual care. Organizations can use the set of indicators as part of a scorecard to compare across jurisdictions, identify priority areas, and ensure their virtual care initiatives are delivering high-quality care based on multiple domains of quality.

Introduction: Understanding differences in knowledge and behaviors among men who have sex with men (MSM), men who have sex with women (MSW), and women, is critical to tailor HIV treatment. We investigated these differences among an international sample of people living with HIV (PLHIV) in 25...

Background: Network meta-analysis (NMA) has rapidly grown in use during the past decade for the comparison of healthcare interventions. While its general use in the comparison of conventional medicines has been studied previously, to our awareness, its use to assess complementary and alternative medicines (CAM) has not been studied. A scoping review of the literature was performed to identify systematic reviews incorporating NMAs involving one or more CAM interventions. Methods: An information specialist executed a multi-database search (e.g., MEDLINE, Embase, Cochrane), and two reviewers performed study selection and data collection. Information on publication characteristics, diseases studied, interventions compared, reporting transparency, outcomes assessed, and other parameters were extracted from each review. Results: A total of 89 SR/NMAs were included. The largest number of NMAs was conducted in China (39.3%), followed by the United Kingdom (12.4%) and the United States (9.0%). Reviews were published between 2010 and 2018, with the majority published between 2015 and 2018. More than 90 different CAM therapies appeared at least once, and the median number per NMA was 2 (IQR 1–4); 20.2% of reviews consisted of only CAM therapies. Dietary supplements (51.1%) and vitamins and minerals (42.2%) were the most commonly studied therapies, followed by electrical stimulation (31.1%), herbal medicines (24.4%), and acupuncture and related treatments (22.2%). A diverse set of conditions was identified, the most common being various forms of cancer (11.1%), osteoarthritis of the hip/knee (7.8%), and depression (5.9%). Most reviews adequately addressed a majority of the PRISMA NMA extension items; however, there were limitations in indication of an existing review protocol, exploration of network geometry, and exploration of risk of bias across studies, such as publication bias. Conclusion: The use of NMA to assess the effectiveness of CAM interventions is growing rapidly. Efforts to identify priority topics for future CAM-related NMAs and to enhance methods for CAM comparisons with conventional medicine are needed. Systematic review registration: https://ruor.uottawa.ca/handle/10393/35658

Background: This review aimed to assess the existing evidence regarding the clinical effectiveness and safety of pharmacological and non-pharmacological interventions in adults with insomnia and identify where research or policy development is needed. Methods: MEDLINE, Embase, PsycINFO, The Cochrane Library, and PubMed were searched from inception until June 14, 2017, along with relevant gray literature sites. Two reviewers independently screened titles/abstracts and full-text articles, and a single reviewer with an independent verifier completed charting, data abstraction, and quality appraisal. Results: A total of 64 systematic reviews (35 with meta-analysis) were included after screening 5024 titles and abstracts and 525 full-text articles. Eight of the included reviews were rated as high quality using the Assessment of Multiple Systematic Reviews 2 (AMSTAR2) tool, and over half of the included articles (n = 40) were rated as low or critically low quality. Consistent evidence of effectiveness across multiple outcomes based on more than one high- or moderate quality review with meta-analysis was found for zolpidem, suvorexant, doxepin, melatonin, and cognitive behavioral therapy (CBT), and evidence of effectiveness across multiple outcomes based on one high-quality review with meta-analysis was found for temazepam, triazolam, zopiclone, trazodone, and behavioral interventions. These interventions were mostly evaluated in the short term (< 16 weeks), and there was very little harms data available for the pharmacological interventions making it difficult to evaluate their risk-benefit ratio. Conclusions: Assuming non-pharmacological interventions are preferable from a safety perspective CBT can be considered an effective first-line therapy for adults with insomnia followed by other behavioral interventions. Short courses of pharmacological interventions can be supplements to CBT or behavioral therapy; however, no evidence regarding the appropriate duration of pharmacological therapy is available from these reviews. Systematic review registration: PROSPERO CRD42017072527.

It is unclear how to engage a wide range of knowledge users in research. We aimed to map the evidence on engaging knowledge users with an emphasis on policy-makers, health system managers, and policy analysts in the knowledge synthesis process through a scoping review. We used the Joanna Briggs Institute guidance for scoping reviews. Nine electronic databases (e.g., MEDLINE), two grey literature sources (e.g., OpenSIGLE), and reference lists of relevant systematic reviews were searched from 1996 to August 2016. We included any type of study describing strategies, barriers and facilitators, or assessing the impact of engaging policy-makers, health system managers, and policy analysts in the knowledge synthesis process. Screening and data abstraction were conducted by two reviewers independently with a third reviewer resolving discrepancies. Frequency and thematic analyses were conducted. After screening 8395 titles and abstracts followed by 394 full-texts, 84 unique documents and 7 companion reports fulfilled our eligibility criteria. All 84 documents were published in the last 10 years, and half were prepared in North America. The most common type of knowledge synthesis with knowledge user engagement was a systematic review (36%). The knowledge synthesis most commonly addressed an issue at the level of national healthcare system (48%) and focused on health services delivery (17%) in high-income countries (86%). Policy-makers were the most common (64%) knowledge users, followed by healthcare professionals (49%) and government agencies as well as patients and caregivers (34%). Knowledge users were engaged in conceptualization and design (49%), literature search and data collection (52%), data synthesis and interpretation (71%), and knowledge dissemination and application (44%). Knowledge users were most commonly engaged as key informants through meetings and workshops as well as surveys, focus groups, and interviews either in-person or by telephone and emails. Knowledge user content expertise/awareness was a common facilitator (18%), while lack of time or opportunity to participate was a common barrier (12%). Knowledge users were most commonly engaged during the data synthesis and interpretation phases of the knowledge synthesis conduct. Researchers should document and evaluate knowledge user engagement in knowledge synthesis. Open Science Framework ( https://osf.io/4dy53/ ).

Background Postoperative delirium is a common preventable complication experienced by older adults undergoing elective surgery. In this systematic review and meta-analysis, we identified prognostic factors associated with the risk of postoperative delirium among older adults undergoing elective surgery. Methods Medline, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, and AgeLine were searched for articles published between inception and April 21, 2016. A total of 5692 titles and abstracts were screened in duplicate for possible inclusion. Studies using any method for diagnosing delirium were eligible. Two reviewers independently completed all data extraction and quality assessments using the Cochrane Risk-of-Bias Tool for randomized controlled trials (RCTs) and the Newcastle-Ottawa Scale (NOS) for cohort studies. Random effects meta-analysis models were used to derive pooled effect estimates. Results Forty-one studies (9384 patients) reported delirium-related prognostic factors. Among our included studies, the pooled incidence of postoperative delirium was 18.4% (95% confidence interval [CI] 14.3–23.3%, number needed to follow [NNF] = 6). Geriatric syndromes were important predictors of delirium, namely history of delirium (odds ratio [OR] 6.4, 95% CI 2.2–17.9), frailty (OR 4.1, 95% CI 1.4–11.7), cognitive impairment (OR 2.7, 95% CI 1.9–3.8), impairment in activities of daily living (ADLs; OR 2.1, 95% CI 1.6–2.6), and impairment in instrumental activities of daily living (IADLs; OR 1.9, 95% CI 1.3–2.8). Potentially modifiable prognostic factors such as psychotropic medication use (OR 2.3, 95% CI 1.4–3.6) and smoking status (OR 1.8 95% CI 1.3–2.4) were also identified. Caregiver support was associated with lower odds of postoperative delirium (OR 0.69, 95% CI 0.52–0.91). Discussion Though caution must be used in interpreting meta-analyses of non-randomized studies due to the potential influence of unmeasured confounding, we identified potentially modifiable prognostic factors including frailty and psychotropic medication use that should be targeted to optimize care.

Elective surgeries can be associated with significant harm to older adults. The present study aimed to identify the prognostic factors associated with the development of postoperative complications among older adults undergoing elective surgery. Medline, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials, and AgeLine were searched for articles published between inception and April 21, 2016. Prospective studies reporting prognostic factors associated with postoperative complications (composite outcome of medical and surgical complications), functional decline, mortality, post-hospitalization discharge destination, and prolonged hospitalization among older adults undergoing elective surgery were included. Study characteristics and prognostic factors associated with the outcomes of interest were extracted independently by two reviewers. Random effects meta-analysis models were used to derive pooled effect estimates for prognostic factors and incidences of adverse outcomes. Of the 5692 titles and abstracts that were screened for inclusion, 44 studies (12,281 patients) reported on the following adverse postoperative outcomes: postoperative complications (n =28), postoperative mortality (n = 11), length of hospitalization (n = 21), functional decline (n = 6), and destination at discharge from hospital (n = 13). The pooled incidence of postoperative complications was 25.17% (95% confidence interval (CI) 18.03–33.98%, number needed to follow = 4). The geriatric syndromes of frailty (odds ratio (OR) 2.16, 95% CI 1.29–3.62) and cognitive impairment (OR 2.01, 95% CI 1.44–2.81) were associated with developing postoperative complications; however, there was no association with traditionally assessed prognostic factors such as age (OR 1.07, 95% CI 1.00–1.14) or American Society of Anesthesiologists status (OR 2.62, 95% CI 0.78–8.79). Besides frailty, other potentially modifiable prognostic factors, including depressive symptoms (OR 1.77, 95% CI 1.22–2.56) and smoking (OR 2.43, 95% CI 1.32–4.46), were also associated with developing postoperative complications. Geriatric syndromes are important prognostic factors for postoperative complications. We identified potentially modifiable prognostic factors (e.g., frailty, depressive symptoms, and smoking) associated with developing postoperative complications that can be targeted preoperatively to optimize care.

Pregnant women with epilepsy frequently experience seizures related to pregnancy complications and are often prescribed anti-epileptic drugs (AEDs) to manage their symptoms. However, less is known about the comparative safety of AED exposure in utero. We aimed to compare the risk of congenital malformations (CMs) and prenatal outcomes of AEDs in infants/children who were exposed to AEDs in utero through a systematic review and Bayesian random-effects network meta-analysis. MEDLINE, EMBASE, and Cochrane CENTRAL were searched from inception to December 15, 2015. Two reviewers independently screened titles/abstracts and full-text papers for experimental and observational studies comparing mono- or poly-therapy AEDs versus control (no AED exposure) or other AEDs, then abstracted data and appraised the risk of bias. The primary outcome was incidence of major CMs, overall and by specific type (cardiac malformations, hypospadias, cleft lip and/or palate, club foot, inguinal hernia, and undescended testes). After screening 5305 titles and abstracts, 642 potentially relevant full-text articles, and 17 studies from scanning reference lists, 96 studies were eligible (n = 58,461 patients). Across all major CMs, many AEDs were associated with higher risk compared to control. For major CMs, ethosuximide (OR, 3.04; 95% CrI, 1.23–7.07), valproate (OR, 2.93; 95% CrI, 2.36–3.69), topiramate (OR, 1.90; 95% CrI, 1.17–2.97), phenobarbital (OR, 1.83; 95% CrI, 1.35–2.47), phenytoin (OR, 1.67; 95% CrI, 1.30–2.17), carbamazepine (OR, 1.37; 95% CrI, 1.10–1.71), and 11 polytherapies were significantly more harmful than control, but lamotrigine (OR, 0.96; 95% CrI, 0.72–1.25) and levetiracetam (OR, 0.72; 95% CrI, 0.43–1.16) were not. The newer generation AEDs, lamotrigine and levetiracetam, were not associated with significant increased risks of CMs compared to control, and were significantly less likely to be associated with children experiencing cardiac malformations than control. However, this does not mean that these agents are not harmful to infants/children exposed in utero. Counselling is advised concerning teratogenic risks when the prescription is written for a woman of childbearing age and before women continue with these agents when considering pregnancy, such as switching from polytherapy to monotherapy with evidence of lower risk and avoiding AEDs, such as valproate, that are consistently associated with CMs. These decisions must be balanced against the need for seizure control. PROSPERO CRD42014008925