Caroline A. Bravo
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Caroline A. Bravo has a total of 62 co-authors. Here are the top co-authors by number of shared publications:
- Diego Llovet
Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
5 shared publications - Gratianne Vaisson
Department of Family and Emergency Medicine, Faculty of Medicine, Laval University, Quebec City, Québec, Canada
4 shared publications - Holly O. Witteman
Department of Family and Emergency Medicine, Faculty of Medicine, Laval University, Quebec City, QC, Canada
4 shared publications - Jill Tinmouth
Sunnybrook Health Science Centre 4 Toronto, Ontario
4 shared publications - Justin Presseau
Ottawa Hospital Research Institute
4 shared publications - Laura Desveaux
Institute for Better Health, Trillium Health Partners, Mississauga, Ontario, Canada
4 shared publications
Latest Publications
- 19 April 2024
- Published by Springer Nature in Nature Medicine
- Vol. 30 (4) , 1054-1064
Risk-based lung cancer screening performance in a universal healthcare setting
Globally, lung cancer is the leading cause of cancer death. Previous trials demonstrated that low-dose computed tomography lung cancer screening of high-risk individuals can reduce lung cancer mortality by 20% or more. Lung cancer screening has been approved by major guidelines in the United States, and over 4,000 sites offer screening. Adoption of lung screening outside the United States has, until recently, been slow. Between June 2017 and May 2019, the Ontario Lung Cancer Screening Pilot successfully recruited 7,768 individuals at high risk identified by using the PLCOm2012noRace lung cancer risk prediction model. In total, 4,451 participants were successfully screened, retained and provided with high-quality follow-up, including appropriate treatment. In the Ontario Lung Cancer Screening Pilot, the lung cancer detection rate and the proportion of early-stage cancers were 2.4% and 79.2%, respectively; serious harms were infrequent; and sensitivity to detect lung cancers was 95.3% or more. With abnormal scans defined as ones leading to diagnostic investigation, specificity was 95.5% (positive predictive value, 35.1%), and adherence to annual recall and early surveillance scans and clinical investigations were high (>85%). The Ontario Lung Cancer Screening Pilot provides insights into how a risk-based organized lung screening program can be implemented in a large, diverse, populous geographic area within a universal healthcare system.
- 19 April 2024
- Published by Springer Nature in Nature Medicine
- Vol. 30 (4) , 1054-1064
Risk-based lung cancer screening performance in a universal healthcare setting
Globally, lung cancer is the leading cause of cancer death. Previous trials demonstrated that low-dose computed tomography lung cancer screening of high-risk individuals can reduce lung cancer mortality by 20% or more. Lung cancer screening has been approved by major guidelines in the United States, and over 4,000 sites offer screening. Adoption of lung screening outside the United States has, until recently, been slow. Between June 2017 and May 2019, the Ontario Lung Cancer Screening Pilot successfully recruited 7,768 individuals at high risk identified by using the PLCOm2012noRace lung cancer risk prediction model. In total, 4,451 participants were successfully screened, retained and provided with high-quality follow-up, including appropriate treatment. In the Ontario Lung Cancer Screening Pilot, the lung cancer detection rate and the proportion of early-stage cancers were 2.4% and 79.2%, respectively; serious harms were infrequent; and sensitivity to detect lung cancers was 95.3% or more. With abnormal scans defined as ones leading to diagnostic investigation, specificity was 95.5% (positive predictive value, 35.1%), and adherence to annual recall and early surveillance scans and clinical investigations were high (>85%). The Ontario Lung Cancer Screening Pilot provides insights into how a risk-based organized lung screening program can be implemented in a large, diverse, populous geographic area within a universal healthcare system.
- Open Access
- 9 May 2022
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 11 (5) , e31739
Developing Reporting Guidelines for Social Media Research (RESOME) by Using a Modified Delphi Method: Protocol for Guideline Development
Background: Social media platforms, such as Facebook, Twitter, and Instagram, are being increasingly used to deliver public health interventions. Despite the high level of research interest, there is no consensus or guidance on how to report on social media interventions. Reporting guidelines that incorporate elements from behavior change theories and social media engagement frameworks could foster more robust evaluations that capture outcomes that have an impact on behavior change and engagement. Objective: The aim of this project is to develop, publish, and promote a list of items for our Reporting Guidelines for Social Media Research (RESOME) checklist. Methods: RESOME will be developed by using a modified Delphi approach wherein 2 rounds of questionnaires will be sent to experts and stakeholders. The questionnaires will ask them to rate their agreement with a series of statements until a level of consensus is reached. This will be followed by a web-based consensus meeting to finalize the reporting guidelines. After the consensus meeting, the reporting guidelines will be published in the form of a paper outlining the need for the new guidelines and how the guidelines were developed, along with the finalized checklist for reporting. Prior to publication, the guidelines will be piloted to check for understanding and simplify the language used, if necessary. Results: The first draft of RESOME has been developed. Round 1 of the Delphi survey took place between July and December 2021. Round 2 is due to take place in February 2022, and the web-based consensus meeting will be scheduled for the spring of 2022. Conclusions: Developing RESOME has the potential to contribute to improved reporting, and such guidelines will make it easier to assess the effectiveness of social media interventions. Future work will be needed to evaluate our guidelines’ usefulness and practicality. International Registered Report Identifier (IRRID): PRR1-10.2196/31739
- 9 May 2022
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 11 (5) , e31739
Open AccessDeveloping Reporting Guidelines for Social Media Research (RESOME) by Using a Modified Delphi Method: Protocol for Guideline Development
Background: Social media platforms, such as Facebook, Twitter, and Instagram, are being increasingly used to deliver public health interventions. Despite the high level of research interest, there is no consensus or guidance on how to report on social media interventions. Reporting guidelines that incorporate elements from behavior change theories and social media engagement frameworks could foster more robust evaluations that capture outcomes that have an impact on behavior change and engagement. Objective: The aim of this project is to develop, publish, and promote a list of items for our Reporting Guidelines for Social Media Research (RESOME) checklist. Methods: RESOME will be developed by using a modified Delphi approach wherein 2 rounds of questionnaires will be sent to experts and stakeholders. The questionnaires will ask them to rate their agreement with a series of statements until a level of consensus is reached. This will be followed by a web-based consensus meeting to finalize the reporting guidelines. After the consensus meeting, the reporting guidelines will be published in the form of a paper outlining the need for the new guidelines and how the guidelines were developed, along with the finalized checklist for reporting. Prior to publication, the guidelines will be piloted to check for understanding and simplify the language used, if necessary. Results: The first draft of RESOME has been developed. Round 1 of the Delphi survey took place between July and December 2021. Round 2 is due to take place in February 2022, and the web-based consensus meeting will be scheduled for the spring of 2022. Conclusions: Developing RESOME has the potential to contribute to improved reporting, and such guidelines will make it easier to assess the effectiveness of social media interventions. Future work will be needed to evaluate our guidelines’ usefulness and practicality. International Registered Report Identifier (IRRID): PRR1-10.2196/31739
- Open Access
- 2 July 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Developing Reporting Guidelines for Social Media Research (RESOME) by Using a Modified Delphi Method: Protocol for Guideline Development (Preprint)
BACKGROUND Social media platforms, such as Facebook, Twitter, and Instagram, are being increasingly used to deliver public health interventions. Despite the high level of research interest, there is no consensus or guidance on how to report on social media interventions. Reporting guidelines that incorporate elements from behavior change theories and social media engagement frameworks could foster more robust evaluations that capture outcomes that have an impact on behavior change and engagement. OBJECTIVE The aim of this project is to develop, publish, and promote a list of items for our Reporting Guidelines for Social Media Research (RESOME) checklist. METHODS RESOME will be developed by using a modified Delphi approach wherein 2 rounds of questionnaires will be sent to experts and stakeholders. The questionnaires will ask them to rate their agreement with a series of statements until a level of consensus is reached. This will be followed by a web-based consensus meeting to finalize the reporting guidelines. After the consensus meeting, the reporting guidelines will be published in the form of a paper outlining the need for the new guidelines and how the guidelines were developed, along with the finalized checklist for reporting. Prior to publication, the guidelines will be piloted to check for understanding and simplify the language used, if necessary. RESULTS The first draft of RESOME has been developed. Round 1 of the Delphi survey took place between July and December 2021. Round 2 is due to take place in February 2022, and the web-based consensus meeting will be scheduled for the spring of 2022. CONCLUSIONS Developing RESOME has the potential to contribute to improved reporting, and such guidelines will make it easier to assess the effectiveness of social media interventions. Future work will be needed to evaluate our guidelines’ usefulness and practicality. INTERNATIONAL REGISTERED REPORT PRR1-10.2196/31739
- 2 July 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDeveloping Reporting Guidelines for Social Media Research (RESOME) by Using a Modified Delphi Method: Protocol for Guideline Development (Preprint)
BACKGROUND Social media platforms, such as Facebook, Twitter, and Instagram, are being increasingly used to deliver public health interventions. Despite the high level of research interest, there is no consensus or guidance on how to report on social media interventions. Reporting guidelines that incorporate elements from behavior change theories and social media engagement frameworks could foster more robust evaluations that capture outcomes that have an impact on behavior change and engagement. OBJECTIVE The aim of this project is to develop, publish, and promote a list of items for our Reporting Guidelines for Social Media Research (RESOME) checklist. METHODS RESOME will be developed by using a modified Delphi approach wherein 2 rounds of questionnaires will be sent to experts and stakeholders. The questionnaires will ask them to rate their agreement with a series of statements until a level of consensus is reached. This will be followed by a web-based consensus meeting to finalize the reporting guidelines. After the consensus meeting, the reporting guidelines will be published in the form of a paper outlining the need for the new guidelines and how the guidelines were developed, along with the finalized checklist for reporting. Prior to publication, the guidelines will be piloted to check for understanding and simplify the language used, if necessary. RESULTS The first draft of RESOME has been developed. Round 1 of the Delphi survey took place between July and December 2021. Round 2 is due to take place in February 2022, and the web-based consensus meeting will be scheduled for the spring of 2022. CONCLUSIONS Developing RESOME has the potential to contribute to improved reporting, and such guidelines will make it easier to assess the effectiveness of social media interventions. Future work will be needed to evaluate our guidelines’ usefulness and practicality. INTERNATIONAL REGISTERED REPORT PRR1-10.2196/31739
- Open Access
- 4 September 2018
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 5 (3) , e25
Designing Emails Aimed at Increasing Family Physicians’ Use of a Web-Based Audit and Feedback Tool to Improve Cancer Screening Rates: Cocreation Process
Background: Providing clinical performance data to health professionals, a process known as audit and feedback, can play an important role in health system improvement. However, audit and feedback tools can only be effective if the targeted health professionals access and actively review their data. Email is used by Cancer Care Ontario, a provincial cancer agency, to promote access to a Web-based audit and feedback tool called the Screening Activity Report (SAR); however, current emails that lack behavior change content have been ineffective at encouraging log-in to the SAR. Objective: The objective of our study was to describe the process and experience of developing email content that incorporates user input and behavior change techniques (BCTs) to promote the use of the SAR among Ontario primary care providers. Methods: Our interdisciplinary research team first identified BCTs shown to be effective in other settings that could be adapted to promote use of the SAR. We then developed draft BCT-informed email content. Next, we conducted cocreation workshops with physicians who had logged in to the SAR more than once over the past year. Participants provided reactions to researcher-developed BCT-informed content and helped to develop an email that they believed would prompt their colleagues to use the SAR. Content from cocreation workshops was brought to focus groups with physicians who had not used the SAR in the past year. We analyzed notes from the cocreation workshops and focus groups to inform decisions about content. Finally, 8 emails were created to test BCT-informed content in a 2×2×2 factorial randomized experiment. Results: We identified 3 key tensions during the development of the email that required us to balance user input with scientific evidence, organizational policies, and our scientific objectives, which are as follows: conflict between user preference and scientific evidence, privacy constraints around personalizing unencrypted emails with performance data, and using cocreation methods in a study with the objective of developing an email that featured BCT-informed content. Conclusions: Teams tasked with developing content to promote health professional engagement with audit and feedback or other quality improvement tools might consider cocreation processes for developing communications that are informed by both users and BCTs. Teams should be cautious about making decisions solely based on user reactions because what users seem to prefer is not always the same as what works. Furthermore, implementing user recommendations may not always be feasible. Teams may face challenges when using cocreation methods to develop a product with the simultaneous goal of having clearly defined variables to test in later studies. The expected role of users, evidence, and the implementation context all warrant consideration to determine whether and how cocreation methods could help to achieve design and scientific objectives.
- 4 September 2018
- Published by JMIR Publications Inc. in JMIR Human Factors
- Vol. 5 (3) , e25
Open AccessDesigning Emails Aimed at Increasing Family Physicians’ Use of a Web-Based Audit and Feedback Tool to Improve Cancer Screening Rates: Cocreation Process
Background: Providing clinical performance data to health professionals, a process known as audit and feedback, can play an important role in health system improvement. However, audit and feedback tools can only be effective if the targeted health professionals access and actively review their data. Email is used by Cancer Care Ontario, a provincial cancer agency, to promote access to a Web-based audit and feedback tool called the Screening Activity Report (SAR); however, current emails that lack behavior change content have been ineffective at encouraging log-in to the SAR. Objective: The objective of our study was to describe the process and experience of developing email content that incorporates user input and behavior change techniques (BCTs) to promote the use of the SAR among Ontario primary care providers. Methods: Our interdisciplinary research team first identified BCTs shown to be effective in other settings that could be adapted to promote use of the SAR. We then developed draft BCT-informed email content. Next, we conducted cocreation workshops with physicians who had logged in to the SAR more than once over the past year. Participants provided reactions to researcher-developed BCT-informed content and helped to develop an email that they believed would prompt their colleagues to use the SAR. Content from cocreation workshops was brought to focus groups with physicians who had not used the SAR in the past year. We analyzed notes from the cocreation workshops and focus groups to inform decisions about content. Finally, 8 emails were created to test BCT-informed content in a 2×2×2 factorial randomized experiment. Results: We identified 3 key tensions during the development of the email that required us to balance user input with scientific evidence, organizational policies, and our scientific objectives, which are as follows: conflict between user preference and scientific evidence, privacy constraints around personalizing unencrypted emails with performance data, and using cocreation methods in a study with the objective of developing an email that featured BCT-informed content. Conclusions: Teams tasked with developing content to promote health professional engagement with audit and feedback or other quality improvement tools might consider cocreation processes for developing communications that are informed by both users and BCTs. Teams should be cautious about making decisions solely based on user reactions because what users seem to prefer is not always the same as what works. Furthermore, implementing user recommendations may not always be feasible. Teams may face challenges when using cocreation methods to develop a product with the simultaneous goal of having clearly defined variables to test in later studies. The expected role of users, evidence, and the implementation context all warrant consideration to determine whether and how cocreation methods could help to achieve design and scientific objectives.
- Open Access
- 16 February 2018
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 7 (2) , e11
Testing Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content
Background: Cancer Care Ontario's Screening Activity Report (SAR) is an online audit and feedback tool designed to help primary care physicians in Ontario, Canada, identify patients who are overdue for cancer screening or have abnormal results requiring follow-up. Use of the SAR is associated with increased screening rates. To encourage SAR use, Cancer Care Ontario sends monthly emails to registered primary care physicians announcing that updated data are available. However, analytics reveal that 50% of email recipients do not open the email and less than 7% click the embedded link to log in to their report. Objective: The goal of the study is to determine whether rewritten emails result in increased log-ins. This manuscript describes how different user-and theory-informed messages intended to improve the impact of the monthly emails will be experimentally tested and how a process evaluation will explore why and how any effects observed were (or were not) achieved. Methods: A user-centered approach was used to rewrite the content of the monthly email, including messages operationalizing 3 behavior change techniques: anticipated regret, material incentive (behavior), and problem solving. A pragmatic, 2x2x2 factorial experiment within a multiphase optimization strategy will test the redesigned emails with an embedded qualitative process evaluation to understand how and why the emails may or may not have worked. Trial outcomes will be ascertained using routinely collected administrative data. Physicians will be recruited for semistructured interviews using convenience and snowball sampling. Results: As of April 2017, 5576 primary care physicians across the province of Ontario, Canada, had voluntarily registered for the SAR, and in so doing, signed up to receive the monthly email updates. From May to August 2017 participants received the redesigned monthly emails with content specific to their allocated experimental condition prompting use of the SAR. We have not yet begun analyses. Conclusions: This study will inform how to communicate effectively with primary care providers by email and identify which behavior change techniques tested are most effective at encouraging engagement with an audit and feedback report.
- 16 February 2018
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 7 (2) , e11
Open AccessTesting Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content
Background: Cancer Care Ontario's Screening Activity Report (SAR) is an online audit and feedback tool designed to help primary care physicians in Ontario, Canada, identify patients who are overdue for cancer screening or have abnormal results requiring follow-up. Use of the SAR is associated with increased screening rates. To encourage SAR use, Cancer Care Ontario sends monthly emails to registered primary care physicians announcing that updated data are available. However, analytics reveal that 50% of email recipients do not open the email and less than 7% click the embedded link to log in to their report. Objective: The goal of the study is to determine whether rewritten emails result in increased log-ins. This manuscript describes how different user-and theory-informed messages intended to improve the impact of the monthly emails will be experimentally tested and how a process evaluation will explore why and how any effects observed were (or were not) achieved. Methods: A user-centered approach was used to rewrite the content of the monthly email, including messages operationalizing 3 behavior change techniques: anticipated regret, material incentive (behavior), and problem solving. A pragmatic, 2x2x2 factorial experiment within a multiphase optimization strategy will test the redesigned emails with an embedded qualitative process evaluation to understand how and why the emails may or may not have worked. Trial outcomes will be ascertained using routinely collected administrative data. Physicians will be recruited for semistructured interviews using convenience and snowball sampling. Results: As of April 2017, 5576 primary care physicians across the province of Ontario, Canada, had voluntarily registered for the SAR, and in so doing, signed up to receive the monthly email updates. From May to August 2017 participants received the redesigned monthly emails with content specific to their allocated experimental condition prompting use of the SAR. We have not yet begun analyses. Conclusions: This study will inform how to communicate effectively with primary care providers by email and identify which behavior change techniques tested are most effective at encouraging engagement with an audit and feedback report.
- Open Access
- 18 January 2018
- Published by JMIR Publications Inc. in JMIR Preprints
Designing Emails Aimed at Increasing Family Physicians Use of a Web-Based Audit and Feedback Tool to Improve Cancer Screening Rates: Cocreation Process (Preprint)
BACKGROUND Providing clinical performance data to health professionals, a process known as audit and feedback, can play an important role in health system improvement. However, audit and feedback tools can only be effective if the targeted health professionals access and actively review their data. Email is used by Cancer Care Ontario, a provincial cancer agency, to promote access to a Web-based audit and feedback tool called the Screening Activity Report (SAR); however, current emails that lack behavior change content have been ineffective at encouraging log-in to the SAR. OBJECTIVE The objective of our study was to describe the process and experience of developing email content that incorporates user input and behavior change techniques (BCTs) to promote the use of the SAR among Ontario primary care providers. METHODS Our interdisciplinary research team first identified BCTs shown to be effective in other settings that could be adapted to promote use of the SAR. We then developed draft BCT-informed email content. Next, we conducted cocreation workshops with physicians who had logged in to the SAR more than once over the past year. Participants provided reactions to researcher-developed BCT-informed content and helped to develop an email that they believed would prompt their colleagues to use the SAR. Content from cocreation workshops was brought to focus groups with physicians who had not used the SAR in the past year. We analyzed notes from the cocreation workshops and focus groups to inform decisions about content. Finally, 8 emails were created to test BCT-informed content in a 2×2×2 factorial randomized experiment. RESULTS We identified 3 key tensions during the development of the email that required us to balance user input with scientific evidence, organizational policies, and our scientific objectives, which are as follows: conflict between user preference and scientific evidence, privacy constraints around personalizing unencrypted emails with performance data, and using cocreation methods in a study with the objective of developing an email that featured BCT-informed content. CONCLUSIONS Teams tasked with developing content to promote health professional engagement with audit and feedback or other quality improvement tools might consider cocreation processes for developing communications that are informed by both users and BCTs. Teams should be cautious about making decisions solely based on user reactions because what users seem to prefer is not always the same as what works. Furthermore, implementing user recommendations may not always be feasible. Teams may face challenges when using cocreation methods to develop a product with the simultaneous goal of having clearly defined variables to test in later studies. The expected role of users, evidence, and the implementation context all warrant consideration to determine whether and how cocreation methods could help to achieve design and scientific objectives.
- 18 January 2018
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessDesigning Emails Aimed at Increasing Family Physicians Use of a Web-Based Audit and Feedback Tool to Improve Cancer Screening Rates: Cocreation Process (Preprint)
BACKGROUND Providing clinical performance data to health professionals, a process known as audit and feedback, can play an important role in health system improvement. However, audit and feedback tools can only be effective if the targeted health professionals access and actively review their data. Email is used by Cancer Care Ontario, a provincial cancer agency, to promote access to a Web-based audit and feedback tool called the Screening Activity Report (SAR); however, current emails that lack behavior change content have been ineffective at encouraging log-in to the SAR. OBJECTIVE The objective of our study was to describe the process and experience of developing email content that incorporates user input and behavior change techniques (BCTs) to promote the use of the SAR among Ontario primary care providers. METHODS Our interdisciplinary research team first identified BCTs shown to be effective in other settings that could be adapted to promote use of the SAR. We then developed draft BCT-informed email content. Next, we conducted cocreation workshops with physicians who had logged in to the SAR more than once over the past year. Participants provided reactions to researcher-developed BCT-informed content and helped to develop an email that they believed would prompt their colleagues to use the SAR. Content from cocreation workshops was brought to focus groups with physicians who had not used the SAR in the past year. We analyzed notes from the cocreation workshops and focus groups to inform decisions about content. Finally, 8 emails were created to test BCT-informed content in a 2×2×2 factorial randomized experiment. RESULTS We identified 3 key tensions during the development of the email that required us to balance user input with scientific evidence, organizational policies, and our scientific objectives, which are as follows: conflict between user preference and scientific evidence, privacy constraints around personalizing unencrypted emails with performance data, and using cocreation methods in a study with the objective of developing an email that featured BCT-informed content. CONCLUSIONS Teams tasked with developing content to promote health professional engagement with audit and feedback or other quality improvement tools might consider cocreation processes for developing communications that are informed by both users and BCTs. Teams should be cautious about making decisions solely based on user reactions because what users seem to prefer is not always the same as what works. Furthermore, implementing user recommendations may not always be feasible. Teams may face challenges when using cocreation methods to develop a product with the simultaneous goal of having clearly defined variables to test in later studies. The expected role of users, evidence, and the implementation context all warrant consideration to determine whether and how cocreation methods could help to achieve design and scientific objectives.
- Open Access
- 5 October 2017
- Published by JMIR Publications Inc.
- Vol. 7 (2) , e11
Testing Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content
- 5 October 2017
- Published by JMIR Publications Inc.
- Vol. 7 (2) , e11
Open AccessTesting Behavior Change Techniques to Encourage Primary Care Physicians to Access Cancer Screening Audit and Feedback Reports: Protocol for a Factorial Randomized Experiment of Email Content