Ružica Tokalić
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Ružica Tokalić has a total of 87 co-authors. Here are the top co-authors by number of shared publications:
- Ana Marušić
Department of Research, University Hospital of Split, Spinčićeva 1, 21000 Split, Croatia
11 shared publications - Marin Viđak
Department of Cardiovascular Medicine, Clinical Hospital Dubrava, Zagreb, Croatia
8 shared publications - Tina Poklepovic Pericic
Department of Prosthodontics, Study of Dental Medicine, University of Split School of Medicine, 21000 Split, Croatia
6 shared publications - Ivan Buljan
Department of Psychology, Faculty of Humanities and Social Sciences, University of Split, 21000 Split, Croatia
5 shared publications - Livia Puljak
Center for Evidence-Based Medicine, Catholic University of Croatia, Zagreb, Croatia
5 shared publications - Fran Šaler
Department of Cardiovascular Medicine, Clinical Hospital Dubrava, Zagreb, Croatia
3 shared publications
Latest Publications
- 1 November 2026
- Published by Medicinska Naklada d.o.o. in Cardiologia Croatica
- Vol. 21 (11-12) , 264
Completeness of Intervention Reporting in Mechanical Circulatory Support Studies: A Comparison of ClinicalTrials.gov Registrations and Published Reports
- 1 November 2026
- Published by Medicinska Naklada d.o.o. in Cardiologia Croatica
- Vol. 21 (11-12) , 264
Completeness of Intervention Reporting in Mechanical Circulatory Support Studies: A Comparison of ClinicalTrials.gov Registrations and Published Reports
- 28 May 2026
- Published by Elsevier in Journal of Hospital Infection
- Vol. 174, 170-184
Developing a standardised surgical site infection prevention bundle: a scoping review of clinical practice guidelines
- 28 May 2026
- Published by Elsevier in Journal of Hospital Infection
- Vol. 174, 170-184
Developing a standardised surgical site infection prevention bundle: a scoping review of clinical practice guidelines
- 23 January 2025
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 180, 111685
Heterogeneity across outcomes in clinical trials on sodium-glucose cotransporter 2 inhibitors in chronic heart failure: a cross-sectional study
- 23 January 2025
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 180, 111685
Heterogeneity across outcomes in clinical trials on sodium-glucose cotransporter 2 inhibitors in chronic heart failure: a cross-sectional study
- Open Access
- 23 October 2023
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-9
Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study
Summary of Findings (SoF) tables concisely present the main findings of evidence synthesis of health evidence, but how users navigate it to understand and interpret the presented information is not clear. We quantified the interaction of medical students with an SoF table while answering a knowledge quiz. Read&Learn tool was used to measure the number of target and non-target table cells visited for each question and the time spent on these cells. Students positively identified target elements for quiz questions and answered simpler questions, but struggled with critical thinking and understanding study outcomes. The question on outcomes with the largest improvement post-intervention had the fewest correct answers, the longest interaction with table cells and the most opened cells before answering. Students spent a median of 72% of the time reading target table cells. A heatmap of the interactions showed that they were mostly answer-oriented. Further development of the tool and metrics is needed to use the tool and the metrics to study the cognitive processes during the assessment of health evidence.
- 23 October 2023
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-9
Open AccessTool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study
Summary of Findings (SoF) tables concisely present the main findings of evidence synthesis of health evidence, but how users navigate it to understand and interpret the presented information is not clear. We quantified the interaction of medical students with an SoF table while answering a knowledge quiz. Read&Learn tool was used to measure the number of target and non-target table cells visited for each question and the time spent on these cells. Students positively identified target elements for quiz questions and answered simpler questions, but struggled with critical thinking and understanding study outcomes. The question on outcomes with the largest improvement post-intervention had the fewest correct answers, the longest interaction with table cells and the most opened cells before answering. Students spent a median of 72% of the time reading target table cells. A heatmap of the interactions showed that they were mostly answer-oriented. Further development of the tool and metrics is needed to use the tool and the metrics to study the cognitive processes during the assessment of health evidence.
- Open Access
- 6 June 2023
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25, e43928
Similar Outcomes of Web-Based and Face-to-Face Training of the GRADE Approach for the Certainty of Evidence: Randomized Controlled Trial
Background: The GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach is a system for transparent evaluation of the certainty of evidence used in clinical practice guidelines and systematic reviews. GRADE is a key part of evidence-based medicine (EBM) training of health care professionals. Objective: This study aimed to compare web-based and face-to-face methods of teaching the GRADE approach for evidence assessment. Methods: A randomized controlled trial was conducted on 2 delivery modes of GRADE education integrated into a course on research methodology and EBM with third-year medical students. Education was based on the Cochrane Interactive Learning “Interpreting the findings” module, which had a duration of 90 minutes. The web-based group received the web-based asynchronous training, whereas the face-to-face group had an in-person seminar with a lecturer. The main outcome measure was the score on a 5-question test that assessed confidence interval interpretation and overall certainty of evidence, among others. Secondary outcomes included writing a recommendation for practice and course satisfaction. Results: In all, 50 participants received the web-based intervention, and 47 participants received the face-to-face intervention. The groups did not differ in the overall scores for the Cochrane Interactive Learning test, with a median of 2 (95% CI 1.0-2.0) correct answers for the web-based group and 2 (95% CI 1.3-3.0) correct answers for the face-to-face group. Both groups gave the most correct answers to the question about rating a body of evidence (35/50, 70% and 24/47, 51% for the web-based and face-to-face group, respectively). The face-to-face group better answered the question about the overall certainty of evidence question. The understanding of the Summary of Findings table did not differ significantly between the groups, with a median of 3 correct answers to 4 questions for both groups (P=.352). The writing style for the recommendations for practice also did not differ between the 2 groups. Students’ recommendations mostly reflected the strengths of the recommendations and focused on the target population, but they used passive words and rarely mentioned the setting for the recommendation. The language of the recommendations was mostly patient centered. Course satisfaction was high in both groups. Conclusions: Training in the GRADE approach could be equally effective when delivered asynchronously on the web or face-to-face. Trial Registration: Open Science Framework akpq7; https://osf.io/akpq7/
- 6 June 2023
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25, e43928
Open AccessSimilar Outcomes of Web-Based and Face-to-Face Training of the GRADE Approach for the Certainty of Evidence: Randomized Controlled Trial
Background: The GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach is a system for transparent evaluation of the certainty of evidence used in clinical practice guidelines and systematic reviews. GRADE is a key part of evidence-based medicine (EBM) training of health care professionals. Objective: This study aimed to compare web-based and face-to-face methods of teaching the GRADE approach for evidence assessment. Methods: A randomized controlled trial was conducted on 2 delivery modes of GRADE education integrated into a course on research methodology and EBM with third-year medical students. Education was based on the Cochrane Interactive Learning “Interpreting the findings” module, which had a duration of 90 minutes. The web-based group received the web-based asynchronous training, whereas the face-to-face group had an in-person seminar with a lecturer. The main outcome measure was the score on a 5-question test that assessed confidence interval interpretation and overall certainty of evidence, among others. Secondary outcomes included writing a recommendation for practice and course satisfaction. Results: In all, 50 participants received the web-based intervention, and 47 participants received the face-to-face intervention. The groups did not differ in the overall scores for the Cochrane Interactive Learning test, with a median of 2 (95% CI 1.0-2.0) correct answers for the web-based group and 2 (95% CI 1.3-3.0) correct answers for the face-to-face group. Both groups gave the most correct answers to the question about rating a body of evidence (35/50, 70% and 24/47, 51% for the web-based and face-to-face group, respectively). The face-to-face group better answered the question about the overall certainty of evidence question. The understanding of the Summary of Findings table did not differ significantly between the groups, with a median of 3 correct answers to 4 questions for both groups (P=.352). The writing style for the recommendations for practice also did not differ between the 2 groups. Students’ recommendations mostly reflected the strengths of the recommendations and focused on the target population, but they used passive words and rarely mentioned the setting for the recommendation. The language of the recommendations was mostly patient centered. Course satisfaction was high in both groups. Conclusions: Training in the GRADE approach could be equally effective when delivered asynchronously on the web or face-to-face. Trial Registration: Open Science Framework akpq7; https://osf.io/akpq7/
- Open Access
- 28 March 2023
- Published by Springer Nature
- p. 19-30
Training, Supervision and Mentoring
This chapter aims to introduce you to important aspects of early-career research, particularly doctoral training, including its formal and informal aspects, and to map what is expected from the individuals at different hierarchical positions in their research environment. The purpose of doctoral training is to provide you with knowledge and skills for research that answers important questions, that research is conducted with care and high standards, that you anticipate the implications and applications of its results, and that your research is replicable, transparent and open. This is not and cannot be achieved only through formal training, but through various forms of what is called a hidden curriculum. In this chapter, we will talk about shadowing and role models, research collaboration and international relationships, networking, summer schools and research exchanges. Considering the complexities of relationships in the research setting, we will also talk about the role of doctoral students, and their involvement in supervising others (such as Masters’ students). We will address the principles of respect, honesty and accountability in these networks of collaboration, with special attention to students and supporting staff in academia. Finally, we will discuss the aspects of work and life balance for doctoral students and the importance of existing support networks, with special attention to mental health support and principles of open communication.
- 28 March 2023
- Published by Springer Nature
- p. 19-30
Open AccessTraining, Supervision and Mentoring
This chapter aims to introduce you to important aspects of early-career research, particularly doctoral training, including its formal and informal aspects, and to map what is expected from the individuals at different hierarchical positions in their research environment. The purpose of doctoral training is to provide you with knowledge and skills for research that answers important questions, that research is conducted with care and high standards, that you anticipate the implications and applications of its results, and that your research is replicable, transparent and open. This is not and cannot be achieved only through formal training, but through various forms of what is called a hidden curriculum. In this chapter, we will talk about shadowing and role models, research collaboration and international relationships, networking, summer schools and research exchanges. Considering the complexities of relationships in the research setting, we will also talk about the role of doctoral students, and their involvement in supervising others (such as Masters’ students). We will address the principles of respect, honesty and accountability in these networks of collaboration, with special attention to students and supporting staff in academia. Finally, we will discuss the aspects of work and life balance for doctoral students and the importance of existing support networks, with special attention to mental health support and principles of open communication.
- 9 February 2023
- Published by Taylor & Francis in Accountability in Research
- Vol. 31 (7) , 847-873
Perception of organizational climate by university staff and students in medicine and humanities: A qualitative study
Organizational climate and culture are important for research organizations because they foster research integrity and responsible conduct of research, reduce questionable research practices, and improve job satisfaction. The aim of our study was to explore how employees and students perceive organizational climate and its consequences in the university setting. We conducted semi-structured interviews with senior students and employees (teaching and non-teaching staff) from two different university schools: School of Medicine and Faculty of Humanities and Social Sciences. Participants were asked questions regarding perceived climate, working environment, and the role of the institution. The data were analyzed using reflexive thematic analysis approach. Three themes were identified. The first theme addressed the difference in the perception and understanding of organizational climate. The second theme dealt with institutional issues emanating from organizational climate. The third theme described the behaviour of stakeholders in formation of organizational climate. Organizational climate is important concept in academic organizations as it influences both employees, particularly early careers researchers, and students. Institutional leadership can strongly influence organizational climate, which can in turn affect job and job satisfaction. Due to importance of personal morality on everyday decision-making, virtue-based research integrity training could be useful in improving academic institutions’ organizational climate.
- 9 February 2023
- Published by Taylor & Francis in Accountability in Research
- Vol. 31 (7) , 847-873
Perception of organizational climate by university staff and students in medicine and humanities: A qualitative study
Organizational climate and culture are important for research organizations because they foster research integrity and responsible conduct of research, reduce questionable research practices, and improve job satisfaction. The aim of our study was to explore how employees and students perceive organizational climate and its consequences in the university setting. We conducted semi-structured interviews with senior students and employees (teaching and non-teaching staff) from two different university schools: School of Medicine and Faculty of Humanities and Social Sciences. Participants were asked questions regarding perceived climate, working environment, and the role of the institution. The data were analyzed using reflexive thematic analysis approach. Three themes were identified. The first theme addressed the difference in the perception and understanding of organizational climate. The second theme dealt with institutional issues emanating from organizational climate. The third theme described the behaviour of stakeholders in formation of organizational climate. Organizational climate is important concept in academic organizations as it influences both employees, particularly early careers researchers, and students. Institutional leadership can strongly influence organizational climate, which can in turn affect job and job satisfaction. Due to importance of personal morality on everyday decision-making, virtue-based research integrity training could be useful in improving academic institutions’ organizational climate.
- Open Access
- 30 October 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Similar Outcomes of Web-Based and Face-to-Face Training of the GRADE Approach for the Certainty of Evidence: Randomized Controlled Trial (Preprint)
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: The GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach is a system for transparent evaluation of the certainty of evidence used in clinical practice guidelines and systematic reviews. GRADE is a key part of evidence-based medicine (EBM) training of health care professionals. Objective: This study aimed to compare web-based and face-to-face methods of teaching the GRADE approach for evidence assessment. Methods: A randomized controlled trial was conducted on 2 delivery modes of GRADE education integrated into a course on research methodology and EBM with third-year medical students. Education was based on the Cochrane Interactive Learning “Interpreting the findings” module, which had a duration of 90 minutes. The web-based group received the web-based asynchronous training, whereas the face-to-face group had an in-person seminar with a lecturer. The main outcome measure was the score on a 5-question test that assessed confidence interval interpretation and overall certainty of evidence, among others. Secondary outcomes included writing a recommendation for practice and course satisfaction. Results: In all, 50 participants received the web-based intervention, and 47 participants received the face-to-face intervention. The groups did not differ in the overall scores for the Cochrane Interactive Learning test, with a median of 2 (95% CI 1.0-2.0) correct answers for the web-based group and 2 (95% CI 1.3-3.0) correct answers for the face-to-face group. Both groups gave the most correct answers to the question about rating a body of evidence (35/50, 70% and 24/47, 51% for the web-based and face-to-face group, respectively). The face-to-face group better answered the question about the overall certainty of evidence question. The understanding of the Summary of Findings table did not differ significantly between the groups, with a median of 3 correct answers to 4 questions for both groups (P=.352). The writing style for the recommendations for practice also did not differ between the 2 groups. Students’ recommendations mostly reflected the strengths of the recommendations and focused on the target population, but they used passive words and rarely mentioned the setting for the recommendation. The language of the recommendations was mostly patient centered. Course satisfaction was high in both groups. Conclusions: Training in the GRADE approach could be equally effective when delivered asynchronously on the web or face-to-face. Trial Registration: Open Science Framework akpq7; https://osf.io/akpq7/
- 30 October 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessSimilar Outcomes of Web-Based and Face-to-Face Training of the GRADE Approach for the Certainty of Evidence: Randomized Controlled Trial (Preprint)
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: The GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach is a system for transparent evaluation of the certainty of evidence used in clinical practice guidelines and systematic reviews. GRADE is a key part of evidence-based medicine (EBM) training of health care professionals. Objective: This study aimed to compare web-based and face-to-face methods of teaching the GRADE approach for evidence assessment. Methods: A randomized controlled trial was conducted on 2 delivery modes of GRADE education integrated into a course on research methodology and EBM with third-year medical students. Education was based on the Cochrane Interactive Learning “Interpreting the findings” module, which had a duration of 90 minutes. The web-based group received the web-based asynchronous training, whereas the face-to-face group had an in-person seminar with a lecturer. The main outcome measure was the score on a 5-question test that assessed confidence interval interpretation and overall certainty of evidence, among others. Secondary outcomes included writing a recommendation for practice and course satisfaction. Results: In all, 50 participants received the web-based intervention, and 47 participants received the face-to-face intervention. The groups did not differ in the overall scores for the Cochrane Interactive Learning test, with a median of 2 (95% CI 1.0-2.0) correct answers for the web-based group and 2 (95% CI 1.3-3.0) correct answers for the face-to-face group. Both groups gave the most correct answers to the question about rating a body of evidence (35/50, 70% and 24/47, 51% for the web-based and face-to-face group, respectively). The face-to-face group better answered the question about the overall certainty of evidence question. The understanding of the Summary of Findings table did not differ significantly between the groups, with a median of 3 correct answers to 4 questions for both groups (P=.352). The writing style for the recommendations for practice also did not differ between the 2 groups. Students’ recommendations mostly reflected the strengths of the recommendations and focused on the target population, but they used passive words and rarely mentioned the setting for the recommendation. The language of the recommendations was mostly patient centered. Course satisfaction was high in both groups. Conclusions: Training in the GRADE approach could be equally effective when delivered asynchronously on the web or face-to-face. Trial Registration: Open Science Framework akpq7; https://osf.io/akpq7/
- Open Access
- 25 August 2022
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 24 (8) , e37000
Web-Based Educational Intervention to Improve Knowledge of Systematic Reviews Among Health Science Professionals: Randomized Controlled Trial
Background: Lack of knowledge of systematic reviews (SRs) could prevent individual health care professionals from using SRs as a source of information in their clinical practice or discourage them from participating in such research. Objective: In this randomized controlled trial, we evaluated the effect of a short web-based educational intervention on short-term knowledge of SRs. Methods: Eligible participants were 871 Master’s students of university health sciences studies in Croatia; 589 (67.6%) students who agreed to participate in the trial were randomized using a computer program into 2 groups. Intervention group A (294/589, 49.9%) received a short web-based educational intervention about SR methodology, and intervention group B (295/589, 50.1%) was presented with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. The participants’ knowledge of SRs was assessed before and after the intervention. The participants could not be blinded because of the nature of the intervention. The primary outcome was the difference in the percentage of correct answers about SR methodology per participant between the groups after the intervention, expressed as relative risk and 95% CI. Results: Results from 162 and 165 participants in the educational intervention and PRISMA checklist groups, respectively, were available for analysis. Most of them (educational intervention group: 130/162, 80.2%; PRISMA checklist group: 131/165, 79.4%) were employed as health care professionals in addition to being health sciences students. After the intervention, the educational intervention group had 23% (relative risk percentage) more correct answers in the postintervention questionnaire than the PRISMA checklist group (relative risk=1.23, 95% CI 1.17-1.29). Conclusions: A short web-based educational intervention about SRs is an effective tool for short-term improvement of knowledge of SRs among health care studies students, most of whom were also employed as health care professionals. Further studies are needed to explore the long-term effects of the tested education. Trial Registration: OSF Registries 10.17605/OSF.IO/RYMVC; https://osf.io/rymvc
- 25 August 2022
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 24 (8) , e37000
Open AccessWeb-Based Educational Intervention to Improve Knowledge of Systematic Reviews Among Health Science Professionals: Randomized Controlled Trial
Background: Lack of knowledge of systematic reviews (SRs) could prevent individual health care professionals from using SRs as a source of information in their clinical practice or discourage them from participating in such research. Objective: In this randomized controlled trial, we evaluated the effect of a short web-based educational intervention on short-term knowledge of SRs. Methods: Eligible participants were 871 Master’s students of university health sciences studies in Croatia; 589 (67.6%) students who agreed to participate in the trial were randomized using a computer program into 2 groups. Intervention group A (294/589, 49.9%) received a short web-based educational intervention about SR methodology, and intervention group B (295/589, 50.1%) was presented with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. The participants’ knowledge of SRs was assessed before and after the intervention. The participants could not be blinded because of the nature of the intervention. The primary outcome was the difference in the percentage of correct answers about SR methodology per participant between the groups after the intervention, expressed as relative risk and 95% CI. Results: Results from 162 and 165 participants in the educational intervention and PRISMA checklist groups, respectively, were available for analysis. Most of them (educational intervention group: 130/162, 80.2%; PRISMA checklist group: 131/165, 79.4%) were employed as health care professionals in addition to being health sciences students. After the intervention, the educational intervention group had 23% (relative risk percentage) more correct answers in the postintervention questionnaire than the PRISMA checklist group (relative risk=1.23, 95% CI 1.17-1.29). Conclusions: A short web-based educational intervention about SRs is an effective tool for short-term improvement of knowledge of SRs among health care studies students, most of whom were also employed as health care professionals. Further studies are needed to explore the long-term effects of the tested education. Trial Registration: OSF Registries 10.17605/OSF.IO/RYMVC; https://osf.io/rymvc