RTRužica Tokalić

Ružica Tokalić

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Ružica Tokalić has a total of 87 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Completeness of Intervention Reporting in Mechanical Circulatory Support Studies: A Comparison of ClinicalTrials.gov Registrations and Published Reports

    by Marin Viđak, Fran Šaler, Ružica Tokalić, Tomislava Bodrožić Džakić Poljak, Ana Marušić

  • Developing a standardised surgical site infection prevention bundle: a scoping review of clinical practice guidelines

    by I. Radman, T. Poklepovic Pericic, Z. Krizanac, A. Babic, I. Bodys-Cupak, M.M. Bala, R. Tokalic, A. Marušić, L. Puljak, O. Barcot


  • Open Access

    Tool to assess recognition and understanding of elements in Summary of Findings Table for health evidence synthesis: a cross-sectional study

    by Jakov Matas, Ružica Tokalić, Daniel García-Costa, Emilia López-Iñesta, Elena Álvarez-García, Francisco Grimaldo, Ana Marušić

    Summary of Findings (SoF) tables concisely present the main findings of evidence synthesis of health evidence, but how users navigate it to understand and interpret the presented information is not clear. We quantified the interaction of medical students with an SoF table while answering a knowledge quiz. Read&Learn tool was used to measure the number of target and non-target table cells visited for each question and the time spent on these cells. Students positively identified target elements for quiz questions and answered simpler questions, but struggled with critical thinking and understanding study outcomes. The question on outcomes with the largest improvement post-intervention had the fewest correct answers, the longest interaction with table cells and the most opened cells before answering. Students spent a median of 72% of the time reading target table cells. A heatmap of the interactions showed that they were mostly answer-oriented. Further development of the tool and metrics is needed to use the tool and the metrics to study the cognitive processes during the assessment of health evidence.


  • Open Access

    Similar Outcomes of Web-Based and Face-to-Face Training of the GRADE Approach for the Certainty of Evidence: Randomized Controlled Trial

    by Ružica Tokalić, Tina Poklepović Peričić, Ana Marušić

    Background: The GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach is a system for transparent evaluation of the certainty of evidence used in clinical practice guidelines and systematic reviews. GRADE is a key part of evidence-based medicine (EBM) training of health care professionals. Objective: This study aimed to compare web-based and face-to-face methods of teaching the GRADE approach for evidence assessment. Methods: A randomized controlled trial was conducted on 2 delivery modes of GRADE education integrated into a course on research methodology and EBM with third-year medical students. Education was based on the Cochrane Interactive Learning “Interpreting the findings” module, which had a duration of 90 minutes. The web-based group received the web-based asynchronous training, whereas the face-to-face group had an in-person seminar with a lecturer. The main outcome measure was the score on a 5-question test that assessed confidence interval interpretation and overall certainty of evidence, among others. Secondary outcomes included writing a recommendation for practice and course satisfaction. Results: In all, 50 participants received the web-based intervention, and 47 participants received the face-to-face intervention. The groups did not differ in the overall scores for the Cochrane Interactive Learning test, with a median of 2 (95% CI 1.0-2.0) correct answers for the web-based group and 2 (95% CI 1.3-3.0) correct answers for the face-to-face group. Both groups gave the most correct answers to the question about rating a body of evidence (35/50, 70% and 24/47, 51% for the web-based and face-to-face group, respectively). The face-to-face group better answered the question about the overall certainty of evidence question. The understanding of the Summary of Findings table did not differ significantly between the groups, with a median of 3 correct answers to 4 questions for both groups (P=.352). The writing style for the recommendations for practice also did not differ between the 2 groups. Students’ recommendations mostly reflected the strengths of the recommendations and focused on the target population, but they used passive words and rarely mentioned the setting for the recommendation. The language of the recommendations was mostly patient centered. Course satisfaction was high in both groups. Conclusions: Training in the GRADE approach could be equally effective when delivered asynchronously on the web or face-to-face. Trial Registration: Open Science Framework akpq7; https://osf.io/akpq7/


  • Open Access

    Training, Supervision and Mentoring

    by Ružica Tokalić

    This chapter aims to introduce you to important aspects of early-career research, particularly doctoral training, including its formal and informal aspects, and to map what is expected from the individuals at different hierarchical positions in their research environment. The purpose of doctoral training is to provide you with knowledge and skills for research that answers important questions, that research is conducted with care and high standards, that you anticipate the implications and applications of its results, and that your research is replicable, transparent and open. This is not and cannot be achieved only through formal training, but through various forms of what is called a hidden curriculum. In this chapter, we will talk about shadowing and role models, research collaboration and international relationships, networking, summer schools and research exchanges. Considering the complexities of relationships in the research setting, we will also talk about the role of doctoral students, and their involvement in supervising others (such as Masters’ students). We will address the principles of respect, honesty and accountability in these networks of collaboration, with special attention to students and supporting staff in academia. Finally, we will discuss the aspects of work and life balance for doctoral students and the importance of existing support networks, with special attention to mental health support and principles of open communication.


  • Perception of organizational climate by university staff and students in medicine and humanities: A qualitative study

    by Marin Viđak, Vicko Tomić, Ivan Buljan, Ružica Tokalić, Ana Marušić

    Organizational climate and culture are important for research organizations because they foster research integrity and responsible conduct of research, reduce questionable research practices, and improve job satisfaction. The aim of our study was to explore how employees and students perceive organizational climate and its consequences in the university setting. We conducted semi-structured interviews with senior students and employees (teaching and non-teaching staff) from two different university schools: School of Medicine and Faculty of Humanities and Social Sciences. Participants were asked questions regarding perceived climate, working environment, and the role of the institution. The data were analyzed using reflexive thematic analysis approach. Three themes were identified. The first theme addressed the difference in the perception and understanding of organizational climate. The second theme dealt with institutional issues emanating from organizational climate. The third theme described the behaviour of stakeholders in formation of organizational climate. Organizational climate is important concept in academic organizations as it influences both employees, particularly early careers researchers, and students. Institutional leadership can strongly influence organizational climate, which can in turn affect job and job satisfaction. Due to importance of personal morality on everyday decision-making, virtue-based research integrity training could be useful in improving academic institutions’ organizational climate.


  • Open Access

    Similar Outcomes of Web-Based and Face-to-Face Training of the GRADE Approach for the Certainty of Evidence: Randomized Controlled Trial (Preprint)

    by Ružica Tokalić, Tina Poklepović Peričić, Ana Marušić

    Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: The GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach is a system for transparent evaluation of the certainty of evidence used in clinical practice guidelines and systematic reviews. GRADE is a key part of evidence-based medicine (EBM) training of health care professionals. Objective: This study aimed to compare web-based and face-to-face methods of teaching the GRADE approach for evidence assessment. Methods: A randomized controlled trial was conducted on 2 delivery modes of GRADE education integrated into a course on research methodology and EBM with third-year medical students. Education was based on the Cochrane Interactive Learning “Interpreting the findings” module, which had a duration of 90 minutes. The web-based group received the web-based asynchronous training, whereas the face-to-face group had an in-person seminar with a lecturer. The main outcome measure was the score on a 5-question test that assessed confidence interval interpretation and overall certainty of evidence, among others. Secondary outcomes included writing a recommendation for practice and course satisfaction. Results: In all, 50 participants received the web-based intervention, and 47 participants received the face-to-face intervention. The groups did not differ in the overall scores for the Cochrane Interactive Learning test, with a median of 2 (95% CI 1.0-2.0) correct answers for the web-based group and 2 (95% CI 1.3-3.0) correct answers for the face-to-face group. Both groups gave the most correct answers to the question about rating a body of evidence (35/50, 70% and 24/47, 51% for the web-based and face-to-face group, respectively). The face-to-face group better answered the question about the overall certainty of evidence question. The understanding of the Summary of Findings table did not differ significantly between the groups, with a median of 3 correct answers to 4 questions for both groups (P=.352). The writing style for the recommendations for practice also did not differ between the 2 groups. Students’ recommendations mostly reflected the strengths of the recommendations and focused on the target population, but they used passive words and rarely mentioned the setting for the recommendation. The language of the recommendations was mostly patient centered. Course satisfaction was high in both groups. Conclusions: Training in the GRADE approach could be equally effective when delivered asynchronously on the web or face-to-face. Trial Registration: Open Science Framework akpq7; https://osf.io/akpq7/

  • Open Access

    Web-Based Educational Intervention to Improve Knowledge of Systematic Reviews Among Health Science Professionals: Randomized Controlled Trial

    by Marina Krnic Martinic, Marta Čivljak, Ana Marušić, Damir Sapunar, Tina Poklepović Peričić, Ivan Buljan, Ružica Tokalić, Snježana Mališa, Marijana Neuberg, Kata Ivanišević, et al.

    Background: Lack of knowledge of systematic reviews (SRs) could prevent individual health care professionals from using SRs as a source of information in their clinical practice or discourage them from participating in such research. Objective: In this randomized controlled trial, we evaluated the effect of a short web-based educational intervention on short-term knowledge of SRs. Methods: Eligible participants were 871 Master’s students of university health sciences studies in Croatia; 589 (67.6%) students who agreed to participate in the trial were randomized using a computer program into 2 groups. Intervention group A (294/589, 49.9%) received a short web-based educational intervention about SR methodology, and intervention group B (295/589, 50.1%) was presented with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) checklist. The participants’ knowledge of SRs was assessed before and after the intervention. The participants could not be blinded because of the nature of the intervention. The primary outcome was the difference in the percentage of correct answers about SR methodology per participant between the groups after the intervention, expressed as relative risk and 95% CI. Results: Results from 162 and 165 participants in the educational intervention and PRISMA checklist groups, respectively, were available for analysis. Most of them (educational intervention group: 130/162, 80.2%; PRISMA checklist group: 131/165, 79.4%) were employed as health care professionals in addition to being health sciences students. After the intervention, the educational intervention group had 23% (relative risk percentage) more correct answers in the postintervention questionnaire than the PRISMA checklist group (relative risk=1.23, 95% CI 1.17-1.29). Conclusions: A short web-based educational intervention about SRs is an effective tool for short-term improvement of knowledge of SRs among health care studies students, most of whom were also employed as health care professionals. Further studies are needed to explore the long-term effects of the tested education. Trial Registration: OSF Registries 10.17605/OSF.IO/RYMVC; https://osf.io/rymvc