Jan Koetsenruijter
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Jan Koetsenruijter has a total of 135 co-authors. Here are the top co-authors by number of shared publications:
- Michel Wensing
Department of General Practice and Health Services Research, Heidelberg University, Heidelberg, Germany
24 shared publications Michel Wensing
Heidelberg University Hospital
8 shared publications- Christos Lionis
Clinic of Social and Family Medicine, School of Medicine, University of Crete, Heraklion, Greece
6 shared publications - Pamela Wronski
Univ Hosp Heidelberg, Dept Gen Practice & Hlth Serv Res, Neuenheimer Feld 130-3, D-69120 Heidelberg, Germany
6 shared publications Anne Rogers
NIHR Collaboration for Leadership in Applied Health Research (CLAHRC) Wessex, Health Sciences, University of Southampton, Highfield Campus, Southampton, United Kingdom
5 shared publications- Agurtzane Mujika
School of Nursing, University of Navarra, Pamplona, Spain
4 shared publications
Latest Publications
- Open Access
- 27 July 2026
- Published by Springer Nature in BMC Neurology
- Vol. 26 (1) , 479
The network and care coordination of ambulatory healthcare providers for people with mobility impairments: a cross-sectional network study involving stroke survivors and people with spinal cord injury in Germany
Background: People with mobility impairments such as stroke survivors or people with spinal cord injury (SCI) receive ambulatory healthcare from several healthcare providers. The coordination of these providers is challenging because there are usually no team meetings or shared treatment protocols. To gain insights into the coordinative processes of ambulatory care, the information transfer between providers was explored. Methods: A cross-sectional network study was conducted in an urban community in the south-west of Germany. First, an exploratory internet search for local providers was conducted. Then, providers were asked to distribute a survey to their patients (stroke, SCI) to identify the provider network. This was followed by a survey of the providers named by the surveyed patients. Network analysis was applied to explore connections and network characteristics (density, centrality). Results: Based on the patient survey ( n = 22), a total of 58 healthcare providers in the community were identified, 20 of whom took part in the provider survey. In the network identified, physiotherapists, general practitioners, occupational therapists, orthopaedic technicians, neurologists, speech therapists and neuropsychologists were connected by 251 ties. The network had a density of 0.152 and a centrality of 0.442. Inter-organizational information sharing was only mentioned for 12 connections between healthcare providers. Care coordination in the community was rated as medium. Conclusion: Network analysis provided insight into a local network of healthcare providers. The network is dominated by a few providers and all providers have a low degree of connectivity. This study found that sharing of patient’s information between providers is rarely implemented.
- 27 July 2026
- Published by Springer Nature in BMC Neurology
- Vol. 26 (1) , 479
Open AccessThe network and care coordination of ambulatory healthcare providers for people with mobility impairments: a cross-sectional network study involving stroke survivors and people with spinal cord injury in Germany
Background: People with mobility impairments such as stroke survivors or people with spinal cord injury (SCI) receive ambulatory healthcare from several healthcare providers. The coordination of these providers is challenging because there are usually no team meetings or shared treatment protocols. To gain insights into the coordinative processes of ambulatory care, the information transfer between providers was explored. Methods: A cross-sectional network study was conducted in an urban community in the south-west of Germany. First, an exploratory internet search for local providers was conducted. Then, providers were asked to distribute a survey to their patients (stroke, SCI) to identify the provider network. This was followed by a survey of the providers named by the surveyed patients. Network analysis was applied to explore connections and network characteristics (density, centrality). Results: Based on the patient survey ( n = 22), a total of 58 healthcare providers in the community were identified, 20 of whom took part in the provider survey. In the network identified, physiotherapists, general practitioners, occupational therapists, orthopaedic technicians, neurologists, speech therapists and neuropsychologists were connected by 251 ties. The network had a density of 0.152 and a centrality of 0.442. Inter-organizational information sharing was only mentioned for 12 connections between healthcare providers. Care coordination in the community was rated as medium. Conclusion: Network analysis provided insight into a local network of healthcare providers. The network is dominated by a few providers and all providers have a low degree of connectivity. This study found that sharing of patient’s information between providers is rarely implemented.
- Open Access
- 6 July 2026
- Published by Springer Nature in European Journal of Trauma and Emergency Surgery
- Vol. 52 (1) , 213
Physical functionality two years after major trauma: predictors from a single center cohort study
Purpose: Traumatic injuries are a major global public health concern, often leading to impaired physical function and disability. Long-term physical function impairments can greatly affect a patient’s health related quality of life, influencing their emotional state and social interactions. This study examines patient-reported physical functionality before and after major trauma, identifying key predictors of poor functional recovery. Methods: This retrospective single-center cohort study investigates physical functionality 23 months after a traumatic injury using standardized questionnaires combined with clinical data. Inclusion criteria were Injury Severity Score (ISS) ≥ 9, requiring ICU treatment, and age ≥ 18 resulting in an eligible sample of 515 patients. Health outcomes were assessed using the Trauma Outcome Profile (TOP), the Abbreviated Injury Scale (AIS), and the ISS. Results: Physical functionality significantly decreased from 94.8 (SD 11.5) to 72.9 (SD 26.7) 23 months post-trauma with almost half of participants still scoring below the critical cutoff of 80 points. The strongest predictor for functional physical impairment was pre-trauma physical functionality (OR 8.21, p < 0.001). Other determinants included age (age 50–59 versus 18–29 OR 2.75, p = 0.001), as well as an impacted lower extremity including pelvic (OR 1.60, p = 0.018). Conclusion: The most important predictors for a post-trauma impaired physical function are pre-trauma functionality and age. Among trauma related factors, injuries involving the lower extremities remained significantly associated with poorer long-term outcomes, whereas overall injury severity was not independently associated with functional impairment.
- 6 July 2026
- Published by Springer Nature in European Journal of Trauma and Emergency Surgery
- Vol. 52 (1) , 213
Open AccessPhysical functionality two years after major trauma: predictors from a single center cohort study
Purpose: Traumatic injuries are a major global public health concern, often leading to impaired physical function and disability. Long-term physical function impairments can greatly affect a patient’s health related quality of life, influencing their emotional state and social interactions. This study examines patient-reported physical functionality before and after major trauma, identifying key predictors of poor functional recovery. Methods: This retrospective single-center cohort study investigates physical functionality 23 months after a traumatic injury using standardized questionnaires combined with clinical data. Inclusion criteria were Injury Severity Score (ISS) ≥ 9, requiring ICU treatment, and age ≥ 18 resulting in an eligible sample of 515 patients. Health outcomes were assessed using the Trauma Outcome Profile (TOP), the Abbreviated Injury Scale (AIS), and the ISS. Results: Physical functionality significantly decreased from 94.8 (SD 11.5) to 72.9 (SD 26.7) 23 months post-trauma with almost half of participants still scoring below the critical cutoff of 80 points. The strongest predictor for functional physical impairment was pre-trauma physical functionality (OR 8.21, p < 0.001). Other determinants included age (age 50–59 versus 18–29 OR 2.75, p = 0.001), as well as an impacted lower extremity including pelvic (OR 1.60, p = 0.018). Conclusion: The most important predictors for a post-trauma impaired physical function are pre-trauma functionality and age. Among trauma related factors, injuries involving the lower extremities remained significantly associated with poorer long-term outcomes, whereas overall injury severity was not independently associated with functional impairment.
- 30 August 2023
- Published by Springer Nature
- p. 61-71
Presentation of Quantitative Research Findings
- Open Access
- 18 October 2022
- Published by Springer Nature in BMC Health Services Research
- Vol. 22 (1) , 1-13
Measuring continuity of ambulatory cardiovascular care: a cross-sectional study on the applicability of the Nijmegen Continuity Questionnaire in Germany
Background: Chronic cardiovascular diseases demand continuous care from general practitioners and medical specialists. Especially in fragmented healthcare systems, such as in Germany, a large body of research is devoted to the improvement of care continuity. Meanwhile, measuring continuity of care itself has been a challenge due to the absence of validated instruments. In 2011, the Dutch Nijmegen Continuity Questionnaire (NCQ) was developed and validated to measure continuity of care across care settings from the patients’ perspectives in the Netherlands. Its applicability in other countries and health systems, however, has rarely been tested. We therefore aimed at assessing the applicability of the Nijmegen Continuity Questionnaire to the German health care context. Methods: We translated and applied the original NCQ to an ambulatory cardiovascular care setting in Germany. Qualitative interview data and quantitative survey data on our adaptation were collected from patients in 27 general practices within the German states of Baden-Wuerttemberg and Rhineland-Palatinate. Qualitative data on understandability and clearness of the questionnaire was obtained using semi-structured telephone interviews and think aloud-protocols. Quantitative data was obtained through an anonymous written questionnaire containing the translated NCQ items to assess applicability of our translation. We performed confirmatory and exploratory factor analyses based on the original NCQ-structure mapped to general practitioners and an aggregated analysis of general practitioners and cardiologists combined. Results: A total of 6 patients participated in the interviews and a total of 435 patients participated in the written survey. The interviews showed that, overall, patients had little difficulties comprehending and answering to our translation of the NCQ. The confirmatory factor analyses then showed that the structure of the original NCQ with 12 items and 3 latent factors can also be found in the German context. However, a simpler 2-factor-structure would also fit well with the data. Conclusion: A German translation of the NCQ yielded a factor structure comparable to the original version and proved to be understandable for patients. Trial registration: The project underlying the study was registered on November 7, 2019 in the German Clinical Trials Register (www.drks.de) under ID: DRKS00019219.
- 18 October 2022
- Published by Springer Nature in BMC Health Services Research
- Vol. 22 (1) , 1-13
Open AccessMeasuring continuity of ambulatory cardiovascular care: a cross-sectional study on the applicability of the Nijmegen Continuity Questionnaire in Germany
Background: Chronic cardiovascular diseases demand continuous care from general practitioners and medical specialists. Especially in fragmented healthcare systems, such as in Germany, a large body of research is devoted to the improvement of care continuity. Meanwhile, measuring continuity of care itself has been a challenge due to the absence of validated instruments. In 2011, the Dutch Nijmegen Continuity Questionnaire (NCQ) was developed and validated to measure continuity of care across care settings from the patients’ perspectives in the Netherlands. Its applicability in other countries and health systems, however, has rarely been tested. We therefore aimed at assessing the applicability of the Nijmegen Continuity Questionnaire to the German health care context. Methods: We translated and applied the original NCQ to an ambulatory cardiovascular care setting in Germany. Qualitative interview data and quantitative survey data on our adaptation were collected from patients in 27 general practices within the German states of Baden-Wuerttemberg and Rhineland-Palatinate. Qualitative data on understandability and clearness of the questionnaire was obtained using semi-structured telephone interviews and think aloud-protocols. Quantitative data was obtained through an anonymous written questionnaire containing the translated NCQ items to assess applicability of our translation. We performed confirmatory and exploratory factor analyses based on the original NCQ-structure mapped to general practitioners and an aggregated analysis of general practitioners and cardiologists combined. Results: A total of 6 patients participated in the interviews and a total of 435 patients participated in the written survey. The interviews showed that, overall, patients had little difficulties comprehending and answering to our translation of the NCQ. The confirmatory factor analyses then showed that the structure of the original NCQ with 12 items and 3 latent factors can also be found in the German context. However, a simpler 2-factor-structure would also fit well with the data. Conclusion: A German translation of the NCQ yielded a factor structure comparable to the original version and proved to be understandable for patients. Trial registration: The project underlying the study was registered on November 7, 2019 in the German Clinical Trials Register (www.drks.de) under ID: DRKS00019219.
- Open Access
- 2 September 2022
- Published by Springer Nature in BMC Primary Care
- Vol. 23 (1) , 1-14
Building resilience in German primary care practices: a qualitative study
Background: In recent years, healthcare has faced many different crises around the world such as HIV-, Ebola- or H1N1-outbrakes, opioid addiction, natural disasters and terrorism attacks). In particular, the current pandemic of Covid-19 has challenged the resilience of health systems. In many healthcare systems, primary care practices play a crucial role in the management of crises as they are often the first point of contact and main health care provider for patients. Therefore, this study explored which situations are perceived as crises by primary care practice teams and potential strategies for crisis management.Methods: A qualitative observational study was conducted. Data were collected in interviews and focus groups with experts from primary care practices and stakeholders focusing on primary care practices in Germany such as physicians, medical assistants, practice managers, quality managers, hygiene managers and institutions on health system level (politics, research and health insurance). All interviews and focus groups were audio-recorded and transcribed verbatim. A qualitative content analysis was performed using a rapid qualitative analysis approach first, followed by a thematic analysis.Results: Two focus groups and 26 interviews including 40 participating experts were conducted. Many different situations were perceived as crises, varying from issues in the practice organization to problems on health system level and international disasters. Distinct aspects associated with the perception of a crisis situation by interviewees were the presence of emotional reactions, a need for organizational changes and a lack of necessary resources. A broad spectrum of possible strategies was discussed that could help to cope with or even prevent the emergence of an actual crisis. In particular, strengthening communication within practice teams and resilience among employees was perceived to be fundamental for improving responses to crises or preventing them.Conclusions: The study provides perspectives of primary health care workers on crises in health, that could inform health policy regarding prevention and management of future crises in primary care facilities.
- 2 September 2022
- Published by Springer Nature in BMC Primary Care
- Vol. 23 (1) , 1-14
Open AccessBuilding resilience in German primary care practices: a qualitative study
Background: In recent years, healthcare has faced many different crises around the world such as HIV-, Ebola- or H1N1-outbrakes, opioid addiction, natural disasters and terrorism attacks). In particular, the current pandemic of Covid-19 has challenged the resilience of health systems. In many healthcare systems, primary care practices play a crucial role in the management of crises as they are often the first point of contact and main health care provider for patients. Therefore, this study explored which situations are perceived as crises by primary care practice teams and potential strategies for crisis management.Methods: A qualitative observational study was conducted. Data were collected in interviews and focus groups with experts from primary care practices and stakeholders focusing on primary care practices in Germany such as physicians, medical assistants, practice managers, quality managers, hygiene managers and institutions on health system level (politics, research and health insurance). All interviews and focus groups were audio-recorded and transcribed verbatim. A qualitative content analysis was performed using a rapid qualitative analysis approach first, followed by a thematic analysis.Results: Two focus groups and 26 interviews including 40 participating experts were conducted. Many different situations were perceived as crises, varying from issues in the practice organization to problems on health system level and international disasters. Distinct aspects associated with the perception of a crisis situation by interviewees were the presence of emotional reactions, a need for organizational changes and a lack of necessary resources. A broad spectrum of possible strategies was discussed that could help to cope with or even prevent the emergence of an actual crisis. In particular, strengthening communication within practice teams and resilience among employees was perceived to be fundamental for improving responses to crises or preventing them.Conclusions: The study provides perspectives of primary health care workers on crises in health, that could inform health policy regarding prevention and management of future crises in primary care facilities.
- Open Access
- 12 April 2022
- Published by JMIR Publications Inc. in JMIR Medical Informatics
- Vol. 10 (4) , e29813-233
The Effect of an Additional Structured Methods Presentation on Decision-Makers’ Reading Time and Opinions on the Helpfulness of the Methods in a Quantitative Report: Nonrandomized Trial
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Although decision-makers in healthcare settings need to read and understand the validity of quantitative reports, information of research methods is not always well read. Presenting the methods in a structured way could improve the reading and perceived relevance for this important report section. Objective: To test the effect of a structured summary of methods used in a quantitative data report on reading behaviour and perceived importance by using computer-assisted eye-tracking. Methods: A nonrandomized pilot trial was performed in a computer laboratory setting with advanced medical students. They were asked to read a quantitative data report and the intervention arm was additionally offered a box with the key features of the methods used. Three data-collection methods were used to document reading behaviours and views of participants: eye-tracking during reading, written questionnaires, and face-to-face interviews. Results: We included 35 participants, 22 in the control arm and 13 in the intervention. The overall reading time of the methods was not different between the two study arms. The intervention arm found the information on methods less helpful for the decision than the control arm (4,09 versus 2,92). Participants who read the box more intensively tended to spent more time on the methods as a whole (Pearson correlation 0.81, P=.001). Conclusions: We found no indication that adding a structured summary of information on research methods used had increased the time spent on reading the methods. However, it resulted in a lower appreciation of the helpfulness of the information on methods. Future studies should focus on other methods to improve the attention for the methods used in in quantitative reports. Clinical Trial: No clinical trial was performed.
- 12 April 2022
- Published by JMIR Publications Inc. in JMIR Medical Informatics
- Vol. 10 (4) , e29813-233
Open AccessThe Effect of an Additional Structured Methods Presentation on Decision-Makers’ Reading Time and Opinions on the Helpfulness of the Methods in a Quantitative Report: Nonrandomized Trial
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Although decision-makers in healthcare settings need to read and understand the validity of quantitative reports, information of research methods is not always well read. Presenting the methods in a structured way could improve the reading and perceived relevance for this important report section. Objective: To test the effect of a structured summary of methods used in a quantitative data report on reading behaviour and perceived importance by using computer-assisted eye-tracking. Methods: A nonrandomized pilot trial was performed in a computer laboratory setting with advanced medical students. They were asked to read a quantitative data report and the intervention arm was additionally offered a box with the key features of the methods used. Three data-collection methods were used to document reading behaviours and views of participants: eye-tracking during reading, written questionnaires, and face-to-face interviews. Results: We included 35 participants, 22 in the control arm and 13 in the intervention. The overall reading time of the methods was not different between the two study arms. The intervention arm found the information on methods less helpful for the decision than the control arm (4,09 versus 2,92). Participants who read the box more intensively tended to spent more time on the methods as a whole (Pearson correlation 0.81, P=.001). Conclusions: We found no indication that adding a structured summary of information on research methods used had increased the time spent on reading the methods. However, it resulted in a lower appreciation of the helpfulness of the information on methods. Future studies should focus on other methods to improve the attention for the methods used in in quantitative reports. Clinical Trial: No clinical trial was performed.
- Open Access
- 27 May 2021
- Published by Springer Nature in BMC Health Services Research
- Vol. 21 (1) , 1-12
Healthcare planning across healthcare sectors in Baden-Wuerttemberg, Germany: a stakeholder online survey to identify indicators
Stakeholders in the German state of Baden-Wuerttemberg agreed upon the central aims for healthcare planning. These include a focus on geographical districts; a comprehensive, cross-sectoral perspective on healthcare needs and services; and use of regional data for healthcare planning. Therefore, healthcare data at district level is needed. Nevertheless, decision makers face the challenge to make a selection from numerous indicators and frameworks, which all have limitations or do not well apply to the targeted setting. The aim of this study was to identify district level indicators to be used in Baden-Wuerttemberg for the purpose of cross-sectoral and needs-based healthcare planning involving stakeholders of the health system. A conceptual framework for indicators was developed. A structured search for indicators identified 374 potential indicators in indicator sets of German and international institutions and agencies (n = 211), clinical practice guidelines (n = 50), data bases (n = 35), indicator databases (n = 25), published literature (n = 35), and other sources (n = 18). These indicators were categorised according to the developed framework dimensions. In an online survey, institutions of various stakeholders were invited to assess the relevance of these indicators from December 2016 until January 2017. Indicators were selected in terms of a median value of the assessed relevance. 22 institutions selected 212 indicators for the five dimensions non-medical determinants of health (20 indicators), health status (25), utilisation of the health system (34), health system performance (87), and healthcare provision (46). Stakeholders assessed a large number of indicators as relevant for use in healthcare planning on district level. Not applicable.
- 27 May 2021
- Published by Springer Nature in BMC Health Services Research
- Vol. 21 (1) , 1-12
Open AccessHealthcare planning across healthcare sectors in Baden-Wuerttemberg, Germany: a stakeholder online survey to identify indicators
Stakeholders in the German state of Baden-Wuerttemberg agreed upon the central aims for healthcare planning. These include a focus on geographical districts; a comprehensive, cross-sectoral perspective on healthcare needs and services; and use of regional data for healthcare planning. Therefore, healthcare data at district level is needed. Nevertheless, decision makers face the challenge to make a selection from numerous indicators and frameworks, which all have limitations or do not well apply to the targeted setting. The aim of this study was to identify district level indicators to be used in Baden-Wuerttemberg for the purpose of cross-sectoral and needs-based healthcare planning involving stakeholders of the health system. A conceptual framework for indicators was developed. A structured search for indicators identified 374 potential indicators in indicator sets of German and international institutions and agencies (n = 211), clinical practice guidelines (n = 50), data bases (n = 35), indicator databases (n = 25), published literature (n = 35), and other sources (n = 18). These indicators were categorised according to the developed framework dimensions. In an online survey, institutions of various stakeholders were invited to assess the relevance of these indicators from December 2016 until January 2017. Indicators were selected in terms of a median value of the assessed relevance. 22 institutions selected 212 indicators for the five dimensions non-medical determinants of health (20 indicators), health status (25), utilisation of the health system (34), health system performance (87), and healthcare provision (46). Stakeholders assessed a large number of indicators as relevant for use in healthcare planning on district level. Not applicable.
- Open Access
- 21 April 2021
- Published by JMIR Publications Inc. in JMIR Preprints
The Effect of an Additional Structured Methods Presentation on Decision-Makers’ Reading Time and Opinions on the Helpfulness of the Methods in a Quantitative Report: Nonrandomized Trial (Preprint)
BACKGROUND Although decision-makers in health care settings need to read and understand the validity of quantitative reports, they do not always carefully read information on research methods. Presenting the methods in a more structured way could improve the time spent reading the methods and increase the perceived relevance of this important report section. OBJECTIVE To test the effect of a structured summary of the methods used in a quantitative data report on reading behavior with eye-tracking and measure the effect on the perceived importance of this section. METHODS A nonrandomized pilot trial was performed in a computer laboratory setting with advanced medical students. All participants were asked to read a quantitative data report; an intervention arm was also shown a textbox summarizing key features of the methods used in the report. Three data-collection methods were used to document reading behavior and the views of participants: eye-tracking (during reading), a written questionnaire, and a face-to-face interview. RESULTS We included 35 participants, 22 in the control arm and 13 in the intervention arm. The overall time spent reading the methods did not differ between the 2 arms. The intervention arm considered the information in the methods section to be less helpful for decision-making than did the control arm (scores for perceived helpfulness were 4.1 and 2.9, respectively, range 1-10). Participants who read the box more intensively tended to spend more time on the methods as a whole (Pearson correlation 0.81, P=.001). CONCLUSIONS Adding a structured summary of information on research methods attracted attention from most participants, but did not increase the time spent on reading the methods or lead to increased perceptions that the methods section was helpful for decision-making. Participants made use of the summary to quickly judge the methods, but this did not increase the perceived relevance of this section.
- 21 April 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessThe Effect of an Additional Structured Methods Presentation on Decision-Makers’ Reading Time and Opinions on the Helpfulness of the Methods in a Quantitative Report: Nonrandomized Trial (Preprint)
BACKGROUND Although decision-makers in health care settings need to read and understand the validity of quantitative reports, they do not always carefully read information on research methods. Presenting the methods in a more structured way could improve the time spent reading the methods and increase the perceived relevance of this important report section. OBJECTIVE To test the effect of a structured summary of the methods used in a quantitative data report on reading behavior with eye-tracking and measure the effect on the perceived importance of this section. METHODS A nonrandomized pilot trial was performed in a computer laboratory setting with advanced medical students. All participants were asked to read a quantitative data report; an intervention arm was also shown a textbox summarizing key features of the methods used in the report. Three data-collection methods were used to document reading behavior and the views of participants: eye-tracking (during reading), a written questionnaire, and a face-to-face interview. RESULTS We included 35 participants, 22 in the control arm and 13 in the intervention arm. The overall time spent reading the methods did not differ between the 2 arms. The intervention arm considered the information in the methods section to be less helpful for decision-making than did the control arm (scores for perceived helpfulness were 4.1 and 2.9, respectively, range 1-10). Participants who read the box more intensively tended to spend more time on the methods as a whole (Pearson correlation 0.81, P=.001). CONCLUSIONS Adding a structured summary of information on research methods attracted attention from most participants, but did not increase the time spent on reading the methods or lead to increased perceptions that the methods section was helpful for decision-making. Participants made use of the summary to quickly judge the methods, but this did not increase the perceived relevance of this section.
- Open Access
- 28 January 2021
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 21 (1) , 1-14
Use of a quantitative data report in a hypothetical decision scenario for health policymaking: a computer-assisted laboratory study
Background: Quantitative data reports are widely produced to inform health policy decisions. Policymakers are expected to critically assess provided information in order to incorporate the best available evidence into the decision-making process. Many other factors are known to influence this process, but little is known about how quantitative data reports are actually read. We explored the reading behavior of (future) health policy decision-makers, using innovative methods. Methods: We conducted a computer-assisted laboratory study, involving starting and advanced students in medicine and health sciences, and professionals as participants. They read a quantitative data report to inform a decision on the use of resources for long-term care in dementia in a hypothetical decision scenario. Data were collected through eye-tracking, questionnaires, and a brief interview. Eye-tracking data were used to generate ‘heatmaps’ and five measures of reading behavior. The questionnaires provided participants’ perceptions of understandability and helpfulness as well as individual characteristics. Interviews documented reasons for attention to specific report sections. The quantitative analysis was largely descriptive, complemented by Pearson correlations. Interviews were analyzed by qualitative content analysis. Results: In total, 46 individuals participated [students (85%), professionals (15%)]. Eye-tracking observations showed that the participants spent equal time and attention for most parts of the presented report, but were less focused when reading the methods section. The qualitative content analysis identified 29 reasons for attention to a report section related to four topics. Eye-tracking measures were largely unrelated to participants’ perceptions of understandability and helpfulness of the report. Conclusions: Eye-tracking data added information on reading behaviors that were not captured by questionnaires or interviews with health decision-makers.
- 28 January 2021
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 21 (1) , 1-14
Open AccessUse of a quantitative data report in a hypothetical decision scenario for health policymaking: a computer-assisted laboratory study
Background: Quantitative data reports are widely produced to inform health policy decisions. Policymakers are expected to critically assess provided information in order to incorporate the best available evidence into the decision-making process. Many other factors are known to influence this process, but little is known about how quantitative data reports are actually read. We explored the reading behavior of (future) health policy decision-makers, using innovative methods. Methods: We conducted a computer-assisted laboratory study, involving starting and advanced students in medicine and health sciences, and professionals as participants. They read a quantitative data report to inform a decision on the use of resources for long-term care in dementia in a hypothetical decision scenario. Data were collected through eye-tracking, questionnaires, and a brief interview. Eye-tracking data were used to generate ‘heatmaps’ and five measures of reading behavior. The questionnaires provided participants’ perceptions of understandability and helpfulness as well as individual characteristics. Interviews documented reasons for attention to specific report sections. The quantitative analysis was largely descriptive, complemented by Pearson correlations. Interviews were analyzed by qualitative content analysis. Results: In total, 46 individuals participated [students (85%), professionals (15%)]. Eye-tracking observations showed that the participants spent equal time and attention for most parts of the presented report, but were less focused when reading the methods section. The qualitative content analysis identified 29 reasons for attention to a report section related to four topics. Eye-tracking measures were largely unrelated to participants’ perceptions of understandability and helpfulness of the report. Conclusions: Eye-tracking data added information on reading behaviors that were not captured by questionnaires or interviews with health decision-makers.