MTMarcia Tummers

Marcia Tummers

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Marcia Tummers has a total of 157 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    An Overview of Stakeholders, Methods, Topics, and Challenges in Participatory Approaches Used in the Development of Medical Devices: A Scoping Review

    by Kas Woudstra, Rob Reuzel, Maroeska Rovers, Marcia Tummers

    Background: There is a wide variety of participatory approaches to involve stakeholders in the development of medical devices, but there is no comprehensive overview of these approaches. We therefore studied what participatory approaches are used in the development of medical devices as well as the most important characteristics and challenges of these approaches. Methods: We conducted a scoping review and searched PubMed, Embase and Web of Science for articles published between July 2014 and July 2019. Papers were included if they presented original research featuring any form of stakeholder participation in the development of medical devices. We used The Spectrum of Public Participation to categorise the approach of each paper. Subsequently, we described the characteristics of each approach: the stakeholders involved, data collection methods, and topics addressed. We also identified challenges of the approaches as reported by researchers. Results: 277 papers were included, which could be categorised into three levels of participation: collaboration, involvement, and consultation. Patients and healthcare professionals are frequently engaged in all approaches. The most often used methods are workshops in the collaboration approach papers, and interviews in the involvement and consultation approach papers. Topics addressed in all approaches are: the problem, device requirements, design choices, testing, and procedural aspects of involvement. Reported challenges entail issues related to sampling, analysis, social dynamics, feasibility, and the limited number of topics that can be addressed. Conclusion: Participatory approaches reported in literature can be categorised in three overarching approaches that have comparable methodological characteristics. This suggests that if researchers want to apply a participatory approach it is not necessary to adopt a pre-determined approach, such as ‘participatory action research’ (PAR). Instead, they can independently determine the degree of participation, stakeholders, methods, topics, and strategies to account for challenges, making sure the participatory approach fits their research question and context.


  • Open Access

    Age-based treatment differences in and reluctance to treating older adults with systemic antipsoriatic therapy – a mixed-method pilot study

    by Elke L. M. ter Haar, Marcia Tummers, Ewald M. Bronkhorst, Peter C. M. van de Kerkhof, Elke M. G. J. de Jong, Satish F. K. Lubeek

    Evidence-based guidance in older adults (≥65 years) with psoriasis is sparse and undertreatment might be present. To assess prescribing patterns, comfort levels, barriers and needs of dermatologists when treating older adults with systemic antipsoriatic therapy. A mixed-methods design was used including a survey among all Dutch dermatologists and residents, followed by semi-structured interviews. Most of the survey respondents applied systemic treatment to the same extent in older versus younger patients (n = 49; 67.1%) and weren't reluctant prescribing systemic therapy (n = 50; 68.5%) in older adults. However, 26% (n = 19) of the respondents treated older adults less often with systemic therapy compared to younger patients and 68.1% (n = 49) performed additional actions in older adults, e.g. intensified monitoring or dose reduction. Based on the survey and interviews (n = 10), the main reasons for these age-based treatment differences were comorbidity, comedication, and fear of adverse events. More evidence-based guidance, education, and time to assess older adults were identified as most important needs, especially regarding frailty screening. Age-based treatment differences in and reluctance to treating older adults with systemic antipsoriatic therapy were common. There is a need for more evidence-based guidance, education, and consultation time, to improve treatment in this growing population.


  • Open Access

    Barriers and Facilitators for Implementation of a Computerized Clinical Decision Support System in Lung Cancer Multidisciplinary Team Meetings—A Qualitative Assessment

    by Sosse E. Klarenbeek, Olga C. J. Schuurbiers-Siebers, Michel M. van Den Heuvel, Mathias Prokop, Marcia Tummers

    Background: Oncological computerized clinical decision support systems (CCDSSs) to facilitate workflows of multidisciplinary team meetings (MDTMs) are currently being developed. To successfully implement these CCDSSs in MDTMs, this study aims to: (a) identify barriers and facilitators for implementation for the use case of lung cancer; and (b) provide actionable findings for an implementation strategy. Methods: The Consolidated Framework for Implementation Science was used to create an interview protocol and to analyze the results. Semi-structured interviews were conducted among various health care professionals involved in MDTMs. The transcripts were analyzed using a thematic analysis following a deductive approach. Results: Twenty-six professionals participated in the interviews. The main facilitators for implementation of the CCDSS were considered to be easy access to well-structured patient data, and the resulting reduction of MDTM preparation time and of duration of MDTMs. Main barriers for adoption were seen in incomplete or non-trustworthy output generated by the system and insufficient adaptability of the system to local and contextual needs. Conclusion: Using a CCDSS in lung cancer MDTMs was expected to increase efficiency of workflows. Successful implementation was seen as dependent on the reliability and adaptability of the CCDSS and involvement of key users in the implementation process.


  • Open Access

    On the integration of early health technology assessment in the innovation process: reflections from five stakeholders

    by Marcia Tummers, Kari Kværner, Laura Sampietro-Colom, Markus Siebert, Murray Krahn, Øyvind Melien, Dominique Hamerlijnck, Payam Abrishami, Janneke Grutters

    Early health technology assessment (HTA), which includes all methods used to inform industry and other stakeholders about the potential value of new medical products in development, including methods to quantify and manage uncertainty, has seen many applications in recent years. However, it is still unclear how such early value assessments can be integrated into the technology innovation process. This commentary contributes to the discussion on the purposes early HTA can serve. Similarities and differences in the perspectives of five stakeholders (i.e., the hospital, the patient, the assessor, the medical device industry, and the policy maker) on the purpose, value, and potential challenges of early HTA are described. All five stakeholders agreed that integrating early HTA in the innovation process has the possibility to shape and refine an innovation, and inform research and development decisions. The early assessment, using a variety of methodologies, can provide insights that are relevant for all stakeholders but several challenges, for example, feasibility and responsibility, need to be addressed before early HTA can become standard practice. For early evaluations to be successful, all relevant stakeholders including patients need to be involved. Also, nimble, flexible assessment methods are needed that fit the dynamics of medical technology. Best practices should be shared to optimize both the innovation process and the methods to perform an early value assessment.


  • Open Access

    The Dutch Citizen Forum on Public Reimbursement of Healthcare: A Qualitative Analysis of Opinion Change

    by Maarten Jansen, Rob Baltussen, Leon Bijlmakers, Marcia Tummers

    Background: A deliberative Citizen Forum ‘Choices in healthcare’ was held in the Netherlands to obtain insight into the criteria informed citizens would propose for the public reimbursement of healthcare. During 3 weekends, 24 citizens participated in evidence-informed deliberation on the basis of 8 case studies. The aim of this study was to assess how the opinions of 8 participants in the deliberative Citizens Forum changed and if so, why participants themselves believe their opinions have changed, whether participation influenced their perceived reasonableness of other participants in the forum and whether it influenced their opinions about involvement of citizens in decision-making. Methods: Semi-structured interviews were held with 8 participants before and after their participation in the Citizen Forum. Using the method of reconstructing interpretive frames opinions about the public reimbursement of healthcare were reconstructed. Results: Participants’ opinions changed over time; they became more aware of the complexity of decision-making and came to accept that there are limits to the available resources and accept cost as a criterion for reimbursement decisionmaking. Participants report that exchanging arguments and personal experiences with other participants made them change their initial opinions. Participants ascribed increases in the perceived reasonableness of other participants’ opinions to feelings of group-bonding and becoming more familiar with each other’s personal circumstances. Participants further believe that citizens represent an additional opinion to that of other stakeholders and believe their opinions should be considered in relation to those of other stakeholders, given they are provided with opportunities for critical discussion. Conclusion: Organized deliberation should allow for the exchange of arguments and the sharing of personal experiences which is linked to learning. On the one hand this is reflected in the uptake of new arguments and on the other hand in the revision, specification or expansion of personal argumentation. Providing opportunities for critical deliberation is key to prevent citizens from adhering to initial emotional reactions that remain unchallenged and which may no longer be supported after deliberation.


  • Open Access

    Exploratory, Participatory and Iterative Assessment of Value: A Response to Recent Commentaries

    by Janneke P.C. Grutters, Tim M. Govers, Jorte Nijboer, Marcia Tummers, Gert Jan van der Wilt, Maroeska M. Rovers


  • Top Cited Papers
    Open Access

    ESUR/ESUI consensus statements on multi-parametric MRI for the detection of clinically significant prostate cancer: quality requirements for image acquisition, interpretation and radiologists’ training

    by Maarten de Rooij, Bas Israël, Marcia Tummers, Hashim U. Ahmed, Tristan Barrett, Francesco Giganti, Bernd Hamm, Vibeke Løgager, Anwar Padhani, Valeria Panebianco, et al.

    Objectives: This study aims to define consensus-based criteria for acquiring and reporting prostate MRI and establishing prerequisites for image quality. Methods: A total of 44 leading urologists and urogenital radiologists who are experts in prostate cancer imaging from the European Society of Urogenital Radiology (ESUR) and EAU Section of Urologic Imaging (ESUI) participated in a Delphi consensus process. Panellists completed two rounds of questionnaires with 55 items under three headings: image quality assessment, interpretation and reporting, and radiologists’ experience plus training centres. Of 55 questions, 31 were rated for agreement on a 9-point scale, and 24 were multiple-choice or open. For agreement items, there was consensus agreement with an agreement ≥ 70% (score 7–9) and disagreement of ≤ 15% of the panellists. For the other questions, a consensus was considered with ≥ 50% of votes. Results: Twenty-four out of 31 of agreement items and 11/16 of other questions reached consensus. Agreement statements were (1) reporting of image quality should be performed and implemented into clinical practice; (2) for interpretation performance, radiologists should use self-performance tests with histopathology feedback, compare their interpretation with expert-reading and use external performance assessments; and (3) radiologists must attend theoretical and hands-on courses before interpreting prostate MRI. Limitations are that the results are expert opinions and not based on systematic reviews or meta-analyses. There was no consensus on outcomes statements of prostate MRI assessment as quality marker. Conclusions: An ESUR and ESUI expert panel showed high agreement (74%) on issues improving prostate MRI quality. Checking and reporting of image quality are mandatory. Prostate radiologists should attend theoretical and hands-on courses, followed by supervised education, and must perform regular performance assessments. Key Points: • Multi-parametric MRI in the diagnostic pathway of prostate cancer has a well-established upfront role in the recently updated European Association of Urology guideline and American Urological Association recommendations. • Suboptimal image acquisition and reporting at an individual level will result in clinicians losing confidence in the technique and returning to the (non-MRI) systematic biopsy pathway. Therefore, it is crucial to establish quality criteria for the acquisition and reporting of mpMRI. • To ensure high-quality prostate MRI, experts consider checking and reporting of image quality mandatory. Prostate radiologists must attend theoretical and hands-on courses, followed by supervised education, and must perform regular self- and external performance assessments.


  • Surgical removal versus retention for the management of asymptomatic disease-free impacted wisdom teeth

    by Hossein Ghaeminia, Marloes El Nienhuijs, Verena Toedtling, John Perry, Marcia Tummers, Theo Jm Hoppenreijs, Wil Jm Van der Sanden, Theodorus G Mettes

    Background Prophylactic removal of asymptomatic disease‐free impacted wisdom teeth is the surgical removal of wisdom teeth in the absence of symptoms and with no evidence of local disease. Impacted wisdom teeth may be associated with pathological changes, such as pericoronitis, root resorption, gum and alveolar bone disease (periodontitis), caries and the development of cysts and tumours. When surgical removal is performed in older people, the risk of postoperative complications, pain and discomfort is increased. Other reasons to justify prophylactic removal of asymptomatic disease‐free impacted third molars have included preventing late lower incisor crowding, preventing damage to adjacent structures such as the second molar or the inferior alveolar nerve, in preparation for orthognathic surgery, in preparation for radiotherapy or during procedures to treat people with trauma to the affected area. Removal of asymptomatic disease‐free wisdom teeth is a common procedure, and researchers must determine whether evidence supports this practice. This review is an update of an review originally published in 2005 and previously updated in 2012 and 2016. Objectives To evaluate the effects of removal compared with retention (conservative management) of asymptomatic disease‐free impacted wisdom teeth in adolescents and adults. Search methods Cochrane Oral Health’s Information Specialist searched the following databases: Cochrane Oral Health’s Trials Register (to 10 May 2019), the Cochrane Central Register of Controlled Trials (CENTRAL) (the Cochrane Library, 2019, Issue 4), MEDLINE Ovid (1946 to 10 May 2019), and Embase Ovid (1980 to 10 May 2019). The US National Institutes of Health Trials Registry (ClinicalTrials.gov)and the World Health Organization International Clinical Trials Registry Platform were searched for ongoing trials. No restrictions were placed on the language or date of publication when searching the electronic databases. . Selection criteria We included randomised controlled trials (RCTs), with no restriction on length of follow‐up, comparing removal (or absence) with retention (or presence) of asymptomatic disease‐free impacted wisdom teeth in adolescents or adults. We also considered quasi‐RCTs and prospective cohort studies for inclusion if investigators measured outcomes with follow‐up of five years or longer. Data collection and analysis Eight review authors screened search results and assessed the eligibility of studies for inclusion according to the review inclusion criteria. Eight review authors independently and in duplicate conducted the risk of bias assessments. When information was unclear, we contacted the study authors for additional information. Main results This review update includes the same two studies that were identified in our previous version of the review: one RCT with a parallel‐group design, which was conducted in a dental hospital setting in the United Kingdom, and one prospective cohort study, which was conducted in the private sector in the USA. Primary outcome No eligible studies in this review reported the effects of removal compared with retention of asymptomatic disease‐free impacted wisdom teeth on health‐related quality of life Secondary outcomes We found only low‐ to very low‐certainty evidence of the effects of removal compared with retention of asymptomatic disease‐free impacted wisdom teeth for a limited number of secondary outcome measures. One prospective cohort study, reporting data from a subgroup of 416 healthy male participants, aged 24 to 84 years, compared the effects of the absence (previous removal or agenesis) against the presence of asymptomatic disease‐free impacted wisdom teeth on periodontitis and caries associated with the distal aspect of the adjacent second molar during a follow‐up period of three to over 25 years. Very low‐certainty evidence suggests that the presence of asymptomatic disease‐free impacted wisdom teeth may be associated with increased risk of periodontitis affecting the adjacent second molar in the long term. In the same study, which is at serious risk of bias, there is insufficient evidence to demonstrate a difference in caries risk associated with the presence or absence of impacted wisdom teeth. One RCT with 164 randomised and 77 analysed adolescent participants compared the effect of extraction with retention of asymptomatic disease‐free impacted wisdom teeth on dimensional changes in the dental arch after five years. Participants (55% female) had previously undergone orthodontic treatment and had 'crowded' wisdom teeth. No evidence from this study, which was at high risk of bias, was found to suggest that removal of asymptomatic disease‐free impacted wisdom teeth has a clinically significant effect on dimensional changes in the dental arch. The included studies did not measure any of our other secondary outcomes: costs, other adverse events associated with retention of asymptomatic disease‐free impacted wisdom teeth (pericoronitis, root resorption, cyst formation, tumour formation, inflammation/infection) and adverse effects associated with their removal (alveolar osteitis/postoperative infection, nerve injury, damage to adjacent teeth during surgery, bleeding, osteonecrosis related to medication/radiotherapy, inflammation/infection). Authors' conclusions Insufficient evidence is available to determine whether asymptomatic disease‐free impacted wisdom teeth should be removed or retained. Although retention of asymptomatic disease‐free impacted wisdom teeth may be associated with increased risk of periodontitis affecting adjacent second molars in the long term, the evidence is very low certainty. Well‐designed RCTs investigating long‐term and rare effects of retention and removal of asymptomatic disease‐free impacted wisdom teeth, in a representative group of individuals, are unlikely to be feasible. In their continuing absence, high quality, long‐term prospective cohort studies may provide valuable evidence in the future. Given the current lack of available evidence, patient values should be considered and clinical expertise used to guide shared decision‐making with people who have asymptomatic disease‐free impacted wisdom teeth. If the decision is made to retain these teeth, clinical assessment at regular intervals to prevent undesirable outcomes is advisable.


  • Open Access

    The Effect of Higher Level Computerized Clinical Decision Support Systems on Oncology Care: A Systematic Review

    by Sosse E. Klarenbeek, Harm H.A. Weekenstroo, J.P. Michiel Sedelaar, Jurgen J. Fütterer, Mathias Prokop, Marcia Tummers

    Background: To deal with complexity in cancer care, computerized clinical decision support systems (CDSSs) are developed to support quality of care and improve decision-making. We performed a systematic review to explore the value of CDSSs using automated clinical guidelines, Artificial Intelligence, datamining or statistical methods (higher level CDSSs) on the quality of care in oncology. Materials and Methods: The search strategy combined synonyms for ‘CDSS’ and ‘cancer.’ Pubmed, Embase, The Cochrane Library, Institute of Electrical and Electronics Engineers, Association of Computing Machinery digital library and Web of Science were systematically searched from January 2000 to December 2019. Included studies evaluated the impact of higher level CDSSs on process outcomes, guideline adherence and clinical outcomes. Results: 11,397 studies were selected for screening, after which 61 full-text articles were assessed for eligibility. Finally, nine studies were included in the final analysis with a total population size of 7985 patients. Types of cancer included breast cancer (63.1%), lung cancer (27.8%), prostate cancer (4.1%), colorectal cancer (3.1%) and other cancer types (1.9%). The included studies demonstrated significant improvements of higher level CDSSs on process outcomes and guideline adherence across diverse settings in oncology. No significant differences were reported for clinical outcomes. Conclusion: Higher level CDSSs seem to improve process outcomes and guidelines adherence but not clinical outcomes. It should be noticed that the included studies primarily focused on breast and lung cancer. To further explore the impact of higher level CDSSs on quality of care, high-quality research is required.


  • Open Access

    Problems and Promises of Health Technologies: The Role of Early Health Economic Modeling

    by Janneke P.C. Grutters, Tim Govers, Jorte Nijboer, Marcia Tummers, Gert Jan van der Wilt, Maroeska M. Rovers

    Background: To assess whether early health economic modeling helps to distinguish those healthcare innovations that are potentially cost-effective from those that are not potentially cost-effective. We will also study what information is retrieved from the health economic models to inform further development, research and implementation decisions. Methods: We performed secondary analyses on an existing database of 32 health economic modeling assessments of 30 innovations, performed by our group. First, we explored whether the assessments could distinguish innovations with potential cost-effectiveness from innovations without potential cost-effectiveness. Second, we explored which recommendations were made regarding development, implementation and further research of the innovation. Results: Of the 30 innovations, 1 (3%) was an idea that was not yet being developed and 14 (47%) were under development. Eight (27%) innovations had finished development, and another 7 (23%) innovations were on the market. Although all assessments showed that the innovation had the potential to become cost-effective, due to improved patient outcomes, cost savings or both, differences were found in the magnitude of the potential benefits, and the likelihood of reaching this potential. The assessments informed how the innovation could be further developed or positioned to maximize its cost-effectiveness, and informed further research. Conclusion: The early health economic assessments provided insight in the potential cost-effectiveness of an innovation in its intended context, and the associated uncertainty. None of the assessments resulted in a firm ‘no-go’ recommendation, but recommendations could be provided on further research and development in order to maximize value for money.