IMIngeborg Meijer

Ingeborg Meijer

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Ingeborg Meijer has a total of 106 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Towards evaluating the research impact of Dutch Universities of Applied Science: an examination of their themes, their output, and desired impacts

    by Sarah K Coombs, Ingeborg Meijer

    Universities of Applied Sciences (UASs) of the Netherlands, like many publicly funded institutions, wish to make their impact on society visible. Policy of the Netherlands Association of Universities of Applied Sciences (NAUAS) indicates that the NAUAS wish to make impact in specific themes. This article explores the overarching question of how the evaluation of the research impact of UAS research can be conducted within the themes of the NAUAS, in a meaningful way. To do so, this article will closely examine and explore how Dutch UAS researchers view their work within the initial 10 themes, the impact they wish to create in those themes, and the output created during this process using data gathered from a national questionnaire and focus groups. We will reflect on these results against the backdrop of the specific UAS policy aims around impacts, doorwerking (effect or influence), and the broader impact literature.

  • Open Access

    Using contribution mapping to evaluate the research impact of Universities of Applied Sciences

    by Sarah K Coombs, Peter Meister-Broekema, Ingeborg Meijer

    Research conducted by Universities of Applied Sciences (UASs) is frequently driven by professional practice where researchers are challenged with finding solutions to real-life problems. These real-life solutions are significantly enhanced by the participation of stakeholders. Through this inclusion and the resulting interactions, activities, and knowledge transfer, between the stakeholder and research(ers), impacts occur at a micro level. Micro impacts are the normal impacts that occur during the research process through interactions between researchers and stakeholders, that facilitate an unexpected and unplanned effect, be it positive or negative (Lykke et al. 2023, Mapping Research Activities and Societal Impact by Taxonomy of Indicators: Uniformity and Diversity across Academic Fields, Journal of Documentation, 79: 1049–70). Contribution analysis has been recognized as a viable method for evaluating micro impacts. One recognized contribution analysis framework is Kok and Schuit’s (2012, Contribution Mapping: A Method for Mapping the Contribution of Research to Enhance Its Impact, Health Research Policy and Systems, 10: 21) Contribution Mapping. It is also one of the frameworks acknowledged as conforming to several of the recommendations for evaluating UAS research impact. However, to do justice to the nature of Practice Oriented research, a new framework is needed. The purpose of this article is to test how Contribution Mapping works in real-life to answer the question: What can we learn from Contribution Mapping as an impact evaluation tool for a future UAS specific research impact evaluation framework? This article will examine the specificity of UAS research, the relevance of Contribution Mapping for evaluating UAS research, and the theoretical and practical implications of Contribution Mapping. Through inductive analysis conducted on information gleaned from interviews and focus groups, observations, challenges, and limitations are identified, and modifications suggested to take into consideration for a new framework.


  • Open Access

    Evaluating and Improving the Societal Impact of Research

    by Gunnar Sivertsen, Ingeborg Meijer

    Societal impact of research does not occur primarily as unexpected, extraordinary incidents of particularly useful breakthroughs in science. Is it more often a result of normal everyday interactions between organisations that need to create, exchange, and make use of new knowledge to further their goals. This chapter discusses how to assess and improve the cocreation and use of research in normal research–society relations.


  • Open Access

    Monitoring Open Science as Transformative Change: Towards a Systemic Framework

    by Ismael Rafols, Jordi Molas-Gallart, Ingeborg Meijer

    Background: Following a flurry of policies for Open Science (OS), there is now a wave of initiatives to monitor its adoption. However, the great diversity of understandings and activities related to Open Science makes monitoring very challenging. There is a danger that by focusing on what can be readily observed (e.g. publications) many other OS activities are overlooked (e.g. participation), with a potential narrowing of OS scope, ‘street-light’ effects, and deviation from the values of OS.Methods:We have conducted desk research to analyse existing OS conceptualisations and monitoring efforts against the evaluation literature. Since Open Science can be understood as a systemic transformation of the research system, we have borrowed concepts from Transformative Innovation Policies frameworks which aim at evaluating socio-technical transitions.Results: In accordance with the notion of OS as a systemic transformation, we propose that OS should imply a change in monitoring frameworks for OS. Just like the shift from the ‘linear model’ to ‘innovation systems’ models in the 1980s was accompanied with new statistical concepts and tools (e.g. the OECD’s Oslo manual and innovation surveys), tracking OS adoption requires a far-reaching change in monitoring. We propose that the new monitoring should shift towards: (i) a systemic perspective which considers the various actions related to OS, including policies and outputs (e.g. datasets) but also processes (e.g. participatory events), outcomes (e.g. citizen interest in science) and expected impacts (e.g. better scientific contributions to addressing societal problems); (ii) implementation of monitoring as reflexive learning (rather than accountability or benchmarking); (iii) mapping the directionality of the activities and the values associated with the choices in directions. Conclusions:A monitoring framework for OS requires a profound change in monitoring framework and practices. The scope should broaden from outputs (such as publications) towards the processes of connection that make science ‘open’ (usage, co-creation and dialogue), as well as towards outcomes (changes in practices) and the longer-term impacts that reflect the values and normative commitments of OS.


  • Driving the innovation process by connecting regional knowledge bases to local needs

    by Leiden University. Centre for Science and Technology Studies, Sonia Daniela Mena Jara, Ingeborg Meijer, Gaston Heimeriks, Tim Willemse

    Novel approaches are needed to support the creation of more open, inclusive, and self-sustaining R&I ecosystems in healthcare. This study analysed 3 European regions (Murcia ES), (Örebro SE), and (Republic of Cyprus CY), incorporating complementary approaches from Responsible Research and Innovation (RRI) and Research and Innovation Smart Specialisation Strategy (RIS3). The exercise entailed the identification of healthcare and innovation stakeholders and the characterisation of the policy landscape in each territory. Moreover, the strengths of the regional knowledge base was analysed by measuring the Revealed Comparative Advantage (RCA) indicator based on relatedness measurement, and by using micro-level fields analyses of scientific publications. This methodology allowed us to identify the fields and topics (strengths) that provide opportunities for innovation processes. Additional identification of social needs in the three territories showed profound differences regarding the alignment of the selected needs with respect to the regions’ capabilities. The results suggest that a timely direct interaction with territorial stakeholders can help in selecting the most promising innovation priorities that are based on local needs and knowledge. The process of interaction requires early engagement to support territorial ownership and is further reinforced by RRI policies in place.

  • Evaluative conversations: Translating between diverse stakeholders in regional RRI projects

    by Tjitske Holtrop, Ingeborg Meijer, Paula Otero-Hermida, Anestis Amanatidis, Chiara Buongiovanni, Donatella Casale, Claudia Colonnello, Alessandro Deserti, Fabio Feudi, Alan Hartmann, et al.

    Since the summer of 2020, researchers from ten projects pertaining to the Horizon2020 Science with and for Society (SwafS) call have been meeting virtually as the SwafS14 Monitoring and Evaluation ecosystem. Topics of discussion were the trials and tribulations of their regional Responsible Research and Innovation (RRI) projects as well as their strategies for monitoring and evaluation. In this paper we make a first attempt at presenting these issues as problems of translation between different kinds of stakeholders. After an exploration of the diversity of stakeholders and the process of translation in regional RRI, we suggest evaluative conversations as a way of improving regional RRI. We intend to develop this idea in the future and that these conversations will facilitate more responsible and engaged monitoring and evaluation and contribute to better R&I policies.


  • Open Access

    The Societal Readiness Thinking Tool: A Practical Resource for Maturing the Societal Readiness of Research Projects

    by Michael J. Bernstein, Mathias Wullum Nielsen, Emil Alnor, André Brasil, Astrid Lykke Birkving, Tung Tung Chan, Erich Griessler, Stefan de Jong, Wouter van de Klippe, Ingeborg Meijer, et al.

    In this paper, we introduce the Societal Readiness (SR) Thinking Tool to aid researchers and innovators in developing research projects with greater responsiveness to societal values, needs, and expectations. The need for societally-focused approaches to research and innovation—complementary to Technology Readiness (TR) frameworks—is presented. Insights from responsible research and innovation (RRI) concepts and practice, organized across critical stages of project-life cycles are discussed with reference to the development of the SR Thinking Tool. The tool is designed to complement not only shortfalls in TR approaches, but also improve upon other efforts to integrate RRI, sustainability, and design thinking in research and innovation cycles. Operationalization and early-stage user tests of the Tool are reported, along with discussion of potential future iterations and applications.


  • Open Access

    Normal versus extraordinary societal impact: how to understand, evaluate, and improve research activities in their relations to society?

    by Gunnar Sivertsen, Ingeborg Meijer

    Societal impact of research does not occur primarily as unexpected extraordinary incidents of particularly useful breakthroughs in science. It is more often a result of normal everyday interactions between organizations that need to create, exchange, and make use of new knowledge to further their goals. We use the distinctions between normal and extraordinary societal impact and between organizational- and individual-level activities and responsibilities to discuss how science–society relations can better be understood, evaluated, and improved by focusing on the organizations that typically interact in a specific domain of research.


  • Open Access

    The relationship between publication volume of biomedical research and burden of disease

    by Niels Hagenaars, Thijs de Kruif, Lissy van de Laar, Ludo Waltman, Ingeborg Meijer, Marcel Levi, Anshu Gupta

    Background One could hypothesize that the biomedical research agenda aligns with the (global) burden of disease, since it should aim to reduce illness and death. We investigated the relationship between publication volume and Research-dependent Fraction of Global Burden of Disease (BoD-RdF): the fraction of Burden of Disease that can only be relieved by further biomedical research. Aim of this comparison is to evaluate and support the optimization of biomedical research portfolios.MethodsBoD-RdF, defined as the burden of disease reported in the 1st quartile of the age corrected burden of disease per capita for all countries, was calculated using 2014 Global Burden of Disease data from WHO for the years 2000 and 2012. Publication volumes were based on 6.5 million publications between 2000 and 2012 from the Clarivate Analytics’ Web of Science database, categorized into disease groups by keyword analysis and text mining techniques. The categorized publication volumes were compared to BoD-RdF. FindingsFrom the global burden of disease in 2012, we estimate that 48% depends on further biomedical research to be relieved (BoD-RdF). Generally, diseases with high burden are underresearched, whereas diseases with relatively little burden are overrepresented in the global research portfolio. Large variations in publication volume (up to twelve-fold) exist for diseases with similar BoD-RdF. Likewise, diseases with a similar publication volume vary greatly in BoD-RdF (up to 50-fold). Compared to 2000, the disease-specific publication volume almost doubled in 2012, but the correlation with burden of disease and BoD-RdF showed only a small improvement.InterpretationWe found a profound and persistent misalignment of publication volume with BoD-RdF. For 18 diseases, which account for 50% of the global BoD-RdF, a factor 2 increase of the publication volume would be justified based on BoD-RdF. This misalignment persisted over the last decade, despite doubling of the total number of disease specific publications. Although we recognize that the global research portfolio will never be dictated by global disease burden alone, we propose that the comparison between BoD-RdF and publication volume provides supportive insights that can be used in optimization of the research portfolio.


  • Scientific knowledge production in European regions: patterns of growth, diversity and complexity

    by Gaston Heimeriks, Deyu Li, Wout Lamers, Ingeborg Meijer, Alfredo Yegros

    We study regional patterns of scientific knowledge production in Europe using all scientific publications in the period 2000–2014 attributed to 813 scientific subfields. We show that the existing scientific portfolio of regions offers opportunities for related diversification and discourages the creation of knowledge on topics unrelated to the local knowledge base. Many lagging regions show clear growth, but complex knowledge production remains highly concentrated in regions in the North and West of Europe. For lagging regions there are advantages in not specializing too soon and to first diversify before moving into developing more complex knowledge.