Ingeborg Meijer
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Ingeborg Meijer has a total of 106 co-authors. Here are the top co-authors by number of shared publications:
- Niels Mejlgaard
Aarhus University
3 shared publications - Alexandra Breukel
European Neuromuscular Centre, Lt. Generaal van Heutszlaan 6, Baarn 3743JN, The Netherlands
2 shared publications Anshu Gupta
2 shared publicationsCarter Bloch
Aarhus University, 8000 Aarhus C, Denmark
2 shared publicationsEllen Sterrenburg
Prinses Beatrix Spierfonds, Den Haag, The Netherlands
2 shared publications- Emad Yaghmaei
Delft University of Technology
2 shared publications
Latest Publications
- Open Access
- 8 January 2026
- Published by Oxford University Press (OUP) in Research Evaluation
- Vol. 35
Towards evaluating the research impact of Dutch Universities of Applied Science: an examination of their themes, their output, and desired impacts
Universities of Applied Sciences (UASs) of the Netherlands, like many publicly funded institutions, wish to make their impact on society visible. Policy of the Netherlands Association of Universities of Applied Sciences (NAUAS) indicates that the NAUAS wish to make impact in specific themes. This article explores the overarching question of how the evaluation of the research impact of UAS research can be conducted within the themes of the NAUAS, in a meaningful way. To do so, this article will closely examine and explore how Dutch UAS researchers view their work within the initial 10 themes, the impact they wish to create in those themes, and the output created during this process using data gathered from a national questionnaire and focus groups. We will reflect on these results against the backdrop of the specific UAS policy aims around impacts, doorwerking (effect or influence), and the broader impact literature.
- 8 January 2026
- Published by Oxford University Press (OUP) in Research Evaluation
- Vol. 35
Open AccessTowards evaluating the research impact of Dutch Universities of Applied Science: an examination of their themes, their output, and desired impacts
Universities of Applied Sciences (UASs) of the Netherlands, like many publicly funded institutions, wish to make their impact on society visible. Policy of the Netherlands Association of Universities of Applied Sciences (NAUAS) indicates that the NAUAS wish to make impact in specific themes. This article explores the overarching question of how the evaluation of the research impact of UAS research can be conducted within the themes of the NAUAS, in a meaningful way. To do so, this article will closely examine and explore how Dutch UAS researchers view their work within the initial 10 themes, the impact they wish to create in those themes, and the output created during this process using data gathered from a national questionnaire and focus groups. We will reflect on these results against the backdrop of the specific UAS policy aims around impacts, doorwerking (effect or influence), and the broader impact literature.
- Open Access
- 27 December 2024
- Published by Oxford University Press (OUP) in Research Evaluation
- Vol. 34
Using contribution mapping to evaluate the research impact of Universities of Applied Sciences
Research conducted by Universities of Applied Sciences (UASs) is frequently driven by professional practice where researchers are challenged with finding solutions to real-life problems. These real-life solutions are significantly enhanced by the participation of stakeholders. Through this inclusion and the resulting interactions, activities, and knowledge transfer, between the stakeholder and research(ers), impacts occur at a micro level. Micro impacts are the normal impacts that occur during the research process through interactions between researchers and stakeholders, that facilitate an unexpected and unplanned effect, be it positive or negative (Lykke et al. 2023, Mapping Research Activities and Societal Impact by Taxonomy of Indicators: Uniformity and Diversity across Academic Fields, Journal of Documentation, 79: 1049–70). Contribution analysis has been recognized as a viable method for evaluating micro impacts. One recognized contribution analysis framework is Kok and Schuit’s (2012, Contribution Mapping: A Method for Mapping the Contribution of Research to Enhance Its Impact, Health Research Policy and Systems, 10: 21) Contribution Mapping. It is also one of the frameworks acknowledged as conforming to several of the recommendations for evaluating UAS research impact. However, to do justice to the nature of Practice Oriented research, a new framework is needed. The purpose of this article is to test how Contribution Mapping works in real-life to answer the question: What can we learn from Contribution Mapping as an impact evaluation tool for a future UAS specific research impact evaluation framework? This article will examine the specificity of UAS research, the relevance of Contribution Mapping for evaluating UAS research, and the theoretical and practical implications of Contribution Mapping. Through inductive analysis conducted on information gleaned from interviews and focus groups, observations, challenges, and limitations are identified, and modifications suggested to take into consideration for a new framework.
- 27 December 2024
- Published by Oxford University Press (OUP) in Research Evaluation
- Vol. 34
Open AccessUsing contribution mapping to evaluate the research impact of Universities of Applied Sciences
Research conducted by Universities of Applied Sciences (UASs) is frequently driven by professional practice where researchers are challenged with finding solutions to real-life problems. These real-life solutions are significantly enhanced by the participation of stakeholders. Through this inclusion and the resulting interactions, activities, and knowledge transfer, between the stakeholder and research(ers), impacts occur at a micro level. Micro impacts are the normal impacts that occur during the research process through interactions between researchers and stakeholders, that facilitate an unexpected and unplanned effect, be it positive or negative (Lykke et al. 2023, Mapping Research Activities and Societal Impact by Taxonomy of Indicators: Uniformity and Diversity across Academic Fields, Journal of Documentation, 79: 1049–70). Contribution analysis has been recognized as a viable method for evaluating micro impacts. One recognized contribution analysis framework is Kok and Schuit’s (2012, Contribution Mapping: A Method for Mapping the Contribution of Research to Enhance Its Impact, Health Research Policy and Systems, 10: 21) Contribution Mapping. It is also one of the frameworks acknowledged as conforming to several of the recommendations for evaluating UAS research impact. However, to do justice to the nature of Practice Oriented research, a new framework is needed. The purpose of this article is to test how Contribution Mapping works in real-life to answer the question: What can we learn from Contribution Mapping as an impact evaluation tool for a future UAS specific research impact evaluation framework? This article will examine the specificity of UAS research, the relevance of Contribution Mapping for evaluating UAS research, and the theoretical and practical implications of Contribution Mapping. Through inductive analysis conducted on information gleaned from interviews and focus groups, observations, challenges, and limitations are identified, and modifications suggested to take into consideration for a new framework.
- Open Access
- 13 November 2024
- Published by Springer Nature
- p. 21-28
Evaluating and Improving the Societal Impact of Research
Societal impact of research does not occur primarily as unexpected, extraordinary incidents of particularly useful breakthroughs in science. Is it more often a result of normal everyday interactions between organisations that need to create, exchange, and make use of new knowledge to further their goals. This chapter discusses how to assess and improve the cocreation and use of research in normal research–society relations.
- 13 November 2024
- Published by Springer Nature
- p. 21-28
Open AccessEvaluating and Improving the Societal Impact of Research
Societal impact of research does not occur primarily as unexpected, extraordinary incidents of particularly useful breakthroughs in science. Is it more often a result of normal everyday interactions between organisations that need to create, exchange, and make use of new knowledge to further their goals. This chapter discusses how to assess and improve the cocreation and use of research in normal research–society relations.
- Open Access
- 2 February 2024
- Published by Center for Open Science in SocArXiv
Monitoring Open Science as Transformative Change: Towards a Systemic Framework
Background: Following a flurry of policies for Open Science (OS), there is now a wave of initiatives to monitor its adoption. However, the great diversity of understandings and activities related to Open Science makes monitoring very challenging. There is a danger that by focusing on what can be readily observed (e.g. publications) many other OS activities are overlooked (e.g. participation), with a potential narrowing of OS scope, ‘street-light’ effects, and deviation from the values of OS.Methods:We have conducted desk research to analyse existing OS conceptualisations and monitoring efforts against the evaluation literature. Since Open Science can be understood as a systemic transformation of the research system, we have borrowed concepts from Transformative Innovation Policies frameworks which aim at evaluating socio-technical transitions.Results: In accordance with the notion of OS as a systemic transformation, we propose that OS should imply a change in monitoring frameworks for OS. Just like the shift from the ‘linear model’ to ‘innovation systems’ models in the 1980s was accompanied with new statistical concepts and tools (e.g. the OECD’s Oslo manual and innovation surveys), tracking OS adoption requires a far-reaching change in monitoring. We propose that the new monitoring should shift towards: (i) a systemic perspective which considers the various actions related to OS, including policies and outputs (e.g. datasets) but also processes (e.g. participatory events), outcomes (e.g. citizen interest in science) and expected impacts (e.g. better scientific contributions to addressing societal problems); (ii) implementation of monitoring as reflexive learning (rather than accountability or benchmarking); (iii) mapping the directionality of the activities and the values associated with the choices in directions. Conclusions:A monitoring framework for OS requires a profound change in monitoring framework and practices. The scope should broaden from outputs (such as publications) towards the processes of connection that make science ‘open’ (usage, co-creation and dialogue), as well as towards outcomes (changes in practices) and the longer-term impacts that reflect the values and normative commitments of OS.
- 2 February 2024
- Published by Center for Open Science in SocArXiv
Open AccessMonitoring Open Science as Transformative Change: Towards a Systemic Framework
Background: Following a flurry of policies for Open Science (OS), there is now a wave of initiatives to monitor its adoption. However, the great diversity of understandings and activities related to Open Science makes monitoring very challenging. There is a danger that by focusing on what can be readily observed (e.g. publications) many other OS activities are overlooked (e.g. participation), with a potential narrowing of OS scope, ‘street-light’ effects, and deviation from the values of OS.Methods:We have conducted desk research to analyse existing OS conceptualisations and monitoring efforts against the evaluation literature. Since Open Science can be understood as a systemic transformation of the research system, we have borrowed concepts from Transformative Innovation Policies frameworks which aim at evaluating socio-technical transitions.Results: In accordance with the notion of OS as a systemic transformation, we propose that OS should imply a change in monitoring frameworks for OS. Just like the shift from the ‘linear model’ to ‘innovation systems’ models in the 1980s was accompanied with new statistical concepts and tools (e.g. the OECD’s Oslo manual and innovation surveys), tracking OS adoption requires a far-reaching change in monitoring. We propose that the new monitoring should shift towards: (i) a systemic perspective which considers the various actions related to OS, including policies and outputs (e.g. datasets) but also processes (e.g. participatory events), outcomes (e.g. citizen interest in science) and expected impacts (e.g. better scientific contributions to addressing societal problems); (ii) implementation of monitoring as reflexive learning (rather than accountability or benchmarking); (iii) mapping the directionality of the activities and the values associated with the choices in directions. Conclusions:A monitoring framework for OS requires a profound change in monitoring framework and practices. The scope should broaden from outputs (such as publications) towards the processes of connection that make science ‘open’ (usage, co-creation and dialogue), as well as towards outcomes (changes in practices) and the longer-term impacts that reflect the values and normative commitments of OS.
- 1 April 2022
- Published by Austrian Platform for Research and Technology Policy Evaluation (FTEVAL)
Driving the innovation process by connecting regional knowledge bases to local needs
Novel approaches are needed to support the creation of more open, inclusive, and self-sustaining R&I ecosystems in healthcare. This study analysed 3 European regions (Murcia ES), (Örebro SE), and (Republic of Cyprus CY), incorporating complementary approaches from Responsible Research and Innovation (RRI) and Research and Innovation Smart Specialisation Strategy (RIS3). The exercise entailed the identification of healthcare and innovation stakeholders and the characterisation of the policy landscape in each territory. Moreover, the strengths of the regional knowledge base was analysed by measuring the Revealed Comparative Advantage (RCA) indicator based on relatedness measurement, and by using micro-level fields analyses of scientific publications. This methodology allowed us to identify the fields and topics (strengths) that provide opportunities for innovation processes. Additional identification of social needs in the three territories showed profound differences regarding the alignment of the selected needs with respect to the regions’ capabilities. The results suggest that a timely direct interaction with territorial stakeholders can help in selecting the most promising innovation priorities that are based on local needs and knowledge. The process of interaction requires early engagement to support territorial ownership and is further reinforced by RRI policies in place.
- 1 April 2022
- Published by Austrian Platform for Research and Technology Policy Evaluation (FTEVAL)
Driving the innovation process by connecting regional knowledge bases to local needs
Novel approaches are needed to support the creation of more open, inclusive, and self-sustaining R&I ecosystems in healthcare. This study analysed 3 European regions (Murcia ES), (Örebro SE), and (Republic of Cyprus CY), incorporating complementary approaches from Responsible Research and Innovation (RRI) and Research and Innovation Smart Specialisation Strategy (RIS3). The exercise entailed the identification of healthcare and innovation stakeholders and the characterisation of the policy landscape in each territory. Moreover, the strengths of the regional knowledge base was analysed by measuring the Revealed Comparative Advantage (RCA) indicator based on relatedness measurement, and by using micro-level fields analyses of scientific publications. This methodology allowed us to identify the fields and topics (strengths) that provide opportunities for innovation processes. Additional identification of social needs in the three territories showed profound differences regarding the alignment of the selected needs with respect to the regions’ capabilities. The results suggest that a timely direct interaction with territorial stakeholders can help in selecting the most promising innovation priorities that are based on local needs and knowledge. The process of interaction requires early engagement to support territorial ownership and is further reinforced by RRI policies in place.
- 1 April 2022
- Published by Austrian Platform for Research and Technology Policy Evaluation (FTEVAL)
Evaluative conversations: Translating between diverse stakeholders in regional RRI projects
Since the summer of 2020, researchers from ten projects pertaining to the Horizon2020 Science with and for Society (SwafS) call have been meeting virtually as the SwafS14 Monitoring and Evaluation ecosystem. Topics of discussion were the trials and tribulations of their regional Responsible Research and Innovation (RRI) projects as well as their strategies for monitoring and evaluation. In this paper we make a first attempt at presenting these issues as problems of translation between different kinds of stakeholders. After an exploration of the diversity of stakeholders and the process of translation in regional RRI, we suggest evaluative conversations as a way of improving regional RRI. We intend to develop this idea in the future and that these conversations will facilitate more responsible and engaged monitoring and evaluation and contribute to better R&I policies.
- 1 April 2022
- Published by Austrian Platform for Research and Technology Policy Evaluation (FTEVAL)
Evaluative conversations: Translating between diverse stakeholders in regional RRI projects
Since the summer of 2020, researchers from ten projects pertaining to the Horizon2020 Science with and for Society (SwafS) call have been meeting virtually as the SwafS14 Monitoring and Evaluation ecosystem. Topics of discussion were the trials and tribulations of their regional Responsible Research and Innovation (RRI) projects as well as their strategies for monitoring and evaluation. In this paper we make a first attempt at presenting these issues as problems of translation between different kinds of stakeholders. After an exploration of the diversity of stakeholders and the process of translation in regional RRI, we suggest evaluative conversations as a way of improving regional RRI. We intend to develop this idea in the future and that these conversations will facilitate more responsible and engaged monitoring and evaluation and contribute to better R&I policies.
- Open Access
- 27 January 2022
- Published by Springer Nature in Science and Engineering Ethics
- Vol. 28 (1) , 1-32
The Societal Readiness Thinking Tool: A Practical Resource for Maturing the Societal Readiness of Research Projects
In this paper, we introduce the Societal Readiness (SR) Thinking Tool to aid researchers and innovators in developing research projects with greater responsiveness to societal values, needs, and expectations. The need for societally-focused approaches to research and innovation—complementary to Technology Readiness (TR) frameworks—is presented. Insights from responsible research and innovation (RRI) concepts and practice, organized across critical stages of project-life cycles are discussed with reference to the development of the SR Thinking Tool. The tool is designed to complement not only shortfalls in TR approaches, but also improve upon other efforts to integrate RRI, sustainability, and design thinking in research and innovation cycles. Operationalization and early-stage user tests of the Tool are reported, along with discussion of potential future iterations and applications.
- 27 January 2022
- Published by Springer Nature in Science and Engineering Ethics
- Vol. 28 (1) , 1-32
Open AccessThe Societal Readiness Thinking Tool: A Practical Resource for Maturing the Societal Readiness of Research Projects
In this paper, we introduce the Societal Readiness (SR) Thinking Tool to aid researchers and innovators in developing research projects with greater responsiveness to societal values, needs, and expectations. The need for societally-focused approaches to research and innovation—complementary to Technology Readiness (TR) frameworks—is presented. Insights from responsible research and innovation (RRI) concepts and practice, organized across critical stages of project-life cycles are discussed with reference to the development of the SR Thinking Tool. The tool is designed to complement not only shortfalls in TR approaches, but also improve upon other efforts to integrate RRI, sustainability, and design thinking in research and innovation cycles. Operationalization and early-stage user tests of the Tool are reported, along with discussion of potential future iterations and applications.
- Open Access
- 10 December 2019
- Published by Oxford University Press (OUP) in Research Evaluation
- Vol. 29 (1) , 66-70
Normal versus extraordinary societal impact: how to understand, evaluate, and improve research activities in their relations to society?
Societal impact of research does not occur primarily as unexpected extraordinary incidents of particularly useful breakthroughs in science. It is more often a result of normal everyday interactions between organizations that need to create, exchange, and make use of new knowledge to further their goals. We use the distinctions between normal and extraordinary societal impact and between organizational- and individual-level activities and responsibilities to discuss how science–society relations can better be understood, evaluated, and improved by focusing on the organizations that typically interact in a specific domain of research.
- 10 December 2019
- Published by Oxford University Press (OUP) in Research Evaluation
- Vol. 29 (1) , 66-70
Open AccessNormal versus extraordinary societal impact: how to understand, evaluate, and improve research activities in their relations to society?
Societal impact of research does not occur primarily as unexpected extraordinary incidents of particularly useful breakthroughs in science. It is more often a result of normal everyday interactions between organizations that need to create, exchange, and make use of new knowledge to further their goals. We use the distinctions between normal and extraordinary societal impact and between organizational- and individual-level activities and responsibilities to discuss how science–society relations can better be understood, evaluated, and improved by focusing on the organizations that typically interact in a specific domain of research.
- Open Access
- 29 August 2019
- Published by Center for Open Science in OSF Preprints
The relationship between publication volume of biomedical research and burden of disease
Background One could hypothesize that the biomedical research agenda aligns with the (global) burden of disease, since it should aim to reduce illness and death. We investigated the relationship between publication volume and Research-dependent Fraction of Global Burden of Disease (BoD-RdF): the fraction of Burden of Disease that can only be relieved by further biomedical research. Aim of this comparison is to evaluate and support the optimization of biomedical research portfolios.MethodsBoD-RdF, defined as the burden of disease reported in the 1st quartile of the age corrected burden of disease per capita for all countries, was calculated using 2014 Global Burden of Disease data from WHO for the years 2000 and 2012. Publication volumes were based on 6.5 million publications between 2000 and 2012 from the Clarivate Analytics’ Web of Science database, categorized into disease groups by keyword analysis and text mining techniques. The categorized publication volumes were compared to BoD-RdF. FindingsFrom the global burden of disease in 2012, we estimate that 48% depends on further biomedical research to be relieved (BoD-RdF). Generally, diseases with high burden are underresearched, whereas diseases with relatively little burden are overrepresented in the global research portfolio. Large variations in publication volume (up to twelve-fold) exist for diseases with similar BoD-RdF. Likewise, diseases with a similar publication volume vary greatly in BoD-RdF (up to 50-fold). Compared to 2000, the disease-specific publication volume almost doubled in 2012, but the correlation with burden of disease and BoD-RdF showed only a small improvement.InterpretationWe found a profound and persistent misalignment of publication volume with BoD-RdF. For 18 diseases, which account for 50% of the global BoD-RdF, a factor 2 increase of the publication volume would be justified based on BoD-RdF. This misalignment persisted over the last decade, despite doubling of the total number of disease specific publications. Although we recognize that the global research portfolio will never be dictated by global disease burden alone, we propose that the comparison between BoD-RdF and publication volume provides supportive insights that can be used in optimization of the research portfolio.
- 29 August 2019
- Published by Center for Open Science in OSF Preprints
Open AccessThe relationship between publication volume of biomedical research and burden of disease
Background One could hypothesize that the biomedical research agenda aligns with the (global) burden of disease, since it should aim to reduce illness and death. We investigated the relationship between publication volume and Research-dependent Fraction of Global Burden of Disease (BoD-RdF): the fraction of Burden of Disease that can only be relieved by further biomedical research. Aim of this comparison is to evaluate and support the optimization of biomedical research portfolios.MethodsBoD-RdF, defined as the burden of disease reported in the 1st quartile of the age corrected burden of disease per capita for all countries, was calculated using 2014 Global Burden of Disease data from WHO for the years 2000 and 2012. Publication volumes were based on 6.5 million publications between 2000 and 2012 from the Clarivate Analytics’ Web of Science database, categorized into disease groups by keyword analysis and text mining techniques. The categorized publication volumes were compared to BoD-RdF. FindingsFrom the global burden of disease in 2012, we estimate that 48% depends on further biomedical research to be relieved (BoD-RdF). Generally, diseases with high burden are underresearched, whereas diseases with relatively little burden are overrepresented in the global research portfolio. Large variations in publication volume (up to twelve-fold) exist for diseases with similar BoD-RdF. Likewise, diseases with a similar publication volume vary greatly in BoD-RdF (up to 50-fold). Compared to 2000, the disease-specific publication volume almost doubled in 2012, but the correlation with burden of disease and BoD-RdF showed only a small improvement.InterpretationWe found a profound and persistent misalignment of publication volume with BoD-RdF. For 18 diseases, which account for 50% of the global BoD-RdF, a factor 2 increase of the publication volume would be justified based on BoD-RdF. This misalignment persisted over the last decade, despite doubling of the total number of disease specific publications. Although we recognize that the global research portfolio will never be dictated by global disease burden alone, we propose that the comparison between BoD-RdF and publication volume provides supportive insights that can be used in optimization of the research portfolio.
- 7 August 2019
- Published by Taylor & Francis in European Planning Studies
- Vol. 27 (11) , 2123-2143
Scientific knowledge production in European regions: patterns of growth, diversity and complexity
We study regional patterns of scientific knowledge production in Europe using all scientific publications in the period 2000–2014 attributed to 813 scientific subfields. We show that the existing scientific portfolio of regions offers opportunities for related diversification and discourages the creation of knowledge on topics unrelated to the local knowledge base. Many lagging regions show clear growth, but complex knowledge production remains highly concentrated in regions in the North and West of Europe. For lagging regions there are advantages in not specializing too soon and to first diversify before moving into developing more complex knowledge.
- 7 August 2019
- Published by Taylor & Francis in European Planning Studies
- Vol. 27 (11) , 2123-2143
Scientific knowledge production in European regions: patterns of growth, diversity and complexity
We study regional patterns of scientific knowledge production in Europe using all scientific publications in the period 2000–2014 attributed to 813 scientific subfields. We show that the existing scientific portfolio of regions offers opportunities for related diversification and discourages the creation of knowledge on topics unrelated to the local knowledge base. Many lagging regions show clear growth, but complex knowledge production remains highly concentrated in regions in the North and West of Europe. For lagging regions there are advantages in not specializing too soon and to first diversify before moving into developing more complex knowledge.