TKTomasz Kupiec

Tomasz Kupiec

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Tomasz Kupiec has a total of 26 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Learning Agendas

    by Karol Olejniczak, Tomasz Kupiec, Yaerin Park

    Learning Agendas (LAs) represent a strategic approach to addressing long-standing challenges in evaluation use, specifically the “two communities” gap between knowledge producers and users and the difficulty of synthesizing fragmented studies into coherent evidence streams. This chapter examines the conceptual foundations and practical implementation of LAs, which are defined as strategic plans for research and evaluation activities that provide important questions and plans for addressing them while balancing diverse organizational needs and time horizons. Drawing on empirical analysis of 24 US federal agency LAs developed under the 2018 Evidence Act and applications within EU co-funded programs in Poland, the chapter reconstructs the Theory of Change underlying LAs using “if–then” causal logic and the COM-B behavioral model. Key findings reveal significant variation in LA scope, stakeholder engagement approaches and structural elements, while identifying persistent challenges in question formulation, process visibility and stakeholder collaboration. The chapter provides practical guidance through an eight-step design framework for commissioning authorities, covering scope definition, user identification, stakeholder engagement, priority question development, timeframes, learning activities, dissemination and challenge mitigation. It concludes by highlighting LAs’ potential to promote democratic practices in evidence-informed policymaking through enhanced stakeholder participation, institutional learning and balanced integration of technical expertise with public values.

  • Ewaluacja w samorządzie lokalnym – specyfika, perspektywy, potencjał

    by Tomasz Kupiec, Grażyna Cieślak, Małgorzata Leszczyńska, Marcin Wojdat

    Artykuł prezentuje syntetyczne ujęcie dyskusji panelowej poświęconej praktyce ewaluacji w samorządach lokalnych, prowadzonej podczas IV Międzynarodowego Kongresu Ewaluacyjnego. Analiza obejmuje cztery kluczowe obszary: specyfikę ewaluacji lokalnej, motywacje i potrzeby jednostek samorządu terytorialnego, bariery utrudniające realizację i wykorzystanie badań oraz potencjalne formy wsparcia rozwoju praktyk ewaluacyjnych. Wskazuje na zróżnicowane uwarunkowania organizacyjne i kulturowe, które wpływają na funkcjonowanie ewaluacji na poziomie lokalnym. Artykuł podkreśla znaczenie instytucjonalizacji, budowania kultury refleksyjnej oraz środowiskowej wymiany wiedzy jako warunków wzmacniania systemów ewaluacyjnych w JST.

  • Od Redakcji

    by Tomasz Kupiec, Monika Bartosiewicz-Niziołek

  • Open Access

    Organisational factors in evaluation use: results from a survey in five EU countries

    by Tomasz Kupiec, Dorota Celinska-Janowicz, Niklas Andreas Andersen, Rasmus Lind Ravn, Stijn van Voorst, Eva Bláhová, Federico Cuomo, Erica Melloni, Oto Potluka, Giancarlo Vecchi

    This study explores the organisational determinants of evaluation use. It proposes a framework distinguishing between the initial and advanced phases of evaluation practice and predicting what factors determine the type of evaluation use at each phase. Our framework was empirically tested using a survey of 1123 public and non-governmental organisations across five European Union (EU) countries: Czechia, Denmark, Italy, the Netherlands and Poland. Our findings suggest that the adoption mode of evaluation practice influences the dominant type of evaluation use, but this impact is limited to the first few years after the evaluation practice was introduced in an organisation. In the advanced phase, we identified significant relationships between dimensions of legitimacy and types of evaluation use. This suggests that organisational legitimacy remains a promising predictor of evaluation use; however, the specific dimensions and their relationships with different types of evaluation use require further investigation.


  • Open Access

    Typology of Carrots, Sticks, and Sermons: Tracing Its Influence on the Discipline of Public Policy

    by Karol Olejniczak, Tomasz Kupiec, Dominika Wojtowicz

    Background: The 1998 book "Carrots, Sticks & Sermons: Policy Instruments and Their Evaluation" introduced a seminal typology categorizing policy tools by their mechanisms of influence. Despite its potential to shape policy theory and practice, its broader disciplinary impact and citation patterns remain underexplored. This article evaluates the book's legacy in public policy literature while testing bibliometric methods, including emerging generative artificial intelligence (GAI) tools for research synthesis. Purpose: The study aims to (1) assess the influence of the book on the discourse in the public policy literature and (2) explore the utility and limits of AI-driven tools for tracing scholarly impact. It addresses four questions: the book's citation trends, its presence in major disciplinary texts, citation intent, and GAI's ability to reference the work accurately. Setting: Not applicable. Intervention: Not applicable. Research Design: A mixed-methods approach consisted of: (i) quantitative bibliometrics (citation counts, trends, and keyword analysis), (ii) qualitative content analysis by human researchers (major disciplinary handbooks/textbooks and articles), and (iii) generative AI semantic search and analysis. Data Collection and Analysis: The quantitative analysis covered a corpus of interdisciplinary public policy literature from 1998 to 2024, extracted from citation databases (Scopus, Web of Science, Google Scholar). Qualitative analysis focused on 20 major handbooks and textbooks from public policy discipline (occurrence of references to book and policy instruments typology) and coding of 20 highly cited articles (classification of citation types in terms of intent). Work with GAI focused on semantic search and analysis with various AI platforms. Findings: The findings underscore the typology's enduring relevance while advocating for methodological rigor in impact assessments and GAI-aided research. The book has achieved "classic" status in public policy, evidenced by 1,369 citations on Google Scholar, 924 citations on Scopus, 627 citations on Web of Science, as well as presence in 16 out of 20 major disciplinary handbooks/textbooks. Its typology is foundational but often superficially referenced; only 7 of 20 top articles applied it directly. GAI tools also referred to the book, although frequently misattributed or diluted the source, highlighting risks in automated literature reviews. The authors propose updating the typology of policy instruments to include behavioral tools (e.g., nudges) and stress the need for human verification of GAI outputs.

  • Open Access

    Metadata Standards and Practices: Lessons Learned from Interviews with Experts

    by Brett Buttliere, Remigiusz Depta, Anna Natalia Gajda, Tomasz Kupiec

    Data is difficult to reuse without consistent metadata, making it difficult to decipher and reuse dataset and analysis scripts. Our team is working on solutions at the variable level, including the so called Variable Object Identification (VOI) system. This Summer 2024 project included interviews with 35 researchers and digital infrastructure providers about “metadata”: current concepts, community needs, currently available tools, and the future of the field. Based on 17 questions, it explored aspects such as variable naming, data reuse problems, transparency and potential solutions including suggestions for standard tools. Online Qualitative Case Study interviews (~1-hour interviews) were recorded, transcribed and analyzed, identifying major themes and mentioned data standards such as RDA, BIDS, DDI, GESIS and Frictionless. The results indicate an awareness of the problems, a limited number of initiatives at the variable level, and difficulties in encouraging the use of standards, despite their potential in standardizing analytical scripts.

  • AI-Supported Individual Interviews: Opportunities and Threats for Evaluation

    by Tomasz Kupiec

    This article presents a comprehensive literature review of the opportunities and challenges associated with using AI to support qualitative evaluation, particularly semi-structured in-depth interviews. By analysing experiences across six stages of the interview process—planning, protocol development, sampling and recruitment, data collection, transcribing and analysis—the study explores the potential of AI in improving efficiency, scalability, and accuracy of qualitative studies. Key findings highlight AI’s capacity to streamline transcription and coding processes while addressing limitations such as contextual understanding and emotional nuance. However, the reliance on human oversight, ethical concerns necessitate further research. This review underscores AI’s role as a complementary tool, enhancing qualitative methods rather than replacing human expertise.


  • Od Redakcji

    by Tomasz Kupiec, Monika Bartosiewicz-Niziołek

  • Open Access

    Motivation to Adopt Evaluation Practice as a Determinant of Evaluation Use

    by Tomasz Kupiec, Zuzanna Wrońska

    The literature contains several models that link types of evaluation use with organizational factors. However, until now, none of them have been thoroughly verified. This study aims to empirically verify the hypotheses proposed by Steven Højlund, who suggests that the type of evaluation use in organizations is determined by the adoption mode of evaluation practice (coercive, mimetic, normative, or voluntary). Qualitative comparative analysis was conducted on 23 cases from departments of Polish municipal administration, revealing the necessary conditions for most types of evaluation use. Instrumental use resulted from voluntary adoption, symbolic use from coercive adoption, and normative adoption—or the absence of coercive factors—led to legitimizing use. The situation was least clear for conceptual use, where we identified three possible combinations of necessary conditions. Although we found some significant relationships between adoption modes and types of evaluation use, the overall explanatory potential of Højlund's model appears to be quite limited.


  • Open Access

    Understanding evaluation use from an organisational perspective: A review of the literature and a research agenda

    by Tomasz Kupiec, Dorota Celińska-Janowicz, Valérie Pattyn

    Why do some types of evaluation use prevail in certain contexts and not in others? The aim of this article is to advance knowledge about organisational factors of evaluation use, that is, determinants of evaluation use grounded in organisational theories. We critically review existing frameworks of organisational factors of evaluation use, highlighting key differences between them and pointing out discrepancies with empirical insights. We discuss the merits of two potential areas for future research that can help concretise theoretical stances: considering organisational legitimacy as a potential direct determinant of evaluation use and incorporating a dynamic perspective in organisational frameworks of evaluation use.