Alexandra Klymenko
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Alexandra Klymenko has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Florian Matthes
Technical University of Munich
9 shared publications - Stephen Meisenbacher
Technical University of Munich
9 shared publications - Alexander Karpp
School of Computation Information and Technology Department of Computer Science Technical University of Munich Garching Germany
2 shared publications - Andreea-Elena Bodea
School of Computation, Information and Technology, Technical University of Munich, Garching, Germany
1 shared publication - Andreea-Elena Bodea
School of Computation Technical University of Munich Information and Technology Garching Germany
1 shared publication - Endrit Jashari
Technical University of Munich
1 shared publication
Latest Publications
- 24 August 2026
- Published by Springer Nature
- p. 81-98
Improving the Utility, Privacy, and Human Acceptance of Differentially Private Rewritten Texts
- 24 August 2026
- Published by Springer Nature
- p. 81-98
Improving the Utility, Privacy, and Human Acceptance of Differentially Private Rewritten Texts
- Open Access
SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systems
The continued promise of Large Language Models (LLMs), particularly in their natural language understanding and generation capabilities, has driven a rapidly increasing interest in identifying and developing LLM use cases. In an effort to complement the ingrained "knowledge" of LLMs, Retrieval-Augmented Generation (RAG) techniques have become widely popular. At its core, RAG involves the coupling of LLMs with domain-specific knowledge bases, whereby the generation of a response to a user question is augmented with contextual and up-to-date information. The proliferation of RAG has sparked concerns about data privacy, particularly with the inherent risks that arise when leveraging databases with potentially sensitive information. Numerous recent works have explored various aspects of privacy risks in RAG systems, from adversarial attacks to proposed mitigations. With the goal of surveying and unifying these works, we ask one simple question: What are the privacy risks in RAG, and how can they be measured and mitigated? To answer this question, we conduct a systematic literature review of RAG works addressing privacy, and we systematize our findings into a comprehensive set of privacy risks, mitigation techniques, and evaluation strategies. We supplement these findings with two primary artifacts: a Taxonomy of RAG Privacy Risks and a RAG Privacy Process Diagram. Our work contributes to the study of privacy in RAG not only by conducting the first systematization of risks and mitigations, but also by uncovering important considerations when mitigating privacy risks in RAG systems and assessing the current maturity of proposed mitigations.
Open AccessSoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systems
The continued promise of Large Language Models (LLMs), particularly in their natural language understanding and generation capabilities, has driven a rapidly increasing interest in identifying and developing LLM use cases. In an effort to complement the ingrained "knowledge" of LLMs, Retrieval-Augmented Generation (RAG) techniques have become widely popular. At its core, RAG involves the coupling of LLMs with domain-specific knowledge bases, whereby the generation of a response to a user question is augmented with contextual and up-to-date information. The proliferation of RAG has sparked concerns about data privacy, particularly with the inherent risks that arise when leveraging databases with potentially sensitive information. Numerous recent works have explored various aspects of privacy risks in RAG systems, from adversarial attacks to proposed mitigations. With the goal of surveying and unifying these works, we ask one simple question: What are the privacy risks in RAG, and how can they be measured and mitigated? To answer this question, we conduct a systematic literature review of RAG works addressing privacy, and we systematize our findings into a comprehensive set of privacy risks, mitigation techniques, and evaluation strategies. We supplement these findings with two primary artifacts: a Taxonomy of RAG Privacy Risks and a RAG Privacy Process Diagram. Our work contributes to the study of privacy in RAG not only by conducting the first systematization of risks and mitigations, but also by uncovering important considerations when mitigating privacy risks in RAG systems and assessing the current maturity of proposed mitigations.
- Open Access
- 13 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 162-176
The Double-edged Sword of LLM-based Data Reconstruction: Understanding and Mitigating Contextual Vulnerability in Word-level Differential Privacy Text Sanitization
- 13 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 162-176
Open AccessThe Double-edged Sword of LLM-based Data Reconstruction: Understanding and Mitigating Contextual Vulnerability in Word-level Differential Privacy Text Sanitization
- Open Access
- 13 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 126-138
LLM-as-a-Judge for Privacy Evaluation? Exploring the Alignment of Human and LLM Perceptions of Privacy in Textual Data
- 13 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 126-138
Open AccessLLM-as-a-Judge for Privacy Evaluation? Exploring the Alignment of Human and LLM Perceptions of Privacy in Textual Data
- Open Access
- 28 June 2025
- Published by Springer Nature in SN Computer Science
- Vol. 6 (6) , 1-22
Supporting the Integration of Privacy-Enhancing Technologies into the Software Development Life Cycle
Privacy-Enhancing Technologies (PETs) have been receiving rising attention in the academic sphere. In practice, however, the adoption of such technologies remains low. Beyond the implementation of a PET, it is not clear where along the process of software engineering PETs should be considered, and which activities must take place to facilitate their implementation. We investigate PETs in the software engineering process from the perspective of privacy requirements engineering. We conduct a systematic literature review and interview 10 privacy experts, exploring the integration of PETs into software engineering, as well as identifying associated challenges and their potential solutions. We also conduct a survey study with five experts and 100 developers to evaluate our created artifact. We propose a unified process diagram that illustrates the roles and activities involved in the implementation of PETs in software systems. We map the identified solution concepts to the diagram, highlighting vital stages of the software engineering process in tackling challenges in adopting PETs. The results of our survey study indicate general overall agreement with the presentation and content of the process diagram. Integrating PETs into software engineering involves a diverse cohort of roles and several challenges, but also concrete solution concepts that can be pinpointed in our process diagram. An analysis of available solutions juxtaposed with perceived challenges from privacy experts reveals there is much work to be done in increasing practitioner education on PETs.
- 28 June 2025
- Published by Springer Nature in SN Computer Science
- Vol. 6 (6) , 1-22
Open AccessSupporting the Integration of Privacy-Enhancing Technologies into the Software Development Life Cycle
Privacy-Enhancing Technologies (PETs) have been receiving rising attention in the academic sphere. In practice, however, the adoption of such technologies remains low. Beyond the implementation of a PET, it is not clear where along the process of software engineering PETs should be considered, and which activities must take place to facilitate their implementation. We investigate PETs in the software engineering process from the perspective of privacy requirements engineering. We conduct a systematic literature review and interview 10 privacy experts, exploring the integration of PETs into software engineering, as well as identifying associated challenges and their potential solutions. We also conduct a survey study with five experts and 100 developers to evaluate our created artifact. We propose a unified process diagram that illustrates the roles and activities involved in the implementation of PETs in software systems. We map the identified solution concepts to the diagram, highlighting vital stages of the software engineering process in tackling challenges in adopting PETs. The results of our survey study indicate general overall agreement with the presentation and content of the process diagram. Integrating PETs into software engineering involves a diverse cohort of roles and several challenges, but also concrete solution concepts that can be pinpointed in our process diagram. An analysis of available solutions juxtaposed with perceived challenges from privacy experts reveals there is much work to be done in increasing practitioner education on PETs.
- Open Access
Investigating User Perspectives on Differentially Private Text Privatization
Recent literature has seen a considerable uptick in $\textit{Differentially Private Natural Language Processing}$ (DP NLP). This includes DP text privatization, where potentially sensitive input texts are transformed under DP to achieve privatized output texts that ideally mask sensitive information $\textit{and}$ maintain original semantics. Despite continued work to address the open challenges in DP text privatization, there remains a scarcity of work addressing user perceptions of this technology, a crucial aspect which serves as the final barrier to practical adoption. In this work, we conduct a survey study with 721 laypersons around the globe, investigating how the factors of $\textit{scenario}$, $\textit{data sensitivity}$, $\textit{mechanism type}$, and $\textit{reason for data collection}$ impact user preferences for text privatization. We learn that while all these factors play a role in influencing privacy decisions, users are highly sensitive to the utility and coherence of the private output texts. Our findings highlight the socio-technical factors that must be considered in the study of DP NLP, opening the door to further user-based investigations going forward.Open AccessInvestigating User Perspectives on Differentially Private Text Privatization
Recent literature has seen a considerable uptick in $\textit{Differentially Private Natural Language Processing}$ (DP NLP). This includes DP text privatization, where potentially sensitive input texts are transformed under DP to achieve privatized output texts that ideally mask sensitive information $\textit{and}$ maintain original semantics. Despite continued work to address the open challenges in DP text privatization, there remains a scarcity of work addressing user perceptions of this technology, a crucial aspect which serves as the final barrier to practical adoption. In this work, we conduct a survey study with 721 laypersons around the globe, investigating how the factors of $\textit{scenario}$, $\textit{data sensitivity}$, $\textit{mechanism type}$, and $\textit{reason for data collection}$ impact user preferences for text privatization. We learn that while all these factors play a role in influencing privacy decisions, users are highly sensitive to the utility and coherence of the private output texts. Our findings highlight the socio-technical factors that must be considered in the study of DP NLP, opening the door to further user-based investigations going forward. - Open Access
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 86-105
Investigating User Perspectives on Differentially Private Text Privatization
Stephen Meisenbacher, Alexandra Klymenko, Alexander Karpp, Florian Matthes. Proceedings of the Sixth Workshop on Privacy in Natural Language Processing. 2025.
- 1 January 2025
- Published by Association for Computational Linguistics (ACL)
- p. 86-105
Open AccessInvestigating User Perspectives on Differentially Private Text Privatization
Stephen Meisenbacher, Alexandra Klymenko, Alexander Karpp, Florian Matthes. Proceedings of the Sixth Workshop on Privacy in Natural Language Processing. 2025.
- Open Access
Towards A Structured Overview of Use Cases for Natural Language Processing in the Legal Domain: A German Perspective
In recent years, the field of Legal Tech has risen in prevalence, as the Natural Language Processing (NLP) and legal disciplines have combined forces to digitalize legal processes. Amidst the steady flow of research solutions stemming from the NLP domain, the study of use cases has fallen behind, leading to a number of innovative technical methods without a place in practice. In this work, we aim to build a structured overview of Legal Tech use cases, grounded in NLP literature, but also supplemented by voices from legal practice in Germany. Based upon a Systematic Literature Review, we identify seven categories of NLP technologies for the legal domain, which are then studied in juxtaposition to 22 legal use cases. In the investigation of these use cases, we identify 15 ethical, legal, and social aspects (ELSA), shedding light on the potential concerns of digitally transforming the legal domain.
Open AccessTowards A Structured Overview of Use Cases for Natural Language Processing in the Legal Domain: A German Perspective
In recent years, the field of Legal Tech has risen in prevalence, as the Natural Language Processing (NLP) and legal disciplines have combined forces to digitalize legal processes. Amidst the steady flow of research solutions stemming from the NLP domain, the study of use cases has fallen behind, leading to a number of innovative technical methods without a place in practice. In this work, we aim to build a structured overview of Legal Tech use cases, grounded in NLP literature, but also supplemented by voices from legal practice in Germany. Based upon a Systematic Literature Review, we identify seven categories of NLP technologies for the legal domain, which are then studied in juxtaposition to 22 legal use cases. In the investigation of these use cases, we identify 15 ethical, legal, and social aspects (ELSA), shedding light on the potential concerns of digitally transforming the legal domain.
- Open Access
A Comparative Analysis of Word-Level Metric Differential Privacy: Benchmarking The Privacy-Utility Trade-off
The application of Differential Privacy to Natural Language Processing techniques has emerged in relevance in recent years, with an increasing number of studies published in established NLP outlets. In particular, the adaptation of Differential Privacy for use in NLP tasks has first focused on the $\textit{word-level}$, where calibrated noise is added to word embedding vectors to achieve "noisy" representations. To this end, several implementations have appeared in the literature, each presenting an alternative method of achieving word-level Differential Privacy. Although each of these includes its own evaluation, no comparative analysis has been performed to investigate the performance of such methods relative to each other. In this work, we conduct such an analysis, comparing seven different algorithms on two NLP tasks with varying hyperparameters, including the $\textit{epsilon ($\varepsilon$)}$ parameter, or privacy budget. In addition, we provide an in-depth analysis of the results with a focus on the privacy-utility trade-off, as well as open-source our implementation code for further reproduction. As a result of our analysis, we give insight into the benefits and challenges of word-level Differential Privacy, and accordingly, we suggest concrete steps forward for the research field.Open AccessA Comparative Analysis of Word-Level Metric Differential Privacy: Benchmarking The Privacy-Utility Trade-off
The application of Differential Privacy to Natural Language Processing techniques has emerged in relevance in recent years, with an increasing number of studies published in established NLP outlets. In particular, the adaptation of Differential Privacy for use in NLP tasks has first focused on the $\textit{word-level}$, where calibrated noise is added to word embedding vectors to achieve "noisy" representations. To this end, several implementations have appeared in the literature, each presenting an alternative method of achieving word-level Differential Privacy. Although each of these includes its own evaluation, no comparative analysis has been performed to investigate the performance of such methods relative to each other. In this work, we conduct such an analysis, comparing seven different algorithms on two NLP tasks with varying hyperparameters, including the $\textit{epsilon ($\varepsilon$)}$ parameter, or privacy budget. In addition, we provide an in-depth analysis of the results with a focus on the privacy-utility trade-off, as well as open-source our implementation code for further reproduction. As a result of our analysis, we give insight into the benefits and challenges of word-level Differential Privacy, and accordingly, we suggest concrete steps forward for the research field.