Wei Xu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Wei Xu has a total of 36 co-authors. Here are the top co-authors by number of shared publications:
- Alan Ritter
School of Interactive Computing, Georgia Institute of Technology, Atlanta, Georgia, USA
2 shared publications - Chris Callison-Burch
University of Pennsylvania, Philadelphia, PA, USA
2 shared publications - Isadora Krsek
Carnegie Mellon University, Pittsburgh, PA, USA
2 shared publications - Juho Kim
School of Computing, KAIST, Daejeon, Republic of Korea and SkillBench, Santa Barbara, California, USA
2 shared publications - Laura Dabbish
Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA
2 shared publications - Motahhare Eslami
School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA
2 shared publications
Latest Publications
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Third Workshop on Human-Centered Evaluation and Auditing of Language Models: AI Agents-in-the-Loop
Large Language Models (LLMs) are increasingly deployed in real-world applications but also pose significant risks. Our previous workshop iterations at CHI’24 and CHI’25 brought together HCI and AI researchers to address the “evaluation crisis” through human-centered evaluation approaches. As the demand for human-centered evaluation grows, a new frontier has emerged: practitioners are increasingly turning to AI agents themselves as tools to support evaluation processes. This third iteration introduces the theme of AI agents-in-the-loop, exploring the emerging frontier where human judgment meets agent automation in LLM evaluation workflows. The workshop will examine critical questions about task allocation between humans and agents, meta-evaluation of evaluator agents, and the design of safeguards that preserve human agency while benefiting from automation. Through position papers, keynote discussion, and collaborative activities, participants will identify key challenges, share emerging practices, and outline research directions for hybrid human-AI auditing and evaluation approaches.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessThird Workshop on Human-Centered Evaluation and Auditing of Language Models: AI Agents-in-the-Loop
Large Language Models (LLMs) are increasingly deployed in real-world applications but also pose significant risks. Our previous workshop iterations at CHI’24 and CHI’25 brought together HCI and AI researchers to address the “evaluation crisis” through human-centered evaluation approaches. As the demand for human-centered evaluation grows, a new frontier has emerged: practitioners are increasingly turning to AI agents themselves as tools to support evaluation processes. This third iteration introduces the theme of AI agents-in-the-loop, exploring the emerging frontier where human judgment meets agent automation in LLM evaluation workflows. The workshop will examine critical questions about task allocation between humans and agents, meta-evaluation of evaluator agents, and the design of safeguards that preserve human agency while benefiting from automation. Through position papers, keynote discussion, and collaborative activities, participants will identify key challenges, share emerging practices, and outline research directions for hybrid human-AI auditing and evaluation approaches.
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-48
Supporting Informed Self-Disclosure: Design Recommendations for Presenting AI-Estimates of Privacy Risks to Users
People candidly discuss sensitive topics online under the perceived safety of anonymity; yet, for many, this perceived safety is tenuous, as miscalibrated risk perceptions can lead to over-disclosure. Recent advances in Natural Language Processing (NLP) afford an unprecedented opportunity to present users with quantified disclosure-based re-identification risk — i.e., “population risk estimates” (PREs). How can PREs be presented to users in a way that promotes informed decision-making, mitigating risk without encouraging unnecessary self-censorship? Using design fictions and comic-boarding, we story-boarded five design concepts for presenting PREs to users and evaluated them through an online survey with N = 44 Reddit users. We found participants had detailed conceptions of how PREs may impact risk awareness and motivation, but envisioned needing additional context and support to effectively interpret and act on risks. We distill our findings into four key design recommendations for how best to present users with quantified privacy risks to support informed disclosure decision-making.
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-48
Open AccessSupporting Informed Self-Disclosure: Design Recommendations for Presenting AI-Estimates of Privacy Risks to Users
People candidly discuss sensitive topics online under the perceived safety of anonymity; yet, for many, this perceived safety is tenuous, as miscalibrated risk perceptions can lead to over-disclosure. Recent advances in Natural Language Processing (NLP) afford an unprecedented opportunity to present users with quantified disclosure-based re-identification risk — i.e., “population risk estimates” (PREs). How can PREs be presented to users in a way that promotes informed decision-making, mitigating risk without encouraging unnecessary self-censorship? Using design fictions and comic-boarding, we story-boarded five design concepts for presenting PREs to users and evaluated them through an online survey with N = 44 Reddit users. We found participants had detailed conceptions of how PREs may impact risk awareness and motivation, but envisioned needing additional context and support to effectively interpret and act on risks. We distill our findings into four key design recommendations for how best to present users with quantified privacy risks to support informed disclosure decision-making.
- Open Access
- 2 May 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (2) , 1-31
Measuring, Modeling, and Helping People Account for Privacy Risks in Online Self-Disclosures with AI
In pseudonymous online fora like Reddit, the benefits of self-disclosure are often apparent to users (e.g., I can vent about my in-laws to understanding strangers), but the privacy risks are more abstract (e.g., will my partner be able to tell that this is me?). Prior work has sought to develop natural language processing (NLP) tools that help users identify potentially risky self-disclosures in their text, but none have been designed for or evaluated with the users they hope to protect. Absent this assessment, these tools will be limited by the social-technical gap: users need assistive tools that help them make informed decisions, not paternalistic tools that tell them to avoid self-disclosure altogether. To bridge this gap, we conducted a study with N =21 Reddit users; we had them use a state-of-the-art NLP disclosure detection model on two of their authored posts and asked them questions to understand if and how the model helped, where it fell short, and how it could be improved to help them make more informed decisions. Despite its imperfections, users responded positively to the model and highlighted its use as a tool that can help them catch mistakes, inform them of risks they were unaware of, and encourage self-reflection. However, our work also shows how, to be useful and usable, AI for supporting privacy decision-making must account for posting context, disclosure norms, and users' lived threat models, and provide explanations that help contextualize detected risks.
- 2 May 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Human-Computer Interaction
- Vol. 9 (2) , 1-31
Open AccessMeasuring, Modeling, and Helping People Account for Privacy Risks in Online Self-Disclosures with AI
In pseudonymous online fora like Reddit, the benefits of self-disclosure are often apparent to users (e.g., I can vent about my in-laws to understanding strangers), but the privacy risks are more abstract (e.g., will my partner be able to tell that this is me?). Prior work has sought to develop natural language processing (NLP) tools that help users identify potentially risky self-disclosures in their text, but none have been designed for or evaluated with the users they hope to protect. Absent this assessment, these tools will be limited by the social-technical gap: users need assistive tools that help them make informed decisions, not paternalistic tools that tell them to avoid self-disclosure altogether. To bridge this gap, we conducted a study with N =21 Reddit users; we had them use a state-of-the-art NLP disclosure detection model on two of their authored posts and asked them questions to understand if and how the model helped, where it fell short, and how it could be improved to help them make more informed decisions. Despite its imperfections, users responded positively to the model and highlighted its use as a tool that can help them catch mistakes, inform them of risks they were unaware of, and encourage self-reflection. However, our work also shows how, to be useful and usable, AI for supporting privacy decision-making must account for posting context, disclosure norms, and users' lived threat models, and provide explanations that help contextualize detected risks.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Human-Centered Evaluation and Auditing of Language Models
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessHuman-Centered Evaluation and Auditing of Language Models
- Open Access
- 27 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Design and Evaluation of an Automatic Text Simplification Prototype with Deaf and Hard-of-hearing Readers
Research has observed benefits from providing lexical and syntactic approaches to Automatic Text Simplification (ATS) to Deaf and Hard-of-hearing (DHH) readers. However, little research has explored DHH readers’ design preferences and interactions with these approaches. This work first explores the design space of ATS systems with DHH readers, identifying potential design configurations for evaluation. Open-ended discussion of participants’ design preferences reveal values informing those preferences, including maintaining reading fluency and efficiency, and control over the tool. Using popular design choices from our formative study, we evaluated a prototype that provides various simplification types to explore DHH readers’ interactions with the system. We observed potential conflicts between participants’ values and design preferences, such as the prototype’s impact on participants’ reading speed and participants’ perceived need to reread simplifications suggested by the tool. However, participants found the tool useful, showing a nuanced preference towards world-level lexical simplifications using pop-ups. Our findings highlight the importance of the tool’s design on users’ reading experiences, and provide implications for the design and evaluation of ATS prototypes with target readers.
- 27 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Open AccessDesign and Evaluation of an Automatic Text Simplification Prototype with Deaf and Hard-of-hearing Readers
Research has observed benefits from providing lexical and syntactic approaches to Automatic Text Simplification (ATS) to Deaf and Hard-of-hearing (DHH) readers. However, little research has explored DHH readers’ design preferences and interactions with these approaches. This work first explores the design space of ATS systems with DHH readers, identifying potential design configurations for evaluation. Open-ended discussion of participants’ design preferences reveal values informing those preferences, including maintaining reading fluency and efficiency, and control over the tool. Using popular design choices from our formative study, we evaluated a prototype that provides various simplification types to explore DHH readers’ interactions with the system. We observed potential conflicts between participants’ values and design preferences, such as the prototype’s impact on participants’ reading speed and participants’ perceived need to reread simplifications suggested by the tool. However, participants found the tool useful, showing a nuanced preference towards world-level lexical simplifications using pop-ups. Our findings highlight the importance of the tool’s design on users’ reading experiences, and provide implications for the design and evaluation of ATS prototypes with target readers.
- 26 February 2024
- Published by Elsevier in Journal of Information Security and Applications
- Vol. 82, 103721
Android malware detection based on a novel mixed bytecode image combined with attention mechanism
- 26 February 2024
- Published by Elsevier in Journal of Information Security and Applications
- Vol. 82, 103721
Android malware detection based on a novel mixed bytecode image combined with attention mechanism
- Open Access
- 1 January 2021
- Published by Association for Computational Linguistics (ACL)
- p. 6193-6209
BiSECT: Learning to Split and Rephrase Sentences with Bitexts
Joongwon Kim, Mounica Maddela, Reno Kriz, Wei Xu, Chris Callison-Burch. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2021.
- 1 January 2021
- Published by Association for Computational Linguistics (ACL)
- p. 6193-6209
Open AccessBiSECT: Learning to Split and Rephrase Sentences with Bitexts
Joongwon Kim, Mounica Maddela, Reno Kriz, Wei Xu, Chris Callison-Burch. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 2021.
- Open Access
Attacking Optical Character Recognition (OCR) Systems with Adversarial Watermarks
Optical character recognition (OCR) is widely applied in real applications serving as a key preprocessing tool. The adoption of deep neural network (DNN) in OCR results in the vulnerability against adversarial examples which are crafted to mislead the output of the threat model. Different from vanilla colorful images, images of printed text have clear backgrounds usually. However, adversarial examples generated by most of the existing adversarial attacks are unnatural and pollute the background severely. To address this issue, we propose a watermark attack method to produce natural distortion that is in the disguise of watermarks and evade human eyes' detection. Experimental results show that watermark attacks can yield a set of natural adversarial examples attached with watermarks and attain similar attack performance to the state-of-the-art methods in different attack scenarios.
Open AccessAttacking Optical Character Recognition (OCR) Systems with Adversarial Watermarks
Optical character recognition (OCR) is widely applied in real applications serving as a key preprocessing tool. The adoption of deep neural network (DNN) in OCR results in the vulnerability against adversarial examples which are crafted to mislead the output of the threat model. Different from vanilla colorful images, images of printed text have clear backgrounds usually. However, adversarial examples generated by most of the existing adversarial attacks are unnatural and pollute the background severely. To address this issue, we propose a watermark attack method to produce natural distortion that is in the disguise of watermarks and evade human eyes' detection. Experimental results show that watermark attacks can yield a set of natural adversarial examples attached with watermarks and attain similar attack performance to the state-of-the-art methods in different attack scenarios.
- Open Access
- 1 January 2015
- Published by Association for Computational Linguistics (ACL)
- p. 705-713
Cost Optimization in Crowdsourcing Translation: Low cost translations made even cheaper
- 1 January 2015
- Published by Association for Computational Linguistics (ACL)
- p. 705-713
Open AccessCost Optimization in Crowdsourcing Translation: Low cost translations made even cheaper