Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks
Preprint
Abstract
LLM use in annotation is becoming widespread, and given LLMs' overall promising performance and speed, simply "reviewing" LLM annotations in interpretive tasks can be tempting. In subjective annotation tasks with multiple plausible answers, reviewing LLM outputs can change the label distribution, impacting both the evaluation of LLM performance, and analysis using these labels in a social science task downstream. We conducted a pre-registered experiment with 410 unique annotators and over 7,000 annotations testing three AI assistance conditions against controls, using two models, and two datasets. We find that presenting crowdworkers with LLM-generated annotation suggestions did not make them faster, but did improve their self-reported confidence in the task. More importantly, annotators strongly took the LLM suggestions, significantly changing the label distribution compared to the baseline. When these labels created with LLM assistance are used to evaluate LLM performance, reported model performance significantly increases. We believe our work underlines the importance of understanding the impact of LLM-assisted annotation on subjective, qualitative tasks, on the creation of gold data for training and testing, and on the evaluation of NLP systems on subjective tasks.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- The role of firm AI capabilities in generative AI-pair codingJournal of Decision Systems, 2024
- Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooM2024
- CollabCoder: A Lower-barrier, Rigorous Workflow for Inductive Collaborative Qualitative Analysis with Large Language Models2024
- ChatGPT outperforms crowd workers for text-annotation tasksProceedings of the National Academy of Sciences of the United States of America, 2023
- Putting Tools in Their Place: The Role of Time and Perspective in Human-AI Collaboration for Qualitative AnalysisProceedings of the ACM on Human-Computer Interaction, 2021
- Supporting SerendipityProceedings of the ACM on Human-Computer Interaction, 2021
- Measurement and Fairness2021
- AI-Mediated Communication2019
- Learning from multiple annotators with varying expertiseMachine Learning, 2013
- Judgment under Uncertainty: Heuristics and BiasesScience, 1974