LHLibby Hemphill

Libby Hemphill

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Libby Hemphill has a total of 98 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    The Context Dependency of Demographic Bias in LLM Annotation

    by Megan A. Brown, Shubham Atreja, Libby Hemphill, Patrick Y. Wu

  • Open Access

    Building a Test Collection for Social Science Dataset Retrieval

    by Ji Eun Kim, Sara Lafia, Libby Hemphill

    Data reuse expedites scientific progress and conserves resources, yet connecting researchers with datasets available for reuse remains a challenge. The scientific community has proposed several recommendation systems to help identify relevant data and maximize reuse. However, test collections or benchmarks for evaluating the performance of dataset recommendation systems are rare, particularly for social science dataset retrieval. To address this gap, we created a novel test collection for evaluating social science dataset recommendation systems. Our collection includes 249,102 query–dataset pairs with relevance judgments, featuring 262 unique search queries and 10,749 datasets. We describe how we created this collection using datasets archived at the Inter-university Consortium for Political and Social Research (ICPSR) and the ICPSR Bibliography of Data-related Literature. Additionally, we demonstrate a potential use case by evaluating the performance of embedding-based recommendation models on our test collection. The test collection is available through ICPSR at https://doi.org/10.3886/E238682V1.

  • Open Access

    Valuing curation infrastructures

    by Morgan F. Wofford, Andrea K. Thomer, Libby Hemphill, Katherine Polasek, Elizabeth Yakel

    This study uses a theoretical lens of infrastructural dimensions to examine stakeholders' perceptions of the value of curation, focusing on the social science data repository, the Inter‐university Consortium for Political and Social Research (ICPSR). Drawing on 67 interviews with both internal (ICPSR staff) and external (funders, data producers, and reusers) stakeholders, we analyze how value is ascribed to curation across technical, organizational, and social components of infrastructure. We identify five key ways interviewees conceptualized the value of curation infrastructures: supporting sustainability and durability, enabling research efficiency, fostering trust, building community, and advancing data equity. Our findings highlight the role of curation in knowledge generation by reframing curation as infrastructure rather than a set of discrete practices. We clarify how transparency operates in dual—and sometimes conflicting—ways: as both understandability and invisibility, shaping trust in and access to data repositories. Second, we demonstrate how data equity is increasingly perceived by stakeholders as a core infrastructural value, enacted through practices that lower barriers to access. Finally, we surface the persistent challenges in evaluating and funding curation infrastructures due to their long time horizons and often‐invisible nature. This work advocates recognizing and funding curation infrastructures as essential for long‐term scientific and societal progress.


  • Open Access

    The Effects of Moral Framing on Online Fundraising Outcomes: Evidence from GoFundMe Campaigns

    by Ji Eun Kim, Libby Hemphill

    This study examines the impact of moral framing on fundraising outcomes, including both monetary and social support, by analyzing a dataset of 14,088 campaigns posted on GoFundMe. We focused on three moral frames: care, fairness, and (ingroup) loyalty, and measured their presence in campaign appeals. Our results show that campaigns in the Emergency category are most influenced by moral framing. Generally, negatively framing appeals by emphasizing harm and unfairness effectively attracts more donations and comments from supporters. However, this approach can have a downside, as it may lead to a decrease in the average donation amount per donor. Additionally, we found that loyalty framing was positively associated with receiving more donations and messages across all fundraising categories. This research extends existing literature on framing and communication strategies related to fundraising and their impact. We also propose practical implications for designing features of online fundraising platforms to better support both fundraisers and supporters.

  • Open Access

    Using Off-the-Shelf Harmful Content Detection Models: Best Practices for Model Reuse

    by Angela Schöpke-Gonzalez, Siqi Wu, Sagar Kumar, Libby Hemphill

    Supervised machine learning is a common approach for automated harmful content detection to support content moderation. This approach relies on data annotated by humans to train models to recognize classes of harmful content. For detection tasks, researchers or content moderation communities typically either design their own annotation tasks to generate training data for new harmful content detection models, or use off-the-shelf (OTS) pre-trained harmful content detection models. OTS model reuse can enable detection tasks in resource-constrained contexts and can help to reduce the environmental impact of training new models -- an energy-intensive process. However, given the plethora of OTS models now available for reuse, determining which OTS model to reuse for a particular task and how to use it can be challenging, especially given that many of these models have been developed for specific contexts that are not always easily transferred onto others. This work aims to provide best practices for reusing OTS models for harmful content detection tasks. By using content analysis and statistical methods to evaluate assumptions about OTS model utility and reusability, we show that model reusers cannot assume that a model claimed to detect a particular concept, will actually detect that concept. Instead, based on our findings, we offer a decision tree for how to assess whether an OTS model would be appropriate for reuse for a new harmful content detection task. This decision tree directs model reusers to critically assess concept definitions, annotation task design, and additional features specified in our content analysis codebook to identify expected model output, and consequently evaluate whether that OTS model is appropriate for reuse for a new detection task.


  • Open Access

    The Spread of Virtual Gifting in Live Streaming: The Case of Twitch

    by Ji Eun Kim, Seura Ha, Sangmi Kim, Libby Hemphill

    This paper examines how gifting spreads among viewers on Twitch, one of the largest live streaming platforms worldwide. Twitch users can give gift subscriptions to other viewers in the chat room, with the majority of gifters opting for community gifting, which is gifting to randomly selected viewers. We identify the random nature of gift-receiving in our data as a natural experiment setting. We investigate whether gift recipients pay it forward, considering various gift types that may either promote or deter the spread of gifting. Our findings reveal that Twitch viewers who receive gift subscriptions are generally more likely to pay it forward than non-recipients, and the positive impact of gift-receiving becomes stronger when the recipient is the sole beneficiary of the giver's gifting behavior. However, we found that gifts from frequent gifters discourage recipients from paying it forward, and gifts from anonymous gifters do not influence the likelihood of viewers becoming future gifters. This research contributes to the existing literature on the spread of online prosocial behavior by providing robust evidence and suggests practical strategies for promoting online gifting.

  • Open Access

    How digital paywalls shape news coverage

    by Paramveer S Dhillon, Anmol Panda, Libby Hemphill

    The internet has significantly transformed how news is produced, consumed, and distributed. As a result, the news industry has transitioned from ad-supported to subscription-based models regulated by digital paywalls. In the light of this disruption, it is crucial to investigate not only how news consumers adapt to this change but also how economic incentives shape content coverage. We analyzed the staggered adoption of digital paywalls by 17 regional US newspapers over 17 years in a difference-in-difference framework to examine the impact of paywall adoption on topical news content coverage. Our results reveal a small but significant decrease in local and soft news coverage, with varying effects across different urban contexts. Specifically, local news coverage experienced a more substantial decline in smaller cities (population<500,000) and regions experiencing an influx of younger residents (age < 40 years). Conversely, soft news coverage increased in areas with a younger demographic influx, indicating a strategic shift by newspapers to cater to digital-savvy audiences and adapt to changing consumption patterns. Our findings underscore the delicate balance between financial imperatives and editorial choices in the newspaper industry and highlight the need for ongoing research into the effects of digital monetization strategies on journalistic content creation, media plurality, and civic accountability.


  • Open Access

    Toxicity on Social Media During the 2022 Mpox Public Health Emergency: Quantitative Study of Topical and Network Dynamics

    by Lizhou Fan, Lingyao Li, Libby Hemphill

    Background: Toxicity on social media, encompassing behaviors such as harassment, bullying, hate speech, and the dissemination of misinformation, has become a pressing social concern in the digital age. Its prevalence intensifies during periods of social crises and unrest, eroding a sense of safety and community. Such toxic environments can adversely impact the mental well-being of those exposed and further deepen societal divisions and polarization. The 2022 mpox outbreak, initially called “monkeypox” but later renamed to reduce stigma and address societal concerns, provides a relevant context for this issue. Objective: In this study, we conducted a comprehensive analysis of the toxic online discourse surrounding the 2022 mpox outbreak. We aimed to dissect its origins, characterize its nature and content, trace its dissemination patterns, and assess its broader societal implications, with the goal of providing insights that can inform strategies to mitigate such toxicity in future crises. Methods: We collected >1.6 million unique tweets and analyzed them with 5 dimensions: context, extent, content, speaker, and intent. Using topic modeling based on bidirectional encoder representations from transformers and social network community clustering, we delineated the toxic dynamics on Twitter. Results: By categorizing topics, we identified 5 high-level categories in the toxic online discourse on Twitter, including disease (20,281/43,521, 46.6%), health policy and health care (8400/43,521, 19.3%), homophobia (10,402/43,521, 23.9%), politics (2611/43,521, 6%), and racism (1784/43,521, 4.1%). Across these categories, users displayed negativity or controversial views on the mpox outbreak, highlighting the escalating political tensions and the weaponization of stigma during this infodemic. Through the toxicity diffusion networks of mentions (17,437 vertices with 3628 clusters), retweets (59,749 vertices with 3015 clusters), and the top users with the highest in-degree centrality, we found that retweets of toxic content were widespread, while influential users rarely engaged with or countered this toxicity through retweets. Conclusions: Our study introduces a comprehensive workflow that combines topical and network analyses to decode emerging social issues during crises. By tracking topical dynamics, we can track the changing popularity of toxic content on the internet, providing a better understanding of societal challenges. Network dynamics highlight key social media influencers and their intentions, suggesting that engaging with these central figures in toxic discourse can improve crisis communication and guide policy making.


  • Open Access

    Imagining Computing Futures and Mitigating Algorithmic Harm: Conversations Between Artistic Disciplines and Computing

    by Angela Schöpke-Gonzalez, Justin Wyss-Gallifent, Charli Brissey, Steph Jordan, Libby Hemphill

    This SIG invites interdisciplinary researchers in ethics, computing, and the arts; data professionals; and arts practitioners into a collective reflection on how these disciplines can work together to mitigate algorithmic harm. As we explore this topic, we recognize the historical and current marginalization of artistic disciplines in terms of credit and funding, and bring into our discussion consideration not only of what computing and data professions can gain from the arts, but of what artistic disciplines can gain from working with computing and data professions guided by the shared goal of mitigating algorithmic harm. This SIG invites reflection on how arts-based methods can help answer the following questions: (1) What agency and responsibility do data professionals as individuals have for mitigating algorithmic harm in their day-to-day workflows? (2) How does a data professional's individual agency and responsibility relate to collectives (e.g., institutions, groups of colleagues, families, employers, etc.) that they are a part of? (3) What agency and responsibility do collectives have for mitigating algorithmic harm? (4) What can artistic disciplines gain from working with computing and data professions to mitigate algorithmic harm? During this SIG, we will introduce the necessary disciplinary contexts for our collective discussion, facilitate a movement improvisation score that we developed called ''On The Perils of Poorly Chosen Sorting Algorithms'', and facilitate reflective discussion around how arts-based methods can invite data professionals to imagine new data workflows that mitigate algorithmic harm.


  • Open Access

    Data, not documents: Moving beyond theories of information‐seeking behavior to advance data discovery

    by Anthony J. Million, Jeremy York, Sara Lafia, Libby Hemphill

    Many theories of human information behavior (HIB) assume that information objects are in text document format. This paper argues four important HIB theories are insufficient for describing users' search strategies for data because of assumptions about the attributes of objects that users seek. We first review and compare four HIB theories: Bates' berrypicking, Marchionni's electronic information search, Dervin's sense‐making, and Meho and Tibbo's social scientist information‐seeking. All four theories assume that information‐seekers search for text documents. Next, we compare these theories to search behavior by analyzing Google Analytics data from the Inter‐university Consortium for Political and Social Research (ICPSR). Users took direct, scenic, and orienting paths when searching for data. We also interviewed ICPSR users (n = 20), and they said they needed dataset documentation and contextual information to find data. However, Dervin's sense‐making alone cannot explain the information‐seeking behaviors that we observed. Instead, what mattered most were object attributes determined by the type of information that users sought (i.e., data, not documents). We conclude by suggesting an alternative frame for building user‐centered data discovery tools.