Generator-Guided Crowd Reaction Assessment
Open Access
- 13 May 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 597-600
Abstract
In the realm of social media, understanding and predicting post reach is a significant challenge. This paper presents a Crowd Reaction AssessMent (CReAM) task designed to estimate if a given social media post will receive more reaction than another, a particularly essential task for digital marketers and content writers. We introduce the Crowd Reaction Estimation Dataset (CRED), consisting of pairs of tweets from The White House with comparative measures of retweet count. The proposed Generator-Guided Estimation Approach (GGEA) leverages generative Large Language Models (LLMs), such as ChatGPT, FLAN-UL2, and Claude, to guide classification models for making better predictions. Our results reveal that a fine-tuned FLANG-RoBERTa model, utilizing a cross-encoder architecture with tweet content and responses generated by Claude, performs optimally. We further use a T5-based paraphraser to generate paraphrases of a given post and demonstrate GGEA's ability to predict which post will elicit the most reactions. We believe this novel application of LLMs provides a significant advancement in predicting social media post reach.Keywords
All Related Versions
Funding Information
- JSPS KAKENHI Grant (23K16956)
- New Energy and Industrial Technology Development Organization (NEDO) (JPNP20006)
This publication has 7 references indexed in Scilit:
- When FLUE Meets FLANG: Benchmarks and Large Pretrained Language Model for Financial Domain2022
- Misinfo Reaction Frames: Reasoning about Readers’ Reactions to News Headlines2022
- Retweet: A popular information diffusion mechanism – A survey paperOnline Social Networks and Media, 2018
- DeepCas2017
- The effect of wording on message propagation: Topic- and author-controlled natural experiments on Twitter2014
- Want to be Retweeted? Large Scale Analytics on Factors Impacting Retweet in Twitter Network2010
- Measuring User Influence in Twitter: The Million Follower FallacyProceedings of the International AAAI Conference on Web and Social Media, 2010