Speaking at the Right Level: Literacy-Controlled Counterspeech Generation with RAG-RL
Preprint
Abstract
Health misinformation spreading online poses a significant threat to public health. Researchers have explored methods for automatically generating counterspeech to health misinformation as a mitigation strategy. Existing approaches often produce uniform responses, ignoring that the health literacy level of the audience could affect the accessibility and effectiveness of counterspeech. We propose a Controlled-Literacy framework using retrieval-augmented generation (RAG) with reinforcement learning (RL) to generate tailored counterspeech adapted to different health literacy levels. In particular, we retrieve knowledge aligned with specific health literacy levels, enabling accessible and factual information to support generation. We design a reward function incorporating subjective user preferences and objective readability-based rewards to optimize counterspeech to the target health literacy level. Experiment results show that Controlled-Literacy outperforms baselines by generating more accessible and user-preferred counterspeech. This research contributes to more equitable and impactful public health communication by improving the accessibility and comprehension of counterspeech to health misinformation.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Science out of its Ivory Tower: improving accessibility with reinforcement learningScientometrics, 2025
- Comprehensive Overview of Reward Engineering and Shaping in Advancing Reinforcement Learning ApplicationsIEEE Access, 2024
- Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers2024
- Exploring the Readiness of Prominent Small Language Models for the Democratization of Financial Literacy2024
- Language Use in Conversational Agent–Based Health Communication: Systematic ReviewJournal of Medical Internet Research, 2022
- Optimizing Readability and Format of Plain Language Summaries for Medical Research Articles: Cross-sectional Survey StudyJournal of Medical Internet Research, 2022
- What is the meaning of health literacy? A systematic review and qualitative synthesisFamily Medicine and Community Health, 2020
- Health Literacy and Use and Trust in Health InformationJournal of Health Communication, 2018
- Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st centuryHealth Promotion International, 2000
- A NEW MEASURE OF RANK CORRELATIONBiometrika, 1938