Detecting Check-Worthy Claims in Political Debates, Speeches, and Interviews Using Audio Data
Authors:
- 14 April 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 12011-12015
Abstract
Developing tools to automatically detect check-worthy claims in political debates and speeches can greatly help moderators of debates, journalists, and fact-checkers. While previous work on this problem has focused exclusively on the text modality, here we explore the utility of the audio modality as an additional input. We create a new multimodal dataset (text and audio in English) containing 48 hours of speech from past political debates in the USA. We then experimentally demonstrate that, in the case of multiple speakers, adding the audio modality yields sizable improvements over using the text modality alone; moreover, an audio-only model could outperform a text-only one for a single speaker. With the aim to enable future research, we make all our data and code publicly available at https://github.com/petar-iv/audio-checkworthiness-detection.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden UnitsIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021
- Overview of the CLEF–2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News2021
- Lie Detection using Speech Processing TechniquesJournal of Physics: Conference Series, 2021
- Finding, visualizing, and quantifying latent structure across diverse animal vocal repertoiresPLOS Computational Biology, 2020
- A Survey of Fake NewsACM Computing Surveys, 2020
- Transformers: State-of-the-Art Natural Language Processing2020
- Detecting Deception in Political Debates Using Acoustic and Textual Features2019
- Bag-of-Lies: A Multimodal Dataset for Deception Detection2019
- Robust Algorithm for Multimodal Deception Detection2019
- SMOTE: Synthetic Minority Over-sampling TechniqueJournal of Artificial Intelligence Research, 2002