Coreference Resolution for Improving Performance Measures of Classification Tasks
Open Access
- 15 August 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (16) , 9272
Abstract
There are several possibilities to improve classification in natural language processing tasks. In this article, we focused on the issue of coreference resolution that was applied to a manually annotated dataset of true and fake news. This dataset was used for the classification task of fake news detection. The research aimed to determine whether performing coreference resolution on the input data before classification or classifying them without performing coreference resolution is more effective. We also wanted to verify whether it is possible to enhance classifier performance metrics by incorporating coreference resolution into the data preparation process. A methodology was proposed, in which we described the implementation methods in detail, starting from the identification of entity mentions in the text using the neuralcoref algorithm, then through word-embedding models (TF–IDF, Doc2Vec), and finally to several machine learning methods. The result was a comparison of the implemented classifiers based on the performance metrics described in the theoretical part. The best result for accuracy was observed for the dataset with coreference resolution applied, which had a median value of 0.8149, while for the F1 score, the best result had a median value of 0.8101. However, the more important finding is that the processed data with the application of coreference resolution led to an improvement in performance metrics in the classification tasks.Keywords
Funding Information
- Scientific Grant Agency of the Ministry of Education of the Slovak Republic (VEGA-1/0490/22, APVV-18-0473, 2021-1-SK01-KA220-HED-000032095)
- Agentúra na Podporu Výskumu a Vývoja (VEGA-1/0490/22, APVV-18-0473, 2021-1-SK01-KA220-HED-000032095)
- European Commission ERASMUS+ Program 2021 (VEGA-1/0490/22, APVV-18-0473, 2021-1-SK01-KA220-HED-000032095)
This publication has 35 references indexed in Scilit:
- A learning method for coreference resolution using semantic role labeling features2017
- A systematic review and comparative analysis of cross-document coreference resolution methods and toolsComputing, 2016
- Deep Reinforcement Learning for Mention-Ranking Coreference Models2016
- Improving Coreference Resolution by Learning Entity-Level Distributed Representations2016
- A Concept Based Graph Model for Document Representation Using Coreference Resolution2015
- Entity-Centric Coreference Resolution with Model Stacking2015
- The Stanford CoreNLP Natural Language Processing Toolkit2014
- Deterministic Coreference Resolution Based on Entity-Centric, Precision-Ranked RulesComputational Linguistics, 2013
- Understanding bag-of-words model: a statistical frameworkInternational Journal of Machine Learning and Cybernetics, 2010
- Random decision forests2002