Exploring the Hybrid Neural Network and Attention Mechanism for Classification of Social Bias
Authors:
- 18 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-4
Abstract
Neural Network models are considered universal learning due to their powerful ability to solve text classification with different data types. Hybrid neural networks in text classification using bidirectional Long Short-term Memory (BiLSTM), Convolutional Neural Network (CNN) and bidirectional Gated Recurrent Unit (BiGRU) have been widely used. In this study, we conducted a preliminary study on text classification of social bias data by combining the CNN, Bidirectional LSTM, Bidirectional GRU, and attention mechanism. The output from bidirectional architectures are given a distinct focus through attention mechanisms employed in both layers. Social bias is opinionated data which is often demonstrated in stereotypical and prejudiced behavior, presenting unfair decision including hatred and emotion about people's identity such as race, religion, ethnicity and gender. Social bias is considered under low resource scenario whereby the data size is limited and subjective. The result shows the proposed hybrid model gives promising results and good potential in learning a small size of data compared to single models.Keywords
Funding Information
- Ministry of Higher Education, Malaysia
This publication has 19 references indexed in Scilit:
- Developing an online hate classifier for multiple social media platformsHuman-centric Computing and Information Sciences, 2020
- The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluationBMC Genomics, 2020
- Bidirectional LSTM with attention mechanism and convolutional layer for text classificationNeurocomputing, 2019
- A State-of-the-Art Survey on Deep Learning Theory and ArchitecturesElectronics, 2019
- Effective Approaches to Attention-based Neural Machine Translation2015
- A Convolutional Neural Network for Modelling Sentences2014
- Glove: Global Vectors for Word Representation2014
- Convolutional Neural Networks for Sentence Classification2014
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Bidirectional recurrent neural networksIEEE Transactions on Signal Processing, 1997