Hierarchical contrastive learning for multi-label text classification
Authors:
Open Access
- 23 April 2025
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 15 (1) , 1-12
Abstract
Multi-label text classification presents a significant challenge within the field of text classification, particularly due to the hierarchical nature of labels, where labels are organized in a tree-like structure that captures parent-child and sibling relationships. This hierarchy reflects semantic dependencies among labels, with higher-level labels representing broader categories and lower-level labels capturing more specific distinctions. Traditional methods often fail to deeply understand and leverage this hierarchical structure, overlooking the subtle semantic differences and correlations that distinguish one label from another. To address this shortcoming, we introduce a novel method called Hierarchical Contrastive Learning for Multi-label Text Classification (HCL-MTC). Our approach leverages the contrastive knowledge embedded within label relationships by constructing a graph representation that explicitly models the hierarchical dependencies among labels. Specifically, we recast multi-label text classification as a multi-task learning problem, incorporating a hierarchical contrastive loss that is computed through a carefully designed sampling process. This unique loss function enables our model to effectively capture both the correlations and distinctions among labels, thereby enhancing the model’s ability to learn the intricacies of the label hierarchy. Experimental results on widely-used datasets, such as RCV1-v2 and WoS, demonstrate that our proposed HCL-MTC model achieves substantial performance gains compared to baseline methods.Keywords
Funding Information
- National Key Research and Development Program of China under Grant Agreement (No 2022YFF0903302)
This publication has 30 references indexed in Scilit:
- Label-text bi-attention capsule networks model for multi-label text classificationNeurocomputing, 2024
- When graph convolution meets double attention: online privacy disclosure detection with multi-label text classificationData Mining and Knowledge Discovery, 2024
- Hierarchical multi-instance multi-label learning for Chinese patent text classificationConnection Science, 2024
- A Comparative Study of Deep Neural Network Models on Multi-Label Text Classification in Finance2021
- Hierarchical Multi-label Text Classification2019
- Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN2018
- HDLTex: Hierarchical Deep Learning for Text Classification2017
- Recursive regularization for large-scale classification with hierarchical and graphical dependencies2013
- Long Short-Term MemoryNeural Computation, 1997
- Backpropagation through time: what it does and how to do itProceedings of the IEEE, 1990