S3INet: Semantic-Information Space Sharing Interaction Network for Arbitrary Shape Text Detection
- 19 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (8) , 14691-14705
Abstract
The detecting arbitrary shape text is a challenging task due to the significant variation in text shape, size, and aspect ratio, as well as the complexity of scene backgrounds. The enhancing feature extraction capabilities is essential for the boosting text detection accuracy. However, traditional text feature extraction methods face several issues, including insufficient multiscale feature fusion, limited information transfer between different feature levels, and constrained receptive field expansion when using asymmetric convolutional kernels for long text detection. To address these challenges, this article introduces an arbitrarily shaped scene text detector called the semantic-information space sharing interaction network (S3INet). The proposed network leverages the semantic-information space sharing module (S3M) to generate a single-level feature map capable of capturing multiscale features with rich semantic information and prominent foreground elements. In addition, we propose the multibranch parallel asymmetric convolutional module (MPACM) group to enhance the representation of text features, thereby further enhancing text detection performance. Extensive experimental evaluations on five publicly available natural scene text datasets (CTW-1500, Total-Text, MSRA-TD500, ICDAR2015, and ICDAR2017-MLT) and two traffic text datasets (CTST-1600 and TPD) demonstrate the superiority of our method. The results indicate that S3INet significantly outperforms most existing state-of-the-art methods in both accuracy and robustness. The code will be released at: https://github.com/runminwang/S3INet.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFB3100800)
- National Natural Science Foundation of China (61502164, 62176097)
- Natural Science Foundation of Hunan Province (2020JJ4057)
- Key Research and Development Program of Changsha Science and Technology Bureau (kq2004050)
- Scientific Research Foundation of Education Department of Hunan Province of China (21A0052)
This publication has 62 references indexed in Scilit:
- Texts as points: Scene text detection with point supervisionPattern Recognition Letters, 2023
- TextMountain: Accurate scene text detection via instance segmentationPattern Recognition, 2021
- Scene Text Detection and Recognition: The Deep Learning EraInternational Journal of Computer Vision, 2020
- HTSTL: Head-and-Tail Search Network With Scale-Transfer Layer for Traffic Sign Text DetectionIEEE Access, 2019
- TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapes2018
- Detecting Text in Natural Image with Connectionist Text Proposal Network2016
- Chinese Traffic Panels Detection and Recognition From Street-Level ImagesMATEC Web of Conferences, 2016
- Fully convolutional networks for semantic segmentation2015
- Detecting texts of arbitrary orientations in natural images2012
- Detecting text in natural scenes with stroke width transform2010