SFNet: Stage Spatial Attention and Feature Waterfall Fusion for Mathematical Document Text Line Detection
Authors:
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 35-42
Abstract
Text line detection is an important technique in layout analysis. Due to the existence of non-text areas and the change of formula height, text line detection in mathematical documents has always been a huge challenge. In view of the complexity of the spatial structure of mathematical text lines, on the one hand, based on the existing attention mechanism, we proposed a composite network structure with Stage Spatial Attention, which has better feature extraction. In addition, a multi-scale feature fusion structure, called Feature Waterfall Fusion, adds features with low-resolution but stronger semantic information into the features with high-resolution but weaker semantic information indirectly and directly. Combining them results in SFNet. On the other hand, to explore the mathematical document text line detection, we constructed a dataset named Mathematical Document Text Line Dataset (MDTL-1850), which includes about 10,669 text line annotations in 1,850 images (1,280 for training and 570 for testing). We assembled SFNet and a learnable post-processing Progressive Scale Expansion (PSE) surpassed mainstream text detection networks such as PSENet and PANet in all metrics on MDTL-1850. Precision $(P)$ , Recall $(R)$ and $F_{1}$ , which improved by 1.0, 0.7 and 0.9 respectively. The experimental results strongly proved the superiority of SFNet network in detecting text line of mathematical documents.
Keywords
Funding Information
- National Natural Science Foundation of China (61876034)
This publication has 21 references indexed in Scilit:
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- A Text Line Detection Method for Mathematical Formula Recognition2013
- Performance Evaluation of Mathematical Formula Identification2012
- SURF: Speeded Up Robust Features2006
- Histograms of Oriented Gradients for Human Detection2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- User-assisted archive document image analysis for digital library construction2004
- Two Geometric Algorithms for Layout Analysis2002
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in positionBiological Cybernetics, 1980