Qiang Huo
Qiang Huo has a total of 34 co-authors. Here are the top co-authors by number of shared publications:
- Jiawei Wang
Department of EEIS University of Science and Technology of China 230026 Hefei China
10 shared publications - Kai Hu
University of Science and Technology of China Hefei China
9 shared publications Lei Sun
Microsoft Research Asia
9 shared publications- Zhuoyao Zhong
Microsoft Research Asia Beijing China
7 shared publications Weihong Lin
Microsoft Research Asia
6 shared publications- Haisong Ding
Microsoft Research Asia
5 shared publications
Latest Publications
- 29 March 2025
- Published by Elsevier in Pattern Recognition
- Vol. 165
UniHDSA: A unified relation prediction approach for hierarchical document structure analysis
- 29 March 2025
- Published by Elsevier in Pattern Recognition
- Vol. 165
UniHDSA: A unified relation prediction approach for hierarchical document structure analysis
- 11 September 2024
- Published by Springer Nature
- p. 40-57
DLAFormer: An End-to-End Transformer For Document Layout Analysis
- 11 September 2024
- Published by Springer Nature
- p. 40-57
DLAFormer: An End-to-End Transformer For Document Layout Analysis
- 11 September 2024
- Published by Springer Nature
- p. 77-96
UniVIE: A Unified Label Space Approach to Visual Information Extraction from Form-Like Documents
- 11 September 2024
- Published by Springer Nature
- p. 77-96
UniVIE: A Unified Label Space Approach to Visual Information Extraction from Form-Like Documents
- 29 July 2024
- Published by Elsevier in Pattern Recognition
- Vol. 156
Detect-order-construct: A tree construction based approach for hierarchical document structure analysis
- 29 July 2024
- Published by Elsevier in Pattern Recognition
- Vol. 156
Detect-order-construct: A tree construction based approach for hierarchical document structure analysis
- Open Access
DLAFormer: An End-to-End Transformer For Document Layout Analysis
Document layout analysis (DLA) is crucial for understanding the physical layout and logical structure of documents, serving information retrieval, document summarization, knowledge extraction, etc. However, previous studies have typically used separate models to address individual sub-tasks within DLA, including table/figure detection, text region detection, logical role classification, and reading order prediction. In this work, we propose an end-to-end transformer-based approach for document layout analysis, called DLAFormer, which integrates all these sub-tasks into a single model. To achieve this, we treat various DLA sub-tasks (such as text region detection, logical role classification, and reading order prediction) as relation prediction problems and consolidate these relation prediction labels into a unified label space, allowing a unified relation prediction module to handle multiple tasks concurrently. Additionally, we introduce a novel set of type-wise queries to enhance the physical meaning of content queries in DETR. Moreover, we adopt a coarse-to-fine strategy to accurately identify graphical page objects. Experimental results demonstrate that our proposed DLAFormer outperforms previous approaches that employ multi-branch or multi-stage architectures for multiple tasks on two document layout analysis benchmarks, DocLayNet and Comp-HRDoc.
Open AccessDLAFormer: An End-to-End Transformer For Document Layout Analysis
Document layout analysis (DLA) is crucial for understanding the physical layout and logical structure of documents, serving information retrieval, document summarization, knowledge extraction, etc. However, previous studies have typically used separate models to address individual sub-tasks within DLA, including table/figure detection, text region detection, logical role classification, and reading order prediction. In this work, we propose an end-to-end transformer-based approach for document layout analysis, called DLAFormer, which integrates all these sub-tasks into a single model. To achieve this, we treat various DLA sub-tasks (such as text region detection, logical role classification, and reading order prediction) as relation prediction problems and consolidate these relation prediction labels into a unified label space, allowing a unified relation prediction module to handle multiple tasks concurrently. Additionally, we introduce a novel set of type-wise queries to enhance the physical meaning of content queries in DETR. Moreover, we adopt a coarse-to-fine strategy to accurately identify graphical page objects. Experimental results demonstrate that our proposed DLAFormer outperforms previous approaches that employ multi-branch or multi-stage architectures for multiple tasks on two document layout analysis benchmarks, DocLayNet and Comp-HRDoc.
- Open Access
Detect-Order-Construct: A Tree Construction based Approach for Hierarchical Document Structure Analysis
Document structure analysis (aka document layout analysis) is crucial for understanding the physical layout and logical structure of documents, with applications in information retrieval, document summarization, knowledge extraction, etc. In this paper, we concentrate on Hierarchical Document Structure Analysis (HDSA) to explore hierarchical relationships within structured documents created using authoring software employing hierarchical schemas, such as LaTeX, Microsoft Word, and HTML. To comprehensively analyze hierarchical document structures, we propose a tree construction based approach that addresses multiple subtasks concurrently, including page object detection (Detect), reading order prediction of identified objects (Order), and the construction of intended hierarchical structure (Construct). We present an effective end-to-end solution based on this framework to demonstrate its performance. To assess our approach, we develop a comprehensive benchmark called Comp-HRDoc, which evaluates the above subtasks simultaneously. Our end-to-end system achieves state-of-the-art performance on two large-scale document layout analysis datasets (PubLayNet and DocLayNet), a high-quality hierarchical document structure reconstruction dataset (HRDoc), and our Comp-HRDoc benchmark. The Comp-HRDoc benchmark will be released to facilitate further research in this field.
Open AccessDetect-Order-Construct: A Tree Construction based Approach for Hierarchical Document Structure Analysis
Document structure analysis (aka document layout analysis) is crucial for understanding the physical layout and logical structure of documents, with applications in information retrieval, document summarization, knowledge extraction, etc. In this paper, we concentrate on Hierarchical Document Structure Analysis (HDSA) to explore hierarchical relationships within structured documents created using authoring software employing hierarchical schemas, such as LaTeX, Microsoft Word, and HTML. To comprehensively analyze hierarchical document structures, we propose a tree construction based approach that addresses multiple subtasks concurrently, including page object detection (Detect), reading order prediction of identified objects (Order), and the construction of intended hierarchical structure (Construct). We present an effective end-to-end solution based on this framework to demonstrate its performance. To assess our approach, we develop a comprehensive benchmark called Comp-HRDoc, which evaluates the above subtasks simultaneously. Our end-to-end system achieves state-of-the-art performance on two large-scale document layout analysis datasets (PubLayNet and DocLayNet), a high-quality hierarchical document structure reconstruction dataset (HRDoc), and our Comp-HRDoc benchmark. The Comp-HRDoc benchmark will be released to facilitate further research in this field.
- Open Access
UniVIE: A Unified Label Space Approach to Visual Information Extraction from Form-like Documents
Existing methods for Visual Information Extraction (VIE) from form-like documents typically fragment the process into separate subtasks, such as key information extraction, key-value pair extraction, and choice group extraction. However, these approaches often overlook the hierarchical structure of form documents, including hierarchical key-value pairs and hierarchical choice groups. To address these limitations, we present a new perspective, reframing VIE as a relation prediction problem and unifying labels of different tasks into a single label space. This unified approach allows for the definition of various relation types and effectively tackles hierarchical relationships in form-like documents. In line with this perspective, we present UniVIE, a unified model that addresses the VIE problem comprehensively. UniVIE functions using a coarse-to-fine strategy. It initially generates tree proposals through a tree proposal network, which are subsequently refined into hierarchical trees by a relation decoder module. To enhance the relation prediction capabilities of UniVIE, we incorporate two novel tree constraints into the relation decoder: a tree attention mask and a tree level embedding. Extensive experimental evaluations on both our in-house dataset HierForms and a publicly available dataset SIBR, substantiate that our method achieves state-of-the-art results, underscoring the effectiveness and potential of our unified approach in advancing the field of VIE.
Open AccessUniVIE: A Unified Label Space Approach to Visual Information Extraction from Form-like Documents
Existing methods for Visual Information Extraction (VIE) from form-like documents typically fragment the process into separate subtasks, such as key information extraction, key-value pair extraction, and choice group extraction. However, these approaches often overlook the hierarchical structure of form documents, including hierarchical key-value pairs and hierarchical choice groups. To address these limitations, we present a new perspective, reframing VIE as a relation prediction problem and unifying labels of different tasks into a single label space. This unified approach allows for the definition of various relation types and effectively tackles hierarchical relationships in form-like documents. In line with this perspective, we present UniVIE, a unified model that addresses the VIE problem comprehensively. UniVIE functions using a coarse-to-fine strategy. It initially generates tree proposals through a tree proposal network, which are subsequently refined into hierarchical trees by a relation decoder module. To enhance the relation prediction capabilities of UniVIE, we incorporate two novel tree constraints into the relation decoder: a tree attention mask and a tree level embedding. Extensive experimental evaluations on both our in-house dataset HierForms and a publicly available dataset SIBR, substantiate that our method achieves state-of-the-art results, underscoring the effectiveness and potential of our unified approach in advancing the field of VIE.
- 19 December 2023
- Published by Elsevier in Pattern Recognition
- Vol. 148
Mathematical formula detection in document images: A new dataset and a new approach
- 19 December 2023
- Published by Elsevier in Pattern Recognition
- Vol. 148
Mathematical formula detection in document images: A new dataset and a new approach
- 19 August 2023
- Published by Springer Nature
- p. 243-260
DQ-DETR: Dynamic Queries Enhanced Detection Transformer for Arbitrary Shape Text Detection
- 19 August 2023
- Published by Springer Nature
- p. 243-260
DQ-DETR: Dynamic Queries Enhanced Detection Transformer for Arbitrary Shape Text Detection
- 19 August 2023
- Published by Springer Nature
- p. 20-37
Improving Handwritten OCR with Training Samples Generated by Glyph Conditional Denoising Diffusion Probabilistic Model
- 19 August 2023
- Published by Springer Nature
- p. 20-37
Improving Handwritten OCR with Training Samples Generated by Glyph Conditional Denoising Diffusion Probabilistic Model