Data Augmentation for Offline Handwritten Text Recognition: A Systematic Literature Review
Open Access
- 10 February 2024
- journal article
- review article
- Published by Springer Nature in SN Computer Science
- Vol. 5 (2) , 1-20
Abstract
Offline Handwritten Text Recognition (HTR) systems concern the automatic recognition and transcription of handwritten text from scanned images to digital media. Recently, HTR research field has become increasingly important due to the growing need for digitizing documents and automating data entry across various industries. However, achieving satisfactory results depend on the amount of available samples to train an optical model. Creating and labeling large enough datasets for this purpose often require significant time and effort, that in some situations may be impractical. To address this problem, data augmentation approaches are commonly used as an essential component of HTR systems. In this way, the present work aims to identify, explore, and analyze the scope of data augmentation approaches for offline HTR systems. Furthermore, we detailed our research protocol and answered four pertinent research questions, which enabled us to discuss trends and possible gaps. A search was conducted across five scientific databases, focusing on papers published between 2012 and 2023. The search yielded 976 primary papers, with 32 meeting the criteria for inclusion in this review. Our results indicate that handwriting synthesis is an emerging research field, and we observed that Digital Image Processing (DIP) is still widely used as an image generator. Nevertheless, the application of Generative Adversarial Networks (GAN) has gained traction in recent years owing to its impressive ability to synthesize images of handwritten text with arbitrary style and content. In addition, we explored and analyzed the most commonly used datasets and text recognition levels in the selected works.Keywords
Funding Information
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (Finance Code 001)
- Fundação de Amparo à Ciência e Tecnologia do Estado de Pernambuco (APQ-1216-1.03/22)
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (315251/2018-2, 141721/2023-5)
- Universitat Politècnica de València
This publication has 72 references indexed in Scilit:
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- CVL-DataBase: An Off-Line Database for Writer Retrieval, Writer Identification and Word Spotting2013
- A genetic algorithm based region sampling for selection of local features in handwritten digit recognition applicationApplied Soft Computing, 2012
- Systematic literature reviews in software engineering – A tertiary studyInformation and Software Technology, 2010
- Systematic literature reviews in software engineering – A systematic literature reviewInformation and Software Technology, 2009
- Multi-dimensional Recurrent Neural Networks2007
- INTEGRATED HANDWRITING RECOGNITION AND INTERPRETATION USING FINITE-STATE MODELSInternational Journal of Pattern Recognition and Artificial Intelligence, 2004
- Baseline estimation for Arabic handwritten words2003
- The IAM-database: an English sentence database for offline handwriting recognitionInternational Journal on Document Analysis and Recognition (IJDAR), 2002
- Off-line cursive handwriting recognition using hidden markov modelsPattern Recognition, 1995