Attention-Based Fully Gated CNN-BGRU for Russian Handwritten Text
Open Access
- 18 December 2020
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 6 (12) , 141
Abstract
This article considers the task of handwritten text recognition using attention-based encoder–decoder networks trained in the Kazakh and Russian languages. We have developed a novel deep neural network model based on a fully gated CNN, supported by multiple bidirectional gated recurrent unit (BGRU) and attention mechanisms to manipulate sophisticated features that achieve 0.045 Character Error Rate (CER), 0.192 Word Error Rate (WER), and 0.253 Sequence Error Rate (SER) for the first test dataset and 0.064 CER, 0.24 WER and 0.361 SER for the second test dataset. Our proposed model is the first work to handle handwriting recognition models in Kazakh and Russian languages. Our results confirm the importance of our proposed Attention-Gated-CNN-BGRU approach for training handwriting text recognition and indicate that it can lead to statistically significant improvements (p-value < 0.05) in the sensitivity (recall) over the tests dataset. The proposed method’s performance was evaluated using handwritten text databases of three languages: English, Russian, and Kazakh. It demonstrates better results on the Handwritten Kazakh and Russian (HKR) dataset than the other well-known models.Keywords
All Related Versions
Funding Information
- Ministry of Education and Science of the Republic of Kazakhstan (AR05135175)
This publication has 50 references indexed in Scilit:
- Lexicon-free handwritten word spotting using character HMMsPattern Recognition Letters, 2012
- Offline recognition of unconstrained handwritten texts using HMMs and statistical language modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- The IAM-database: an English sentence database for offline handwriting recognitionInternational Journal on Document Analysis and Recognition (IJDAR), 2002
- An HMM-based approach for off-line unconstrained handwritten word modeling and recognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- Handwritten word recognition using segmentation-free hidden Markov modeling and segmentation-based dynamic programming techniquesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Off-line cursive handwriting recognition using hidden markov modelsPattern Recognition, 1995
- Strategies for cursive script recognition using hidden Markov modelsMachine Vision and Applications, 1995
- Off-line handwritten word recognition using a hidden Markov model type stochastic networkIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994
- A Suggestion for Using Powerful and Informative Tests of NormalityThe American Statistician, 1990
- An analysis of variance test for normality (complete samples)Biometrika, 1965