Attention-based Fully Gated CNN-BGRU for Russian Handwritten Text
Authors:
Preprint
Abstract
This research approaches the task of handwritten text with attention encoder-decoder networks that are trained on Kazakh and Russian language. We developed a novel deep neural network model based on Fully Gated CNN, supported by Multiple bidirectional GRU and Attention mechanisms to manipulate sophisticated features that achieve 0.045 Character Error Rate (CER), 0.192 Word Error Rate (WER) and 0.253 Sequence Error Rate (SER) for the first test dataset and 0.064 CER, 0.24 WER and 0.361 SER for the second test dataset. Also, we propose fully gated layers by taking the advantage of multiple the output feature from Tahn and input feature, this proposed work achieves better results and We experimented with our model on the Handwritten Kazakh & Russian Database (HKR). Our research is the first work on the HKR dataset and demonstrates state-of-the-art results to most of the other existing models.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Writer-aware CNN for parsimonious HMM-based offline handwritten Chinese text recognitionPattern Recognition, 2020
- Continuous Handwritten Script Recognition2014
- Lexicon-free handwritten word spotting using character HMMsPattern Recognition Letters, 2012
- The IAM-database: an English sentence database for offline handwriting recognitionInternational Journal on Document Analysis and Recognition (IJDAR), 2002
- Handwritten word recognition using segmentation-free hidden Markov modeling and segmentation-based dynamic programming techniquesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Off-line cursive handwriting recognition using hidden markov modelsPattern Recognition, 1995
- Off-line handwritten word recognition using a hidden Markov model type stochastic networkIEEE Transactions on Pattern Analysis and Machine Intelligence, 1994
- Speech recognition using hidden Markov models: A CMU perspectiveSpeech Communication, 1990
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- A Maximum Likelihood Approach to Continuous Speech RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1983