Two streams deep neural network for handwriting word recognition
- PDF / 1,104,852 Bytes
- 22 Pages / 439.642 x 666.49 pts Page_size
- 74 Downloads / 207 Views
Two streams deep neural network for handwriting word recognition Alaa Sulaiman1
· Khairuddin Omar1 · Mohammad F. Nasrudin1
Received: 11 September 2019 / Revised: 12 September 2020 / Accepted: 17 September 2020 / © Springer Science+Business Media, LLC, part of Springer Nature 2020
Abstract Handwritten word recognition is one of the hot topics in automatic handwritten text recognition that received a lot of attention in recent years. Unlike character recognition, word recognition deals with considerable variations in word shape and written style. This paper proposes a novel deep model for language-independent handwritten word recognition. The proposed deep structure has two parallel stages for jointly learning character and wordlevel information. In the character-level stage, a weakly character segmentation method is performed and then applies a series of Long short-term memory (LSTM) layers for character-level representation. The word-level stage employs a series of convolutional layers for the shape and structure representation of the word. These representations are then concatenated and followed by a series of fully connected layers for jointly learning the words and the character-level information. Since the character segmentation is language independent and error-prone, the proposed deep structure only applies weakly separation scheme and does not rely on any character segmentation algorithm. Thus, it effectively utilizes character level representation without bounding on any language model. In the proposed methodology, we use two new data augmentation strategies based on a psychological assumption to increase the model generalization performance. Experimental results on five public datasets including Arabic, English and German languages demonstrate that the proposed deep model has a superior performance to the state-of-the-art methods. Keywords Handwritten word recognition · Deep model · Convolutional layer · ConvLSTM
1 Introduction During recent years, the handwriting word recognition(HWR) has become one of the most challenging and also, captivating research areas in the field of computer vision and pattern recognition. The HWR is used to describe the ability of the computers to translate a human Alaa Sulaiman
[email protected] 1
Pattern Recognition Research Group, Center of Artificial Intelligence Technology, Faculty of Information Science and Technology University Kebangsaan Malaysia (UKM), Bangi, Selangor 43600, Malaysia
Multimedia Tools and Applications
writing text from its image form to an editable text form. It is one of the crucial research problems because of its high potential in different applications like extraction, digitization, and analysis of historical stored handwritten documents, mail sorting, bank processing, reading a postal address on the envelope, etc. Although a large number of researches have been devoted to this field of research, it is still remained as a challenging task in computer vision because of the large-scale intra-class variability in handwriting shape, difficulti
Data Loading...
