Recurrent Neural Network-based Models as Bahasa Indonesia-Sundanese Language Neural Machine Translator
Authors:
- 16 February 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 951-956
Abstract
Sequential data are available in many domains including weather observation data, stock price, gene sequence, and many others. Sequential data processing is very instrumental as a solution to a variety of downstream tasks in Natural Language Processing such as language translation. Translating a language to another language has become instrumental when peoples interact with other people who speak a different language. However, language translation is not an easy computation task when there is a language-resource gap. This paper presents some empirical results from the exploration of the Recurrent Neural Network (RNN), the Gated Recurrent Unit (GRU), the Long Short-term Memory (LSTM), and the Bidirectional Long Short-term Memory (Bi-LSTM) models as machine translation models from Bahasa Indonesia to the Sundanese language. These empirical results show that the Bi-LSTM achieved the highest performance (0.95 average training accuracy and 0.92 average testings BLEU score) compared to the RNN (0.93 average training accuracy and 0.91 average testings BLEU score), the GRU (0.88 average training accuracy and 0.89 average testings BLEU score), and the LSTM (0.92 average training accuracy and 0.91 average testings BLEU score) models. These results validate some previously reported studies that claim the Bi-LSTM model potentially outperforms the other recurrent neural network-based models when it is used to process sequence datasets.Keywords
Funding Information
- Binus University
This publication has 18 references indexed in Scilit:
- LSTM: A Search Space OdysseyIEEE Transactions on Neural Networks and Learning Systems, 2016
- A review of combined approaches for prediction of short-term wind speed and powerRenewable and Sustainable Energy Reviews, 2014
- On the Properties of Neural Machine Translation: Encoder–Decoder Approaches2014
- What Is Translation?Translation Review, 2012
- Statistical Machine Translation: A Guide for Linguists and TranslatorsLanguage and Linguistics Compass, 2011
- Improving the Learning Speed in 2-Layered LSTM Network by Estimating the Configuration of Hidden Units and Optimizing Weights Initialization2008
- Statistical machine translationACM Computing Surveys, 2008
- Framewise phoneme classification with bidirectional LSTM and other neural network architecturesNeural Networks, 2005
- Long Short-Term MemoryNeural Computation, 1997
- Language Levels in SundaneseMan, 1974