Lam Nguyen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Interests
Lam Nguyen has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Huu Nguyen
Faculty of Information Technology, Ho Chi Minh City University of Food Industry, Ho Chi Minh City, Vietnam
1 shared publication - Phuoc Tran
Ton Duc Thang University
1 shared publication - Thien Nguyen
Natural Language Processing and Knowledge Discovery Research Group, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, Vietnam
1 shared publication
Latest Publications
- Open Access
- 1 January 2021
- Published by Wiley in Complexity
- Vol. 2021 (1)
Improving Transformer‐Based Neural Machine Translation with Prior Alignments
Transformer is a neural machine translation model which revolutionizes machine translation. Compared with traditional statistical machine translation models and other neural machine translation models, the recently proposed transformer model radically and fundamentally changes machine translation with its self‐attention and cross‐attention mechanisms. These mechanisms effectively model token alignments between source and target sentences. It has been reported that the transformer model provides accurate posterior alignments. In this work, we empirically prove the reverse effect, showing that prior alignments help transformer models produce better translations. Experiment results on Vietnamese‐English news translation task show not only the positive effect of manually annotated alignments on transformer models but also the surprising outperformance of statistically constructed alignments reinforced with the flexibility of token‐type selection over manual alignments in improving transformer models. Statistically constructed word‐to‐lemma alignments are used to train a word‐to‐word transformer model. The novel hybrid transformer model improves the baseline transformer model and transformer model trained with manual alignments by 2.53 and 0.79 BLEU, respectively. In addition to BLEU score, we make limited human judgment on translation results. Strong correlation between human and machine judgment confirms our findings.
- 1 January 2021
- Published by Wiley in Complexity
- Vol. 2021 (1)
Open AccessImproving Transformer‐Based Neural Machine Translation with Prior Alignments
Transformer is a neural machine translation model which revolutionizes machine translation. Compared with traditional statistical machine translation models and other neural machine translation models, the recently proposed transformer model radically and fundamentally changes machine translation with its self‐attention and cross‐attention mechanisms. These mechanisms effectively model token alignments between source and target sentences. It has been reported that the transformer model provides accurate posterior alignments. In this work, we empirically prove the reverse effect, showing that prior alignments help transformer models produce better translations. Experiment results on Vietnamese‐English news translation task show not only the positive effect of manually annotated alignments on transformer models but also the surprising outperformance of statistically constructed alignments reinforced with the flexibility of token‐type selection over manual alignments in improving transformer models. Statistically constructed word‐to‐lemma alignments are used to train a word‐to‐word transformer model. The novel hybrid transformer model improves the baseline transformer model and transformer model trained with manual alignments by 2.53 and 0.79 BLEU, respectively. In addition to BLEU score, we make limited human judgment on translation results. Strong correlation between human and machine judgment confirms our findings.