Seungjun Lee
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Interests
Seungjun Lee has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Chanjun Park
Soongsil University, Seoul, Republic of Korea
1 shared publication - Heuiseok Lim
Korea University, Seoul, Republic of Korea
1 shared publication - Hyeonseok Moon
Department of Computer Science and Engineering, Korea University, Republic of Korea
1 shared publication - Jaehyung Seo
Department of Computer Science and Engineering, Korea University, Seoul, Republic of Korea
1 shared publication - Jungseob Lee
Korea University, Seoul, Republic of Korea
1 shared publication - Seonmin Koo
Department of Computer Science and Engineering, Korea University, 145, Anam-ro, Seongbuk-gu, Seoul 02841, Republic of Korea
1 shared publication
Latest Publications
- Top Cited PapersOpen Access
- 16 February 2023
- Published by MDPI AG in Mathematics
- Vol. 11 (4) , 1006
A Survey on Evaluation Metrics for Machine Translation
The success of Transformer architecture has seen increased interest in machine translation (MT). The translation quality of neural network-based MT transcends that of translations derived using statistical methods. This growth in MT research has entailed the development of accurate automatic evaluation metrics that allow us to track the performance of MT. However, automatically evaluating and comparing MT systems is a challenging task. Several studies have shown that traditional metrics (e.g., BLEU, TER) show poor performance in capturing semantic similarity between MT outputs and human reference translations. To date, to improve performance, various evaluation metrics have been proposed using the Transformer architecture. However, a systematic and comprehensive literature review on these metrics is still missing. Therefore, it is necessary to survey the existing automatic evaluation metrics of MT to enable both established and new researchers to quickly understand the trend of MT evaluation over the past few years. In this survey, we present the trend of automatic evaluation metrics. To better understand the developments in the field, we provide the taxonomy of the automatic evaluation metrics. Then, we explain the key contributions and shortcomings of the metrics. In addition, we select the representative metrics from the taxonomy, and conduct experiments to analyze related problems. Finally, we discuss the limitation of the current automatic metric studies through the experimentation and our suggestions for further research to improve the automatic evaluation metrics.
- 16 February 2023
- Published by MDPI AG in Mathematics
- Vol. 11 (4) , 1006
Top Cited PapersOpen AccessA Survey on Evaluation Metrics for Machine Translation
The success of Transformer architecture has seen increased interest in machine translation (MT). The translation quality of neural network-based MT transcends that of translations derived using statistical methods. This growth in MT research has entailed the development of accurate automatic evaluation metrics that allow us to track the performance of MT. However, automatically evaluating and comparing MT systems is a challenging task. Several studies have shown that traditional metrics (e.g., BLEU, TER) show poor performance in capturing semantic similarity between MT outputs and human reference translations. To date, to improve performance, various evaluation metrics have been proposed using the Transformer architecture. However, a systematic and comprehensive literature review on these metrics is still missing. Therefore, it is necessary to survey the existing automatic evaluation metrics of MT to enable both established and new researchers to quickly understand the trend of MT evaluation over the past few years. In this survey, we present the trend of automatic evaluation metrics. To better understand the developments in the field, we provide the taxonomy of the automatic evaluation metrics. Then, we explain the key contributions and shortcomings of the metrics. In addition, we select the representative metrics from the taxonomy, and conduct experiments to analyze related problems. Finally, we discuss the limitation of the current automatic metric studies through the experimentation and our suggestions for further research to improve the automatic evaluation metrics.