Exploiting Hanja-Based Resources in Processing Korean Historic Documents Written by Common Literati
Open Access
- 17 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 59909-59919
Abstract
This research aims to explore the comprehension of historical Korean archives authored by common literati. Numerous endeavors have been made to study Korean historical documents; however, the majority of these endeavors focus solely on royal documents. By comparing the distinct linguistic characteristics between royal and commoner languages, this study challenges the applicability of the royal language-centric approach to commoner documents. In particular, we investigate the feasibility and limitations of existing resources that share the same writing system (Hanja) as historical Korean documents for processing Korean common literati documents. Through our investigation, we propose a simple yet effective methodology that enables the utilization of Hanja-based language resources in processing Korean common literati documents: the removal of special characters. We demonstrate that aligning characteristics of Hanja-based resources allows considerable performance improvements. To the best of our knowledge, our study represents the first research endeavor to concentrate on the comprehension of common literati documents.Keywords
Funding Information
- ICT Creative Consilience Program through the Institute of Information and Communications Technology Planning and Evaluation (IITP) grant funded by Korean Government (IITP-2024-2020-0-01819)
- National Research Foundation of Korea (NRF) grant funded by Korean Government (2022R1A5A7026673)
- Basic Science Research Program through NRF funded by the Ministry of Education (NRF-2021R1A6A1A03045425)
This publication has 26 references indexed in Scilit:
- Sundial-GAN: A Cascade Generative Adversarial Networks Framework for Deciphering Oracle Bone Inscriptions2022
- Restoring and attributing ancient texts using deep neural networksNature, 2022
- AnchiBERT: A Pre-Trained Model for Ancient Chinese Language Understanding and Generation2021
- Ancient Korean Neural Machine TranslationIEEE Access, 2020
- A Survey on Deep Learning for Named Entity RecognitionIEEE Transactions on Knowledge and Data Engineering, 2020
- Deep Learning Based Approach for Historical Manuscript Dating2019
- KuroNet: Pre-Modern Japanese Kuzushiji Character Recognition with Deep Learning2019
- Ancient Chinese2008
- Semantic and Phonological Processing in Reading Korean Hangul and Hanja WordsJournal of Psycholinguistic Research, 2005
- Orthographic and Phonological Activation in the Semantic Processing of Korean Hanja and HangulLanguage and Cognitive Processes, 1999