Development of a Geographical Question- Answering System in the Kazakh Language
Open Access
- 25 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 105460-105469
Abstract
The study presents a detailed framework designed to develop a Question-Answering System (QA System) for the Kazakh language, highlighting its importance in the field of Low Resource Languages (LRL) Text Processing. This effort aims to fill the gap in resources for languages that lack substantial digital tools. Specifically, the project focuses on geographical questions about Kazakhstan, aiming to enhance accessibility and understanding of the nation’s geography. The challenges associated with LRL text processing are addressed through the creation of a question-answer corpus, training a Bidirectional Encoder Representations from Transformers (BERT)-based model, and evaluating the system using Bilingual Evaluation Understudy (BLEU) metrics. The endeavor begins with the careful compilation of a corpus containing 50,000 questions, which supports the subsequent development phases and ensures the creation of a robust QA System. In the second phase, a BERT model equipped with 91,821,056 parameters is trained, enhancing the model’s ability to understand the complex linguistic nuances of the Kazakh language. The final phase involves a rigorous evaluation using BLEU metrics, where the system achieves an impressive average score of 0.9576. This score indicates a high level of agreement between the system-generated answers and the reference answers, demonstrating the system’s effectiveness at interpreting and responding to queries about Kazakh geography. This study significantly contributes to the field by providing a systematic and nuanced approach to QA System development and underscores the model’s effectiveness through thorough evaluation and comparative analysis.Keywords
Funding Information
- Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan
This publication has 40 references indexed in Scilit:
- Natural language processing: state of the art, current trends and challengesMultimedia Tools and Applications, 2022
- The state of the art in open domain complex question answering: a surveyApplied Intelligence, 2022
- Text‐based question answering from information retrieval and deep neural network perspectives: A surveyWIREs Data Mining and Knowledge Discovery, 2021
- Hierarchical fusion of common sense knowledge and classifier decisions for answer selection in community question answeringNeural Networks, 2020
- A literature review on question answering techniques, paradigms and systemsJournal of King Saud University Computer and Information Sciences, 2020
- Investigating Query Expansion and Coreference Resolution in Question Answering on BERT2020
- A short survey on end-to-end simple question answering systemsArtificial Intelligence Review, 2020
- LC-QuAD 2.0: A Large Dataset for Complex Question Answering over Wikidata and DBpedia2019
- Visual question answering via Attention-based syntactic structure tree-LSTMApplied Soft Computing, 2019
- Core techniques of question answering systems over knowledge bases: a surveyKnowledge and Information Systems, 2017