Developing Deep Learning Models for Turkish Automatic Punctuation Restoration Using a Novel Dataset
Open Access
- 19 November 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian and Low-Resource Language Information Processing
- Vol. 24 (11) , 1-15
Abstract
Today, automatic speech recognition systems are widely used by individuals, institutions, and organizations. However, the lack of punctuation marks in the texts produced by these systems complicates the comprehensibility of the texts and hinders advanced text analysis. Consequently, there is an increasing need for automatic punctuation restoration models. A review of existing studies reveals that most research focuses on the English language, while languages like Turkish, which belong to the agglutinative language group, have been relatively underexplored. In this study, a unique dataset has been created for Turkish automatic punctuation restoration. Models developed using convolutional neural networks, transformer encoder, and FnetEncoder layers were trained and analyzed with this dataset. The hyper-parameters of the developed models were optimized using Bayesian optimization. The analysis results showed that the best performance was achieved by the transformer encoder-based model with an overall F-score of 90.10%. Additionally, all models were observed to be more successful in predicting periods and spaces compared to commas. This study contributes to the literature by focusing on the Turkish language and offers a novel approach to automatic punctuation restoration with the creation of a new dataset and the developed models.Keywords
This publication has 29 references indexed in Scilit:
- Towards explainable automatic punctuation restoration for Portuguese using transformersExpert Systems with Applications, 2024
- CTRAN: CNN-Transformer-based network for natural language understandingEngineering Applications of Artificial Intelligence, 2023
- Evaluation of Transformer-Based Models for Punctuation and Capitalization Restoration in Spanish and Portuguese2023
- How Much Does Tokenization Affect Neural Machine Translation?2023
- A study on the evaluation of tokenizer performance in natural language processingApplied Artificial Intelligence, 2023
- Abstractive text summarization and new large-scale datasets for agglutinative languages Turkish and HungarianLanguage Resources and Evaluation, 2022
- Towards better subtitles: A multilingual approach for punctuation restoration of speech transcriptsExpert Systems with Applications, 2021
- AgglutiFiT: Efficient Low-Resource Agglutinative Language Model Fine-TuningIEEE Access, 2020
- Punctuation Restoration System for Slovene Language2020
- Sequential Model-Based Optimization for General Algorithm Configuration2011