Digital Paleography in Arabic Manuscripts: The Performance Levels Of The Gemini Model in Recognizing Naskh, Ta‘liq, And Ruq‘ah Scripts
- 26 June 2026
- journal article
- Published by Dinbilimleri Akademik Arastirma Dergisi in Dinbilimleri Akademik Araştırma Dergisi
- Vol. 26 (2) , 909-941
Abstract
The digitization of manuscripts remains a critical challenge in Digital Humanities due to the morphological complexity of Arabic scripts. This study evaluates the performance of Large Language Models, specifically Gemini, in digitizing Arabic manuscripts. Using manuscripts in naskh, ruq‘ah, and ta‘līq scripts, model outputs were analyzed via Levenshtein distance, Word Error Rate, and Character Error Rate metrics. Results indicate recognition accuracy varies by script, with raw character accuracy at 97.91% for naskh, 94.32% for ruq‘ah, and 93.51% for ta‘līq. A substantial portion of errors in ruq‘ah and ta‘līq arose from orthographic variations in the letter yā and the hamza. Excluding these anomalies, accuracy across all scripts consistently reached the 97–98% range. The study concludes that while AI models demonstrate robust performance in deciphering manuscript templates, their integration into classical text edition (tahqīq) requires careful oversight of paleographic nuances, despite their high potential to assist professional publication. The experiment was conducted with the Gemini 3.1 Pro model under a fixed-prompt protocol. Since only the opening page of a single manuscript was used per script type, the findings should be interpreted as preliminary indicators rather than definitive conclusions.Keywords
This publication has 21 references indexed in Scilit:
- Automatic Transcription of Ottoman Documents Using Deep Learning2024
- Bir Örnek Üzerinden Rik’a Yazı Karakterinin İncelenmesiFSM İlmî Araştırmalar İnsan ve Toplum Bilimleri Dergisi, 2024
- Printed Ottoman text recognition using synthetic data and data augmentationInternational Journal on Document Analysis and Recognition (IJDAR), 2023
- Understanding the application of handwritten text recognition technology in heritage contexts: a systematic review of Transkribus in published researchArchival Science, 2022
- Chapter 7: Inviting AI into the Archives: The Reception of Handwritten Recognition Technology into Historical Manuscript Transcription2022
- Transforming scholarship in the archives through handwritten text recognitionJournal of Documentation, 2019
- Corpus Coranicum projesi: Kur’an’ı Geç Antik döneme ait bir metin olarak okumakAnkara Üniversitesi İlahiyat Fakültesi Dergisi, 2012
- Arabic Manuscripts2009
- How Good Can It Get?D-Lib Magazine, 2009
- A Multi-stream Approach to Off-Line Handwritten Word RecognitionNinth International Conference on Document Analysis and Recognition (ICDAR 2007), 2007