Developing Usable Datasets for AI training: Real and simulated sherds
Top Cited Papers
Open Access
- 1 October 2026
- journal article
- Published by Council for British Archaeology in Internet Archaeology
- No. 74
Abstract
This article discusses the process for creating a dataset to train and test the core and the corrector AI classifiers of the Arch-I-Scan Project. This dataset includes the photographs of real sherds that were compiled by the project from the collections of our project partners as well as synthetic sherds that were generated to supplement the low numbers of real sherd training data and to account for the imbalances among the numbers of real sherds per class (i.e., per vessel form). This article presents the simulation process used to create the synthetic sherds, as well as the process we used to decrease the differences between images of real and simulated sherds so that they were useable together for training the machine. Finally, the compilation and size of the resulting overall dataset are outlined.Keywords
This publication has 15 references indexed in Scilit:
- Classification and Error Correction in Data-driven AIInternet Archaeology, 2026
- The Arch-I-Scan Project's recording and image preparation processes: development and refinementsInternet Archaeology, 2026
- The Power and Limitations of Data-driven AIInternet Archaeology, 2026
- The Arch-I-Scan Project's Dataset of Photographs of Roman FinewaresInternet Archaeology, 2026
- Introduction: Aims, rationale, objectives and approaches of the Arch-I-Scan ProjectInternet Archaeology, 2026
- The automatic recognition of ceramics from only one photo: The ArchAIDE appJournal of Archaeological Science: Reports, 2021
- Dynamic Ensemble Selection and Data Preprocessing for Multi-Class Imbalance LearningInternational Journal of Pattern Recognition and Artificial Intelligence, 2019
- A systematic study of the class imbalance problem in convolutional neural networksNeural Networks, 2018
- Microsoft COCO: Common Objects in Context2014
- Learning from Imbalanced DataIEEE Transactions on Knowledge and Data Engineering, 2009