Mo.Se.: Mosaic image segmentation based on deep cascading learning
Open Access
- 19 January 2021
- journal article
- research article
- Published by Universitat Politecnica de Valencia in Virtual Archaeology Review
- Vol. 12 (24) , 25-38
Abstract
Mosaic is an ancient type of art used to create decorative images or patterns combining small components. A digital version of a mosaic can be useful for archaeologists, scholars and restorers who are interested in studying, comparing and preserving mosaics. Nowadays, archaeologists base their studies mainly on manual operation and visual observation that, although still fundamental, should be supported by an automatized procedure of information extraction. In this context, this research explains improvements which can change the manual and time-consuming procedure of mosaic tesserae drawing. More specifically, this paper analyses the advantages of using Mo.Se. (Mosaic Segmentation), an algorithm that exploits deep learning and image segmentation techniques; the methodology combines U-Net 3 Network with the Watershed algorithm. The final purpose is to define a workflow which establishes the steps to perform a robust segmentation and obtain a digital (vector) representation of a mosaic. The detailed approach is presented, and theoretical justifications are provided, building various connections with other models, thus making the workflow both theoretically valuable and practically scalable for medium or large datasets. The automatic segmentation process was tested with the high-resolution orthoimage of an ancient mosaic by following a close-range photogrammetry procedure. Our approach has been tested in the pavement of St. Stephen's Church in Umm ar-Rasas, a Jordan archaeological site, located 30 km southeast of the city of Madaba (Jordan). Experimental results show that this generalized framework yields good performances, obtaining higher accuracy compared with other state-of-the-art approaches. Mo.Se. has been validated using publicly available datasets as a benchmark, demonstrating that the combination of learning-based methods with procedural ones enhances segmentation performance in terms of overall accuracy, which is almost 10% higher. This study’s ambitious aim is to provide archaeologists with a tool which accelerates their work of automatically extracting ancient geometric mosaics.Highlights:A Mo.Se. (Mosaic Segmentation) algorithm is described with the purpose to perform robust image segmentation to automatically detect tesserae in ancient mosaics.This research aims to overcome manual and time-consuming procedure of tesserae segmentation by proposing an approach that uses deep learning and image processing techniques, obtaining a digital replica of a mosaic.Extensive experiments show that the proposed framework outperforms state-of-the-art methods with higher accuracy, even compared with publicly available datasets.Keywords
This publication has 27 references indexed in Scilit:
- U-Net: deep learning for cell counting, detection, and morphometryNature Methods, 2018
- Automatic Mosaic Digitalization: a Deep Learning approach to tessera segmentation2018
- Denoising autoencoders for Non-Intrusive Load Monitoring: Improvements and comparative evaluationEnergy and Buildings, 2018
- Segmentation of Mosaic Images Based on Deformable Models Using Genetic Algorithms2017
- DIGITALIZATION CULTURE VS ARCHAEOLOGICAL VISUALIZATION: INTEGRATION OF PIPELINES AND OPEN ISSUESThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2017
- 3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation2016
- On the Assessment of Segmentation Methods for Images of Mosaics2015
- Novel imaging of heritage objects and sites2014
- Islamic geometrical patterns indexing and classification using discrete symmetry groupsJournal on Computing and Cultural Heritage, 2008
- Digital Mosaic Frameworks ‐ An OverviewComputer Graphics Forum, 2007