Approach for Tattoo Detection and Identification Based on YOLOv5 and Similarity Distance
Open Access
- 26 June 2024
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (13) , 5576
Abstract
The large number of images in the different areas and the possibilities of technologies lead to various solutions in automatization using image data. In this paper, tattoo detection and identification were analyzed. The combination of YOLOv5 object detection methods and similarity measures was investigated. During the experimental research, various parameters have been investigated to determine the best combination of parameters for tattoo detection. In this case, the influence of data augmentation parameters, the size of the YOLOv5 models (n, s, m, l, x), and the three main hyperparameters of YOLOv5 were analyzed. Also, the efficiency of the most popular similarity distances cosine and Euclidean was analyzed in the tattoo identification process with the purpose of matching the detected tattoo with the person’s tattoo in the database. Experiments have been performed using the deMSI dataset, where images were manually labeled to be suitable for use by the YOLOv5 algorithm. To validate the results obtained, the newly collected tattoo dataset was used. The results have shown that the highest average accuracy of all tattoo detection experiments has been obtained using the YOLOv5l model, where mAP@0.5:0.95 is equal to 0.60, and mAP@0.5 is equal to 0.79. The accuracy for tattoo identification reaches 0.98, and the F-score is up to 0.52 when the highest cosine similarity tattoo is associated. Meanwhile, to ensure that no suspects will be missed, the cosine similarity threshold value of 0.15 should be applied. Then, photos with higher similarity scores should be analyzed only. This would lead to a 1.0 recall and would reduce the manual tattoo comparison by 20%.Keywords
This publication has 22 references indexed in Scilit:
- Travel Direction Recommendation Model Based on Photos of User Social Network ProfileIEEE Access, 2023
- Deep learning based online metallic surface defect detection method for wire and arc additive manufacturingRobotics and Computer-Integrated Manufacturing, 2022
- Edge device based Military Vehicle Detection and Classification from UAVMultimedia Tools and Applications, 2021
- Investigation of MRI Prostate Localization using Different MRI Modality Scans2021
- A geometric-based tattoo retrieval system2016
- Deep Tattoo Recognition2016
- Tattoo based identification: Sketch to image matching2013
- Detecting and classifying scars, marks, and tattoos found in the wild2012
- Large-Scale Tattoo Image Retrieval2012
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004