Synthetic images aid the recognition of human-made art forgeries
Preprint
Abstract
Previous research has shown that Artificial Intelligence is capable of distinguishing between authentic paintings by a given artist and human-made forgeries with remarkable accuracy, provided sufficient training. However, with the limited amount of existing known forgeries, augmentation methods for forgery detection are highly desirable. In this work, we examine the potential of incorporating synthetic artworks into training datasets to enhance the performance of forgery detection. Our investigation focuses on paintings by Vincent van Gogh, for which we release the first dataset specialized for forgery detection. To reinforce our results, we conduct the same analyses on the artists Amedeo Modigliani and Raphael. We train a classifier to distinguish original artworks from forgeries. For this, we use human-made forgeries and imitations in the style of well-known artists and augment our training sets with images in a similar style generated by Stable Diffusion and StyleGAN. We find that the additional synthetic forgeries consistently improve the detection of human-made forgeries. In addition, we find that, in line with previous research, the inclusion of synthetic forgeries in the training also enables the detection of AI-generated forgeries, especially if created using a similar generator.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Art authentication with vision transformersNeural Computing and Applications, 2023
- Madhubani Art Classification using transfer learning with deep feature fusion and decision fusion based techniquesEngineering Applications of Artificial Intelligence, 2022
- On art authentication and the Rijksmuseum challenge: A residual neural network approachExpert Systems with Applications, 2022
- Authentication of Vincent van Gogh’s Work2021
- Fine-tuning Convolutional Neural Networks for fine art classificationExpert Systems with Applications, 2018
- Geometric tight frame based stylometry for art authentication of van Gogh paintingsApplied and Computational Harmonic Analysis, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Visual stylometry using background selection and wavelet-HMT-based Fisher information distances for attribution and dating of impressionist paintingsSignal Processing, 2013
- A digital technique for art authenticationProceedings of the National Academy of Sciences, 2004
- Fractal analysis of Pollock's drip paintingsNature, 1999