Portrait photography splicing detection using ensemble of convolutional neural networks
Authors:
- 23 March 2021
- journal article
- research article
- Published by SAGE Publications in Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
- Vol. 41 (5) , 5347-5357
Abstract
Forged portraits of people are widely used for creating deceitful propaganda of individuals or events in social media, and even for cooking up fake pieces of evidence in court proceedings. Hence, it is very important to find the authenticity of the images, and image forgery detection is a significant research area now. This work proposes an ensemble learning technique by combining predictions of different Convolutional Neural Networks (CNNs) for detecting forged portrait photographs. In the proposed method seven different pretrained CNN architectures such as AlexNet, VGG-16, GoogLeNet, Res-Net-18, ResNet-101, Inception-v3, and Inception-ResNet-v2 are utilized. As an initial step, we fine-tune the seven pretrained networks for portrait forgery detection with illuminant maps of images as input, and then uses a majority voting ensemble scheme to combine predictions from the fine-tuned networks. Ensemble methods had been found out to be good for improving the generalization capability of classification models. Experimental analysis is conducted using two publicly available portrait splicing datasets (DSO-1 and DSI-1). The results show that the proposed method outperforms the state-of-the-art methods using traditional machine learning techniques as well as the methods using single CNN classification models.Keywords
This publication has 31 references indexed in Scilit:
- Using an Ensemble of Incrementally Fine-Tuned CNNs for Cross-Domain Object Category RecognitionIEEE Access, 2019
- Illumination‐based texture descriptor and fruitfly support vector neural network for image forgery detection in face imagesIET Image Processing, 2018
- The relative performance of ensemble methods with deep convolutional neural networks for image classificationJournal of Applied Statistics, 2018
- Improving optimization of convolutional neural networks through parameter fine-tuningNeural Computing and Applications, 2017
- Multiscale Local Gabor Phase Quantization for image forgery detectionMultimedia Tools and Applications, 2017
- Digital image forgery detection using compact multi-texture representationJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology, 2017
- Illuminant-Based Transformed Spaces for Image ForensicsIEEE Transactions on Information Forensics and Security, 2015
- Exposing Digital Image Forgeries by Illumination Color ClassificationIEEE Transactions on Information Forensics and Security, 2013
- Ensemble-based classifiersArtificial Intelligence Review, 2009
- Design of effective neural network ensembles for image classification purposesImage and Vision Computing, 2001