Hierarchical Feature Fusion and Enhanced Attention Mechanism for Robust GAN-Generated Image Detection
Open Access
- 23 April 2025
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 13 (9) , 1372
Abstract
In recent years, with the rapid advancement of deep learning technologies such as generative adversarial networks (GANs), deepfake technology has become increasingly sophisticated. As a result, the generated fake images are becoming more difficult to visually distinguish from real ones. Existing deepfake detection methods primarily rely on training models with specific datasets. However, these models often suffer from limited generalization when processing images of unknown origin or across domains, leading to a significant decrease in detection accuracy. To address this issue, this paper proposes a deepfake image-detection network based on feature aggregation and enhancement. The key innovation of the proposed method lies in the integration of two modules: the Feature Aggregation Module (FAM) and the Attention Enhancement Module (AEM). The FAM effectively aggregates both deep semantic information and shallow detail features through a multi-scale feature-fusion mechanism, overcoming the limitations of traditional methods that rely on a single-level feature. Meanwhile, the AEM enhances the network’s ability to capture subtle forgery traces by incorporating attention mechanisms and filtering techniques, significantly boosting the model’s efficiency in processing complex information. The experimental results demonstrate that the proposed method achieves significant improvements across all evaluation metrics. Specifically, on the StarGAN dataset, the model attained outstanding performance, with accuracy (Acc) and average precision (AP) both reaching 100%. In cross-dataset testing, the proposed method exhibited strong generalization ability, raising the overall average accuracy to 87.0% and average precision to 92.8%, representing improvements of 5.2% and 6.7%, respectively, compared to existing state-of-the-art methods. These results show that the proposed method can not only achieve optimal performance on data with the same distribution, but also demonstrate strong generalization ability in cross-domain detection tasks.Keywords
Funding Information
- Start-up Scientific Research Project for Introducing Talents of Beijing Normal University at Zhuhai (312200502504, 2023B1212060026)
- Opening Project of the Guangdong Province Key Laboratory of Information Security Technology (312200502504, 2023B1212060026)
This publication has 32 references indexed in Scilit:
- Did You Note My Palette? Unveiling Synthetic Images Through Color Statistics2024
- Rethinking the Up-Sampling Operations in CNN-Based Generative Network for Generalizable Deepfake Detection2024
- DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priors2024
- Whodunit: Detection and Attribution of Synthetic Images by Leveraging Model-specific Fingerprints2024
- Forensic analysis of AI-compression traces in spatial and frequency domainPattern Recognition Letters, 2024
- IC-GAN: An Improved Conditional Generative Adversarial Network for RGB-to-IR image translation with applications to forest fire monitoringExpert Systems with Applications, 2023
- Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold2023
- Beyond the Spectrum: Detecting Deepfakes via Re-Synthesis2021
- Hybrid LSTM and Encoder–Decoder Architecture for Detection of Image ForgeriesIEEE Transactions on Image Processing, 2019
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015