Peng Sun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Peng Sun has a total of 22 co-authors. Here are the top co-authors by number of shared publications:
Lei Liu
Northeastern University, College of Information Science and Engineering, Shenyang, China
4 shared publicationsYubo Lang
Criminal Investigation Police University of China, Department of Public Security Information Technology and Intelligence, Shenyang, China
4 shared publicationsJingjiao Li
Northeastern University, College of Information Science and Engineering, Shenyang, China
2 shared publicationsSilong Peng
Institute of Automation Chinese Academy of Sciences 100190 Beijing China
2 shared publicationsZhe Shen
Civil aviation college Shenyang Aerospace University 110136 Shenyang China
2 shared publicationsDaguo Shan
Department of Criminal Science and Technique, Criminal Investigation Police University of China, Shenyang, Liaoning, China
1 shared publication
Latest Publications
- 1 November 2023
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 32 (06) , 063006-16
Improved image forgery localization method from a statistical perspective
Powerful image editing software makes the process of image manipulation easy, which increases security risks. Therefore, it is urgent to locate the tampered region to uncover the processing history. However, previous research has mainly focused on feature extraction, with little discussion on classifiers for classifying original and tampered regions. We improve the splicing forgery localization method from a statistical perspective. The refined color filter array feature provides sufficient data for statistical analysis, and the geometric mean is used to eliminate anomalous data. Subsequently, a classifier that combines the expectation–maximization algorithm and Bayesian theory is proposed to binarize the original and tampered regions. The two steps of feature extraction and feature classification are associated from a statistical perspective, which ultimately improve the performance of the method effectively. Extensive experimental results demonstrate that the refined feature used for classification has several advantages, and the proposed classifier is appropriate for handling complex image manipulation across different statistical distributions. The proposed method outperforms the reference methods in both the Columbia and Korus datasets.
- 1 November 2023
- Published by SPIE-Intl Soc Optical Eng in Journal of Electronic Imaging
- Vol. 32 (06) , 063006-16
Improved image forgery localization method from a statistical perspective
Powerful image editing software makes the process of image manipulation easy, which increases security risks. Therefore, it is urgent to locate the tampered region to uncover the processing history. However, previous research has mainly focused on feature extraction, with little discussion on classifiers for classifying original and tampered regions. We improve the splicing forgery localization method from a statistical perspective. The refined color filter array feature provides sufficient data for statistical analysis, and the geometric mean is used to eliminate anomalous data. Subsequently, a classifier that combines the expectation–maximization algorithm and Bayesian theory is proposed to binarize the original and tampered regions. The two steps of feature extraction and feature classification are associated from a statistical perspective, which ultimately improve the performance of the method effectively. Extensive experimental results demonstrate that the refined feature used for classification has several advantages, and the proposed classifier is appropriate for handling complex image manipulation across different statistical distributions. The proposed method outperforms the reference methods in both the Columbia and Korus datasets.
- Open Access
Multimodal Graph Learning for Deepfake Detection
Existing deepfake detectors face several challenges in achieving robustness and generalization. One of the primary reasons is their limited ability to extract relevant information from forgery videos, especially in the presence of various artifacts such as spatial, frequency, temporal, and landmark mismatches. Current detectors rely on pixel-level features that are easily affected by unknown disturbances or facial landmarks that do not provide sufficient information. Furthermore, most detectors cannot utilize information from multiple domains for detection, leading to limited effectiveness in identifying deepfake videos. To address these limitations, we propose a novel framework, namely Multimodal Graph Learning (MGL) that leverages information from multiple modalities using two GNNs and several multimodal fusion modules. At the frame level, we employ a bi-directional cross-modal transformer and an adaptive gating mechanism to combine the features from the spatial and frequency domains with the geometric-enhanced landmark features captured by a GNN. At the video level, we use a Graph Attention Network (GAT) to represent each frame in a video as a node in a graph and encode temporal information into the edges of the graph to extract temporal inconsistency between frames. Our proposed method aims to effectively identify and utilize distinguishing features for deepfake detection. We evaluate the effectiveness of our method through extensive experiments on widely-used benchmarks and demonstrate that our method outperforms the state-of-the-art detectors in terms of generalization ability and robustness against unknown disturbances.
Open AccessMultimodal Graph Learning for Deepfake Detection
Existing deepfake detectors face several challenges in achieving robustness and generalization. One of the primary reasons is their limited ability to extract relevant information from forgery videos, especially in the presence of various artifacts such as spatial, frequency, temporal, and landmark mismatches. Current detectors rely on pixel-level features that are easily affected by unknown disturbances or facial landmarks that do not provide sufficient information. Furthermore, most detectors cannot utilize information from multiple domains for detection, leading to limited effectiveness in identifying deepfake videos. To address these limitations, we propose a novel framework, namely Multimodal Graph Learning (MGL) that leverages information from multiple modalities using two GNNs and several multimodal fusion modules. At the frame level, we employ a bi-directional cross-modal transformer and an adaptive gating mechanism to combine the features from the spatial and frequency domains with the geometric-enhanced landmark features captured by a GNN. At the video level, we use a Graph Attention Network (GAT) to represent each frame in a video as a node in a graph and encode temporal information into the edges of the graph to extract temporal inconsistency between frames. Our proposed method aims to effectively identify and utilize distinguishing features for deepfake detection. We evaluate the effectiveness of our method through extensive experiments on widely-used benchmarks and demonstrate that our method outperforms the state-of-the-art detectors in terms of generalization ability and robustness against unknown disturbances.
- 11 September 2022
- Published by Elsevier in Forensic Science International
- Vol. 340, 111464
Splicing forgery localization via noise fingerprint incorporated with CFA configuration
- 11 September 2022
- Published by Elsevier in Forensic Science International
- Vol. 340, 111464
Splicing forgery localization via noise fingerprint incorporated with CFA configuration
- 9 March 2021
- Published by Springer Nature in Applied Intelligence
- Vol. 51 (10) , 7427-7439
PSigmoid: Improving squeeze-and-excitation block with parametric sigmoid
- 9 March 2021
- Published by Springer Nature in Applied Intelligence
- Vol. 51 (10) , 7427-7439
PSigmoid: Improving squeeze-and-excitation block with parametric sigmoid
- Open Access
Identification of splicing edges in tampered image based on Dichromatic Reflection Model
Imaging is a sophisticated process combining a plenty of photovoltaic conversions, which lead to some spectral signatures beyond visual perception in the final images. Any manipulation against an original image will destroy these signatures and inevitably leave some traces in the final forgery. Therefore we present a novel optic-physical method to discriminate splicing edges from natural edges in a tampered image. First, we transform the forensic image from RGB into color space of S and o1o2. Then on the assumption of Dichromatic Reflection Model, edges in the image are discovered by composite gradient and classified into different types based on their different photometric properties. Finally, splicing edges are reserved against natural ones by a simple logical algorithm. Experiment results show the efficacy of the proposed method.
Open AccessIdentification of splicing edges in tampered image based on Dichromatic Reflection Model
Imaging is a sophisticated process combining a plenty of photovoltaic conversions, which lead to some spectral signatures beyond visual perception in the final images. Any manipulation against an original image will destroy these signatures and inevitably leave some traces in the final forgery. Therefore we present a novel optic-physical method to discriminate splicing edges from natural edges in a tampered image. First, we transform the forensic image from RGB into color space of S and o1o2. Then on the assumption of Dichromatic Reflection Model, edges in the image are discovered by composite gradient and classified into different types based on their different photometric properties. Finally, splicing edges are reserved against natural ones by a simple logical algorithm. Experiment results show the efficacy of the proposed method.
- 3 January 2020
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 79 (11-12) , 8235-8248
Authentication of splicing manipulation by exposing inconsistency in color shift
- 3 January 2020
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 79 (11-12) , 8235-8248
Authentication of splicing manipulation by exposing inconsistency in color shift
- 1 August 2018
- Published by Elsevier in Forensic Science International
- Vol. 289, 1-11
Exposing splicing forgery based on color temperature estimation
- 1 August 2018
- Published by Elsevier in Forensic Science International
- Vol. 289, 1-11
Exposing splicing forgery based on color temperature estimation