Ruiyang Xia
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Ruiyang Xia has a total of 22 co-authors. Here are the top co-authors by number of shared publications:
- Guoquan Li
School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
5 shared publications - Hongying Meng
Brunel University of London
4 shared publications - Lin Yuan
Chongqing Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications, Chongqing, China
4 shared publications - Xinbo Gao
Xidian University, Xi'an, China
4 shared publications - Zhengwen Huang
Department of Electronic and Electrical Engineering, Brunel University London, London, UK
4 shared publications - Jie Li
State Key Laboratory of Integrated Services Networks, School of Electronic Engineering, Xidian University, Xian, China
3 shared publications
Latest Publications
- 16 September 2026
- Published by Elsevier in Neurocomputing
- Vol. 707
Toward a lighter real-time UAV detector via shared filter and semantic guidance
- 16 September 2026
- Published by Elsevier in Neurocomputing
- Vol. 707
Toward a lighter real-time UAV detector via shared filter and semantic guidance
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 48 (7) , 7859-7874
SSD: Making Face Forgery Clues Evident Again With Self-Steganographic Detection
The rapid development of generative AI techniques enables the synthesis of highly realistic facial images, posing significant challenges for the accurate detection of face forgeries. In contrast to solely elevating detector awareness, proactively reducing the intrinsic difficulty of forgery detection can streamline detector complexity while improving both generalization and robustness. This insight motivates our defense strategy to make face forgery clues more evident. Specifically, a novel proactive approach dubbed Self-Steganographic Detection (SSD) is proposed to imperceptibly embed facial images into themselves as a form of detection evidence. The recovery process is designed to remain robust under normal manipulations while exhibiting deliberate degradation under malicious manipulations, thereby clearly revealing potential forgeries. Unlike embedding bit-level vectors, pixel-level images are informative to ensure the generalization of our approach. Due to the similarity between the protected and embedded images, SSD performs detection without storing any embedded information in advance. To support practical deployment, our approach incorporates a dual detection scheme that aims to identify unprotected images and determine the authenticity of protected images. Extensive experiments using 8 face forgery techniques demonstrate the effectiveness of our approach compared to state-of-the-art methods.
- 1 July 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 48 (7) , 7859-7874
SSD: Making Face Forgery Clues Evident Again With Self-Steganographic Detection
The rapid development of generative AI techniques enables the synthesis of highly realistic facial images, posing significant challenges for the accurate detection of face forgeries. In contrast to solely elevating detector awareness, proactively reducing the intrinsic difficulty of forgery detection can streamline detector complexity while improving both generalization and robustness. This insight motivates our defense strategy to make face forgery clues more evident. Specifically, a novel proactive approach dubbed Self-Steganographic Detection (SSD) is proposed to imperceptibly embed facial images into themselves as a form of detection evidence. The recovery process is designed to remain robust under normal manipulations while exhibiting deliberate degradation under malicious manipulations, thereby clearly revealing potential forgeries. Unlike embedding bit-level vectors, pixel-level images are informative to ensure the generalization of our approach. Due to the similarity between the protected and embedded images, SSD performs detection without storing any embedded information in advance. To support practical deployment, our approach incorporates a dual detection scheme that aims to identify unprotected images and determine the authenticity of protected images. Extensive experiments using 8 face forgery techniques demonstrate the effectiveness of our approach compared to state-of-the-art methods.
- 15 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 32 (10709908) , 2284-2288
Big Brother Is Watching: Proactive Deepfake Detection via Learnable Hidden Face
As deepfake technologies continue to evolve, proactive defense techniques have gained increasing attention for their potential to either neutralize deepfake operations or simplify detection through pre-embedded signals. In this paper, inspired by watermark-based forensic methods, we explore a novel detection framework built on the concept of “hiding a learnable face within a face”. Specifically, we use a semi-fragile invertible steganography network to imperceptibly embed a learnable template image within a host face image to be protected. This template serves as an indicator revealing signs of tampering when recovered through the inverse steganography process. Unlike manually designed templates, it is optimized during training to resemble a neutral facial appearance—functioning like a subtle “big brother” hidden within the image. Through a self-blending mechanism and robustness learning strategy with a simulated transmission channel, we develop a robust detector that accurately distinguishes between malicious tampering and benign processing of the steganographic image. Extensive experiments across multiple datasets validate the superiority of the proposed approach over competing passive and proactive detection methods.
- 15 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 32 (10709908) , 2284-2288
Big Brother Is Watching: Proactive Deepfake Detection via Learnable Hidden Face
As deepfake technologies continue to evolve, proactive defense techniques have gained increasing attention for their potential to either neutralize deepfake operations or simplify detection through pre-embedded signals. In this paper, inspired by watermark-based forensic methods, we explore a novel detection framework built on the concept of “hiding a learnable face within a face”. Specifically, we use a semi-fragile invertible steganography network to imperceptibly embed a learnable template image within a host face image to be protected. This template serves as an indicator revealing signs of tampering when recovered through the inverse steganography process. Unlike manually designed templates, it is optimized during training to resemble a neutral facial appearance—functioning like a subtle “big brother” hidden within the image. Through a self-blending mechanism and robustness learning strategy with a simulated transmission channel, we develop a robust detector that accurately distinguishes between malicious tampering and benign processing of the steganographic image. Extensive experiments across multiple datasets validate the superiority of the proposed approach over competing passive and proactive detection methods.
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 6676-6685
Advancing Generalized Deepfake Detector with Forgery Perception Guidance
One of the serious impacts brought by artificial intelligence is the abuse of deepfake techniques. Despite the proliferation of deepfake detection methods aimed at safeguarding the authenticity of media across the Internet, they mainly consider the improvement of detector architecture or the synthesis of forgery samples. The forgery perceptions, including the feature responses and prediction scores for forgery samples, have not been well considered. As a result, the generalization across multiple deepfake techniques always comes with complicated detector structures and expensive training costs. In this paper, we shift the focus to real-time perception analysis in the training process and generalize deepfake detectors through an efficient method dubbed Forgery Perception Guidance (FPG). In particular, after investigating the deficiencies of forgery perceptions, FPG adopts a sample refinement strategy to pertinently train the detector, thereby elevating the generalization efficiently. Moreover, FPG introduces more sample information as explicit optimizations, which makes the detector further adapt the sample diversities. Experiments demonstrate that FPG improves the generality of deepfake detectors with small training costs, minor detector modifications, and the acquirement of real data only. In particular, our approach not only outperforms the state-of-the-art on both the cross-dataset and cross-manipulation evaluation but also surpasses the baseline that needs more than 3× training time.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 6676-6685
Open AccessAdvancing Generalized Deepfake Detector with Forgery Perception Guidance
One of the serious impacts brought by artificial intelligence is the abuse of deepfake techniques. Despite the proliferation of deepfake detection methods aimed at safeguarding the authenticity of media across the Internet, they mainly consider the improvement of detector architecture or the synthesis of forgery samples. The forgery perceptions, including the feature responses and prediction scores for forgery samples, have not been well considered. As a result, the generalization across multiple deepfake techniques always comes with complicated detector structures and expensive training costs. In this paper, we shift the focus to real-time perception analysis in the training process and generalize deepfake detectors through an efficient method dubbed Forgery Perception Guidance (FPG). In particular, after investigating the deficiencies of forgery perceptions, FPG adopts a sample refinement strategy to pertinently train the detector, thereby elevating the generalization efficiently. Moreover, FPG introduces more sample information as explicit optimizations, which makes the detector further adapt the sample diversities. Experiments demonstrate that FPG improves the generality of deepfake detectors with small training costs, minor detector modifications, and the acquirement of real data only. In particular, our approach not only outperforms the state-of-the-art on both the cross-dataset and cross-manipulation evaluation but also surpasses the baseline that needs more than 3× training time.
- 30 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (2) , 1492-1505
A Lightweight Object Counting Network Based on Density Map Knowledge Distillation
Object counting aims to count the accurate number of object instances in images, and its operation efficiency is essential. However, most current CNN-based methods rely on complex network architectures, which results in them consuming a significant amount of memory, time, and other resources at runtime. This seriously limits their deployment in practical application scenarios, such as public safety and agriculture planting. Therefore, we propose a lightweight object counting method named EdgeCount to effectively balance inference speed and object counting accuracy. Specifically, we construct a network composed of a student model (EdgeCount) and a teacher model (EdgeCount-T) with the same encoder-decoder structure based on density map knowledge distillation (DMKD), allowing the EdgeCount to learn object density distribution from the EdgeCount-T. After that, we introduce spatial and channel reconstruction convolution (SCConv), composed of a spatial reconstruction unit (SRU) and a channel reconstruction unit (CRU), to decrease spatial and channel redundancy with lower computational costs. Moreover, a low parameter weighted multi-scale feature fusion module (LWMFFM) is designed to further improve the countering ability through segmenting minor structural discrepacies among multi-scale features. Extensive experiments conducted on challenging remote sensing and dense crowd object counting datasets demonstrate the effectiveness and superiority of our method. In particular, under the four NVIDIA Jetson devices, EdgeCount can accurately counter objects with only 0.12M parameters and 19.87M floating-point operations per second (FLOPs) in the size of 128, which achieves the lowest latency and fastest FPS compared with other state-of-the-art object counters.
- 30 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (2) , 1492-1505
A Lightweight Object Counting Network Based on Density Map Knowledge Distillation
Object counting aims to count the accurate number of object instances in images, and its operation efficiency is essential. However, most current CNN-based methods rely on complex network architectures, which results in them consuming a significant amount of memory, time, and other resources at runtime. This seriously limits their deployment in practical application scenarios, such as public safety and agriculture planting. Therefore, we propose a lightweight object counting method named EdgeCount to effectively balance inference speed and object counting accuracy. Specifically, we construct a network composed of a student model (EdgeCount) and a teacher model (EdgeCount-T) with the same encoder-decoder structure based on density map knowledge distillation (DMKD), allowing the EdgeCount to learn object density distribution from the EdgeCount-T. After that, we introduce spatial and channel reconstruction convolution (SCConv), composed of a spatial reconstruction unit (SRU) and a channel reconstruction unit (CRU), to decrease spatial and channel redundancy with lower computational costs. Moreover, a low parameter weighted multi-scale feature fusion module (LWMFFM) is designed to further improve the countering ability through segmenting minor structural discrepacies among multi-scale features. Extensive experiments conducted on challenging remote sensing and dense crowd object counting datasets demonstrate the effectiveness and superiority of our method. In particular, under the four NVIDIA Jetson devices, EdgeCount can accurately counter objects with only 0.12M parameters and 19.87M floating-point operations per second (FLOPs) in the size of 128, which achieves the lowest latency and fastest FPS compared with other state-of-the-art object counters.
- 1 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 33 (10577149) , 4432-4443
Inspector for Face Forgery Detection: Defending Against Adversarial Attacks From Coarse to Fine
The emergence of face forgery has raised global concerns on social security, thereby facilitating the research on automatic forgery detection. Although current forgery detectors have demonstrated promising performance in determining authenticity, their susceptibility to adversarial perturbations remains insufficiently addressed. Given the nuanced discrepancies between real and fake instances are essential in forgery detection, previous defensive paradigms based on input processing and adversarial training tend to disrupt these discrepancies. For the detectors, the learning difficulty is thus increased, and the natural accuracy is dramatically decreased. To achieve adversarial defense without changing the instances as well as the detectors, a novel defensive paradigm called Inspector is designed specifically for face forgery detectors. Specifically, Inspector defends against adversarial attacks in a coarse-to-fine manner. In the coarse defense stage, adversarial instances with evident perturbations are directly identified and filtered out. Subsequently, in the fine defense stage, the threats from adversarial instances with imperceptible perturbations are further detected and eliminated. Experimental results across different types of face forgery datasets and detectors demonstrate that our method achieves state-of-the-art performances against various types of adversarial perturbations while better preserving natural accuracy. Code is available on https://github.com/xarryon/Inspector.
- 1 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 33 (10577149) , 4432-4443
Inspector for Face Forgery Detection: Defending Against Adversarial Attacks From Coarse to Fine
The emergence of face forgery has raised global concerns on social security, thereby facilitating the research on automatic forgery detection. Although current forgery detectors have demonstrated promising performance in determining authenticity, their susceptibility to adversarial perturbations remains insufficiently addressed. Given the nuanced discrepancies between real and fake instances are essential in forgery detection, previous defensive paradigms based on input processing and adversarial training tend to disrupt these discrepancies. For the detectors, the learning difficulty is thus increased, and the natural accuracy is dramatically decreased. To achieve adversarial defense without changing the instances as well as the detectors, a novel defensive paradigm called Inspector is designed specifically for face forgery detectors. Specifically, Inspector defends against adversarial attacks in a coarse-to-fine manner. In the coarse defense stage, adversarial instances with evident perturbations are directly identified and filtered out. Subsequently, in the fine defense stage, the threats from adversarial instances with imperceptible perturbations are further detected and eliminated. Experimental results across different types of face forgery datasets and detectors demonstrate that our method achieves state-of-the-art performances against various types of adversarial perturbations while better preserving natural accuracy. Code is available on https://github.com/xarryon/Inspector.
- 1 December 2022
- Published by Elsevier in Pattern Recognition Letters
- Vol. 165, 91-97
Bi-path Combination YOLO for Real-time Few-shot Object Detection
- 1 December 2022
- Published by Elsevier in Pattern Recognition Letters
- Vol. 165, 91-97
Bi-path Combination YOLO for Real-time Few-shot Object Detection
- 21 May 2022
- Published by Springer Nature in Neural Computing and Applications
- Vol. 34 (15) , 12571-12585
Transformers only look once with nonlinear combination for real-time object detection
- 21 May 2022
- Published by Springer Nature in Neural Computing and Applications
- Vol. 34 (15) , 12571-12585
Transformers only look once with nonlinear combination for real-time object detection
- 18 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 32 (10) , 6502-6514
CBASH: Combined Backbone and Advanced Selection Heads With Object Semantic Proposals for Weakly Supervised Object Detection
Most recent object detection methods have achieved growing performance on public datasets. However, enormous efforts are needed for these methods due to the extensive annotations of ground-truth boxes. Weakly Supervised Object Detection (WSOD) methods hence have been proposed to solve this problem as only image-level annotations are required and then output bounding boxes related to the objects. In order to further elevate the weakly supervised detection methods on the extraction of reasonable features, the training of potential positive proposals, and the generation of proposals before training, we propose a new Combined Backbone and Advanced Selection Heads (CBASH) method with the proposals generated from the object semantic information. Specifically, Combined Backbone will make the unobvious object features more noticeable, Advanced Selection Heads promote more potential positive proposals to get training, and the generated object semantic proposals elevate the quality and quantity of positive proposals. The proposed method is evaluated on the challenging PASCAL VOC 2007 and 2012 benchmark datasets. Experimental results show that our proposed method can achieve improved performance on both VOC 2007 and VOC 2012 datasets and outperforms the existing state-of-the-art methods.
- 18 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 32 (10) , 6502-6514
CBASH: Combined Backbone and Advanced Selection Heads With Object Semantic Proposals for Weakly Supervised Object Detection
Most recent object detection methods have achieved growing performance on public datasets. However, enormous efforts are needed for these methods due to the extensive annotations of ground-truth boxes. Weakly Supervised Object Detection (WSOD) methods hence have been proposed to solve this problem as only image-level annotations are required and then output bounding boxes related to the objects. In order to further elevate the weakly supervised detection methods on the extraction of reasonable features, the training of potential positive proposals, and the generation of proposals before training, we propose a new Combined Backbone and Advanced Selection Heads (CBASH) method with the proposals generated from the object semantic information. Specifically, Combined Backbone will make the unobvious object features more noticeable, Advanced Selection Heads promote more potential positive proposals to get training, and the generated object semantic proposals elevate the quality and quantity of positive proposals. The proposed method is evaluated on the challenging PASCAL VOC 2007 and 2012 benchmark datasets. Experimental results show that our proposed method can achieve improved performance on both VOC 2007 and VOC 2012 datasets and outperforms the existing state-of-the-art methods.
- 13 August 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 70 (00189456) , 1-10
Classify and Localize Threat Items in X-Ray Imagery With Multiple Attention Mechanism and High-Resolution and High-Semantic Features
No doubt incorporating deep learning in security public transportation is an attractive and challenging research direction. In this article, we incorporate multiple attention mechanisms with high-resolution and high-semantic features into neural networks to further classify and localize threat items automatically. We propose our efficient model located in different network layers. To be specific, our model is involved in three modules called the spatial attention module (SAM), the channel attention module (CAM), and the high-resolution and high-semantic module (HRHSM). For shallow and deep layers, we adapt SAM and CAM to mine the long-range spatial and channel information of the network, respectively. With regard to the last few layers with different sizes, we leverage HRHSM to fuse their features so that the output contains high-resolution and high-semantic features. Due to the generalizability, our model can be broadly applied to many commonly used networks. Experimental results on the SIXray dataset that is consisted of six classes of threat item in X-ray images, CIFAR-10, and CIFAR-100 datasets demonstrate that our modules can improve the performance of networks in image classification and object localization without ground-truth bounding boxes.
- 13 August 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 70 (00189456) , 1-10
Classify and Localize Threat Items in X-Ray Imagery With Multiple Attention Mechanism and High-Resolution and High-Semantic Features
No doubt incorporating deep learning in security public transportation is an attractive and challenging research direction. In this article, we incorporate multiple attention mechanisms with high-resolution and high-semantic features into neural networks to further classify and localize threat items automatically. We propose our efficient model located in different network layers. To be specific, our model is involved in three modules called the spatial attention module (SAM), the channel attention module (CAM), and the high-resolution and high-semantic module (HRHSM). For shallow and deep layers, we adapt SAM and CAM to mine the long-range spatial and channel information of the network, respectively. With regard to the last few layers with different sizes, we leverage HRHSM to fuse their features so that the output contains high-resolution and high-semantic features. Due to the generalizability, our model can be broadly applied to many commonly used networks. Experimental results on the SIXray dataset that is consisted of six classes of threat item in X-ray images, CIFAR-10, and CIFAR-100 datasets demonstrate that our modules can improve the performance of networks in image classification and object localization without ground-truth bounding boxes.