Task-Oriented Video Compression via XAI-Guided Frame Filtering
- 3 March 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 33 (10709908) , 1275-1279
Abstract
Task-oriented video compression aims to eliminate redundancy while preserving task-critical information. However, existing spatial domain methods incur high computational overhead, whereas temporal domain approaches often rely on black-box confidence scores that may discard taskrelevant frames. These methods follow an implicit informationpreservation paradigm that entangles redundancy and relevance, yielding opaque decision-making. In this paper, we therefore reformulate it as an explicit and explainable frame filtering method. Instead of relying on black-box confidence scores, task relevance is quantified by an explainable saliency score grounded in explicit model attribution and statistical aggregation, providing a transparent criterion for frame filtering. This offline-defined saliency metric supervises a lightweight online regressor, so that each online decision inherits the same explainable semantic meaning while avoiding heavy computation at the edge. Specifically, frame filtering is decomposed into two sequential and explainable steps: a similarity detector first removes structurally redundant frames, and a saliency-guided filter then discards frames with limited contribution to the downstream task. Experimental results demonstrate the effectiveness of the proposed method.Keywords
Funding Information
- National Natural Science Foundation of China (62401275)
- National Natural Science Foundation of China (62277032)
- Natural Science Foundation of Jiangsu Higher Education Institutions of China (24KJB510031)
- Qinglan Project of Jiangsu Province of China
- Key Lab of Broadband Wireless Communication and Sensor Network Technology
- Nanjing University of Posts and Telecommunications
This publication has 21 references indexed in Scilit:
- ECVC: Exploiting Non-Local Correlations in Multiple Frames for Contextual Video Compression2025
- IIRNet: Infinite impulse response inspired network for compressed video quality enhancementNeurocomputing, 2024
- Rate-Distortion-Cognition Controllable Versatile Neural Image Compression2024
- Temporal Adaptive Learned Surveillance Video CompressionIEEE Transactions on Broadcasting, 2024
- Saliency Map-Guided End-to-End Image Coding for MachinesIEEE Signal Processing Letters, 2024
- Task-Aware Encoder Control for Deep Video Compression2024
- Visual Explanations via Iterated Integrated Attributions2023
- TransTIC: Transferring Transformer-based Image Compression from Human Perception to Machine Perception2023
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Overview of the H.264/AVC video coding standardIEEE Transactions on Circuits and Systems for Video Technology, 2003