Qiong Liu
Research Subjects
Qiong Liu has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Xi Zhou
CloudWalk Technology, Shanghai, China
4 shared publications - Chunhui Zhang
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
2 shared publications - Li Liu
The Hong Kong University of Science and Technology (Guangzhou)., China
2 shared publications - Xin Sun
Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai, China
2 shared publications - Longguang Wang
Sun Yat-sen University
1 shared publication - Xuan Wang
School of Management, Shanghai University of International Business and Economics, Shanghai, China
1 shared publication
Latest Publications
- 16 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 31 (10709908) , 1149-1153
Multi-Level Signal Fusion for Enhanced Weakly-Supervised Audio-Visual Video Parsing
The weakly-supervised audio-visual video parsing (AVVP) task aims toparse a video into temporal events and predict their modality-specific categories. Current works primarily focus on refining training strategies and follow the framework fusing signals only at the segment level. However, they miss the point that video events, being composed of consecutive segments, require the integration of both local and global contexts to fully capture their essence. In this letter, we present the L ocal- G lobal F usion Net work ( LGFNet ), designed to facilitate multi-level interaction between audio and visual signals. Specifically, we create a two-dimensional map to generate multi-scale event proposals for both audio and visual modalities. Subsequently, we fuse audio and visual signals at both segment and event levels with a novel boundary-aware feature aggregation method, enabling the simultaneous capture of local and global information. To enhance the temporal alignment between the two modalities, we employ segment-level and event-level contrastive learning. In-depth experiments demonstrate the superiority of our LGFNet.
- 16 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 31 (10709908) , 1149-1153
Multi-Level Signal Fusion for Enhanced Weakly-Supervised Audio-Visual Video Parsing
The weakly-supervised audio-visual video parsing (AVVP) task aims toparse a video into temporal events and predict their modality-specific categories. Current works primarily focus on refining training strategies and follow the framework fusing signals only at the segment level. However, they miss the point that video events, being composed of consecutive segments, require the integration of both local and global contexts to fully capture their essence. In this letter, we present the L ocal- G lobal F usion Net work ( LGFNet ), designed to facilitate multi-level interaction between audio and visual signals. Specifically, we create a two-dimensional map to generate multi-scale event proposals for both audio and visual modalities. Subsequently, we fuse audio and visual signals at both segment and event levels with a novel boundary-aware feature aggregation method, enabling the simultaneous capture of local and global information. To enhance the temporal alignment between the two modalities, we employ segment-level and event-level contrastive learning. In-depth experiments demonstrate the superiority of our LGFNet.
- 16 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 31 (10709908) , 1209-1213
Point Spatio-Temporal Pyramid Network for Point Cloud Video Understanding
The robustness to spatio-temporal sampling is significant for point cloud video understanding. Previous works overlook this issue and usually suffer notable performance drops when point densities and frame rates are changed. To remedy this, we propose a point spatio-temporal pyramid (PoST-Py) to improve the sampling robustness of point cloud video modeling. Specifically, we propose a pluggable PoST-Py to collect multi-scale feature maps from different layers of the backbone. Then, these features are integrated into a unified representation. This allows the model to capture multi-scale spatio-temporal information simultaneously. In addition, we employ the temporal cardinality difference to enhance the features to capture motion information. Extensive experiments show that PoST-Py achieves state-of-the-art performance, particularly with a notable improvement of over 2% under varying point sampling. This demonstrates the improved robustness of our method.
- 16 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Signal Processing Letters
- Vol. 31 (10709908) , 1209-1213
Point Spatio-Temporal Pyramid Network for Point Cloud Video Understanding
The robustness to spatio-temporal sampling is significant for point cloud video understanding. Previous works overlook this issue and usually suffer notable performance drops when point densities and frame rates are changed. To remedy this, we propose a point spatio-temporal pyramid (PoST-Py) to improve the sampling robustness of point cloud video modeling. Specifically, we propose a pluggable PoST-Py to collect multi-scale feature maps from different layers of the backbone. Then, these features are integrated into a unified representation. This allows the model to capture multi-scale spatio-temporal information simultaneously. In addition, we employ the temporal cardinality difference to enhance the features to capture motion information. Extensive experiments show that PoST-Py achieves state-of-the-art performance, particularly with a notable improvement of over 2% under varying point sampling. This demonstrates the improved robustness of our method.
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 5552-5561
All in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignment
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 5552-5561
Open AccessAll in One: Exploring Unified Vision-Language Tracking with Multi-Modal Alignment
- 26 February 2023
- Published by Springer Nature
- p. 3-20
HiCo: Hierarchical Contrastive Learning for Ultrasound Video Model Pretraining
- 26 February 2023
- Published by Springer Nature
- p. 3-20
HiCo: Hierarchical Contrastive Learning for Ultrasound Video Model Pretraining