Jiawei Feng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jiawei Feng has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Fuwei Zhang
School of Computer Science and Technology, North University of China, Taiyuan, China
2 shared publications - Ruomei Wang
School of Software Engineering, Sun Yat-sen University, Guangzhou, China
2 shared publications - Yuanmao Luo
School of Computer Science and Engineering, National Engineering Research Center of Digital Life, Sun Yat-sen University, Guangzhou, China
2 shared publications - Fan Zhou
Sun Yat-Sen University, Guangzhou, China
1 shared publication - Mingyang Liu
National Engineering Research Center of Digital Life, School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China
1 shared publication - Xiaonan Luo
Guilin University of Electronic Technology, Guilin, China
1 shared publication
Latest Publications
- 16 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (9) , 8896-8911
Modality-Aware Heterogeneous Graph for Joint Video Moment Retrieval and Highlight Detection
The joint task of video moment retrieval and video highlight detection is a challenging study, which requires building a model that not only captures contextual information between sequences in time but also has the ability to understand and judge significance. This paper solves these problems from three aspects. Firstly, we design a parameter-free cross-modal statistical correlation interaction method. A novel saliency enhancement function is defined to quantify the saliency differences between the important features associated with the query and other features to achieve parameter-free cross-modal fusion. Secondly, we propose a novel modality-aware heterogeneous graph reasoning mechanism (MHGR). MHGR can effectively capture the global context information between sequences, enhance the local association relationship between sequences, and deal with the complexity of multi-modal data better through the organic combination of two key modules: parameter-free cross-modal statistical correlation interaction, and heterogeneous graph reasoning mechanism. Thirdly, a lightweight solution for the joint task of video moment retrieval and highlight detection is designed based on the above two novel algorithm modules. Comprehensive experiments are conducted on publicly available benchmark data to validate the advantages of the new solution in comparison with a series of state-of-the-art peer methods. Quantitative results consistently demonstrate that the new solution is lightweight and has high inference performance so the remarkable improvement in accuracy achieved by the new solution with respect to peer methods. An extended ablation study is further conducted to show the usefulness of each module of the solution in acquiring its computational capabilities.
- 16 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 34 (9) , 8896-8911
Modality-Aware Heterogeneous Graph for Joint Video Moment Retrieval and Highlight Detection
The joint task of video moment retrieval and video highlight detection is a challenging study, which requires building a model that not only captures contextual information between sequences in time but also has the ability to understand and judge significance. This paper solves these problems from three aspects. Firstly, we design a parameter-free cross-modal statistical correlation interaction method. A novel saliency enhancement function is defined to quantify the saliency differences between the important features associated with the query and other features to achieve parameter-free cross-modal fusion. Secondly, we propose a novel modality-aware heterogeneous graph reasoning mechanism (MHGR). MHGR can effectively capture the global context information between sequences, enhance the local association relationship between sequences, and deal with the complexity of multi-modal data better through the organic combination of two key modules: parameter-free cross-modal statistical correlation interaction, and heterogeneous graph reasoning mechanism. Thirdly, a lightweight solution for the joint task of video moment retrieval and highlight detection is designed based on the above two novel algorithm modules. Comprehensive experiments are conducted on publicly available benchmark data to validate the advantages of the new solution in comparison with a series of state-of-the-art peer methods. Quantitative results consistently demonstrate that the new solution is lightweight and has high inference performance so the remarkable improvement in accuracy achieved by the new solution with respect to peer methods. An extended ablation study is further conducted to show the usefulness of each module of the solution in acquiring its computational capabilities.
- 27 February 2024
- Published by Springer Nature in Neural Computing and Applications
- Vol. 36 (14) , 8055-8071
Video Q &A based on two-stage deep exploration of temporally-evolving features with enhanced cross-modal attention mechanism
- 27 February 2024
- Published by Springer Nature in Neural Computing and Applications
- Vol. 36 (14) , 8055-8071
Video Q &A based on two-stage deep exploration of temporally-evolving features with enhanced cross-modal attention mechanism