Yunxiao Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yunxiao Wang has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Liqiang Nie
Harbin Institute of Technology (Shenzhen), Shenzhen, China
3 shared publications - Meng Liu
School of Computer Science and Technology, Shandong Jianzhu University, Jinan, China
3 shared publications - Meng Wang
Hefei University of Technology, Hefei, China
1 shared publication - Xin Luo
School of Software, Shandong University, Jinan, China
1 shared publication Yinglong Wang
Shandong Artificial Intelligence Institute, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
1 shared publication- Yinwei Wei
Shandong University
1 shared publication
Latest Publications
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 5947-5955
Unlocking the Power of Multimodal Learning for Emotion Recognition in Conversation
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 5947-5955
Open AccessUnlocking the Power of Multimodal Learning for Emotion Recognition in Conversation
- Open Access
- 16 January 2023
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 55 (9) , 1-37
A Survey on Video Moment Localization
Video moment localization, also known as video moment retrieval, aims to search a target segment within a video described by a given natural language query. Beyond the task of temporal action localization whereby the target actions are pre-defined, video moment retrieval can query arbitrary complex activities. In this survey paper, we aim to present a comprehensive review of existing video moment localization techniques, including supervised, weakly supervised, and unsupervised ones. We also review the datasets available for video moment localization and group results of related work. In addition, we discuss promising future directions for this field, in particular large-scale datasets and interpretable video moment localization models.
- 16 January 2023
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 55 (9) , 1-37
Open AccessA Survey on Video Moment Localization
Video moment localization, also known as video moment retrieval, aims to search a target segment within a video described by a given natural language query. Beyond the task of temporal action localization whereby the target actions are pre-defined, video moment retrieval can query arbitrary complex activities. In this survey paper, we aim to present a comprehensive review of existing video moment localization techniques, including supervised, weakly supervised, and unsupervised ones. We also review the datasets available for video moment localization and group results of related work. In addition, we discuss promising future directions for this field, in particular large-scale datasets and interpretable video moment localization models.
- 19 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 25 (15209210) , 3921-3933
Siamese Alignment Network for Weakly Supervised Video Moment Retrieval
Video moment retrieval, i.e., localizing the specific video moments within a video given a description query, has attracted substantial attention over the past several years. Although great progress has been achieved thus far, most of existing methods are supervised, which require moment-level temporal annotation information. In contrast, weakly-supervised methods which only need video-level annotations remain largely unexplored. In this paper, we propose a novel end-to-end Siamese alignment network for weakly-supervised video moment retrieval. To be specific, we design a multi-scale Siamese module, which could progressively reduce the semantic gap between the visual and textual modality with the Siamese structure. In addition, we present a context-aware multiple instance learning module by considering the influence of adjacent contexts, enhancing the moment-query and video-query alignment simultaneously. By promoting the matching of both moment-level and video-level, our model can effectively improve the retrieval performance, even if only having weak video level annotations. Extensive experiments on two benchmark datasets, i.e., ActivityNet-Captions and Charades-STA, verify the superiority of our model compared with several state-of-the-art baselines.
- 19 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 25 (15209210) , 3921-3933
Siamese Alignment Network for Weakly Supervised Video Moment Retrieval
Video moment retrieval, i.e., localizing the specific video moments within a video given a description query, has attracted substantial attention over the past several years. Although great progress has been achieved thus far, most of existing methods are supervised, which require moment-level temporal annotation information. In contrast, weakly-supervised methods which only need video-level annotations remain largely unexplored. In this paper, we propose a novel end-to-end Siamese alignment network for weakly-supervised video moment retrieval. To be specific, we design a multi-scale Siamese module, which could progressively reduce the semantic gap between the visual and textual modality with the Siamese structure. In addition, we present a context-aware multiple instance learning module by considering the influence of adjacent contexts, enhancing the moment-query and video-query alignment simultaneously. By promoting the matching of both moment-level and video-level, our model can effectively improve the retrieval performance, even if only having weak video level annotations. Extensive experiments on two benchmark datasets, i.e., ActivityNet-Captions and Charades-STA, verify the superiority of our model compared with several state-of-the-art baselines.