Pengjie Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Pengjie Li has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
Jianwei Li
Beijing Sports University
1 shared publicationKaiyu Zhang
Beijing Sports University
1 shared publicationShouxin Zong
Beijing Sports University
1 shared publicationXin Wang
School of Sport Engineering Beijing Sport University 100084 Beijing China
1 shared publicationYanfei Shen
Beijing Sports University
1 shared publication- Yuanyuan Shen
School of Sport Engineering Beijing Sport University 100084 Beijing China
1 shared publication
Latest Publications
- Open Access
Attention-Driven Multimodal Alignment for Long-term Action Quality Assessment
Long-term action quality assessment (AQA) focuses on evaluating the quality of human activities in videos lasting up to several minutes. This task plays an important role in the automated evaluation of artistic sports such as rhythmic gymnastics and figure skating, where both accurate motion execution and temporal synchronization with background music are essential for performance assessment. However, existing methods predominantly fall into two categories: unimodal approaches that rely solely on visual features, which are inadequate for modeling multimodal cues like music; and multimodal approaches that typically employ simple feature-level contrastive fusion, overlooking deep cross-modal collaboration and temporal dynamics. As a result, they struggle to capture complex interactions between modalities and fail to accurately track critical performance changes throughout extended sequences. To address these challenges, we propose the Long-term Multimodal Attention Consistency Network (LMAC-Net). LMAC-Net introduces a multimodal attention consistency mechanism to explicitly align multimodal features, enabling stable integration of visual and audio information and enhancing feature representations. Specifically, we introduce a multimodal local query encoder module to capture temporal semantics and cross-modal relations, and use a two-level score evaluation for interpretable results. In addition, attention-based and regression-based losses are applied to jointly optimize multimodal alignment and score fusion. Experiments conducted on the RG and Fis-V datasets demonstrate that LMAC-Net significantly outperforms existing methods, validating the effectiveness of our proposed approach.
Open AccessAttention-Driven Multimodal Alignment for Long-term Action Quality Assessment
Long-term action quality assessment (AQA) focuses on evaluating the quality of human activities in videos lasting up to several minutes. This task plays an important role in the automated evaluation of artistic sports such as rhythmic gymnastics and figure skating, where both accurate motion execution and temporal synchronization with background music are essential for performance assessment. However, existing methods predominantly fall into two categories: unimodal approaches that rely solely on visual features, which are inadequate for modeling multimodal cues like music; and multimodal approaches that typically employ simple feature-level contrastive fusion, overlooking deep cross-modal collaboration and temporal dynamics. As a result, they struggle to capture complex interactions between modalities and fail to accurately track critical performance changes throughout extended sequences. To address these challenges, we propose the Long-term Multimodal Attention Consistency Network (LMAC-Net). LMAC-Net introduces a multimodal attention consistency mechanism to explicitly align multimodal features, enabling stable integration of visual and audio information and enhancing feature representations. Specifically, we introduce a multimodal local query encoder module to capture temporal semantics and cross-modal relations, and use a two-level score evaluation for interpretable results. In addition, attention-based and regression-based losses are applied to jointly optimize multimodal alignment and score fusion. Experiments conducted on the RG and Fis-V datasets demonstrate that LMAC-Net significantly outperforms existing methods, validating the effectiveness of our proposed approach.
- 22 October 2021
- Published by Springer Nature
- p. 287-298
Soccer Field Registration Based on Geometric Constraint and Deep Learning Method
- 22 October 2021
- Published by Springer Nature
- p. 287-298
Soccer Field Registration Based on Geometric Constraint and Deep Learning Method
- 4 December 2020
- Published by Springer Nature
- p. 413-420
An Image-Based Method for 3D Human Shapes Retrieval
- 4 December 2020
- Published by Springer Nature
- p. 413-420
An Image-Based Method for 3D Human Shapes Retrieval