Erteng Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Erteng Liu has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Yijun Bei
Zhejiang University, Ningbo, Zhejiang, China
4 shared publications - Hengrui Lou
Zhejiang University, Hangzhou, China
2 shared publications - Zunlei Feng
Zhejiang University, Hangzhou, China
2 shared publications - Butian Huang
Hangzhou Dianzi University
1 shared publication - Hongchang Zhang
School of Software Technology Zhejiang University, Ningbo 310048, P. R. China
1 shared publication - Jianhai Chen
College of Computer Science and Technology, Zhejiang University, Hangzhou, China
1 shared publication
Latest Publications
- Open Access
- 17 February 2026
- Published by Elsevier in SSRN Electronic Journal
Low-Cost Training for Multimodal Large Models via Prompt Tuning and Modal Fusion
Multimodal Large Models have reshaped key industries via multi-sensory collaborative cognition, yet training trillion-parameter MLLMs demands immense computing power and annotated samples, making traditional full-parameter fine-tuning unfit for low-cost scenarios. As a core low-cost approach, prompt tuning suffers from inefficient feature extraction and inadequate modal alignment in multimodal tasks. To solve these, we propose the STMPT-MF method, boosting feature extraction and training efficiency with three key contributions: 1) a progressive feature extraction strategy for efficient feature utilization; 2) a novel cross-modal interaction module and dynamic fusion module that collaboratively realize accurate modal alignment by correcting feature mismatches; 3) extensive systematic experiments that fully validate the method’s effectiveness, superiority and the value of each innovative module.
- 17 February 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessLow-Cost Training for Multimodal Large Models via Prompt Tuning and Modal Fusion
Multimodal Large Models have reshaped key industries via multi-sensory collaborative cognition, yet training trillion-parameter MLLMs demands immense computing power and annotated samples, making traditional full-parameter fine-tuning unfit for low-cost scenarios. As a core low-cost approach, prompt tuning suffers from inefficient feature extraction and inadequate modal alignment in multimodal tasks. To solve these, we propose the STMPT-MF method, boosting feature extraction and training efficiency with three key contributions: 1) a progressive feature extraction strategy for efficient feature utilization; 2) a novel cross-modal interaction module and dynamic fusion module that collaboratively realize accurate modal alignment by correcting feature mismatches; 3) extensive systematic experiments that fully validate the method’s effectiveness, superiority and the value of each innovative module.
- Open Access
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 12592-12599
A Large-scale Universal Evaluation Benchmark For Face Forgery Detection
- 27 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 12592-12599
Open AccessA Large-scale Universal Evaluation Benchmark For Face Forgery Detection
- 27 May 2025
- Published by World Scientific Pub Co Pte Ltd in International Journal of Pattern Recognition and Artificial Intelligence
- Vol. 39 (09)
One-Step Multi-Frame Inpainting Framework for Real-Time Lip-Sync Digital Human Generation
In recent times, audio-driven lip-synching generation for digital humans has attracted considerable attention. However, the prevailing methodologies frequently encounter challenges pertaining to elevated computational complexity and deficient real-time performance. Although the MuseTalk framework has achieved notable progress in inference efficiency through its end-to-end, latent-space-based single-step generation algorithm, it still suffers from noticeable lip jitter and insufficient synchronization between audio and lip movements. To address these limitations, we propose an enhanced multi-frame inpainting framework that integrates Variational Autoencoders (VAE) and a multi-scale U-Net architecture. Specifically, our approach directly synthesizes the occluded lip region by leveraging multi-frame visual references combined with corresponding audio embeddings, thereby effectively improving lip synchronization and maintaining identity consistency. Furthermore, we introduce a landmark-guided multi-frame sampling strategy designed to enhance model attention towards lip dynamics. To facilitate deeper feature extraction and fusion, we propose a hierarchical latent-space feature fusion network (FusionNet), incorporating global and local residual connections and an enhanced Convolutional Block Attention Module. Additionally, a frame interpolation technique is employed during inference to further smooth lip movements and significantly mitigate lip jitter. The model has been trained on a large-scale Chinese dataset and comprehensively evaluated using both Chinese and English datasets. The experimental results demonstrate that the proposed framework achieves high visual accuracy, consistent lip synchronization, and efficient real-time inference, highlighting its strong cross-lingual generalization capability.
- 27 May 2025
- Published by World Scientific Pub Co Pte Ltd in International Journal of Pattern Recognition and Artificial Intelligence
- Vol. 39 (09)
One-Step Multi-Frame Inpainting Framework for Real-Time Lip-Sync Digital Human Generation
In recent times, audio-driven lip-synching generation for digital humans has attracted considerable attention. However, the prevailing methodologies frequently encounter challenges pertaining to elevated computational complexity and deficient real-time performance. Although the MuseTalk framework has achieved notable progress in inference efficiency through its end-to-end, latent-space-based single-step generation algorithm, it still suffers from noticeable lip jitter and insufficient synchronization between audio and lip movements. To address these limitations, we propose an enhanced multi-frame inpainting framework that integrates Variational Autoencoders (VAE) and a multi-scale U-Net architecture. Specifically, our approach directly synthesizes the occluded lip region by leveraging multi-frame visual references combined with corresponding audio embeddings, thereby effectively improving lip synchronization and maintaining identity consistency. Furthermore, we introduce a landmark-guided multi-frame sampling strategy designed to enhance model attention towards lip dynamics. To facilitate deeper feature extraction and fusion, we propose a hierarchical latent-space feature fusion network (FusionNet), incorporating global and local residual connections and an enhanced Convolutional Block Attention Module. Additionally, a frame interpolation technique is employed during inference to further smooth lip movements and significantly mitigate lip jitter. The model has been trained on a large-scale Chinese dataset and comprehensively evaluated using both Chinese and English datasets. The experimental results demonstrate that the proposed framework achieves high visual accuracy, consistent lip synchronization, and efficient real-time inference, highlighting its strong cross-lingual generalization capability.
- 1 May 2025
- Published by Elsevier in Pattern Recognition
- Vol. 167
Target-Directed Progressive Gradient Adjusting for transfer learning
- 1 May 2025
- Published by Elsevier in Pattern Recognition
- Vol. 167
Target-Directed Progressive Gradient Adjusting for transfer learning
- Open Access
- 10 July 2023
- Published by Association for Computing Machinery (ACM)
- p. 114-122
Efficient Balancing A* Search for Multi-robot Collaboration With Blockchain Consensus
- 10 July 2023
- Published by Association for Computing Machinery (ACM)
- p. 114-122
Open AccessEfficient Balancing A* Search for Multi-robot Collaboration With Blockchain Consensus