QLQingyuan Liu

Qingyuan Liu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Qingyuan Liu has a total of 12 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • MotionFlow: Efficient Motion Generation With Latent Flow Matching

    by Kun Dong, Jian Xue, Xing Lan, Qingyuan Liu, Ke Lu

    In the field of human centric multimedia, text-driven human motion generation is a significant pursuit with wide-ranging applications across diverse scenarios. Despite substantial advancements, existing methods often suffer from a trade-off between inference latency and high-quality generation. To overcome this gap, we propose the Motion Latent Flow Matching model (MotionFlow), a novel and powerful framework for motion generation. It introduces flow matching algorithm in the latent space, which can achieve superior performance with just one-step inference. In addition to the text-driven task, we further extend our method to controllable motion generation. Specifically, we integrate a control encoder into the latent space and further decode the predicted latent code into motion space to support explicit supervision, ensuring the synthesized motion can tightly align with the input signals. Extensive experiments demonstrate that our MotionFlow not only outperforms current leading approaches for the text-driven task, but also delivers remarkable capabilities in controllable motion generation.


  • Open Access

    Towards Accurate and Smooth Human Motion Reconstruction from Sparse Tracking with State Space Model

    by Kun Dong, Jian Xue, Zehai Niu, Qingyuan Liu, Shun Mao, Ke Lu, Xing Lan

    Reconstructing accurate full-body poses from sparse tracking is crucial in generative multimedia, yet achieving effective sequence modeling and high-quality generation remains challenging. Recently, the state space models (SSMs), especially Mamba, have showcased considerable promise in sequence modeling, indicating an appealing direction for building motion generation models. However, adapting SSM to this task is quite challenging due to two main aspects. Firstly, the sparsity of input conditions poses significant difficulty in accurately estimating full-body motions. Secondly, SSM lacks a specialized design to capture the temporal dependencies within motion sequences. To address these challenges, we propose a novel conditional diffusion model, Pose Mamba Diffusion (PMDiff), which comprises a bidirectional Pose Mamba Denoiser to achieve effective sequence modeling. Our PMDiff can effectively leverage the robust generation capabilities of diffusion models in conjunction with the sequence modeling proficiency of Mamba to track full-body poses accurately. Additionally, we notice that synthesized human motions often lack smoothness, resulting in unnatural motion sequences. To overcome this issue, we further introduce a learning-free Temporal Motion Filter (TMF), which can remarkably improve the smoothness of the generated human motion. Extensive experiments conducted on the large motion capture database (AMASS) show that our PMDiff outperforms previous state-of-the-art methods in terms of both accuracy and smoothness.

  • Open Access

    MPRW-HGNN: A Meta-path Random Walk based Heterogeneous Graph Neural Network

    by Hongjuan Pei, Qingyuan Liu, Jian Xue, KuiJie Zhang, Kun Dong, Yan Ding, Liren Zhang, Ke Lu

    In recent years, graph neural networks have been widely used in multimedia information retrieval and other graph data processing tasks due to their powerful feature learning capabilities. However, existing graph neural network models typically handle only homogeneous graph data with simple structures and single semantics effectively. However, when faced with heterogeneous multimedia data characterized by complex interactions and rich semantics, the performance of traditional models degrades significantly. To address this challenge, this paper proposes a heterogeneous graph neural network algorithm based on meta-path random walk (MPRW-HGNN). First, we design a module at the meta-path instance level that generates meta-path instances and their structural representations via random walks. Then, a soft-attention mechanism is employed to fuse information from multiple meta-paths, better capturing the fine-grained semantic structures around nodes. Subsequently, we utilize a self-attention mechanism to explore semantic correlations and differences between multiple paths, enabling adaptive weighted fusion of multiple path information to generate robust node features for heterogeneous graph data. Through extensive experiments on information retrieval tasks using the IMDB movie dataset and DBLP academic paper dataset, we demonstrate the significant advantages of our proposed algorithm in handling multimodal data and improving retrieval accuracy.

  • FlexControl: Flexible and Efficient Full-Body Controllable Text-to-Motion Generation

    by Qingyuan Liu, Ke Lu, Zehai Niu, Kun Dong, Jian Xue, Xiaoyu Qin, Jinbao Wang

  • Open Access

    Realistic Full-Body Motion Generation from Sparse Tracking with State Space Model

    by Kun Dong, Jian Xue, Zehai Niu, Xing Lan, Ke Lu, Qingyuan Liu, Xiaoyu Qin

    In the domain of generative multimedia and interactive experiences, generating realistic and accurate full-body poses from sparse tracking is crucial for many real-world applications, while achieving sequence modeling and efficient motion generation remains challenging. Recently, state space models (SSMs) with efficient hardware-aware designs (i.e., Mamba) have shown great potential for sequence modeling, particularly in temporal contexts. However, processing motion data is still challenging for SSMs. Specifically, the sparsity of input conditions makes motion generation an ill-posed problem. Moreover, the complex structure of the human body further complicates this task. To address these issues, we present Motion Mamba Diffusion (MMD), a novel conditional diffusion model, which effectively utilizes the sequence modeling capability of SSMs and the robust generation ability of diffusion models to track full-body poses accurately. In particular, we design a bidirectional Temporal Mamba Module (TMM) to model motion sequence. Additionally, a Spatial Mamba Module (SMM) is further proposed for feature enhancement within a single frame. Extensive experiments on the large motion capture dataset (AMASS) demonstrate that our proposed approach outperforms the latest methods in terms of accuracy and smoothness, thus providing a crucial advancement for creating realistic virtual avatars in various applications.


  • Open Access

    AdaptControl: Adaptive Human Motion Control and Generation via User Prompt and Spatial Trajectory Guidance

    by Qingyuan Liu, Zehai Niu, Ke Lu, Kun Dong, Jian Xue, Xiaoyu Qin, Jinbao Wang

    In the field of generative multimedia and interactive experiences, human motion generation guided by natural language and spatial signals has emerged as a critical research direction. However, generating human motions that precisely follow spatial trajectories while maintaining naturalness remains a significant challenge. Existing methods often struggle to achieve a balance between spatial control precision and motion realism. Moreover, the spatial guidance signals and the relative rotations of human limbs reside in different representation spaces, complicating the precise control of human motions along specified paths. To address these issues, we propose AdaptControl, a motion generation model capable of precise spatial trajectory control while ensuring that the generated motion adheres to both text descriptions and spatial guidance. AdaptControl employs a Natural Guidance module to optimize the generated motion noise while closely following the spatial constraints and maintaining realistic dynamics. Simultaneously, the Control Dominance Adjustor adaptively fuses features from the text and spatial signals, allowing the model to consider information from both sources. Finally, the Fusion Diffusion module integrates the guided noise from the Natural Guidance module with the fused features from the Control Dominance Adjustor to generate the final output motion. Extensive experiments demonstrate that AdaptControl outperforms state-of-the-art methods in trajectory adherence, motion realism, and semantic consistency, opening up new possibilities for intuitive and interactive human motion generation and facilitating the development of user-centered design and interactive applications.