Xin Dong
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Xin Dong has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Aoyang Liu
Shenzhen International Graduate School, Tsinghua University, Shenzhen, China
1 shared publication - Lihan Zhang
Institute of Artificial Intelligence (TeleAI), China Telecom, Shanghai, China
1 shared publication - Xiaojun Liang
Peng Cheng Laboratory, Shenzhen, China
1 shared publication - Yansong Tang
Tsinghua Shenzhen International Graduate School, Tsinghua University
1 shared publication - Yutao Guo
Tsinghua Univ
1 shared publication
Latest Publications
- Open Access
- 12 January 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 22 (1) , 1-24
Enhancing Pose-Guided Human Image Generation with Comprehensive and Adjustable 3D Control
Pose-guided human image generation aims to render a source image in a specific pose. Current methods predominantly employ 2D-based signals, which exhibit inherent information deficits, as pose conditions. This leads to difficulty in establishing precise source-target appearance-pose correspondence and further causing uncertainty in predicting self-occluded regions’ appearance. To address these issues, we propose a 3D Pose Conditional Diffusion model (3DPCD) that leverages a human parametric model to integrate comprehensive and adjustable 3D control into forward–backward diffusion steps. Specifically, we employ Fourier-transformed SMPL-X as the 3D pose representation to facilitate precise source-target correspondence by understanding the complete pose information. Building on this, we further propose a hierarchical appearance-pose alignment method, which aligns appearance with the complete pose information at both global and local levels. Moreover, motivated by the fact that human pose transformation is a progressive process in 3D space and our 3D pose representation is adjustable, we integrate progressively interpolated 3D control into a series of sampling steps. This effectively mitigates uncertainties in pixel transfer between poses. It should be noted that the proposed explicit pose-guided strategy also supports flexible adjustment of pose, shape, and viewpoint. Both quantitative and qualitative evaluations demonstrate that our 3DPCD outperforms state-of-the-art methods on the widely used DeepFashion InShop benchmark and our newly constructed PoseWeb-33 dataset, which features richer appearance variations and more diverse conditional poses.
- 12 January 2026
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 22 (1) , 1-24
Open AccessEnhancing Pose-Guided Human Image Generation with Comprehensive and Adjustable 3D Control
Pose-guided human image generation aims to render a source image in a specific pose. Current methods predominantly employ 2D-based signals, which exhibit inherent information deficits, as pose conditions. This leads to difficulty in establishing precise source-target appearance-pose correspondence and further causing uncertainty in predicting self-occluded regions’ appearance. To address these issues, we propose a 3D Pose Conditional Diffusion model (3DPCD) that leverages a human parametric model to integrate comprehensive and adjustable 3D control into forward–backward diffusion steps. Specifically, we employ Fourier-transformed SMPL-X as the 3D pose representation to facilitate precise source-target correspondence by understanding the complete pose information. Building on this, we further propose a hierarchical appearance-pose alignment method, which aligns appearance with the complete pose information at both global and local levels. Moreover, motivated by the fact that human pose transformation is a progressive process in 3D space and our 3D pose representation is adjustable, we integrate progressively interpolated 3D control into a series of sampling steps. This effectively mitigates uncertainties in pixel transfer between poses. It should be noted that the proposed explicit pose-guided strategy also supports flexible adjustment of pose, shape, and viewpoint. Both quantitative and qualitative evaluations demonstrate that our 3DPCD outperforms state-of-the-art methods on the widely used DeepFashion InShop benchmark and our newly constructed PoseWeb-33 dataset, which features richer appearance variations and more diverse conditional poses.