Jingwen Chen
Research Subjects
Jingwen Chen has a total of 22 co-authors. Here are the top co-authors by number of shared publications:
- Yingwei Pan
HiDream.ai Inc., Beijing, China
14 shared publications - Tao Mei
HiDream.ai Inc., Beijing, China
12 shared publications - Ting Yao
HiDream.ai Inc., Beijing, China
11 shared publications - Siqi Wan
University of Science and Technology of China
4 shared publications - Yehao Li
HiDream.ai Inc., Beijing, China
4 shared publications - Yehao Li
HiDream.ai Inc
4 shared publications
Latest Publications
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 506-515
LayerEdit: Towards End-to-End Context-Aware Layer Editing
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 506-515
Open AccessLayerEdit: Towards End-to-End Context-Aware Layer Editing
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 17137-17140
HiDream-O1-Image: An Open-Source Pixel-Level Unified Transformer for General Image Generation
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 17137-17140
Open AccessHiDream-O1-Image: An Open-Source Pixel-Level Unified Transformer for General Image Generation
- Open Access
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 54-62
MM-SkillBench & MM-SkillRouter: Benchmarking and Routing Multimodal Skills for Agents
- 9 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 54-62
Open AccessMM-SkillBench & MM-SkillRouter: Benchmarking and Routing Multimodal Skills for Agents
- 11 September 2026
- Published by Springer Nature
- p. 430-447
PhysEdit: Physically Consistent Image Editing via Causal Enforcement
- 11 September 2026
- Published by Springer Nature
- p. 430-447
PhysEdit: Physically Consistent Image Editing via Causal Enforcement
- Open Access
Incorporating Visual Correspondence into Diffusion Model for Virtual Try-On
Diffusion models have shown preliminary success in virtual try-on (VTON) task. The typical dual-branch architecture comprises two UNets for implicit garment deformation and synthesized image generation respectively, and has emerged as the recipe for VTON task. Nevertheless, the problem remains challenging to preserve the shape and every detail of the given garment due to the intrinsic stochasticity of diffusion model. To alleviate this issue, we novelly propose to explicitly capitalize on visual correspondence as the prior to tame diffusion process instead of simply feeding the whole garment into UNet as the appearance reference. Specifically, we interpret the fine-grained appearance and texture details as a set of structured semantic points, and match the semantic points rooted in garment to the ones over target person through local flow warping. Such 2D points are then augmented into 3D-aware cues with depth/normal map of target person. The correspondence mimics the way of putting clothing on human body and the 3D-aware cues act as semantic point matching to supervise diffusion model training. A point-focused diffusion loss is further devised to fully take the advantage of semantic point matching. Extensive experiments demonstrate strong garment detail preservation of our approach, evidenced by state-of-the-art VTON performances on both VITON-HD and DressCode datasets. Code is publicly available at: https://github.com/HiDream-ai/SPM-Diff.
Open AccessIncorporating Visual Correspondence into Diffusion Model for Virtual Try-On
Diffusion models have shown preliminary success in virtual try-on (VTON) task. The typical dual-branch architecture comprises two UNets for implicit garment deformation and synthesized image generation respectively, and has emerged as the recipe for VTON task. Nevertheless, the problem remains challenging to preserve the shape and every detail of the given garment due to the intrinsic stochasticity of diffusion model. To alleviate this issue, we novelly propose to explicitly capitalize on visual correspondence as the prior to tame diffusion process instead of simply feeding the whole garment into UNet as the appearance reference. Specifically, we interpret the fine-grained appearance and texture details as a set of structured semantic points, and match the semantic points rooted in garment to the ones over target person through local flow warping. Such 2D points are then augmented into 3D-aware cues with depth/normal map of target person. The correspondence mimics the way of putting clothing on human body and the 3D-aware cues act as semantic point matching to supervise diffusion model training. A point-focused diffusion loss is further devised to fully take the advantage of semantic point matching. Extensive experiments demonstrate strong garment detail preservation of our approach, evidenced by state-of-the-art VTON performances on both VITON-HD and DressCode datasets. Code is publicly available at: https://github.com/HiDream-ai/SPM-Diff.
- 3 November 2024
- Published by Springer Nature
- p. 184-199
Improving Virtual Try-On with Garment-Focused Diffusion Models
- 3 November 2024
- Published by Springer Nature
- p. 184-199
Improving Virtual Try-On with Garment-Focused Diffusion Models
- 1 October 2024
- Published by Springer Nature
- p. 110-126
Improving Text-Guided Object Inpainting with Semantic Pre-inpainting
- 1 October 2024
- Published by Springer Nature
- p. 110-126
Improving Text-Guided Object Inpainting with Semantic Pre-inpainting
- 30 September 2024
- Published by Springer Nature
- p. 237-254
Unleashing Text-to-Image Diffusion Prior for Zero-Shot Image Captioning
- 30 September 2024
- Published by Springer Nature
- p. 237-254
Unleashing Text-to-Image Diffusion Prior for Zero-Shot Image Captioning
- Open Access
Improving Virtual Try-On with Garment-focused Diffusion Models
Diffusion models have led to the revolutionizing of generative modeling in numerous image synthesis tasks. Nevertheless, it is not trivial to directly apply diffusion models for synthesizing an image of a target person wearing a given in-shop garment, i.e., image-based virtual try-on (VTON) task. The difficulty originates from the aspect that the diffusion process should not only produce holistically high-fidelity photorealistic image of the target person, but also locally preserve every appearance and texture detail of the given garment. To address this, we shape a new Diffusion model, namely GarDiff, which triggers the garment-focused diffusion process with amplified guidance of both basic visual appearance and detailed textures (i.e., high-frequency details) derived from the given garment. GarDiff first remoulds a pre-trained latent diffusion model with additional appearance priors derived from the CLIP and VAE encodings of the reference garment. Meanwhile, a novel garment-focused adapter is integrated into the UNet of diffusion model, pursuing local fine-grained alignment with the visual appearance of reference garment and human pose. We specifically design an appearance loss over the synthesized garment to enhance the crucial, high-frequency details. Extensive experiments on VITON-HD and DressCode datasets demonstrate the superiority of our GarDiff when compared to state-of-the-art VTON approaches. Code is publicly available at: \href{https://github.com/siqi0905/GarDiff/tree/master}{https://github.com/siqi0905/GarDiff/tree/master}.
Open AccessImproving Virtual Try-On with Garment-focused Diffusion Models
Diffusion models have led to the revolutionizing of generative modeling in numerous image synthesis tasks. Nevertheless, it is not trivial to directly apply diffusion models for synthesizing an image of a target person wearing a given in-shop garment, i.e., image-based virtual try-on (VTON) task. The difficulty originates from the aspect that the diffusion process should not only produce holistically high-fidelity photorealistic image of the target person, but also locally preserve every appearance and texture detail of the given garment. To address this, we shape a new Diffusion model, namely GarDiff, which triggers the garment-focused diffusion process with amplified guidance of both basic visual appearance and detailed textures (i.e., high-frequency details) derived from the given garment. GarDiff first remoulds a pre-trained latent diffusion model with additional appearance priors derived from the CLIP and VAE encodings of the reference garment. Meanwhile, a novel garment-focused adapter is integrated into the UNet of diffusion model, pursuing local fine-grained alignment with the visual appearance of reference garment and human pose. We specifically design an appearance loss over the synthesized garment to enhance the crucial, high-frequency details. Extensive experiments on VITON-HD and DressCode datasets demonstrate the superiority of our GarDiff when compared to state-of-the-art VTON approaches. Code is publicly available at: \href{https://github.com/siqi0905/GarDiff/tree/master}{https://github.com/siqi0905/GarDiff/tree/master}.
- Open Access
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 9408-9410
3D Creation at Your Fingertips: From Text or Image to 3D Assets
We demonstrate an automatic 3D creation system, which can create realistic 3D assets solely from a text or image prompt without requiring any specialized 3D modeling skills. Users can either describe the object they envision in natural language or upload a reference image that records what they have seen with the phone. Our system will generate a high-quality 3D mesh that faithfully matches the users' input. We propose a coarse-to-fine framework to achieve this goal. Specifically, we first obtain a low-resolution mesh instantly by utilizing a pre-trained text/image conditional 3D generative model. Using such coarse mesh as the initialization, we further optimize a high-resolution textured 3D mesh with fine-grained appearance guidance from large-scale 2D diffusion models. Our system can create visually-pleasing results in minutes, which is significantly faster than existing methods. Meanwhile, the system ensures that the resulting 3D assets are precisely aligned with the input text or image prompt. With these advanced capabilities, our demonstration provides a streamlined and intuitive platform for users to incorporate 3D creation into their daily lives.
- 26 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 9408-9410
Open Access3D Creation at Your Fingertips: From Text or Image to 3D Assets
We demonstrate an automatic 3D creation system, which can create realistic 3D assets solely from a text or image prompt without requiring any specialized 3D modeling skills. Users can either describe the object they envision in natural language or upload a reference image that records what they have seen with the phone. Our system will generate a high-quality 3D mesh that faithfully matches the users' input. We propose a coarse-to-fine framework to achieve this goal. Specifically, we first obtain a low-resolution mesh instantly by utilizing a pre-trained text/image conditional 3D generative model. Using such coarse mesh as the initialization, we further optimize a high-resolution textured 3D mesh with fine-grained appearance guidance from large-scale 2D diffusion models. Our system can create visually-pleasing results in minutes, which is significantly faster than existing methods. Meanwhile, the system ensures that the resulting 3D assets are precisely aligned with the input text or image prompt. With these advanced capabilities, our demonstration provides a streamlined and intuitive platform for users to incorporate 3D creation into their daily lives.