HieraFashDiff: Hierarchical Fashion Design with Multi-stage Diffusion Models
Open Access
- 11 April 2025
- journal article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 39 (8) , 8762-8770
Abstract
Fashion design is a challenging and complex process. Recent works on fashion generation and editing are all agnostic of the actual fashion design process, which limits their usage in practice. In this paper, we propose a novel hierarchical diffusion-based framework tailored for fashion design, coined as HieraFashDiff. Our model is designed to mimic the practical fashion design workflow, by unraveling the denosing process into two successive stages: 1) an ideation stage that generates design proposals given high-level concepts and 2) an iteration stage that continuously refines the proposals using low-level attributes. Our model supports fashion design generation and fine-grained local editing in a single framework. To train our model, we contribute a new dataset of full-body fashion images annotated with hierarchical text descriptions. Extensive evaluations show that, as compared to prior approaches, our method can generate fashion designs and edited results with higher fidelity and better prompt adherence, showing its promising potential to augment the practical fashion design workflow.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion2024
- MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing2023
- Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing2023
- DiffCloth: Diffusion Based Garment Synthesis and Manipulation via Structural Cross-modal Semantic Alignment2023
- FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model2023
- Fashion Captioning: Towards Generating Accurate Descriptions with Semantic Rewards2020
- TailorGAN: Making User-Defined Fashion Designs2020
- Attribute Manipulation Generative Adversarial Networks for Fashion Images2019
- Be Your Own Prada: Fashion Synthesis with Structural Coherence2017
- Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields2017