From Air to Wear: Personalized 3D Digital Fashion With AR/VR Immersive 3D Sketching
- 29 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 31 (12) , 10227-10236
Abstract
In the era of immersive consumer electronics, such as AR/VR headsets and smart devices, people increasingly seek ways to express their identity through virtual fashion. However, existing 3D garment design tools remain inaccessible to everyday users due to steep technical barriers and limited data. In this work, we introduce a 3D sketch-driven 3D garment generation framework that empowers ordinary users — even those without design experience — to create high-quality digital clothing through simple 3D sketches in AR/VR environments. By combining a conditional diffusion model, a sketch encoder trained in a shared latent space, and an adaptive curriculum learning strategy, our system interprets imprecise, free-hand input and produces realistic, personalized garments. To address the scarcity of training data, we also introduce KO3DClothes, a new dataset of paired 3D garments and user-created sketches. Extensive experiments and user studies confirm that our method significantly outperforms existing baselines in both fidelity and usability, demonstrating its promise for democratized fashion design on next-generation consumer platforms.Keywords
All Related Versions
Funding Information
- National Key R&D Program of China (2022YFB3303301)
- ZJU Kunpeng & Ascend Center of Excellence
- Dream Set Off - Kunpeng & Ascend Seed Program
This publication has 60 references indexed in Scilit:
- Magic3DSketch: Create colorful 3D models from sketch-based 3D modeling guided by text and language-image pre-trainingNeurocomputing, 2025
- Deep3DSketch+: Rapid 3D Modeling from Single Free-Hand Sketches2023
- A Diffusion-ReFinement Model for Sketch-to-Point Modeling2023
- 3D Shape Reconstruction from Free-Hand Sketches2023
- SketchSampler: Sketch-Based 3D Reconstruction via View-Dependent Depth Sampling2022
- BCNet: Learning Body and Cloth Shape from a Single Image2020
- Curriculum DeepSDF2020
- Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images2020
- A survey on CAD methods in 3D garment designComputers in Industry, 2010
- Sketch-based modeling: A surveyComputers & Graphics, 2009