SMPLicit: Topology-aware Generative Model for Clothed People
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 11870-11880
Abstract
In this paper we introduce SMPLicit, a novel generative model to jointly represent body pose, shape and clothing geometry. In contrast to existing learning-based approaches that require training specific models for each type of garment, SMPLicit can represent in a unified manner different garment topologies (e.g. from sleeveless tops to hoodies and to open jackets), while controlling other properties like the garment size or tightness/looseness. We show our model to be applicable to a large variety of garments including T-shirts, hoodies, jackets, shorts, pants, skirts, shoes and even hair. The representation flexibility of SMPLicit builds upon an implicit model conditioned with the SMPL human body parameters and a learnable latent space which is semantically interpretable and aligned with the clothing attributes. The proposed model is fully differentiable, allowing for its use into larger end-to-end trainable systems. In the experimental section, we demonstrate SMPLicit can be readily used for fitting 3D scans and for 3D reconstruction in images of dressed people. In both cases we are able to go beyond state of the art, by retrieving complex garment geometries, handling situations with multiple clothing layers and providing a tool for easy outfit editing. To stimulate further research in this direction, we will make our code and model publicly available at http://www.iri.upc.edu/people/ecorona/smplicit/.Keywords
All Related Versions
Funding Information
- Deutsche Forschungsgemeinschaft
This publication has 54 references indexed in Scilit:
- Active garment recognition and target grasping point detection using deep learningPattern Recognition, 2018
- Unite the People: Closing the Loop Between 3D and 2D Human Representations2017
- Deep Residual Learning for Image Recognition2016
- SMPLACM Transactions on Graphics, 2015
- DynaACM Transactions on Graphics, 2015
- Single-view hair modeling using a hairstyle databaseACM Transactions on Graphics, 2015
- A Layered Model of Human Body and Garment Deformation2014
- DRAPEACM Transactions on Graphics, 2012
- SCAPEACM Transactions on Graphics, 2005
- Marching cubes: A high resolution 3D surface construction algorithmACM SIGGRAPH Computer Graphics, 1987