Deep Person Generation: A Survey from the Perspective of Face, Pose, and Cloth Synthesis
Authors:
Open Access
- 28 March 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 55 (12) , 1-37
Abstract
Deep person generation has attracted extensive research attention due to its wide applications in virtual agents, video conferencing, online shopping, and art/movie production. With the advancement of deep learning, visual appearances (face, pose, cloth) of a person image can be easily generated on demand. In this survey, we first summarize the scope of person generation, and then systematically review recent progress and technical trends in identity-preserving deep person generation, covering three major tasks: talking-head generation (face), pose-guided person generation (pose), and garment-oriented person generation (cloth). More than two hundred papers are covered for a thorough overview, and the milestone works are highlighted to witness the major technical breakthrough. Based on these fundamental tasks, many applications are investigated, e.g., virtual fitting, digital human, and generative data augmentation. We hope this survey could shed some light on the future prospects of identity-preserving deep person generation, and provide a helpful foundation for full applications towards the digital human.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62276017, U1636211, 61672081)
- 2022 Tencent Big Travel Rhino-Bird Special Research Program
- Fund of the State Key Laboratory of Software Development Environment (SKLSDE-2021ZX-18)
This publication has 167 references indexed in Scilit:
- MVC2016
- MSP-IMPROV: An Acted Corpus of Dyadic Interactions to Study Emotion PerceptionIEEE Transactions on Affective Computing, 2016
- Human Parsing with Contextualized Convolutional Neural Network2015
- Real-time expression transfer for facial reenactmentACM Transactions on Graphics, 2015
- Photo-real talking head with deep bidirectional LSTM2015
- TCD-TIMIT: An Audio-Visual Corpus of Continuous SpeechIEEE Transactions on Multimedia, 2015
- CREMA-D: Crowd-Sourced Emotional Multimodal Actors DatasetIEEE Transactions on Affective Computing, 2014
- Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural EnvironmentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- An audio-visual corpus for speech perception and automatic speech recognitionThe Journal of the Acoustical Society of America, 2006
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004