Kunlin Liu
Research Subjects
Kunlin Liu has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Hao Tang
Peking University, Beijing, China
1 shared publication - Nenghai Yu
University of Science and Technology of China, Hefei, China
1 shared publication - Weiming Zhang
University of Science and Technology of China, Hefei, China
1 shared publication - Wenbo Zhou
School of Cyber Science and Technology, University of Science and Technology of China, China
1 shared publication - Xuehai Zhang
Department of Cyber Science and Technology, University of Science and Technology of China, Hefei 230026, China
1 shared publication - Zhenyu Zhang
Nanjing University
1 shared publication
Latest Publications
- Open Access
- 1 December 2023
- Published by MDPI AG in Preprints.org
ControlFace: Feature Disentangling for Controllable Face Swapping
Face swapping is an intriguing and intricate task in the field of computer vision. Currently, most mainstream face swapping methods employ face recognition models to extract identity features and inject them into the generation process. Nonetheless, such methods often struggle to effectively transfer identity information, result in generated results failing to achieve a high identity similarity with the source face. Furthermore, if we can accurately disentangle identity information, we can achieve controllable face swapping, thereby providing more choices to users. In pursuit of this goal, we propose a new face swapping framework (ControlFace) based on the disentanglement of identity information. We disentangle the structure and texture of the source face, encoding and characterizing them in the form of feature embeddings separately. According to the semantic level of each feature representation, we inject them into the corresponding feature mapper and fuse them adequately in the latent space of StyleGAN. Owing to such disentanglement of structure and texture, we are able to controllablely transfer parts of the identity features. Extensive experiments and comparisons with state-of-the-art face swapping methods demonstrate the superiority of our face swapping framework in terms of transferring identity information, producing high-quality face images and controllable face swapping.
- 1 December 2023
- Published by MDPI AG in Preprints.org
Open AccessControlFace: Feature Disentangling for Controllable Face Swapping
Face swapping is an intriguing and intricate task in the field of computer vision. Currently, most mainstream face swapping methods employ face recognition models to extract identity features and inject them into the generation process. Nonetheless, such methods often struggle to effectively transfer identity information, result in generated results failing to achieve a high identity similarity with the source face. Furthermore, if we can accurately disentangle identity information, we can achieve controllable face swapping, thereby providing more choices to users. In pursuit of this goal, we propose a new face swapping framework (ControlFace) based on the disentanglement of identity information. We disentangle the structure and texture of the source face, encoding and characterizing them in the form of feature embeddings separately. According to the semantic level of each feature representation, we inject them into the corresponding feature mapper and fuse them adequately in the latent space of StyleGAN. Owing to such disentanglement of structure and texture, we are able to controllablely transfer parts of the identity features. Extensive experiments and comparisons with state-of-the-art face swapping methods demonstrate the superiority of our face swapping framework in terms of transferring identity information, producing high-quality face images and controllable face swapping.