Training-Free 3-D Face Avatars Generation by Knowledge Discovering in Foundational Models
- 8 April 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. 12 (6) , 5481-5490
Abstract
An informative 3-D avatar, closely mirroring real-world traits, plays a pivotal role in accessing the metaverse. Traditional methods for creating 3-D avatars usually employ one-to-one training, which restricts avatar diversity. To enhance style diversity in generated 3-D avatars, we utilize synthesized images derived with prompts from ChatGPT in a conversational manner, ultimately resulting in a broader range of 3-D variations. Rather than creating models from scratch, we devise a training-free framework that utilizes established large-scale foundation models. Specifically, we employ a real-world image synthesis technique guided by text prompts that are generated by ChatGPT in a conversational manner, to describe the desired characteristics of the synthesized image. As a result, these informative latent representations can accurately reflect the distinct style of the synthesized image, and further lead to the creation of photorealistic and diverse 3D avatars. Our training-free design allows this proposed method to achieve competitive performance compared to existing generation models, while requiring minimal computational resources.Keywords
This publication has 27 references indexed in Scilit:
- Metaverse in Education: Vision, Opportunities, and Challenges2022
- Meta-learning-based adversarial training for deep 3D face recognition on point cloudsPattern Recognition, 2022
- A review on Single Image Super Resolution techniques using generative adversarial networkOptik, 2022
- High-Resolution Image Synthesis with Latent Diffusion Models2022
- Virtual reality: A survey of enabling technologies and its applications in IoTJournal of Network and Computer Applications, 2021
- NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis2020
- Personal identifiability of user tracking data during observation of 360-degree VR videoScientific Reports, 2020
- MaskGAN: Towards Diverse and Interactive Facial Image Manipulation2020
- Privacy Preserving Utility Mining: A Survey2018
- A content service deployment plan for metaverse museum exhibitions—Centering on the combination of beacons and HMDsInternational Journal of Information Management, 2017