Geometry-Aware Foundation Makeup Simulation Using Radiative Transfer Models
Open Access
- 16 June 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Abstract
This research details a simulation pipeline methodology for applying a physics-based foundation simulation pipeline that leverages both full-spectrum Kubelka–Munk theory and the four-flux radiative transfer model. Unlike traditional alpha-blending, image-processing techniques, or contemporary deep learning methods such as GAN-based makeup transfer and neural style transfer, this approach simulates the actual physical light transport within a translucent cosmetic layer applied to human skin. While generative AI models often provide visually plausible results, they frequently lack physical consistency, fail to satisfy optical energy conservation (light transport) constraints, and cannot accurately account for complex 3D lighting interactions. By operating in a physically linear color space and reconstructing full-wavelength spectral reflectances from RGB data, this system ensures rigorous color accuracy and robustness under varying environmental lighting. This work focuses on the cohesive system-level synthesis of these physics-based components and provides a comparative empirical evaluation under professional DSLR and consumer mobile imaging environments. This provides a practical end-to-end pipeline that achieves physically consistent virtual try-on while remaining grounded in optical physics.Keywords
This publication has 13 references indexed in Scilit:
- EleGANt: Exquisite and Locally Editable GAN for Makeup Transfer2022
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric2018
- First-person pose recognition using egocentric workspaces2015
- Physically-based cosmetic rendering2013
- A Color Management Process for Real Time Color Reconstruction of Multispectral ImagesLecture Notes in Computer Science, 2009
- Analysis of human faces using a measurement-based skin reflectance modelACM Transactions on Graphics, 2006
- Characteristic spectra of Munsell colorsJournal of the Optical Society of America A, 1989
- Color constancy: a method for recovering surface spectral reflectanceJournal of the Optical Society of America A, 1986
- Four-flux models to solve the scattering transfer equation in terms of Lorenz-Mie parametersApplied Optics, 1984
- Calculation of the Color of Pigmented Plastics*Journal of the Optical Society of America, 1942