Capturing Rich Details of Human Eyes
Open Access
- 9 November 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 45 (6) , 1-16
Abstract
Capturing rich details of human eyes is essential for realistic digital humans, yet remains challenging due to the eye's complex optical structure. The sclera, cornea, and iris exhibit distinct appearance properties, and their geometry and appearance are tightly coupled through reflection and refraction in image observations. We present a human eye capture and reconstruction system based on multi-source optical measurements, which are tailored to different eye components to capture detail-rich observations at multiple scales and provide direct constraints for staged, decoupled reconstruction. For the sclera, multi-view and multi-gaze imaging recovers subject-specific exterior geometry and establishes an eye-centric frame. For the cornea, specular highlights and dense Placido-based topographic cues estimate the anterior surface before it is used as the refractive interface for iris reconstruction. For the iris, refraction-aware photometric reconstruction recovers albedo, normals, and fine-scale displacement under limited viewing angles. Experiments demonstrate detailed reconstruction of scleral shape, corneal topography, and iris micro-geometry across diverse subjects. The reconstructed assets further expose physiology-supported ocular details, including scleral asymmetry, non-axisymmetric corneal shape, iris relief, and pupil-center motion, providing evidence for reconstruction fidelity and useful annotations for downstream rendering, tracking, and data generation. We will release a consented 20-eye reconstructed ocular asset dataset containing component models and textures for all eye components.Keywords
This publication has 42 references indexed in Scilit:
- Accurate eye tracking from dense 3D surface reconstructions using single-shot deflectometryNature Communications, 2025
- A 3D Morphable Eye Region Model for Gaze Estimation2016
- Analysis of iris surface features in populations of diverse ancestryRoyal Society Open Science, 2016
- Eye contact and video-mediated communication: A reviewDisplays, 2013
- Corneal Elevation Topography: Best Fit Sphere, Elevation Distance, Asphericity, Toricity, and Clinical ImplicationsCornea, 2011
- Keratoconus: A reviewContact Lens and Anterior Eye, 2010
- CLMICornea, 2008
- Aberrations induced in wavefront-guided laser refractive surgery due to shifts between natural and dilated pupil center locationsJournal of Cataract & Refractive Surgery, 2006
- Optimal modeling of corneal surfaces with Zernike polynomialsIEEE Transactions on Biomedical Engineering, 2001
- Corneal topographyCurrent Opinion in Ophthalmology, 1997