Deep Learning-based Single-Shot Composite Fringe Projection Profilometry with Pixel-Wise Uncertainty Quantification
Preprint
Abstract
Driven by the growing demand for high-speed 3D measurement in advanced manufacturing, optical metrology algorithms must deliver high accuracy and robustness under dynamic conditions. Fringe projection profilometry (FPP) offers high precision, yet the 2pi ambiguity of the wrapped phase means that conventional absolute phase recovery typically relies on multiple coded patterns, sacrificing temporal resolution. Deep learning-based composite FPP (CFPP) shows promise for single-shot phase recovery from a composite fringe, but limited interpretability makes it difficult to assess reconstruction reliability or trace error sources in the absence of ground truth. To address this, we propose HSURE-CFPP (Heteroscedastic Snapshot-ensemble Uncertainty-aware Ratio Estimation for CFPP). HSURE-CFPP predicts the numerator-denominator ratio used for wrapped-phase computation with a heteroscedastic snapshot-ensemble network, enabling ultra-fast 3D imaging from a single composite fringe and producing pixel-wise uncertainty maps for confidence assessment and unreliable-region identification. Specifically, a heteroscedastic likelihood jointly estimates pixel-wise noise variance to capture data uncertainty, while a snapshot ensemble quantifies model uncertainty via dispersion across snapshots, yielding total predictive uncertainty as an interpretable reliability measure. Experiments on static and dynamic scenes demonstrate that HSURE-CFPP achieves high-accuracy reconstruction at high speed and that the predicted uncertainty correlates well with reconstruction errors, providing a deployable quality-assessment mechanism for deep-learning-based FPP.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Deep-learning-enabled single-shot high-frequency color fringe projection profilometry based on dual inner shifting-phase methodMeasurement, 2024
- Deep learning-based frequency-multiplexing composite-fringe projection profilometry technique for one-shot 3D shape measurementMeasurement, 2024
- Deep learning-based binocular composite color fringe projection profilometry for fast 3D measurementsOptics and Lasers in Engineering, 2023
- Dropout vs. batch normalization: an empirical study of their impact to deep learningMultimedia Tools and Applications, 2020
- Phase shifting algorithms for fringe projection profilometry: A reviewOptics and Lasers in Engineering, 2018
- Absolute phase retrieval methods for digital fringe projection profilometry: A reviewOptics and Lasers in Engineering, 2018
- In situ surface topography of laser powder bed fusion using fringe projectionAdditive Manufacturing, 2016
- Temporal phase unwrapping algorithms for fringe projection profilometry: A comparative reviewOptics and Lasers in Engineering, 2016
- A state of the art in structured light patterns for surface profilometryPattern Recognition, 2010
- Fourier transform profilometry based on composite structured light patternOptics & Laser Technology, 2007