Task-Specific Near-Field Photometric Stereo for Measuring Metal Surface Texture
- 29 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20 (4) , 6019-6029
Abstract
Surface texture measurement helps control the quality of large workpieces produced by machine systems. Current optical measurement methods, e.g., fringe projection profilometry and coherent scanning interferometry, are difficult to perform full-field measurements of microtextures on large-sized surfaces. Photometric stereo could potentially address this challenge; however, machined metal surfaces exhibit highly reflective non-Lambertian reflectance that dramatically decreases its effectiveness. To solve this problem, a task-specific near-field photometric stereo approach is proposed to dramatically enhance the accuracy of the surface normal estimation on machined metal surfaces. First, a near-field photometric stereo network is designed for efficient industrial applications, which fully employs the pixelwise information under a small number of lights to achieve surface normal estimation. Then, a task-specific training strategy is proposed to train the proposed network, where a task-specific real dataset is established for each specific combination of material and machine processing to optimize the network parameters initially trained by a synthetic dataset. Experiments on synthetic sinusoidal surfaces and real machined surfaces validated the superiority of the proposed method for metal reflectance compared with the state-of-the-art photometric stereo methods and the sub/micrometer-level sensitivity to surface height variations. Two case studies on tool marks on a large freeform surface and defects on a stamping surface are presented, demonstrating their potential for industrial applications.Keywords
Funding Information
- National Key Research and Development Program of China (2019YFA0706701)
- National Natural Science Foundation of China (52175477, U22A20176, 91948301)
This publication has 28 references indexed in Scilit:
- Prediction of the Posture-Dependent Tool Tip Dynamics in Robotic Milling Based on Multi-Task Gaussian Process RegressionsRobotics and Computer-Integrated Manufacturing, 2022
- DiLiGenT102: A Photometric Stereo Benchmark Dataset with Controlled Shape and Material Variation2022
- SPLINE-Net: Sparse Photometric Stereo Through Lighting Interpolation and Normal Estimation Networks2019
- Learning to Minify Photometric Stereo2019
- Model-driven photometric stereo for in-process inspection of non-diffuse curved surfacesCIRP Annals, 2019
- CNN-PS: CNN-Based Photometric Stereo for General Non-convex Surfaces2018
- PS-FCN: A Flexible Learning Framework for Photometric Stereo2018
- LED-Based Photometric Stereo: Modeling, Calibration and Numerical SolutionJournal of Mathematical Imaging and Vision, 2017
- Vision-based system for chatter identification and process optimization in high-speed millingThe International Journal of Advanced Manufacturing Technology, 2016
- On-machine tool prediction of flank wear from machined surface images using texture analyses and support vector regressionPrecision Engineering, 2016