Reinforcement Learning Approach to Optimizing Profilometric Sensor Trajectories for Surface Inspection
Open Access
Abstract
High-precision surface defect detection in manufacturing often relies on laser triangulation profilometric sensors for detailed surface measurements, providing detailed and accurate surface measurements over a line. Accurate motion between the sensor and workpiece, usually managed by robotic systems, is critical for maintaining optimal distance and orientation. This paper introduces a novel Reinforcement Learning (RL) approach to optimize inspection trajectories for profilometric sensors based on the boustrophedon scanning method. The RL model dynamically adjusts sensor position and tilt to ensure consistent profile distribution and high-quality scanning. We use a simulated environment replicating real-world conditions, including sensor noise and surface irregularities, to plan trajectories offline using CAD models. Key contributions include designing a state space, action space, and reward function tailored for profilometric sensor inspection. The Proximal Policy Optimization (PPO) algorithm trains the RL agent to optimize these trajectories effectively. Validation involves testing the model on various parts in simulation and performing real-world inspection with a UR3e robotic arm, demonstrating the approach’s practicality and effectiveness.Keywords
All Related Versions
Funding Information
- Severo Ochoa Program for predoctoral research and teaching (PA-20-PF-BP19-067)
This publication has 26 references indexed in Scilit:
- Micro-Defect Inspection on Curved Surface Using a 6-DOF Robot Arm with One-Shot BRDF ImagingIFAC-PapersOnLine, 2023
- Simulation of Laser Profilometer Measurements in the Presence of Speckle Using Perlin NoiseSensors, 2023
- A High-Efficient Reinforcement Learning Approach for Dexterous ManipulationBiomimetics, 2023
- A Survey on Deep Reinforcement Learning Algorithms for Robotic ManipulationSensors, 2023
- A Reinforcement Learning Approach to View Planning for Automated Inspection TasksSensors, 2021
- Vision guided robotic inspection for parts in manufacturing and remanufacturing industryJournal of Remanufacturing, 2020
- An Automatic Surface Defect Inspection System for Automobiles Using Machine Vision MethodsSensors, 2019
- 3D Point Cloud Analysis for Detection and Characterization of Defects on Airplane Exterior SurfaceJournal of Nondestructive Evaluation, 2017
- 3D part inspection path planning of a laser scanner with control on the uncertaintyComputer-Aided Design, 2011
- Field and Service Robotics1998