Learning to Shape by Grinding: Cutting-Surface-Aware Model-Based Reinforcement Learning
- 9 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (10) , 6235-6242
Abstract
Object shaping by grinding is a crucial industrial process in which a rotating grinding belt removes material. Object-shape transition models are essential to achieving automation by robots; however, learning such a complex model that depends on process conditions is challenging because it requires a significant amount of data, and the irreversible nature of the removal process makes data collection expensive. This letter proposes a cutting-surface-aware Model-Based Reinforcement Learning (MBRL) method for robotic grinding. Our method employs a cutting-surface-aware model as the object's shape transition model, which in turn is composed of a geometric cutting model and a cutting-surface-deviation model, based on the assumption that the robot action can specify the cutting surface made by the tool. Furthermore, according to the grinding resistance theory, the cutting-surface-deviation model does not require raw shape information, making the model's dimensions smaller and easier to learn than a naive shape transition model directly mapping the shapes. Through evaluation and comparison by simulation and real robot experiments, we confirm that our MBRL method can achieve high data efficiency for learning object shaping by grinding and also provide generalization capability for initial and target shapes that differ from the training data.Keywords
All Related Versions
Funding Information
- JST-Mirai Program (JPMJMI21B1)
This publication has 16 references indexed in Scilit:
- Learning Rope Manipulation Policies Using Dense Object Descriptors Trained on Synthetic Depth Data2020
- Tethered Tool Manipulation Planning With Cable ManeuveringIEEE Robotics and Automation Letters, 2020
- PyVista: 3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)Journal of Open Source Software, 2019
- Deep reinforcement learning with smooth policy update: Application to robotic cloth manipulationRobotics and Autonomous Systems, 2019
- A Framework for Manipulating Deformable Linear Objects by Coherent Point DriftIEEE Robotics and Automation Letters, 2018
- Robotic manipulation and sensing of deformable objects in domestic and industrial applications: a surveyThe International Journal of Robotics Research, 2018
- Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuning2018
- 3D Math Primer for Graphics and Game Development2011
- Modeling and experimental study of grinding forces in surface grindingJournal of Materials Processing Technology, 2009
- Efficient Training of Artificial Neural Networks for Autonomous NavigationNeural Computation, 1991