Event-Driven Force Measurement of a Variable-Stiffness Robotic Finger Using Masked Autoencoder Pre-Training
- 21 April 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (6) , 5831-5838
Abstract
Force feedback in compliant robotic grippers is essential for precise manipulation tasks but remains challenging because irregular deformation of soft materials renders traditional sensor integration impractical. Event camera has emerged as a powerful alternative to conventional vision sensors through their ability to capture only temporal changes in a scene, thereby significantly reducing data redundancy and processing overhead. In this letter, we introduce a novel vision-based force prediction framework that employs a Mamba-Like architecture to process event camera data in compliant grippers. To validate our approach, we have developed a custom gripper with variable stiffness and created a comprehensive dataset comprising over 9,000 event frames. Our methodology combines self-supervised pre-training for learning rich feature representations with a Mamba-like regression framework to achieve accurate force prediction. The proposed method demonstrates a 0.14 improvement in RMSE when compared to existing Vision Transformer approaches. Through extensive experimental validation—including real-time performance analysis, ablation studies, and generalization tests across various gripper configurations—we demonstrate the framework's effectiveness. Our results indicate robust performance suitable for practical industrial applications, suggesting potential extensions to other compliant robotics applications that require precise force estimation.Keywords
Funding Information
- National Science Foundation (CMMI-2131711)
This publication has 39 references indexed in Scilit:
- VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting2024
- A variable stiffness robotic gripper based on parallel beam with vision-based force sensing for flexible graspingRobotica, 2023
- Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimation2023
- TransFlow: Transformer as Flow Learner2023
- A ConvNet for the 2020s2022
- Masked Autoencoders Are Scalable Vision Learners2022
- A soft thumb-sized vision-based sensor with accurate all-round force perceptionNature Machine Intelligence, 2022
- Model-based 3D Hand Reconstruction via Self-Supervised Learning2021
- Ultra-sensitive and resilient compliant strain gauges for soft machinesNature, 2020
- Monitoring and Control of Manufacturing Processes: A ReviewProcedia CIRP, 2013