Soft Robot Configuration Estimation and Control Using Simultaneous Localization and Mapping
Authors:
- Christian SorensenCSChristian Sorensen
- Phillip HyattPHPhillip Hyatt
- Matthew RicksMRMatthew Ricks
- Seth NielsenSNSeth Nielsen
- Marc D. KillpackMKMarc D. Killpack
- 27 September 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 616-623
Abstract
In this paper we present a novel approach to accomplishing soft robot configuration estimation and control using RGB-D cameras and SLAM-based methods. By placing cameras on the unactuated sections of our large-scale (approximately 2 meters long) pneumatic soft robot, we can map an environment and then estimate the orientation of the robot links using landmark-based localization. Using the orientations of each camera we can solve for the joint configurations between them. We first show that this method works for a traditional rigid robot (Baxter) where we can compare against the ground truth encoder values. For Baxter, the median joint angle error was on the order of 1-2 ◦ . We then show that the SLAM-based method provides estimates for soft robot configuration that are within 1 ◦ when compared to our past methods of using a HTC Vive Tracker. While HTC Vive Trackers and commonly used motion capture systems require externally mounted sensors placed in the robot’s environment, the SLAM-based estimation method presented here works in any visually feature-rich environment. Finally we show that this method of estimation is effective for closed-loop control of soft robots by controlling our large-scale soft robot through a series of joint configurations.Keywords
Funding Information
- National Science Foundation
This publication has 28 references indexed in Scilit:
- Design and experiments on an inflatable link robot with a built-in vision sensorMechatronics, 2020
- An inductance-based sensing system for bellows-driven continuum joints in soft robotsAutonomous Robots, 2018
- Fabric sensory sleeves for soft robot state estimation2017
- Multi-objective design optimization of a soft, pneumatic robot2017
- Sensing the motion of bellows through changes in mutual inductance2016
- Articulated Robot Motion for Simultaneous Localization and Mapping (ARM-SLAM)IEEE Robotics and Automation Letters, 2016
- Data-Driven Bending Angle Prediction of Soft Pneumatic Actuators with Embedded Flex SensorsIFAC-PapersOnLine, 2016
- TRAC-IK: An open-source library for improved solving of generic inverse kinematics2015
- State estimation and tracking of deforming planar elastic rods2014
- Contactless deflection sensor for soft robots2011