Symmetric Models for Visual Force Policy Learning
Authors:
- 13 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3101-3107
Abstract
While it is generally acknowledged that force feedback is beneficial to robotic control, applications of policy learning to robotic manipulation typically only leverage visual feedback. Recently, symmetric neural models have been used to significantly improve the sample efficiency and performance of policy learning across a variety of robotic manipulation domains. This paper explores an application of symmetric policy learning to visual-force problems. We present Symmetric Visual Force Learning (SVFL), a novel method for robotic control which leverages visual and force feedback. We demonstrate that SVFL can significantly outperform state of the art baselines for visual force learning and report several interesting empirical findings related to the utility of learning force feedback control policies in both general manipulation tasks and scenarios with low visual acuity.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- BulletArm: An Open-Source Robotic Manipulation Benchmark and Learning Framework2023
- Visual Foresight with a Local Dynamics Model2023
- Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulation2022
- Lifelong Visual-Tactile Cross-Modal Learning for Robotic Material PerceptionIEEE Transactions on Neural Networks and Learning Systems, 2020
- Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich TasksIEEE Transactions on Robotics, 2020
- Connecting Touch and Vision via Cross-Modal Prediction2019
- See, feel, act: Hierarchical learning for complex manipulation skills with multisensory fusionScience Robotics, 2019
- MuJoCo: A physics engine for model-based control2012
- Learning force control policies for compliant manipulation2011
- Historical Perspective and State of the Art in Robot Force ControlThe International Journal of Robotics Research, 1987