A Virtual Reality Framework for Human-Robot Collaboration in Cloth Folding
Authors:
- Marco MolettaMMMarco Moletta
- Maciej K. WozniakMWMaciej K. Wozniak
- Michael C. WelleMWMichael C. Welle
- Danica KragicDKDanica Kragic
Preprint
Abstract
We present a virtual reality (VR) framework to automate the data collection process in cloth folding tasks. The framework uses skeleton representations to help the user define the folding plans for different classes of garments, allowing for replicating the folding on unseen items of the same class. We evaluate the framework in the context of automating garment folding tasks. A quantitative analysis is performed on 3 classes of garments, demonstrating that the framework reduces the need for intervention by the user. We also compare skeleton representations with RGB and binary images in a classification task on a large dataset of clothing items, motivating the use of the framework for other classes of garments.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- EDO-Net: Learning Elastic Properties of Deformable Objects from Graph Dynamics2023
- Shared-Control Robotic Manipulation in Virtual Reality2022
- Challenges and Outlook in Robotic Manipulation of Deformable ObjectsIEEE Robotics & Automation Magazine, 2022
- VisuoSpatial Foresight for physical sequential fabric manipulationAutonomous Robots, 2021
- Comparing Virtual Reality Interfaces for the Teleoperation of Robots2020
- Virtual reality human-robot collaborative welding: A case study of weaving gas tungsten arc weldingJournal of Manufacturing Processes, 2019
- A framework for augmented reality guidance in industryThe International Journal of Advanced Manufacturing Technology, 2019
- Interactive Robot Programing Using Mixed RealityIFAC-PapersOnLine, 2018
- Repeatable Folding Task by Humanoid Robot Worker Using Deep LearningIEEE Robotics and Automation Letters, 2016
- Building Skeleton Models via 3-D Medial Surface/Axis Thinning AlgorithmsGraphical Models and Image Processing, 1994