A multimodal execution monitor with anomaly classification for robot-assisted feeding
Authors:
- 1 September 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5406-5413
Abstract
Activities of daily living (ADLs) are important for quality of life. Robotic assistance offers the opportunity for people with disabilities to perform ADLs on their own. However, when a complex semi-autonomous system provides real-world assistance, occasional anomalies are likely to occur. Robots that can detect, classify and respond appropriately to common anomalies have the potential to provide more effective and safer assistance. We introduce a multimodal execution monitor to detect and classify anomalous executions when robots operate near humans. Our system builds on our past work on multimodal anomaly detection. Our new monitor classifies the type and cause of common anomalies using an artificial neural network. We implemented and evaluated our execution monitor in the context of robot-assisted feeding with a general-purpose mobile manipulator. In our evaluations, our monitor outperformed baseline methods from the literature. It succeeded in detecting 12 common anomalies from 8 able-bodied participants with 83% accuracy and classifying the types and causes of the detected anomalies with 90% and 81% accuracies, respectively. We then performed an in-home evaluation with Henry Evans, a person with severe quadriplegia. With our system, Henry successfully fed himself while the monitor detected, classified the types, and classified the causes of anomalies with 86%, 90%, and 54% accuracy, respectively.Keywords
This publication has 22 references indexed in Scilit:
- An autonomous robotic assistant for drinking2015
- Tactile sensing over articulated joints with stretchable sensors2013
- Reaching in clutter with whole-arm tactile sensingThe International Journal of Robotics Research, 2013
- Two fault detection and isolation schemes for robot manipulators using soft computing techniquesApplied Soft Computing, 2010
- Anomaly detectionACM Computing Surveys, 2009
- Monitoring the execution of robot plans using semantic knowledgeRobotics and Autonomous Systems, 2008
- Execution monitoring in robotics: A surveyRobotics and Autonomous Systems, 2005
- Supervision, fault-detection and fault-diagnosis methods — An introductionControl Engineering Practice, 1997
- Measuring the Activities of Daily Living: Comparisons Across National SurveysJournal of Gerontology, 1990
- Model for the interaural time differences in the azimuthal planeThe Journal of the Acoustical Society of America, 1977