Deep Visual Perception for Dynamic Walking on Discrete Terrain
Authors:
- Avinash SiravuruASAvinash Siravuru
- Allan WangAWAllan Wang
- Quan NguyenQNQuan Nguyen
- Koushil SreenathKSKoushil Sreenath
Preprint
Abstract
Dynamic bipedal walking on discrete terrain, like stepping stones, is a challenging problem requiring feedback controllers to enforce safety-critical constraints. To enforce such constraints in real-world experiments, fast and accurate perception for foothold detection and estimation is needed. In this work, a deep visual perception model is designed to accurately estimate step length of the next step, which serves as input to the feedback controller to enable vision-in-the-loop dynamic walking on discrete terrain. In particular, a custom convolutional neural network architecture is designed and trained to predict step length to the next foothold using a sampled image preview of the upcoming terrain at foot impact. The visual input is offered only at the beginning of each step and is shown to be sufficient for the job of dynamically stepping onto discrete footholds. Through extensive numerical studies, we show that the robot is able to successfully autonomously walk for over 100 steps without failure on a discrete terrain with footholds randomly positioned within a step length range of 45-85 centimeters.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Domain randomization for transferring deep neural networks from simulation to the real world2017
- The critical phase for visual control of human walking over complex terrainProceedings of the National Academy of Sciences, 2017
- From 2D Design of Underactuated Bipedal Gaits to 3D Implementation: Walking With Speed TrackingIEEE Access, 2016
- Rapidly Exponentially Stabilizing Control Lyapunov Functions and Hybrid Zero DynamicsIEEE Transactions on Automatic Control, 2014
- Performance Analysis and Feedback Control of ATRIAS, A Three-Dimensional Bipedal RobotJournal of Dynamic Systems, Measurement, and Control, 2013
- Humans exploit the biomechanics of bipedal gait during visually guided walking over complex terrainProceedings Of The Royal Society B-Biological Sciences, 2013
- Understanding the roles of vision in the control of human locomotionGait & Posture, 1997