Real-time monocular depth estimation on embedded devices: challenges and performances in terrestrial and underwater scenarios
Authors:
- 3 October 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 50-55
Abstract
Ahstract―The knowledge of the environmental depth is essen-tial in multiple robotics and computer vision tasks for both ter-restrial and underwater scenarios. Recent works aim at enabling depth perception using single RGB images on deep architectures, such as convolutional neural networks and vision transformers, which are generally unsuitable for real-time inference on low-power embedded hardwares. Moreover, such architectures are trained to estimate depth maps mainly on terrestrial scenarios, due to the scarcity of underwater depth data. Purposely, we present two lightweight architectures based on optimized Mo-bileN etV3 encoders an a specifically designed decoder to achieve fast inferences and accurate estimations over embedded devices, and a feasibility study to predict depth maps over underwater scenarios. Precisely, we propose the MobileNetV3s 75 configuration to infer on the 32-bit ARM CPU and the MobileNetV3 LMin for the 8-bit Edge TPU hardwares. In underwater settings, the proposed design achieves comparable estimations with fast inference performances compared to state of the art methods. The proposed architectures would be considered a promising approach for real-time monocular depth estimation with the aim of improving the environment perception for underwater drones, lightweight robots and internet-of-things.Keywords
This publication has 12 references indexed in Scilit:
- Deep Joint Depth Estimation and Color Correction From Monocular Underwater Images Based on Unsupervised Adaptation NetworksIEEE Transactions on Circuits and Systems for Video Technology, 2019
- Searching for MobileNetV32019
- Unsupervised Single Image Underwater Depth Estimation2019
- FastDepth: Fast Monocular Depth Estimation on Embedded Systems2019
- CReaM: Condensed Real-time Models for Depth Prediction using Convolutional Neural Networks2018
- Underwater Image Restoration Based on Image Blurriness and Light AbsorptionIEEE Transactions on Image Processing, 2017
- Underwater Depth Estimation and Image Restoration Based on Single ImagesIEEE Computer Graphics and Applications, 2016
- Single underwater image enhancement using depth estimation based on blurriness2015
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- ImageNet: A large-scale hierarchical image database2009