Monocular Depth Estimation of Noncooperative Spacecraft Based on Deep Learning
- 1 June 2023
- journal article
- research article
- Published by American Institute of Aeronautics and Astronautics (AIAA) in Journal of Aerospace Information Systems
- Vol. 20 (6) , 334-342
Abstract
Estimating position and stereographic geometry information of noncooperative spacecraft through three-dimensional (3-D) reconstruction techniques is of great significance. Depth information acquisition is an important component of 3-D reconstruction. Monocular cameras are cheaper and more widely used than depth sensors. The relative positions of noncooperative spacecraft and our spacecraft can be calculated from depth maps of monocular depth estimation and the camera parameters, providing data support for subsequent tracking and capture missions. This paper proposes a monocular depth estimation network combining the convolutional neural network (CNN) and a vision transformer (VIT) to improve the prediction accuracy of few-shot samples. We extract detail features and global features from the CNN and VIT encoders, respectively, and then fuse deep features and shallow features by a skip-connected upsampling decoder. Compared with the representative depth estimation algorithms in recent years on the NYU-Depth V2 dataset, the proposed network structure combines the advantages of the CNN and VIT as well as estimates the global depth of the scene more accurately while maintaining details. To solve the lack of spacecraft data collection, a new dataset is made from 3-D simulation models. Experiments on the self-made dataset demonstrate the feasibility of this method in aerospace engineering.Keywords
Funding Information
- National Natural Science Foundation of China (No. 62001035)
- RD Program of Beijing Municipal Education Commission (No. KM202111232018)
- Key Research Training Project of Beijing Information Science and Technology University (No. 2021YJPY216)
This publication has 19 references indexed in Scilit:
- Monocular Visual-Inertial Sensing of Unknown Rotating Objects: Observability Analyses and Case Study for Metric 3D Reconstructing of Space DebrisIEEE Robotics and Automation Letters, 2022
- Autonomous measurement and semantic segmentation of non-cooperative targets with deep convolutional neural networksJournal of Ambient Intelligence and Humanized Computing, 2022
- Monocular Depth Estimation Using Laplacian Pyramid-Based Depth ResidualsIEEE Transactions on Circuits and Systems for Video Technology, 2021
- Vision based reconstruction and pose estimation for spacecraft with axisymmetric structureOptik, 2020
- A new pose estimation method for non-cooperative spacecraft based on point cloudInternational Journal of Intelligent Computing and Cybernetics, 2019
- An Efficient Pose Measurement Method of a Space Non-Cooperative Target Based on Stereo VisionIEEE Access, 2017
- Non-cooperative spacecraft pose tracking based on point cloud featureActa Astronautica, 2017
- Unsupervised Learning of Depth and Ego-Motion from Video2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004