Learning Multi-View Representation With LSTM for 3-D Shape Recognition and Retrieval
- 12 October 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 21 (5) , 1169-1182
Abstract
Shape representation for 3D models is an impor- tant topic in computer vision, multimedia analysis and com- puter graphics. Recent multi-view based methods demonstrate promising performance for 3D shape recognition and retrieval. However, most multi-view based methods ignore the correlations of multiple views or suffer from high computional cost. In this paper, we propose a novel multi-view based network architecture for 3D shape recognition and retrieval. Our network combines Convolutional Neural Networks (CNN) with Long Short Term Memory (LSTM) to exploit the correlative information from multiple views. Well-pretrained CNNs with residual connections are first used to extract low-level feature of each view image rendered from a 3D shape. Then, LSTM and a sequence voting layer are employed to aggregate these features into a shape descriptor. Highway network and a three-step training strategy are also adopted to boost the optimization of the deep network. Experimental results on two public datasets demonstrate that the proposed method achieves promising performance for 3D shape recognition and the state-of-the-art performance for 3D shape retrieval.Keywords
Funding Information
- National Natural Science Foundation of China (61602499, 61471371, 61401474)
- Hunan Provincial Natural Science Foundation (2016JJ3025)
- National Postdoctoral Program for Innovative Talents (BX201600172)
- China Postdoctoral Science Foundation
- Fundamental Research Funds for the Central Universities
This publication has 36 references indexed in Scilit:
- Covariance-Based Descriptors for Efficient 3D Shape Matching, Retrieval, and ClassificationIEEE Transactions on Multimedia, 2015
- A novel local surface feature for 3D object recognition under clutter and occlusionInformation Sciences, 2015
- Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and RecognitionIEEE Transactions on Multimedia, 2014
- 3D Object Recognition in Cluttered Scenes with Local Surface Features: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Rotational Projection Statistics for 3D Local Surface Description and Object RecognitionInternational Journal of Computer Vision, 2013
- Real-time Object Recognition in Sparse Range Images Using Error Surface EmbeddingInternational Journal of Computer Vision, 2009
- A Concise and Provably Informative Multi‐Scale Signature Based on Heat DiffusionComputer Graphics Forum, 2009
- On Visual Similarity Based 3D Model RetrievalComputer Graphics Forum, 2003
- Description of shape information for 2-D and 3-D objectsSignal Processing: Image Communication, 2000
- Long Short-Term MemoryNeural Computation, 1997