Local N-ary Patterns: a local multi-modal descriptor for place categorization
- 11 January 2016
- journal article
- Published by Taylor & Francis in Advanced Robotics
- Vol. 30 (6) , 402-415
Abstract
This paper presents an effective integration method of multiple modalities such as depth, color, and reflectance for place categorization. To achieve better performance with integrated multi-modalities, we introduce a novel descriptor, local N-ary patterns (LTP), which can perform robust discrimination of place categorization. In this paper, the LNP descriptor is applied to a combination of two modalities, i.e. depth and reflectance, provided by a laser range finder. However, the LNP descriptor can be easily extended to a larger number of modalities. The proposed LNP describes relationships between the multi-modal values of pixels and their neighboring pixels. Since we consider the multi-modal relationship, our proposed method clearly demonstrates more effective classification results than using individual modalities. We carried out experiments with the Kyushu University Indoor Semantic Place Dataset, which is publicly available. This data-set is composed of five indoor categories: corridors, kitchens, laboratories, study rooms, and offices. We confirmed that our proposed method outperforms previous uni-modal descriptors. Graphical AbstractKeywords
This publication has 16 references indexed in Scilit:
- Categorization of indoor places by combining local binary pattern histograms of range and reflectance data from laser range findersAdvanced Robotics, 2013
- Categorization of Indoor Places Using the Kinect SensorSensors, 2012
- Histogram of Oriented Uniform Patterns for robust place recognition and categorizationThe International Journal of Robotics Research, 2012
- CENTRIST: A Visual Descriptor for Scene CategorizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- Conceptual spatial representations for indoor mobile robotsRobotics and Autonomous Systems, 2008
- Efficient exploration of unknown indoor environments using a team of mobile robotsAnnals of Mathematics and Artificial Intelligence, 2008
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Modeling the Shape of the Scene: A Holistic Representation of the Spatial EnvelopeInternational Journal of Computer Vision, 2001
- The Spatial Semantic HierarchyArtificial Intelligence, 2000
- Processing of laser scanner data—algorithms and applicationsISPRS Journal of Photogrammetry and Remote Sensing, 1999