Incremental Online Object Learning in a Vehicular Radar-Vision Fusion Framework
Authors:
- 17 December 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 12 (2) , 402-411
Abstract
In this paper, we propose an object learning system that incorporates sensory information from an automotive radar system and a video camera. The radar system provides coarse attention for the focus of visual analysis on relatively small areas within the image plane. The attended visual areas are coded and learned by a three-layer neural network utilizing what is called in-place learning: Each neuron is responsible for the learning of its own processing characteristics within the connected network environment, through inhibitory and excitatory connections with other neurons. The modeled bottom-up, lateral, and top-down connections in the network enable sensory sparse coding, unsupervised learning, and supervised learning to occur concurrently. This paper is applied to learn two types of encountered objects in multiple outdoor driving settings. Cross-validation results show that the overall recognition accuracy is above 95% for the radar-attended window images. In comparison with the uncoded representation and purely unsupervised learning (without top-down connection), the proposed network improves the overall recognition rate by 15.93% and 6.35%, respectively. The proposed system is also compared favorably with other learning algorithms. The result indicates that our learning system is the only one that is fit for incremental and online object learning in a real-time driving environment.Keywords
This publication has 21 references indexed in Scilit:
- VITA II-active collision avoidance in real traffic2005
- Radar and vision data fusion for hybrid adaptive cruise control on highwaysMachine Vision and Applications, 2003
- Advanced lane recognition-fusing vision and radar2002
- An obstacle detection method by fusion of radar and motion stereoIEEE Transactions on Intelligent Transportation Systems, 2002
- EMS-vision: application to hybrid adaptive cruise control2000
- Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesNature, 1996
- Principal components, minor components, and linear neural networksNeural Networks, 1992
- Vision and navigation for the Carnegie-Mellon NavlabIEEE Transactions on Pattern Analysis and Machine Intelligence, 1988
- Relations between the statistics of natural images and the response properties of cortical cellsJournal of the Optical Society of America A, 1987
- Receptive fields of single neurones in the cat's striate cortexThe Journal of Physiology, 1959