Rishi Ramakrishnan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Rishi Ramakrishnan has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
Juan Nieto
University of Sydney, Australia
3 shared publicationsSteve Scheding
University of Sydney, Australia
2 shared publicationsAnna Chlingaryan
Australian Centre for Field Robotics, The University of Sydney, Sydney, NSW, Australia
1 shared publicationArman Melkumyan
Australian Centre for Field Robotics, The University of Sydney, Sydney, NSW, Australia
1 shared publication- Craig Jin
The University of Sydney
1 shared publication Eric L. Ferguson
Australian Centre for Field Robotics, The University of Sydney, Australia
1 shared publication
Latest Publications
- 3 January 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 56 (5) , 2798-2810
Pretraining for Hyperspectral Convolutional Neural Network Classification
Convolutional neural networks (CNNs) have been shown to be a powerful tool for image classification. Recently, they have been adopted into the remote sensing community with applications in material classification from hyperspectral images. However, CNNs are time-consuming to train and often require large amounts of labeled training data. The widespread use of CNNs in the image processing and computer vision communities has been facilitated by the networks that have already been trained on large amounts of data. These pretrained networks can be used to initialize networks for new tasks. This transfer of knowledge makes it far less time-consuming to train a new classifier and reduces the need for a large labeled data set. This concept of transfer learning has not yet been fully explored by those using CNNs to train material classifiers from hyperspectral data. This paper provides an insight into training hyperspectral CNN classifiers by transferring knowledge from well labeled data sets to data sets that are less well labeled. It is shown that these CNNs can transfer between completely different domains and sensing platforms, and still improve classification performance. The application of this work is in the training of material classifiers of data acquired from field-based platforms, by transferring knowledge from publicly accessible airborne data sets. Factors, such as training set size, CNN architectures, and the impact of filter width and wavelength interval, are studied.
- 3 January 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 56 (5) , 2798-2810
Pretraining for Hyperspectral Convolutional Neural Network Classification
Convolutional neural networks (CNNs) have been shown to be a powerful tool for image classification. Recently, they have been adopted into the remote sensing community with applications in material classification from hyperspectral images. However, CNNs are time-consuming to train and often require large amounts of labeled training data. The widespread use of CNNs in the image processing and computer vision communities has been facilitated by the networks that have already been trained on large amounts of data. These pretrained networks can be used to initialize networks for new tasks. This transfer of knowledge makes it far less time-consuming to train a new classifier and reduces the need for a large labeled data set. This concept of transfer learning has not yet been fully explored by those using CNNs to train material classifiers from hyperspectral data. This paper provides an insight into training hyperspectral CNN classifiers by transferring knowledge from well labeled data sets to data sets that are less well labeled. It is shown that these CNNs can transfer between completely different domains and sensing platforms, and still improve classification performance. The application of this work is in the training of material classifiers of data acquired from field-based platforms, by transferring knowledge from publicly accessible airborne data sets. Factors, such as training set size, CNN architectures, and the impact of filter width and wavelength interval, are studied.
- 1 March 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2657-2661
Convolutional neural networks for passive monitoring of a shallow water environment using a single sensor
A cost effective approach to remote monitoring of protected areas such as marine reserves and restricted naval waters is to use passive sonar to detect, classify, localize, and track marine vessel activity (including small boats and autonomous underwater vehicles). Cepstral analysis of underwater acoustic data enables the time delay between the direct path arrival and the first multipath arrival to be measured, which in turn enables estimation of the instantaneous range of the source (a small boat). However, this conventional method is limited to ranges where the Lloyd's mirror effect (interference pattern formed between the direct and first multipath arrivals) is discernible. This paper proposes the use of convolutional neural networks (CNNs) for the joint detection and ranging of broadband acoustic noise sources such as marine vessels in conjunction with a data augmentation approach for improving network performance in varied signal-to-noise ratio (SNR) situations. Performance is compared with a conventional passive sonar ranging method for monitoring marine vessel activity using real data from a single hydrophone mounted above the sea floor. It is shown that CNNs operating on cepstrum data are able to detect the presence and estimate the range of transiting vessels at greater distances than the conventional method.
- 1 March 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2657-2661
Convolutional neural networks for passive monitoring of a shallow water environment using a single sensor
A cost effective approach to remote monitoring of protected areas such as marine reserves and restricted naval waters is to use passive sonar to detect, classify, localize, and track marine vessel activity (including small boats and autonomous underwater vehicles). Cepstral analysis of underwater acoustic data enables the time delay between the direct path arrival and the first multipath arrival to be measured, which in turn enables estimation of the instantaneous range of the source (a small boat). However, this conventional method is limited to ranges where the Lloyd's mirror effect (interference pattern formed between the direct and first multipath arrivals) is discernible. This paper proposes the use of convolutional neural networks (CNNs) for the joint detection and ranging of broadband acoustic noise sources such as marine vessels in conjunction with a data augmentation approach for improving network performance in varied signal-to-noise ratio (SNR) situations. Performance is compared with a conventional passive sonar ranging method for monitoring marine vessel activity using real data from a single hydrophone mounted above the sea floor. It is shown that CNNs operating on cepstrum data are able to detect the presence and estimate the range of transiting vessels at greater distances than the conventional method.
- 1 May 2015
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 4835-4842
Shadow compensation for outdoor perception
Outdoor robotic systems rely on perception modules that must be robust to variations in environmental conditions. In particular, vision-based perception systems are affected by illumination variations caused by occlusions. We propose an approach to calculate the lighting distribution of outdoor scenes. The new approach enables us to compensate for shadows and therefore obtain images which are invariant to the sun position and scene geometry, while also retaining the dimensionality of the original data. The method combines images with geometric information provided by range sensors to infer shadows. We select a pair of points on a shadow boundary from a single material and estimate a terrestrial sunlight-skylight ratio. Individual scaling factors are then calculated for all points based on their orientation and incident illumination sources. The result is a coloured point cloud that is independent of illumination variation due to occlusions and geometry. To demonstrate the effectiveness and generalisation of the approach, we present evaluations using two datasets with different cameras. The first uses a hyperspectral sensor that allows us to analyse the results for a large number of wavelengths, while the second dataset uses a standard RGB camera. The approach is shown to consistently provide good illumination compensation in both scenarios.
- 1 May 2015
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 4835-4842
Shadow compensation for outdoor perception
Outdoor robotic systems rely on perception modules that must be robust to variations in environmental conditions. In particular, vision-based perception systems are affected by illumination variations caused by occlusions. We propose an approach to calculate the lighting distribution of outdoor scenes. The new approach enables us to compensate for shadows and therefore obtain images which are invariant to the sun position and scene geometry, while also retaining the dimensionality of the original data. The method combines images with geometric information provided by range sensors to infer shadows. We select a pair of points on a shadow boundary from a single material and estimate a terrestrial sunlight-skylight ratio. Individual scaling factors are then calculated for all points based on their orientation and incident illumination sources. The result is a coloured point cloud that is independent of illumination variation due to occlusions and geometry. To demonstrate the effectiveness and generalisation of the approach, we present evaluations using two datasets with different cameras. The first uses a hyperspectral sensor that allows us to analyse the results for a large number of wavelengths, while the second dataset uses a standard RGB camera. The approach is shown to consistently provide good illumination compensation in both scenarios.
- 1 December 2013
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 907-914
Verification of Sky Models for Image Calibration
Perception systems operating in outdoor scenarios face challenges due to the high dynamic range of the image, as different regions are illuminated by varying amounts of sunlight and skylight. A pre-processing step like image calibration can be used to convert the pixel values to an illumination independent domain such as reflectance. Each pixel is therefore represented by a characteristic material description, instead of an illumination and viewpoint dependent pixel colour. This assists object identification, segmentation and classification algorithms. This paper investigates modelling the sky colour through a number of parametric approaches typically used in the computer graphics community for rendering purposes, namely those developed by Preetham and Hosek-Wilkie. The models are compared in terms of chromaticity with observations taken from a camera and are used to develop an environment map for the application of inverse reflectometry of diffuse objects in an outdoor environment. This is of particular importance for applications involving imaging objects whose primary illumination source is skylight. It was found that the Hosek-Wilkie model produced more robust estimations and was less sensitive to changes in azimuth, while both models had similar reconstruction results with angular errors of approximately 0.15 radians.
- 1 December 2013
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 907-914
Verification of Sky Models for Image Calibration
Perception systems operating in outdoor scenarios face challenges due to the high dynamic range of the image, as different regions are illuminated by varying amounts of sunlight and skylight. A pre-processing step like image calibration can be used to convert the pixel values to an illumination independent domain such as reflectance. Each pixel is therefore represented by a characteristic material description, instead of an illumination and viewpoint dependent pixel colour. This assists object identification, segmentation and classification algorithms. This paper investigates modelling the sky colour through a number of parametric approaches typically used in the computer graphics community for rendering purposes, namely those developed by Preetham and Hosek-Wilkie. The models are compared in terms of chromaticity with observations taken from a camera and are used to develop an environment map for the application of inverse reflectometry of diffuse objects in an outdoor environment. This is of particular importance for applications involving imaging objects whose primary illumination source is skylight. It was found that the Hosek-Wilkie model produced more robust estimations and was less sensitive to changes in azimuth, while both models had similar reconstruction results with angular errors of approximately 0.15 radians.
- 1 July 2013
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 37 (21536996) , 1210-1213
Combining strong features for registration of hyperspectral and lidar data from field-based platforms
This paper presents an approach to automatically register hyperspectral images with lidar point clouds using a combination of SIFT and SURF feature descriptors. The aim is to generate 3D terrain maps of the environment combining spectral and geometrical information. The datasets are acquired from field-based platforms which, due to the lack of georeferencing, cannot be simply fused and require a registration processing step. In addition, some applications, such as in mining, cannot rely on reliable GPS signal. The proposed method is validated using experimental data acquired from vertical mine walls.
- 1 July 2013
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 37 (21536996) , 1210-1213
Combining strong features for registration of hyperspectral and lidar data from field-based platforms
This paper presents an approach to automatically register hyperspectral images with lidar point clouds using a combination of SIFT and SURF feature descriptors. The aim is to generate 3D terrain maps of the environment combining spectral and geometrical information. The datasets are acquired from field-based platforms which, due to the lack of georeferencing, cannot be simply fused and require a registration processing step. In addition, some applications, such as in mining, cannot rely on reliable GPS signal. The proposed method is validated using experimental data acquired from vertical mine walls.