RRRishi Ramakrishnan

Rishi Ramakrishnan

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Rishi Ramakrishnan has a total of 12 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Pretraining for Hyperspectral Convolutional Neural Network Classification

    by Lloyd Windrim, Arman Melkumyan, Richard J. Murphy, Anna Chlingaryan, Rishi Ramakrishnan

    Convolutional neural networks (CNNs) have been shown to be a powerful tool for image classification. Recently, they have been adopted into the remote sensing community with applications in material classification from hyperspectral images. However, CNNs are time-consuming to train and often require large amounts of labeled training data. The widespread use of CNNs in the image processing and computer vision communities has been facilitated by the networks that have already been trained on large amounts of data. These pretrained networks can be used to initialize networks for new tasks. This transfer of knowledge makes it far less time-consuming to train a new classifier and reduces the need for a large labeled data set. This concept of transfer learning has not yet been fully explored by those using CNNs to train material classifiers from hyperspectral data. This paper provides an insight into training hyperspectral CNN classifiers by transferring knowledge from well labeled data sets to data sets that are less well labeled. It is shown that these CNNs can transfer between completely different domains and sensing platforms, and still improve classification performance. The application of this work is in the training of material classifiers of data acquired from field-based platforms, by transferring knowledge from publicly accessible airborne data sets. Factors, such as training set size, CNN architectures, and the impact of filter width and wavelength interval, are studied.


  • Convolutional neural networks for passive monitoring of a shallow water environment using a single sensor

    by Eric L. Ferguson, Rishi Ramakrishnan, Stefan B. Williams, Craig T. Jin

    A cost effective approach to remote monitoring of protected areas such as marine reserves and restricted naval waters is to use passive sonar to detect, classify, localize, and track marine vessel activity (including small boats and autonomous underwater vehicles). Cepstral analysis of underwater acoustic data enables the time delay between the direct path arrival and the first multipath arrival to be measured, which in turn enables estimation of the instantaneous range of the source (a small boat). However, this conventional method is limited to ranges where the Lloyd's mirror effect (interference pattern formed between the direct and first multipath arrivals) is discernible. This paper proposes the use of convolutional neural networks (CNNs) for the joint detection and ranging of broadband acoustic noise sources such as marine vessels in conjunction with a data augmentation approach for improving network performance in varied signal-to-noise ratio (SNR) situations. Performance is compared with a conventional passive sonar ranging method for monitoring marine vessel activity using real data from a single hydrophone mounted above the sea floor. It is shown that CNNs operating on cepstrum data are able to detect the presence and estimate the range of transiting vessels at greater distances than the conventional method.


  • Shadow compensation for outdoor perception

    by Rishi Ramakrishnan, Juan Nieto, Steve Scheding

    Outdoor robotic systems rely on perception modules that must be robust to variations in environmental conditions. In particular, vision-based perception systems are affected by illumination variations caused by occlusions. We propose an approach to calculate the lighting distribution of outdoor scenes. The new approach enables us to compensate for shadows and therefore obtain images which are invariant to the sun position and scene geometry, while also retaining the dimensionality of the original data. The method combines images with geometric information provided by range sensors to infer shadows. We select a pair of points on a shadow boundary from a single material and estimate a terrestrial sunlight-skylight ratio. Individual scaling factors are then calculated for all points based on their orientation and incident illumination sources. The result is a coloured point cloud that is independent of illumination variation due to occlusions and geometry. To demonstrate the effectiveness and generalisation of the approach, we present evaluations using two datasets with different cameras. The first uses a hyperspectral sensor that allows us to analyse the results for a large number of wavelengths, while the second dataset uses a standard RGB camera. The approach is shown to consistently provide good illumination compensation in both scenarios.


  • Verification of Sky Models for Image Calibration

    by Rishi Ramakrishnan, Juan Nieto, Steve Scheding

    Perception systems operating in outdoor scenarios face challenges due to the high dynamic range of the image, as different regions are illuminated by varying amounts of sunlight and skylight. A pre-processing step like image calibration can be used to convert the pixel values to an illumination independent domain such as reflectance. Each pixel is therefore represented by a characteristic material description, instead of an illumination and viewpoint dependent pixel colour. This assists object identification, segmentation and classification algorithms. This paper investigates modelling the sky colour through a number of parametric approaches typically used in the computer graphics community for rendering purposes, namely those developed by Preetham and Hosek-Wilkie. The models are compared in terms of chromaticity with observations taken from a camera and are used to develop an environment map for the application of inverse reflectometry of diffuse objects in an outdoor environment. This is of particular importance for applications involving imaging objects whose primary illumination source is skylight. It was found that the Hosek-Wilkie model produced more robust estimations and was less sensitive to changes in azimuth, while both models had similar reconstruction results with angular errors of approximately 0.15 radians.


  • Combining strong features for registration of hyperspectral and lidar data from field-based platforms

    by Sildomar T. Monteiro, Juan Nieto, Richard Murphy, Rishi Ramakrishnan, Zachary Taylor

    This paper presents an approach to automatically register hyperspectral images with lidar point clouds using a combination of SIFT and SURF feature descriptors. The aim is to generate 3D terrain maps of the environment combining spectral and geometrical information. The datasets are acquired from field-based platforms which, due to the lack of georeferencing, cannot be simply fused and require a registration processing step. In addition, some applications, such as in mining, cannot rely on reliable GPS signal. The proposed method is validated using experimental data acquired from vertical mine walls.