JRJoshua Rapp

Joshua Rapp

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Joshua Rapp has a total of 23 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Unambiguous range extension for Doppler single-photon lidar

    by Ruangrawee Kitichotkul, Joshua Rapp, Yanting Ma, Hassan Mansour

    Single-photon lidar (SPL) measures the time delay between a laser pulse emission and a single photon detection. SPL typically uses a periodic sequence of illumination pulses to improve the accuracy of distance estimates, and the radial velocity of a moving target can also be determined from the Doppler shift in the pulse repetition frequency. Although increasing the repetition frequency increases the photon detection rate, it also decreases the unambiguous range. Several alternative pulsing modes have been proposed to break this tradeoff for SPL measurements of static scenes, e.g., using multiple repetition rates or random pulse trains to yield both high count rates and a long unambiguous range. In this work, we show that velocity can still be estimated despite the use of non-periodic range extension pulse patterns. We derive a general model for the photon acquisition process with a moving target and propose maximum likelihood estimators (MLEs) to recover the distance, velocity, and photon flux levels. Each range extension mode requires a tailored initialization scheme in order for our MLE solver to converge to the global optimum. We demonstrate through simulations and experiments that non-periodic SPL can simultaneously achieve long-range, high-accuracy distance and velocity estimates.


  • Simultaneous range and velocity measurement with Doppler single-photon lidar

    by Ruangrawee Kitichotkul, Joshua Rapp, Yanting Ma, Hassan Mansour

    Single-photon lidar (SPL) can accurately measure distances to targets from extremely weak reflections. However, the conventional wisdom holds that pulsed lidar cannot directly measure velocity, unlike other forms of lidar. We present a detection model for SPL that explicitly includes a target’s radial velocity, manifesting as a Doppler shift in the repetition frequency of the received laser pulse train. We propose an approach called Doppler SPL, comprising a pair of methods for jointly estimating range and velocity. Our first method estimates the Doppler shift via Fourier analysis of the detection times. The second method is a maximum likelihood (ML) estimator that can improve the Fourier estimate and enable joint estimation of the flux from signal and background sources. We derive the Cramér–Rao bound for the estimation problem and show via simulations that the ML estimator is statistically efficient across diverse acquisition settings. We also demonstrate simultaneous estimation of range with sub-centimeter accuracy and velocity with 0.1 m/s root mean square error for experimental measurements at 50 frames per second (fps), despite a signal-to-background ratio as low as 0.007. Finally, we present an example of a 3D video reconstruction at 120 fps with per-pixel velocity estimates. With the addition of velocimetry, Doppler SPL has the potential to introduce advanced capabilities in applications such as atmospheric monitoring or autonomous navigation.


  • Multi-Layered Surface Estimation for Low-Cost Optical Coherence Tomography

    by Joshua Rapp, Hassan Mansour, Petros Boufounos, Toshiaki Koike-Akino, Kieran Parsons

    Optical coherence tomography (OCT) has broad applicability for 3D sensing, such as reconstructing the surface profiles of multi-layered samples in industrial settings. However, accurately determining the number of layers and their precise locations is a challenging task, especially for low-cost OCT systems having low signal-to-noise ratio (SNR). This paper introduces a principled and noise-robust method of detection and estimation of surfaces measured with OCT. We first derive the maximum likelihood estimator (MLE) for the position and reflectivity of a single opaque surface. We next derive a threshold that uses the acquisition noise variance and the number of measurements available to set a target probability for false acceptance of spurious surface estimates. The threshold and MLE are then incorporated into an algorithm that sequentially detects and estimates surface locations. We demonstrate reconstruction of fine details in samples with optical path lengths around 1 mm and depth error down to 1.5 $\mu$ m despite SNRs as low as –10 dB.


  • Single-Pixel Imaging of Spatio-Temporal Flows Using Differentiable Latent Dynamics

    by Aleksei Sholokhov, Saleh Nabi, Joshua Rapp, Steven L. Brunton, J. Nathan Kutz, Petros T. Boufounos, Hassan Mansour

    Imaging dynamic spatio-temporal flows typically requires high-speed, high-resolution sensors that may be physically or economically prohibitive. Single-pixel imaging (SPI) has emerged as a low-cost acquisition technique where light from a scene is projected through a spatial light modulator onto a single photodiode with a high temporal acquisition rate. The scene is then reconstructed from the temporal samples using computational techniques that leverage prior assumptions on the scene structure. In this paper, we propose to image spatio-temporal flows from incomplete measurements by leveraging scene priors in the form of a reduced-order model (ROM) of the dynamics learned from training data examples. By combining SPI acquisition with the ROM prior implemented as a neural ordinary differential equation, we achieve high-quality image sequence reconstruction with significantly reduced data requirements. Specifically, our approach achieves similar performance levels to leading methods despite using one to two orders of magnitude fewer samples. We demonstrate superior reconstruction at low sampling rates for simulated trajectories governed by Burgers' equation, Kolmogorov flow, and turbulent plumes emulating gas leaks.


  • The Role of Detection Times in Reflectivity Estimation With Single-Photon Lidar

    by Ruangrawee Kitichotkul, Joshua Rapp, Vivek K Goyal

    In direct time-of-flight single-photon lidar, the photon detection times are typically used to estimate the depth, while the number of detections is used to estimate the reflectivity. This paper examines the use of detection times in reflectivity estimation with a free-running SPAD by proposing new estimators and unifying previous results with new analysis. In the low-flux regime where dead times are negligible, we examine the Cramér-Rao bound of reflectivity estimation. When depth is unknown, we show that an estimator based on censoring can perform almost as well as a maximum likelihood estimator, and, surprisingly, incorrect depth estimation can reduce the mean-squared errors of reflectivity estimation. We also examined joint estimation of signal and background fluxes, for which our proposed censoring-based estimator performs as well as the maximum likelihood estimator. In the high-flux regime where dead times are not negligible, we model the detection times as a Markov chain and examine some reflectivity estimators that exploit the detection times.


  • Top Cited Papers

    High-flux single-photon lidar

    by Joshua Rapp, Yanting Ma, Robin M. A. Dawson, Vivek K Goyal

    In time-correlated single-photon counting (TCSPC), photons that arrive during the detector and timing electronics dead times are missed, causing distortion of the detection time distribution. Conventional wisdom holds that TCSPC should be performed with detections in fewer than 5% of illumination cycles to avoid substantial distortion. This requires attenuation and leads to longer acquisition times if the incident flux is too high. Through the example of ranging with a single-photon lidar system, this work demonstrates that accurately modeling the sequence of detection times as a Markov chain allows for measurements at much higher incident flux without attenuation. Our probabilistic model is validated by the close match between the limiting distribution of the Markov chain and both simulated and experimental data, so long as issues of calibration and afterpulsing are minimal. We propose an algorithm that corrects for the distortion in detection histograms caused by dead times without assumptions on the form of the transient light intensity. Our histogram correction yields substantially improved depth imaging performance, and modest additional improvement is achieved with a parametric model assuming a single depth per pixel. We show results for depth and flux estimation with up to 5 photoelectrons per illumination cycle on average, facilitating an increase in time efficiency of more than two orders of magnitude. The use of identical TCSPC equipment in other fields suggests that our modeling and histogram correction could likewise enable high-flux acquisitions in fluorescence lifetime microscopy or quantum optics applications.


  • Open Access

    Seeing around corners with edge-resolved transient imaging

    by Joshua Rapp, Charles Saunders, Julián Tachella, John Murray-Bruce, Yoann Altmann, Jean-Yves Tourneret, Stephen McLaughlin, Robin M. A. Dawson, Franco N. C. Wong, Vivek K. Goyal

    Non-line-of-sight (NLOS) imaging is a rapidly growing field seeking to form images of objects outside the field of view, with potential applications in autonomous navigation, reconnaissance, and even medical imaging. The critical challenge of NLOS imaging is that diffuse reflections scatter light in all directions, resulting in weak signals and a loss of directional information. To address this problem, we propose a method for seeing around corners that derives angular resolution from vertical edges and longitudinal resolution from the temporal response to a pulsed light source. We introduce an acquisition strategy, scene response model, and reconstruction algorithm that enable the formation of 2.5-dimensional representations—a plan view plus heights—and a 180∘ field of view for large-scale scenes. Our experiments demonstrate accurate reconstructions of hidden rooms up to 3 meters in each dimension despite a small scan aperture (1.5-centimeter radius) and only 45 measurement locations.


  • Dithered depth imaging

    by Joshua Rapp, Robin M. A. Dawson, Vivek K Goyal

    Single-photon lidar (SPL) is a promising technology for depth measurement at long range or from weak reflectors because of the sensitivity to extremely low light levels. However, constraints on the timing resolution of existing arrays of single-photon avalanche diode (SPAD) detectors limit the precision of resulting depth estimates. In this work, we describe an implementation of subtractively-dithered SPL that can recover high-resolution depth estimates despite the coarse resolution of the detector. Subtractively-dithered measurement is achieved by adding programmable delays into the photon timing circuitry that introduce relative time shifts between the illumination and detection that are shorter than the time bin duration. Careful modeling of the temporal instrument response function leads to an estimator that outperforms the sample mean and results in depth estimates with up to 13 times lower root mean-squared error than if dither were not used. The simple implementation and estimation suggest that globally dithered SPAD arrays could be used for high spatial- and temporal-resolution depth sensing.


  • Top Cited Papers

    Advances in Single-Photon Lidar for Autonomous Vehicles: Working Principles, Challenges, and Recent Advances

    by Joshua Rapp, Julian Tachella, Yoann Altmann, Stephen McLaughlin, Vivek K Goyal

    The safety and success of autonomous vehicles (AVs) depend on their ability to accurately map and respond to their surroundings in real time. One of the most promising recent technologies for depth mapping is single-photon lidar (SPL), which measures the time of flight of individual photons. The long-range capabilities (kilometers), excellent depth resolution (centimeters), and use of low-power (eye-safe) laser sources renders this modality a strong candidate for use in AVs. While presenting unique opportunities, the remarkable sensitivity of single-photon detectors introduces several signal processing challenges. The discrete nature of photon counting and the particular design of the detection devices means the acquired signals cannot be treated as arising in a linear system with additive Gaussian noise. Moreover, the number of useful photon detections may be small despite a large data volume, thus requiring careful modeling and algorithmic design for real-time performance. This article discusses the main working principles of SPL and summarizes recent advances in signal processing techniques for this modality, highlighting promising applications in AVs as well as a number of challenges for vehicular lidar that cannot be solved by better hardware alone.


  • Predicting Dead Time Distortion for High-Flux Single-Photon Lidar

    by Joshua Rapp, Yanting Ma, Robin M. A. Dawson, Vivek K Goyal

    Detector and electronics dead times distort photon detection histograms at high flux, but can be mitigated by probabilistic modeling identifying the sequence of detections as a Markov chain.