Jun-Tian Ye
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jun-Tian Ye has a total of 25 co-authors. Here are the top co-authors by number of shared publications:
- Feihu Xu
University of Science and Technology of China
7 shared publications - Xin Yuan
Data61, Commonwealth Scientific and Industrial Research Organisation (CSIRO), Marsfield, NSW 2122, Australia
3 shared publications - Xiongfei Su
Zhejiang University, Hangzhou, China and Westlake University, Hangzhou, China
3 shared publications - Yu Hong
University of Science and Technology of China
3 shared publications - Jian-Wei Pan
University of Science and Technology of China
2 shared publications Zheng-Ping Li
Hefei National Research Center for Physical Sciences at the Microscale and School of Physical Sciences, University of Science and Technology of China, Hefei, China
2 shared publications
Latest Publications
- 28 April 2025
- Published by Optica Publishing Group in Optics Letters
- Vol. 50 (9) , 2970-2973
Single-photon laser reflective tomography over 7 km
Long-range, high-resolution imaging is valuable in a variety of applications, including space debris monitoring or Earth observation. While traditional imaging techniques have limited lateral resolution due to optical diffraction, laser reflective tomography (LRT) can surpass the limit and reconstruct the three-dimensional image of objects by measuring the one-dimensional range profiles of the objects from different angles. The independence of spatial resolution and the long-range imaging capability makes this a strong candidate technology for optical remote sensing applications. The present study describes a compact high performance time-correlated single-photon counting (TCSPC) range profiling system. With the proposed computational reconstruction framework, experimental results of laser reflective tomography at 7.1 km ranges with 1.2 cm resolution are presented, which is roughly 30-times better resolution than optical diffraction limit. Accurate 3D tomography of complex objects is also verified in this work. The results indicate the great potential for practical, compact, high-resolution imaging systems over extra-long ranges.
- 28 April 2025
- Published by Optica Publishing Group in Optics Letters
- Vol. 50 (9) , 2970-2973
Single-photon laser reflective tomography over 7 km
Long-range, high-resolution imaging is valuable in a variety of applications, including space debris monitoring or Earth observation. While traditional imaging techniques have limited lateral resolution due to optical diffraction, laser reflective tomography (LRT) can surpass the limit and reconstruct the three-dimensional image of objects by measuring the one-dimensional range profiles of the objects from different angles. The independence of spatial resolution and the long-range imaging capability makes this a strong candidate technology for optical remote sensing applications. The present study describes a compact high performance time-correlated single-photon counting (TCSPC) range profiling system. With the proposed computational reconstruction framework, experimental results of laser reflective tomography at 7.1 km ranges with 1.2 cm resolution are presented, which is roughly 30-times better resolution than optical diffraction limit. Accurate 3D tomography of complex objects is also verified in this work. The results indicate the great potential for practical, compact, high-resolution imaging systems over extra-long ranges.
- 6 November 2024
- Published by Springer Nature in Nature Computational Science
- Vol. 4 (12) , 920-927
Real-time non-line-of-sight computational imaging using spectrum filtering and motion compensation
Non-line-of-sight (NLOS) imaging aims at recovering the shape and albedo of hidden objects. Despite recent advances, real-time video of complex and dynamic scenes remains a major challenge owing to the weak signal of multiply scattered light. Here we propose and demonstrate a framework of spectrum filtering and motion compensation to realize high-quality NLOS video for room-sized scenes. Spectrum filtering leverages a wave-based model for denoising and deblurring in the frequency domain, enabling computational image reconstruction with a small number of sampling points. Motion compensation tailored with an interleaved scanning scheme can compute high-resolution live video during the acquisition of low-quality image sequences. Together, we demonstrate live NLOS videos at 4 fps for a variety of dynamic real-life scenes. The results mark a substantial stride toward real-time, large-scale and low-power NLOS imaging and sensing applications.
- 6 November 2024
- Published by Springer Nature in Nature Computational Science
- Vol. 4 (12) , 920-927
Real-time non-line-of-sight computational imaging using spectrum filtering and motion compensation
Non-line-of-sight (NLOS) imaging aims at recovering the shape and albedo of hidden objects. Despite recent advances, real-time video of complex and dynamic scenes remains a major challenge owing to the weak signal of multiply scattered light. Here we propose and demonstrate a framework of spectrum filtering and motion compensation to realize high-quality NLOS video for room-sized scenes. Spectrum filtering leverages a wave-based model for denoising and deblurring in the frequency domain, enabling computational image reconstruction with a small number of sampling points. Motion compensation tailored with an interleaved scanning scheme can compute high-resolution live video during the acquisition of low-quality image sequences. Together, we demonstrate live NLOS videos at 4 fps for a variety of dynamic real-life scenes. The results mark a substantial stride toward real-time, large-scale and low-power NLOS imaging and sensing applications.
- Open Access
- 25 June 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (5) , 1-12
Plug-and-Play Algorithms for Dynamic Non-line-of-sight Imaging
Non-line-of-sight (NLOS) imaging has the ability to recover 3D images of scenes outside the direct line of sight, which is of growing interest for diverse applications. Despite the remarkable progress, NLOS imaging of dynamic objects is still challenging. It requires a large amount of multibounce photons for the reconstruction of single-frame data. To overcome this obstacle, we develop a computational framework for dynamic time-of-flight NLOS imaging based on plug-and-play (PnP) algorithms. By combining imaging forward model with the deep denoising network from the computer vision community, we show a 4 frames-per-second (fps) 3D NLOS video recovery (128 × 128 × 512) in post-processing. Our method leverages the temporal similarity among adjacent frames and incorporates sparse priors and frequency filtering. This enables higher-quality reconstructions for complex scenes. Extensive experiments are conducted to verify the superior performance of our proposed algorithm both through simulations and real data.
- 25 June 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (5) , 1-12
Open AccessPlug-and-Play Algorithms for Dynamic Non-line-of-sight Imaging
Non-line-of-sight (NLOS) imaging has the ability to recover 3D images of scenes outside the direct line of sight, which is of growing interest for diverse applications. Despite the remarkable progress, NLOS imaging of dynamic objects is still challenging. It requires a large amount of multibounce photons for the reconstruction of single-frame data. To overcome this obstacle, we develop a computational framework for dynamic time-of-flight NLOS imaging based on plug-and-play (PnP) algorithms. By combining imaging forward model with the deep denoising network from the computer vision community, we show a 4 frames-per-second (fps) 3D NLOS video recovery (128 × 128 × 512) in post-processing. Our method leverages the temporal similarity among adjacent frames and incorporates sparse priors and frequency filtering. This enables higher-quality reconstructions for complex scenes. Extensive experiments are conducted to verify the superior performance of our proposed algorithm both through simulations and real data.
- 7 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 46 (12) , 8474-8485
Curvature Regularization for Non-Line-of-Sight Imaging From Under-Sampled Data
Non-line-of-sight (NLOS) imaging aims to reconstruct the three-dimensional hidden scenes by using time-of-flight photon information after multiple diffuse reflections. The under-sampled scanning data can facilitate fast imaging. However, the resulting reconstruction problem becomes a serious ill-posed inverse problem, the solution of which is highly likely to be degraded due to noises and distortions. In this paper, we propose novel NLOS reconstruction models based on curvature regularization, i.e., the object-domain curvature regularization model and the dual (signal and object)-domain curvature regularization model. In what follows, we develop efficient optimization algorithms relying on the alternating direction method of multipliers (ADMM) with the backtracking stepsize rule, for which all solvers can be implemented on GPUs. We evaluate the proposed algorithms on both synthetic and real datasets, which achieve state-of-the-art performance, especially in the compressed sensing setting. Based on GPU computing, our algorithm is the most effective among iterative methods, balancing reconstruction quality and computational time.
- 7 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 46 (12) , 8474-8485
Curvature Regularization for Non-Line-of-Sight Imaging From Under-Sampled Data
Non-line-of-sight (NLOS) imaging aims to reconstruct the three-dimensional hidden scenes by using time-of-flight photon information after multiple diffuse reflections. The under-sampled scanning data can facilitate fast imaging. However, the resulting reconstruction problem becomes a serious ill-posed inverse problem, the solution of which is highly likely to be degraded due to noises and distortions. In this paper, we propose novel NLOS reconstruction models based on curvature regularization, i.e., the object-domain curvature regularization model and the dual (signal and object)-domain curvature regularization model. In what follows, we develop efficient optimization algorithms relying on the alternating direction method of multipliers (ADMM) with the backtracking stepsize rule, for which all solvers can be implemented on GPUs. We evaluate the proposed algorithms on both synthetic and real datasets, which achieve state-of-the-art performance, especially in the compressed sensing setting. Based on GPU computing, our algorithm is the most effective among iterative methods, balancing reconstruction quality and computational time.
- 8 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Quantum Electronics
- Vol. 30 (1: Single-) , 1-11
Model-Guided Iterative Diffusion Sampling for NLOS Reconstruction
We consider the reconstruction problem of non-line-of-sight (NLOS) imaging. The proposed diffusion-based method starts with back-projection from NLOS measurement and iteratively estimates the noise using a trained light-weight U-Net and model-guided iterative gradient descent. Unlike previous large networks, our diffusion-based method relies on a series of iterative refinement steps, each of which is trained with a regression loss. This benefits our iterative approach to capture richer distributions. Furthermore, rather than estimating the posterior mean value, our method generates samples from the target posterior and allows only one trained model being adaptive to different settings, such as diverse sampling time resolution, various spatial resolution and multiple channels of color scenes. Simulation and real-data experiments verify that our proposed method achieves better reconstruction results both in quality and quantity than existing methods.
- 8 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Quantum Electronics
- Vol. 30 (1: Single-) , 1-11
Model-Guided Iterative Diffusion Sampling for NLOS Reconstruction
We consider the reconstruction problem of non-line-of-sight (NLOS) imaging. The proposed diffusion-based method starts with back-projection from NLOS measurement and iteratively estimates the noise using a trained light-weight U-Net and model-guided iterative gradient descent. Unlike previous large networks, our diffusion-based method relies on a series of iterative refinement steps, each of which is trained with a regression loss. This benefits our iterative approach to capture richer distributions. Furthermore, rather than estimating the posterior mean value, our method generates samples from the target posterior and allows only one trained model being adaptive to different settings, such as diverse sampling time resolution, various spatial resolution and multiple channels of color scenes. Simulation and real-data experiments verify that our proposed method achieves better reconstruction results both in quality and quantity than existing methods.
- 1 October 2023
- Published by Wiley in Computer Graphics Forum
- Vol. 42 (7)
Multi‐scale Iterative Model‐guided Unfolding Network for NLOS Reconstruction
Non‐line‐of‐sight (NLOS) imaging can reconstruct hidden objects by analyzing diffuse reflection of relay surfaces, and is potentially used in autonomous driving, medical imaging and national defense. Despite the challenges of low signal‐to‐noise ratio (SNR) and ill‐conditioned problem, NLOS imaging has developed rapidly in recent years. While deep neural networks have achieved impressive success in NLOS imaging, most of them lack flexibility when dealing with multiple spatial‐temporal resolution and multi‐scene images in practical applications. To bridge the gap between learning methods and physical priors, we present a novel end‐to‐end Multi‐scale Iterative Model‐guided Unfolding (MIMU), with superior performance and strong flexibility. Furthermore, we overcome the lack of real training data with a general architecture that can be trained in simulation. Unlike existing encoder‐decoder architectures and generative adversarial networks, the proposed method allows for only one trained model adaptive for various dimensions, such as various sampling time resolution, various spatial resolution and multiple channels for colorful scenes. Simulation and real‐data experiments verify that the proposed method achieves better reconstruction results both in quality and quantity than existing methods.
- 1 October 2023
- Published by Wiley in Computer Graphics Forum
- Vol. 42 (7)
Multi‐scale Iterative Model‐guided Unfolding Network for NLOS Reconstruction
Non‐line‐of‐sight (NLOS) imaging can reconstruct hidden objects by analyzing diffuse reflection of relay surfaces, and is potentially used in autonomous driving, medical imaging and national defense. Despite the challenges of low signal‐to‐noise ratio (SNR) and ill‐conditioned problem, NLOS imaging has developed rapidly in recent years. While deep neural networks have achieved impressive success in NLOS imaging, most of them lack flexibility when dealing with multiple spatial‐temporal resolution and multi‐scene images in practical applications. To bridge the gap between learning methods and physical priors, we present a novel end‐to‐end Multi‐scale Iterative Model‐guided Unfolding (MIMU), with superior performance and strong flexibility. Furthermore, we overcome the lack of real training data with a general architecture that can be trained in simulation. Unlike existing encoder‐decoder architectures and generative adversarial networks, the proposed method allows for only one trained model adaptive for various dimensions, such as various sampling time resolution, various spatial resolution and multiple channels for colorful scenes. Simulation and real‐data experiments verify that the proposed method achieves better reconstruction results both in quality and quantity than existing methods.
- Open Access
- 10 July 2023
- Published by AIP Publishing in Applied Physics Letters
- Vol. 123 (2)
Ultraviolet photon-counting single-pixel imaging
We demonstrate photon-counting single-pixel imaging in the ultraviolet region. Toward this target, we develop a high-performance compact single-photon detector based on a 4H-SiC single-photon avalanche diode (SPAD), where a tailored readout circuit with active hold-off time is designed to restrain detector noise and operate the SPAD in the free-running mode. We use structured illumination to reconstruct 192 × 192 compressed images at a 4 fps frame rate. To show the superior capability of ultraviolet characteristics, we use our single-pixel imaging system to identify and distinguish different transparent objects under low-intensity irradiation and image ultraviolet light sources. The results provide a practical solution for general ultraviolet imaging applications.
- 10 July 2023
- Published by AIP Publishing in Applied Physics Letters
- Vol. 123 (2)
Open AccessUltraviolet photon-counting single-pixel imaging
We demonstrate photon-counting single-pixel imaging in the ultraviolet region. Toward this target, we develop a high-performance compact single-photon detector based on a 4H-SiC single-photon avalanche diode (SPAD), where a tailored readout circuit with active hold-off time is designed to restrain detector noise and operate the SPAD in the free-running mode. We use structured illumination to reconstruct 192 × 192 compressed images at a 4 fps frame rate. To show the superior capability of ultraviolet characteristics, we use our single-pixel imaging system to identify and distinguish different transparent objects under low-intensity irradiation and image ultraviolet light sources. The results provide a practical solution for general ultraviolet imaging applications.