Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Hengwei Yu has a total of 27 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Dual-mode LiDAR SoC with an on-chip interframe filter and common optical platform design for keystone correction and auto-focus

    by Jier Wang, Hengwei Yu, Patrick Yin Chiang

    This paper presents an innovative methodology that incorporates direct time-of-flight technology into intelligent sensing for projectors, along with a lightweight, dual-mode optically integrated LiDAR system. The proposed LiDAR system-on-chip, which utilizes a single-photon avalanche diode and time to digital converter with 0.13 µm bipolar CMOS DMOS technology, integrates an on-chip interframe filter, a common optical platform design, and a lightweight keystone correction assist algorithm. This comprehensive integration enables the system to achieve a measurement range of 11 m with 1% relative precision (simulations indicate the potential to achieve 30 m) in auto-focus mode. Additionally, it facilitates high frame-per-second keystone correction within a range of ±30∘ with an error of ±2∘ under illumination conditions of 20 klux.


  • An Angle-Insensitive 138-dB Dynamic Range Light Sensor With 4 Time-Interleaved Channels 32-ppm/°C Temperature-Independent Flicker Detection

    by Yuan Li, Zhihong Lin, Wenbo Dong, Ziwen Hu, Chill Wang, Shenglong Zhuo, Yifan Wu, Hengwei Yu, Patrick Yin Chiang

    This brief presents an angle-insensitive, high dynamic range light sensor with 4-channels (CHs) temperatureindependent flicker detection. Angle insensitivity is achieved by two pairs of Dual-Photodiodes (PDs) for X-axis and Y-axis respectively. 4-CHs temperature-independent flicker detection is realized by a time-interleaved architecture sharing two Trans-Impedance-Amplifiers (TIAs) and one 16-bit third-order incremental ΔΣADC, whose clock provided by a newly proposed relaxation oscillator with real-time comparator offset and current-mirror mismatch temperature variation calibration. 7-Levels Auto-Gain-Control (AGC) is implemented to extend dynamic range. The chip was fabricated using 180nm CMOS technology. Experiment results show that the proposed light sensor can achieve -30°~°30 flat angular response with +/-67° field-of-view (FOV). 4-CHs flicker detection with 32ppm/°C temperature coefficient is achieved in the range of -30~85°C. 7-Levels AGC extends input light dynamic range to 138dB (0.012~103klux). The chip power consumption is 0.39mW under 1.8V supply and chip area is 2mm x 0.65mm.


  • Open Access

    A 256 × 256 LiDAR Imaging System Based on a 200 mW SPAD-Based SoC with Microlens Array and Lightweight RGB-Guided Depth Completion Neural Network

    by Jier Wang, Jie Li, Yifan Wu, Hengwei Yu, Lebei Cui, Miao Sun, Patrick Yin Chiang

    Light detection and ranging (LiDAR) technology, a cutting-edge advancement in mobile applications, presents a myriad of compelling use cases, including enhancing low-light photography, capturing and sharing 3D images of fascinating objects, and elevating the overall augmented reality (AR) experience. However, its widespread adoption has been hindered by the prohibitive costs and substantial power consumption associated with its implementation in mobile devices. To surmount these obstacles, this paper proposes a low-power, low-cost, single-photon avalanche detector (SPAD)-based system-on-chip (SoC) which packages the microlens arrays (MLAs) and a lightweight RGB-guided sparse depth imaging completion neural network for 3D LiDAR imaging. The proposed SoC integrates an 8 × 8 SPAD macropixel array with time-to-digital converters (TDCs) and a charge pump, fabricated using a 180 nm bipolar-CMOS-DMOS (BCD) process. Initially, the primary function of this SoC was limited to serving as a ranging sensor. A random MLA-based homogenizing diffuser efficiently transforms Gaussian beams into flat-topped beams with a 45° field of view (FOV), enabling flash projection at the transmitter. To further enhance resolution and broaden application possibilities, a lightweight neural network employing RGB-guided sparse depth complementation is proposed, enabling a substantial expansion of image resolution from 8 × 8 to quarter video graphics array level (QVGA; 256 × 256). Experimental results demonstrate the effectiveness and stability of the hardware encompassing the SoC and optical system, as well as the lightweight features and accuracy of the algorithmic neural network. The state-of-the-art SoC-neural network solution offers a promising and inspiring foundation for developing consumer-level 3D imaging applications on mobile devices.


  • Open Access

    A 256x256 LiDAR Imaging System Based on a 200mW SPAD-Based SoC with Micro-lens Array and Light-Weight RGB-guide Depth Completion Neural Network

    by Jier Wang, Jie Li, Yifan Wu, Hengwei Yu, Lebei Cui, Miao Sun, Patrick Yin Chiang

    Light Detection and Ranging (LiDAR) technology, a cutting-edge advancement in mobile applications, presents a myriad of compelling use cases, including enhancing low-light photography, capturing and sharing 3D images of fascinating objects, and elevating the overall augmented reality (AR) experience. However, its widespread adoption has been hindered by the prohibitive costs and substantial power consumption associated with its implementation. To surmount these obstacles, this paper proposes a low-power, low-cost, SPAD-based system-on-chip (SoC) which packages the microlens arrays (MLA) and incorporates with a light-weight RGB-guided sparse depth imaging completion neural network for 3D LiDAR imaging. The proposed SoC integrates an 8x8 Single-Photon Avalanche Detectors (SPADs) macro pixel array with time-to-digital converters (TDC) and charge pump, fabricated using a 180nm bipolar-CMOS-DMOS (BCD) process. A random MLA-based homogenizing diffuser efficiently transforms Gaussian beams into flat-topped beams with a 45° field of view (FOV), enabling flash projection at the transmitter. To further enhance resolution and broaden application possibilities, a lightweight neural network employing RGB-guided sparse depth complementation is proposed, enabling a substantial expansion of image resolution from 8x8 to quarter video graphics array level (QVGA; 256x256). Experimental results demonstrate the effectiveness and stability of the hardware encompassing the SoC and optical system, as well as the lightweight features and accuracy of the algorithmic neural network. This integrated state-of-the-art hardware-software solution offers a promising and inspiring foundation for developing consumer-level 3D imaging applications.


  • All-in-One SPAD Ranging Sensor With Real-Time Xtalk Calibration and Integrated Biasing

    by Hengwei Yu, Shenglong Zhuo, Yifan Wu, Long Wang, Tao Xia, Lei Zhao, Jiqing Xu, Yuan Li, Zhihong Lin, Patrick Yin Chiang

    This letter presents a novel fully integrated dToF system-on-chip ranging sensor based on a SPADs array. The sensor is made a configurable array of $16\times16$ SPADs, a 940nm VCSEL, a co-design VCSEL driver and embedded DSP core. To suitable different ranging scenarios with high reliability and low cost, the above mentioned are all packaged into one module for ranging. However, the package of coverglass can cause Xtalk, which have a negative impact on ranging. In order to reduce the influence of Xtalk on ranging. This letter proposes a real-time Xtalk calibration circuit system, which can automatically adjust the laser pulse width, when Xtalk and target bins are mixed together. And also to mitigate the effect of SPAD jitter on the Xtalk bins width, an adjustable bias voltage charge pump circuit is adopted to realize the accurate adjustment of pixel SPAD’s bias voltage. The system has been turned out with precision of better than 5mm within 6m in 80% reflectance of target, still with a precision better than 8mm at a distance within 4m in 18% reflectance of target.


  • Open Access

    A dToF Ranging Sensor with Accurate Photon Detector Measurements for LiDAR Applications

    by Hengwei Yu, Long Wang, Jiqing Xu, Patrick Yin Chiang

    Direct time-of-flight (dToF) ranging sensors based on single-photon avalanche diodes (SPADs) have been used as a prominent depth-sensing devices. Time-to-digital converters (TDCs) and histogram builders have become the standard for dToF sensors. However, one of the main current issues is the bin width of the histogram, which limits the accuracy of depth without TDC architecture modifications. SPAD-based light detection and ranging (LiDAR) systems require new methods to overcome their inherent drawbacks for accurate 3D ranging. In this work, we report an optimal matched filter to process the raw data of the histogram to obtain high-accuracy depth. This method is performed by feeding the raw data of the histogram into the different matched filters and using the Center-of-Mass (CoM) algorithm for depth extraction. Comparing the measurement results of different matched filters, the filter with the highest depth accuracy can be obtained. Finally, we implemented a dToF system-on-chip (SoC) ranging sensor. The sensor is made of a configurable array of 16 × 16 SPADs, a 940 nm vertical-cavity surface-emitting laser (VCSEL), an integrated VCSEL driver, and an embedded microcontroller unit (MCU) core to implement the best matched filter. To achieve suitably high reliability and low cost, the above-mentioned features are all packaged into one module for ranging. The system resulted in a precision of better than 5 mm within 6 m with 80% reflectance of the target, and had a precision better than 8 mm at a distance within 4 m with 18% reflectance of the target.


  • Solid-State dToF LiDAR System Using an Eight-Channel Addressable, 20-W/Ch Transmitter, and a 128 × 128 SPAD Receiver With SNR-Based Pixel Binning and Resolution Upscaling

    by Shenglong Zhuo, Tao Xia, Lei Zhao, Miao Sun, Yifan Wu, Lei Wang, Hengwei Yu, Jiqing Xu, Jier Wang, Zhihong Lin, et al.

    An entire solid-state direct time-of-flight (dToF) light detection and ranging (LiDAR) system that incorporates innovations for both the transmitter (TX) and the receiver (RX) is presented in this work. For the illumination TX, we demonstrate solid-state channel addressability, which significantly reduces the transmit power and improves the ranging distance by dividing the field of view (FoV) into separately illuminated sub-regions. In the RX, we introduce single-photon avalanche diodes (SPADs) pixel binning, which enables reconfigurability of the sensor’s spatial resolution. Finally, we introduce a machine learning (ML) technique that enables this pixel-binned depth sensor to upscale its spatial resolution after training/inference fusion with the intensity image. The laser diode driver (LDD) chip is implemented in the 180-nm bipolar-CMOS-DMOS (BCD) process and is capable of pumping more than 8-A peak current into a multi-junction vertical-cavity surface-emitting laser (VCSEL) array, producing up to 20.3-W optical pulses under 12.5-V supply voltage. The sensor chip is also implemented in the 180-nm BCD process with a $128 \times 128$ SPAD array and reconfigurable pixel binning. Hardware and software co-optimization under low signal-to-noise ratio (SNR) conditions with ML-based spatial resolution upscaling is demonstrated.