Sangho Lee
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Sangho Lee has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Kyuho Jason Lee
Yonsei University
4 shared publications - Jeongmin Shin
Department of Electrical Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea
3 shared publications - Jueun Jung
Yonsei University
3 shared publications - Seungbin Kim
Ulsan National Institute of Science and Technology
3 shared publications - Bokyoung Seo
Ulsan National Institute of Science and Technology
2 shared publications - Donghyeon Han
Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology (MIT), Cambridge, MA, USA
2 shared publications
Latest Publications
- 10 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems I: Regular Papers
- Vol. 72 (7) , 3286-3297
C 2 IM-NN: A Low-Power 3D Point Clouds Matching Processor With 1D-CNN Prediction and CAM-Based In-Memory k-NN Searching
This paper presents a content addressable memory (CAM)-based computing-in-memory (C $^{2}$ IM) system designed for energy-efficient k-nearest neighbor (k-NN) searching in 3D point clouds. For autonomous driving applications, an essential process for perceiving the mobile robot’s movements in 3D space is k-NN searching. Especially with the limited hardware resources of mobile processors, the 3D point cloud is too large to upload onto the chip, leading to $O(N^{2})$ of external memory accesses and distance calculations. The proposed C $^{2}$ IM processor enhances energy efficiency and reduces power consumption through three key features: 1) Dilated 1D-CNN prediction enables voxel-based partitioning, reducing the external memory accesses from $O(N^{2})$ to $O(N)$ ; 2) Vertex clustering reorganizes groups of points into evenly distributed clusters based on the underlying data distribution and reduces the number of points of comparisons by 49.8%; and 3) In-memory k-NN searching with CAM achieves high system energy efficiency while minimizing data transactions between memory and computation logic. Designed with 28 nm CMOS technology, the proposed C $^{2}$ IM achieves up to 23.08 $\times$ energy efficiency, and 48.4% reduction in memory footprint compared to previous ASIC accelerators, and a 99.51% reduction in power consumption compared to state-of-the-art processor implemented in FPGA with high-bandwidth memory.
- 10 January 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems I: Regular Papers
- Vol. 72 (7) , 3286-3297
C 2 IM-NN: A Low-Power 3D Point Clouds Matching Processor With 1D-CNN Prediction and CAM-Based In-Memory k-NN Searching
This paper presents a content addressable memory (CAM)-based computing-in-memory (C $^{2}$ IM) system designed for energy-efficient k-nearest neighbor (k-NN) searching in 3D point clouds. For autonomous driving applications, an essential process for perceiving the mobile robot’s movements in 3D space is k-NN searching. Especially with the limited hardware resources of mobile processors, the 3D point cloud is too large to upload onto the chip, leading to $O(N^{2})$ of external memory accesses and distance calculations. The proposed C $^{2}$ IM processor enhances energy efficiency and reduces power consumption through three key features: 1) Dilated 1D-CNN prediction enables voxel-based partitioning, reducing the external memory accesses from $O(N^{2})$ to $O(N)$ ; 2) Vertex clustering reorganizes groups of points into evenly distributed clusters based on the underlying data distribution and reduces the number of points of comparisons by 49.8%; and 3) In-memory k-NN searching with CAM achieves high system energy efficiency while minimizing data transactions between memory and computation logic. Designed with 28 nm CMOS technology, the proposed C $^{2}$ IM achieves up to 23.08 $\times$ energy efficiency, and 48.4% reduction in memory footprint compared to previous ASIC accelerators, and a 99.51% reduction in power consumption compared to state-of-the-art processor implemented in FPGA with high-bandwidth memory.
- 21 November 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (2) , 67-77
A Mobile Semantic Lidar SLAM Processor With Artificial-Intelligence-Based 3-D Perception and Spatiotemporal-Aware Computing
A low-power artificial intelligence (AI)-based semantic LiDAR SLAM processor is proposed to expand autonomous driving into emerging mobile robots. It combines point neural network (PNN)-based 3D segmentation with LiDAR SLAM to minimize pose errors due to the lack of perception in previous SLAM. The proposed processor is designed with a heterogeneous multi-core architecture utilizing SIMD and reconfigurable processing elements to fully support the three main operations: k-nearest neighbor (kNN); PNN; and non-linear optimization. It accelerates kNN operations with spherical bin partitioning optimized for the distribution of LiDAR data to eliminate unnecessary search spaces. In addition, the proposed spatio-temporal-aware computing minimizes excessive memory overhead and workload imbalance in kNN and PNN operations. Consequently, fabricated with 28-nm CMOS technology, the processor achieves 8.245 mJ/frame of energy consumption and a maximum performance of 20.7 ms latency, successfully demonstrating real-time semantic LiDAR SLAM system with 99.86% lower power consumption compared to modern CPU+GPU platforms.
- 21 November 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (2) , 67-77
A Mobile Semantic Lidar SLAM Processor With Artificial-Intelligence-Based 3-D Perception and Spatiotemporal-Aware Computing
A low-power artificial intelligence (AI)-based semantic LiDAR SLAM processor is proposed to expand autonomous driving into emerging mobile robots. It combines point neural network (PNN)-based 3D segmentation with LiDAR SLAM to minimize pose errors due to the lack of perception in previous SLAM. The proposed processor is designed with a heterogeneous multi-core architecture utilizing SIMD and reconfigurable processing elements to fully support the three main operations: k-nearest neighbor (kNN); PNN; and non-linear optimization. It accelerates kNN operations with spherical bin partitioning optimized for the distribution of LiDAR data to eliminate unnecessary search spaces. In addition, the proposed spatio-temporal-aware computing minimizes excessive memory overhead and workload imbalance in kNN and PNN operations. Consequently, fabricated with 28-nm CMOS technology, the processor achieves 8.245 mJ/frame of energy consumption and a maximum performance of 20.7 ms latency, successfully demonstrating real-time semantic LiDAR SLAM system with 99.86% lower power consumption compared to modern CPU+GPU platforms.
- 6 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 60 (1) , 112-124
An Energy-Efficient Processor for Real-Time Semantic LiDAR SLAM in Mobile Robots
Emerging mobile robots require simultaneous localization and mapping (SLAM) systems with advanced 3-D perception and long-range 360 $^{\circ}$ interaction for autonomous driving. However, previous SLAM processors, which targeted only camera-based visual SLAM, are unsuitable for autonomous driving systems due to their limited field of view (FoV), inaccurate depth estimation, and lack of perception. In contrast, LiDAR offers a long-range 3-D point cloud with precise depth information and 360 $^{\circ}$ FoV, enabling the capture of fine environmental details. With its high accuracy and environmental robustness, LiDAR SLAM with accurate 3-D perception, semantic LiDAR SLAM, emerges as the most promising solution in autonomous driving systems. Nevertheless, real-time system-on-chip (SoC) implementation of semantic LiDAR SLAM has not been reported, primarily due to memory-intensive and compute-intensive operations caused by the simultaneous execution of multiple algorithms. Moreover, achieving real-time performance has not been feasible, even in the high-performance CPU $+$ GPU. In this article, a real-time and fully integrated semantic LiDAR SLAM processor (LSPU) is presented with semantic LiDAR-PNN-SLAM (LP-SLAM) system, which provides point neural network (PNN)-based 3-D segmentation, localization, and mapping simultaneously. The LSPU executes the LP-SLAM with the following features: 1) a $k$ -nearest neighbor (kNN) cluster with 2-D/3-D spherical coordinate-based bin (SB) searching to eliminate external memory access through dynamic memory allocation; 2) a PNN engine (PNNE) with a global point-level task scheduler (GPTS) to maximize core utilization by two-step workload balancing; 3) a keypoint extraction core (KEC) to skip redundant computation in the sorting operation; and 4) an optimization cluster with reconfigurable computation modes to support keypoint-level pipelining and parallel processing in non-linear optimization (NLO). As a result, the proposed LSPU achieves 20.7 ms of processing time, demonstrating real-time semantic LP-SLAM while consuming 99.89% lower energy compared to modern CPU $+$ GPU platforms.
- 6 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Solid-State Circuits
- Vol. 60 (1) , 112-124
An Energy-Efficient Processor for Real-Time Semantic LiDAR SLAM in Mobile Robots
Emerging mobile robots require simultaneous localization and mapping (SLAM) systems with advanced 3-D perception and long-range 360 $^{\circ}$ interaction for autonomous driving. However, previous SLAM processors, which targeted only camera-based visual SLAM, are unsuitable for autonomous driving systems due to their limited field of view (FoV), inaccurate depth estimation, and lack of perception. In contrast, LiDAR offers a long-range 3-D point cloud with precise depth information and 360 $^{\circ}$ FoV, enabling the capture of fine environmental details. With its high accuracy and environmental robustness, LiDAR SLAM with accurate 3-D perception, semantic LiDAR SLAM, emerges as the most promising solution in autonomous driving systems. Nevertheless, real-time system-on-chip (SoC) implementation of semantic LiDAR SLAM has not been reported, primarily due to memory-intensive and compute-intensive operations caused by the simultaneous execution of multiple algorithms. Moreover, achieving real-time performance has not been feasible, even in the high-performance CPU $+$ GPU. In this article, a real-time and fully integrated semantic LiDAR SLAM processor (LSPU) is presented with semantic LiDAR-PNN-SLAM (LP-SLAM) system, which provides point neural network (PNN)-based 3-D segmentation, localization, and mapping simultaneously. The LSPU executes the LP-SLAM with the following features: 1) a $k$ -nearest neighbor (kNN) cluster with 2-D/3-D spherical coordinate-based bin (SB) searching to eliminate external memory access through dynamic memory allocation; 2) a PNN engine (PNNE) with a global point-level task scheduler (GPTS) to maximize core utilization by two-step workload balancing; 3) a keypoint extraction core (KEC) to skip redundant computation in the sorting operation; and 4) an optimization cluster with reconfigurable computation modes to support keypoint-level pipelining and parallel processing in non-linear optimization (NLO). As a result, the proposed LSPU achieves 20.7 ms of processing time, demonstrating real-time semantic LP-SLAM while consuming 99.89% lower energy compared to modern CPU $+$ GPU platforms.