Changhyeon Kim
Research Subjects
Changhyeon Kim has a total of 18 co-authors. Here are the top co-authors by number of shared publications:
- Hyoun Jin Kim
Seoul National University
8 shared publications - Junha Kim
Department of Mechanical and Aerospace Engineering and Automation and Systems Research Institute, Seoul National University, Seoul, Korea
5 shared publications - Dongjae Lee
Department of Mechanical Engineering, Seoul National University, Seoul, South Korea
3 shared publications - Changsuk Oh
Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles, CA, 90095, USA.
2 shared publications - Pyojin Kim
Department of Mechanical and Robotics Engineering, Gwangju Institute of Science and Technology (GIST), Gwangju, South Korea
2 shared publications - Youngseok Jang
KAIST
2 shared publications
Latest Publications
- 25 August 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (10) , 15361-15374
Plane-Based Stereo Visual Localization With a Prior LiDAR Map
In autonomous driving, a prior LiDAR map(PLM) is used as a powerful tool for correcting SLAM drift, but finding robust and accurate correspondences between cross modal sensors is a challenging problem. To address this cross-modality issue, this paper proposes a real-time plane-based stereo localization system with a PLM. In the proposed system, drift in visual pose estimation is eliminated through plane-based joint optimization and the registration module. Two types of planes are employed in this system: surfel, ensuring accuracy in a narrow domain, and global plane, providing robustness in a wide area. For accurate and robust matching between the visual map point and PLM, surfels and global planes in PLM are utilized collaboratively based on point-to-PLM distance. To reduce the computational cost of the registration module, a plane-to-plane drift estimation module is proposed. The performance of the proposed system is extensively validated across synthetic simulation and real-world indoor and outdoor datasets. We validate the effectiveness of each module through ablation studies and also assess the robustness against error that may exist in PLM and initial pose. In most of the validation, the proposed system shows more accurate and robust performance compared to the state-of-the-art methods.
- 25 August 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 26 (10) , 15361-15374
Plane-Based Stereo Visual Localization With a Prior LiDAR Map
In autonomous driving, a prior LiDAR map(PLM) is used as a powerful tool for correcting SLAM drift, but finding robust and accurate correspondences between cross modal sensors is a challenging problem. To address this cross-modality issue, this paper proposes a real-time plane-based stereo localization system with a PLM. In the proposed system, drift in visual pose estimation is eliminated through plane-based joint optimization and the registration module. Two types of planes are employed in this system: surfel, ensuring accuracy in a narrow domain, and global plane, providing robustness in a wide area. For accurate and robust matching between the visual map point and PLM, surfels and global planes in PLM are utilized collaboratively based on point-to-PLM distance. To reduce the computational cost of the registration module, a plane-to-plane drift estimation module is proposed. The performance of the proposed system is extensively validated across synthetic simulation and real-world indoor and outdoor datasets. We validate the effectiveness of each module through ablation studies and also assess the robustness against error that may exist in PLM and initial pose. In most of the validation, the proposed system shows more accurate and robust performance compared to the state-of-the-art methods.
- 27 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-16
Real-Time Moving Object Detection for 3-D LiDAR Using Occlusion Accumulation in Range Image
Deep learning methods have been applied to detect moving objects from 3D LiDAR data, but they require extra computing devices (GPUs) and often struggle to operate at real-time LiDAR frame rates. Additionally, retraining is necessary for new environments, which demands significant resources. Non-learning methods that operate online without prior maps and rely solely on a CPU often fail to achieve real-time performance. Furthermore, they are limited in applicability due to their dependence on specific pose estimation algorithms. To address these issues, we propose a novel occlusion accumulation framework in the range image domain for real-time 3D LiDAR moving object detection on a CPU. By incorporating compensation strategies that account for LiDAR artifacts and measurement sparsity, the proposed method reduces false positives and improves detection accuracy. Our approach is also flexible, integrating seamlessly with different pose estimation algorithms without performance degradation. Extensive experiments on KITTI, Apollo, and CARLA datasets demonstrate that the proposed method achieves competitive results compared to state-of-the-art (SOTA) learning-based methods on KITTI and outperforms them in cross-validation on Apollo and CARLA. Moreover, the proposed method operates four times faster than SOTA non-learning-based methods while offering higher detection accuracy, making it highly suitable for real-world applications in autonomous driving and robotic navigation. We provide all the source code and datasets used in this paper to the public at: https://github.com/JunhaAgu/Mapless_Moving.
- 27 February 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-16
Real-Time Moving Object Detection for 3-D LiDAR Using Occlusion Accumulation in Range Image
Deep learning methods have been applied to detect moving objects from 3D LiDAR data, but they require extra computing devices (GPUs) and often struggle to operate at real-time LiDAR frame rates. Additionally, retraining is necessary for new environments, which demands significant resources. Non-learning methods that operate online without prior maps and rely solely on a CPU often fail to achieve real-time performance. Furthermore, they are limited in applicability due to their dependence on specific pose estimation algorithms. To address these issues, we propose a novel occlusion accumulation framework in the range image domain for real-time 3D LiDAR moving object detection on a CPU. By incorporating compensation strategies that account for LiDAR artifacts and measurement sparsity, the proposed method reduces false positives and improves detection accuracy. Our approach is also flexible, integrating seamlessly with different pose estimation algorithms without performance degradation. Extensive experiments on KITTI, Apollo, and CARLA datasets demonstrate that the proposed method achieves competitive results compared to state-of-the-art (SOTA) learning-based methods on KITTI and outperforms them in cross-validation on Apollo and CARLA. Moreover, the proposed method operates four times faster than SOTA non-learning-based methods while offering higher detection accuracy, making it highly suitable for real-world applications in autonomous driving and robotic navigation. We provide all the source code and datasets used in this paper to the public at: https://github.com/JunhaAgu/Mapless_Moving.
- 30 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics & Automation Magazine
- Vol. 32 (3) , 88-102
Towards Fully Integrated Autonomous Excavation: Autonomous Excavator for Precise Earth Cutting and Onboard Landscape Inspection
Autonomous excavator systems (AESs) can alleviate the issues caused by the shortage of skilled labor forces and increasing labor costs. For autonomous excavation, real-time landscape estimation, excavation path generation, control, and precise landscape inspection are all essential. In this article, we propose and experimentally validate an integrated AES that incorporates all these elements. Specifically, unlike previous research, we introduce a sensor arrangement capable of sufficiently covering the regions of interest (ROIs) regardless of the inclination of the target landscape, a motion planning method that satisfies geometric and physical constraints, and a precise postexcavation inspection module using onboard sensors only. The proposed methodology was experimentally validated using a real 30-ton hydraulic excavator. It successfully performed a cutting task on an upward slope with 45° inclination and achieved a centimeter-level accuracy through autonomous repetitive excavation; also, the proposed postexcavation inspection method demonstrated subcentimeter precision within seconds using onboard sensors only.
- 30 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics & Automation Magazine
- Vol. 32 (3) , 88-102
Towards Fully Integrated Autonomous Excavation: Autonomous Excavator for Precise Earth Cutting and Onboard Landscape Inspection
Autonomous excavator systems (AESs) can alleviate the issues caused by the shortage of skilled labor forces and increasing labor costs. For autonomous excavation, real-time landscape estimation, excavation path generation, control, and precise landscape inspection are all essential. In this article, we propose and experimentally validate an integrated AES that incorporates all these elements. Specifically, unlike previous research, we introduce a sensor arrangement capable of sufficiently covering the regions of interest (ROIs) regardless of the inclination of the target landscape, a motion planning method that satisfies geometric and physical constraints, and a precise postexcavation inspection module using onboard sensors only. The proposed methodology was experimentally validated using a real 30-ton hydraulic excavator. It successfully performed a cutting task on an upward slope with 45° inclination and achieved a centimeter-level accuracy through autonomous repetitive excavation; also, the proposed postexcavation inspection method demonstrated subcentimeter precision within seconds using onboard sensors only.
- 11 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 4243-4256
Autonomous Heavy Object Pushing Using a Coaxial Tiltrotor
Aerial physical interaction (APhI) with a multirotor-based platform such as pushing a heavy object demands generation of a sufficiently large interaction force while maintaining the stability. Such requirement can cause rotor saturation, because the rotor thrust enlarged for interaction force may leave a reduced margin for attitude stabilization. We first design an $H$ -shaped coaxial tiltrotor that can generate a sufficiently large interaction force than a conventional multirotor. We then propose an overall framework composed of high-level robust controller and low-level control allocation for the coaxial tiltrotor to ensure robustness against uncertain motion of the unknown interacting object and to overcome the saturation issue. To guarantee the robustness at all time, we design a controller based on a nonlinear disturbance observer (DOB). Then, we formulate a problem of computing low-level actuator inputs avoiding rotor saturation as a tractable nonlinear optimization problem, which can be solved real-time. The proposed framework is validated in extensive real-world experiments where the $3.3$ kg tiltrotor successfully pushes a cart weighing up to $60$ kg. An ablation study with the tiltrotor shows effectiveness of the proposed control allocation law in avoiding rotor saturation. Furthermore, a comparative experiment with a conventional multirotor shows failure in the same setting, which validates the use of the coaxial tiltrotor. An experimental video can be found at https://youtu.be/Gdmcmoz_UjU Note to Practitioners —The motivation of this work is to enable heavy object manipulation, especially pushing operation, using a multirotor platform. To push a heavy object, which has not been treated in existing works, is challenging due to the presence of a large unknown interaction wrench and rotor saturation issue. To resolve this problem, we first build an $H$ -shaped coaxial tiltrotor that can effectively utilize rotor thrusts to generate horizontal interaction force. Then, a robust controller is designed to address uncertainty in the interaction wrench for the tiltrotor. Finally, we propose an optimization-based control allocation to avoid rotor saturation. Real-world experiments including heavy object pushing and ablation study with respect to the control allocation law are conducted to show the effectiveness of the proposed framework. We validate the use of the coaxial tiltrotor in additional comparative experiments with a conventional multirotor which fails in pushing a $60$ kg cart. The proposed framework can be utilized in various applications such as disaster relief operations, emergency rescue and aerial delivery.
- 11 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 4243-4256
Autonomous Heavy Object Pushing Using a Coaxial Tiltrotor
Aerial physical interaction (APhI) with a multirotor-based platform such as pushing a heavy object demands generation of a sufficiently large interaction force while maintaining the stability. Such requirement can cause rotor saturation, because the rotor thrust enlarged for interaction force may leave a reduced margin for attitude stabilization. We first design an $H$ -shaped coaxial tiltrotor that can generate a sufficiently large interaction force than a conventional multirotor. We then propose an overall framework composed of high-level robust controller and low-level control allocation for the coaxial tiltrotor to ensure robustness against uncertain motion of the unknown interacting object and to overcome the saturation issue. To guarantee the robustness at all time, we design a controller based on a nonlinear disturbance observer (DOB). Then, we formulate a problem of computing low-level actuator inputs avoiding rotor saturation as a tractable nonlinear optimization problem, which can be solved real-time. The proposed framework is validated in extensive real-world experiments where the $3.3$ kg tiltrotor successfully pushes a cart weighing up to $60$ kg. An ablation study with the tiltrotor shows effectiveness of the proposed control allocation law in avoiding rotor saturation. Furthermore, a comparative experiment with a conventional multirotor shows failure in the same setting, which validates the use of the coaxial tiltrotor. An experimental video can be found at https://youtu.be/Gdmcmoz_UjU Note to Practitioners —The motivation of this work is to enable heavy object manipulation, especially pushing operation, using a multirotor platform. To push a heavy object, which has not been treated in existing works, is challenging due to the presence of a large unknown interaction wrench and rotor saturation issue. To resolve this problem, we first build an $H$ -shaped coaxial tiltrotor that can effectively utilize rotor thrusts to generate horizontal interaction force. Then, a robust controller is designed to address uncertainty in the interaction wrench for the tiltrotor. Finally, we propose an optimization-based control allocation to avoid rotor saturation. Real-world experiments including heavy object pushing and ablation study with respect to the control allocation law are conducted to show the effectiveness of the proposed framework. We validate the use of the coaxial tiltrotor in additional comparative experiments with a conventional multirotor which fails in pushing a $60$ kg cart. The proposed framework can be utilized in various applications such as disaster relief operations, emergency rescue and aerial delivery.
- 2 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (5) , 4854-4861
Image-Based Time-Varying Contact Force Control of Aerial Manipulator Using Robust Impedance Filter
The use of aerial manipulators for safe and efficient physical interaction with their surrounding environments has been gaining attention within the aerial robotics research community. In this paper, we present an image-based time-varying force tracking controller for an aerial manipulator conducting forceful interaction with a static surface. To this end, we first extract visual features from the surface using a monocular camera and calculate image feature vectors for the rotational and translational movements of the camera. Then, the RISATE (Robust Integral of SATuration Error)-based impedance filter continuously updates the desired values of the image features based on the previously designated force profile. Our stability analysis verifies that the error between the desired and actual contact force is uniformly ultimately bounded in an arbitrarily small bound with the proposed strategy even with the switching between free-flight and contact modes. Moreover, through time-varying force-tracking experiments with a quadrotor-based aerial manipulator, we validate the reproducibility and improved force-tracking performance of the proposed method.
- 2 April 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (5) , 4854-4861
Image-Based Time-Varying Contact Force Control of Aerial Manipulator Using Robust Impedance Filter
The use of aerial manipulators for safe and efficient physical interaction with their surrounding environments has been gaining attention within the aerial robotics research community. In this paper, we present an image-based time-varying force tracking controller for an aerial manipulator conducting forceful interaction with a static surface. To this end, we first extract visual features from the surface using a monocular camera and calculate image feature vectors for the rotational and translational movements of the camera. Then, the RISATE (Robust Integral of SATuration Error)-based impedance filter continuously updates the desired values of the image features based on the previously designated force profile. Our stability analysis verifies that the error between the desired and actual contact force is uniformly ultimately bounded in an arbitrarily small bound with the proposed strategy even with the switching between free-flight and contact modes. Moreover, through time-varying force-tracking experiments with a quadrotor-based aerial manipulator, we validate the reproducibility and improved force-tracking performance of the proposed method.
- 11 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 24 (12) , 14757-14771
Scale-Aware Monocular Visual Odometry and Extrinsic Calibration Using Vehicle Kinematics
This paper proposes a new approach to scale-aware monocular visual odometry (VO) and extrinsic calibration using constraints on camera motion by vehicle kinematics. Main idea is to utilize the Ackermann steering model to observe absolute metric scale in turning motion. To describe motion of the camera attached to the vehicle, we first estimate unknown camera-vehicle relative pose by the proposed extrinsic calibration method. To stably observe scale, we detect turn regions and design an observer to estimate the absolute scale as a function of the camera rotation and direction of translational motion during turning. Using the observed scale, we propose an absolute scale recovery to estimate the unknown scale between turns. Because the proposed scale observer becomes singular near zero rotation, we conduct sensitivity analysis on the scale observer, and investigate appropriate conditions for stable scale estimation. For quantitative evaluation of the extrinsic calibration and the absolute scale recovery, we randomly generate synthetic driving datasets with various noise conditions, and evaluate the performance of each module statistically by Monte-Carlo simulations. To evaluate the overall performance, we implement our method and state-of-the-art monocular and stereo VO methods in the public outdoor driving KITTI dataset, and our method shows competitive scale recovery performance with no external sensor and no assumption on surroundings such as planar ground landmarks. To show promising applicability, we collect real-world driving datasets in two multi-floor underground parking lots, and demonstrate the accurate absolute scale recovery performance of our method in indoor driving situations.
- 11 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 24 (12) , 14757-14771
Scale-Aware Monocular Visual Odometry and Extrinsic Calibration Using Vehicle Kinematics
This paper proposes a new approach to scale-aware monocular visual odometry (VO) and extrinsic calibration using constraints on camera motion by vehicle kinematics. Main idea is to utilize the Ackermann steering model to observe absolute metric scale in turning motion. To describe motion of the camera attached to the vehicle, we first estimate unknown camera-vehicle relative pose by the proposed extrinsic calibration method. To stably observe scale, we detect turn regions and design an observer to estimate the absolute scale as a function of the camera rotation and direction of translational motion during turning. Using the observed scale, we propose an absolute scale recovery to estimate the unknown scale between turns. Because the proposed scale observer becomes singular near zero rotation, we conduct sensitivity analysis on the scale observer, and investigate appropriate conditions for stable scale estimation. For quantitative evaluation of the extrinsic calibration and the absolute scale recovery, we randomly generate synthetic driving datasets with various noise conditions, and evaluate the performance of each module statistically by Monte-Carlo simulations. To evaluate the overall performance, we implement our method and state-of-the-art monocular and stereo VO methods in the public outdoor driving KITTI dataset, and our method shows competitive scale recovery performance with no external sensor and no assumption on surroundings such as planar ground landmarks. To show promising applicability, we collect real-world driving datasets in two multi-floor underground parking lots, and demonstrate the accurate absolute scale recovery performance of our method in indoor driving situations.
- Open Access
- 6 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 24087-24102
Scale-Aware Visual-Inertial Depth Estimation and Odometry Using Monocular Self-Supervised Learning
For real-world applications with a single monocular camera, scale ambiguity is an important issue. Because self-supervised data-driven approaches that do not require additional data containing scale information cannot avoid the scale ambiguity, state-of-the-art deep-learning-based methods address this issue by learning the scale information from additional sensor measurements. In that regard, inertial measurement unit (IMU) is a popular sensor for various mobile platforms due to its lightweight and inexpensiveness. However, unlike supervised learning that can learn the scale from the ground-truth information, learning the scale from IMU is challenging in a self-supervised setting. We propose a scale-aware monocular visual-inertial depth estimation and odometry method with end-to-end training. To learn the scale from the IMU measurements with end-to-end training in the monocular self-supervised setup, we propose a new loss function named as preintegration loss function, which trains scale-aware ego-motion by comparing the ego-motion integrated from IMU measurement and predicted ego-motion. Since the gravity and the bias should be compensated to obtain the ego-motion by integrating IMU measurements, we design a network to predict the gravity and the bias in addition to the ego-motion and the depth map. The overall performance of the proposed method is compared to state-of-the-art methods in the popular outdoor driving dataset, i.e., KITTI dataset, and the author-collected indoor driving dataset. In the KITTI dataset, the proposed method shows competitive performance compared with state-of-the-art monocular depth estimation and odometry methods, i.e., root-mean-square error of 5.435 m in the KITTI Eigen split and absolute trajectory error of 22.46 m and 0.2975 degrees in the KITTI odometry 09 sequence. Different from other up-to-scale monocular methods, the proposed method can estimate the metric-scaled depth and camera poses. Additional experiments on the author-collected indoor driving dataset qualitatively confirm the accurate performance of metric-depth and metric pose estimations.
- 6 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 24087-24102
Open AccessScale-Aware Visual-Inertial Depth Estimation and Odometry Using Monocular Self-Supervised Learning
For real-world applications with a single monocular camera, scale ambiguity is an important issue. Because self-supervised data-driven approaches that do not require additional data containing scale information cannot avoid the scale ambiguity, state-of-the-art deep-learning-based methods address this issue by learning the scale information from additional sensor measurements. In that regard, inertial measurement unit (IMU) is a popular sensor for various mobile platforms due to its lightweight and inexpensiveness. However, unlike supervised learning that can learn the scale from the ground-truth information, learning the scale from IMU is challenging in a self-supervised setting. We propose a scale-aware monocular visual-inertial depth estimation and odometry method with end-to-end training. To learn the scale from the IMU measurements with end-to-end training in the monocular self-supervised setup, we propose a new loss function named as preintegration loss function, which trains scale-aware ego-motion by comparing the ego-motion integrated from IMU measurement and predicted ego-motion. Since the gravity and the bias should be compensated to obtain the ego-motion by integrating IMU measurements, we design a network to predict the gravity and the bias in addition to the ego-motion and the depth map. The overall performance of the proposed method is compared to state-of-the-art methods in the popular outdoor driving dataset, i.e., KITTI dataset, and the author-collected indoor driving dataset. In the KITTI dataset, the proposed method shows competitive performance compared with state-of-the-art monocular depth estimation and odometry methods, i.e., root-mean-square error of 5.435 m in the KITTI Eigen split and absolute trajectory error of 22.46 m and 0.2975 degrees in the KITTI odometry 09 sequence. Different from other up-to-scale monocular methods, the proposed method can estimate the metric-scaled depth and camera poses. Additional experiments on the author-collected indoor driving dataset qualitatively confirm the accurate performance of metric-depth and metric pose estimations.
- 1 October 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 74, 1301-1305
Relative Pose Estimator based on Semi-Dense Homography for UAV Landing on Moving Target using Monocular Camera
- 1 October 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 74, 1301-1305
Relative Pose Estimator based on Semi-Dense Homography for UAV Landing on Moving Target using Monocular Camera