Yangtao Ge
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Yangtao Ge has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Jing Wu
Department of Mechanical and Energy Engineering, Southern University of Science and Technology (SUSTech), Shenzhen, China
3 shared publications - Chen Yao
Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Department of Mechanical and Energy Engineering, Southern University of Science and Technology (SUSTech), Shenzhen, China
2 shared publications - Zheng Zhu
Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, China
2 shared publications - Zhenzhong Jia
Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems, Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, China
2 shared publications - Zirui Wang
Department of Mechanical and Energy Engineering, Southern University of Science and Technology (SUSTech), Shenzhen, China
2 shared publications Bangzhen Huang
Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, Guangdong Province, P R China
1 shared publication
Latest Publications
- 26 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (2) , 1680-1687
FAST-LIEO: Fast and Real-Time LiDAR-Inertial-Event-Visual Odometry
Unlike a standard camera that relies on exposure to obtain output frame by frame, an event camera only outputs an event when the change of brightness intensity in a pixel exceeds a threshold, and the outputs of different pixels are independent to each other. Benefited from its bio-inspired design, event camera has the advantages of low latency and high dynamic range. The researches on multi-sensor fusion with event camera are few so far. In this paper, we propose FAST-LIEO, a framework for fast and real-time LiDAR-inertial-event odometry. The framework tightly fuses LiDAR and event camera measurements without any feature extraction or matching. Besides, our system supports both LIEO and LIEVO (extended with RGB camera fusion). We design a novel EIO subsystem for LiDAR-event fusion. The EIO subsystem maintains a semi-dense event map and estimates the state by aligning the event representation to map. The semi-dense event map is built from LiDAR points by utilizing the edge information and temporal information provided by event representations. Besides testing our method on public benchmark dataset, we also collected real-world data by utilizing our sensor suite and conducted experiments on our self-captured dataset. The experiment results show the high robustness and accuracy of our method in challenging conditions with high real-time ability. To the best of our knowledge, our FAST-LIEO is the first system that can tightly fuse LiDAR, IMU, event camera and standard camera measurements in simultaneously localization and mapping.
- 26 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (2) , 1680-1687
FAST-LIEO: Fast and Real-Time LiDAR-Inertial-Event-Visual Odometry
Unlike a standard camera that relies on exposure to obtain output frame by frame, an event camera only outputs an event when the change of brightness intensity in a pixel exceeds a threshold, and the outputs of different pixels are independent to each other. Benefited from its bio-inspired design, event camera has the advantages of low latency and high dynamic range. The researches on multi-sensor fusion with event camera are few so far. In this paper, we propose FAST-LIEO, a framework for fast and real-time LiDAR-inertial-event odometry. The framework tightly fuses LiDAR and event camera measurements without any feature extraction or matching. Besides, our system supports both LIEO and LIEVO (extended with RGB camera fusion). We design a novel EIO subsystem for LiDAR-event fusion. The EIO subsystem maintains a semi-dense event map and estimates the state by aligning the event representation to map. The semi-dense event map is built from LiDAR points by utilizing the edge information and temporal information provided by event representations. Besides testing our method on public benchmark dataset, we also collected real-world data by utilizing our sensor suite and conducted experiments on our self-captured dataset. The experiment results show the high robustness and accuracy of our method in challenging conditions with high real-time ability. To the best of our knowledge, our FAST-LIEO is the first system that can tightly fuse LiDAR, IMU, event camera and standard camera measurements in simultaneously localization and mapping.
- 30 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (7) , 6696-6703
TAIL: A Terrain-Aware Multi-Modal SLAM Dataset for Robot Locomotion in Deformable Granular Environments
Terrain-aware perception holds the potential to improve the robustness and accuracy of autonomous robot navigation in the wilds, thereby facilitating effective off-road traversals. However, the lack of multi-modal perception across various motion patterns hinders the solutions of Simultaneous Localization And Mapping (SLAM), especially when confronting non-geometric hazards in demanding landscapes. In this paper, we first propose a Terrain-Aware multI-modaL (TAIL) dataset tailored to deformable and sandy terrains. It incorporates various types of robotic proprioception and distinct ground interactions for the unique challenges and benchmark of multi-sensor fusion SLAM. The versatile sensor suite comprises stereo frame cameras, multiple ground-pointing RGB-D cameras, a rotating 3D LiDAR, an IMU, and an RTK device. This ensemble is hardware-synchronized, well-calibrated, and self-contained. Utilizing both wheeled and quadrupedal locomotion, we efficiently collect comprehensive sequences to capture rich unstructured scenarios. It spans the spectrum of scope, terrain interactions, scene changes, ground-level properties, and dynamic robot characteristics. We benchmark several state-of-the-art SLAM methods against ground truth and provide performance validations. Corresponding challenges and limitations are also reported.
- 30 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (7) , 6696-6703
TAIL: A Terrain-Aware Multi-Modal SLAM Dataset for Robot Locomotion in Deformable Granular Environments
Terrain-aware perception holds the potential to improve the robustness and accuracy of autonomous robot navigation in the wilds, thereby facilitating effective off-road traversals. However, the lack of multi-modal perception across various motion patterns hinders the solutions of Simultaneous Localization And Mapping (SLAM), especially when confronting non-geometric hazards in demanding landscapes. In this paper, we first propose a Terrain-Aware multI-modaL (TAIL) dataset tailored to deformable and sandy terrains. It incorporates various types of robotic proprioception and distinct ground interactions for the unique challenges and benchmark of multi-sensor fusion SLAM. The versatile sensor suite comprises stereo frame cameras, multiple ground-pointing RGB-D cameras, a rotating 3D LiDAR, an IMU, and an RTK device. This ensemble is hardware-synchronized, well-calibrated, and self-contained. Utilizing both wheeled and quadrupedal locomotion, we efficiently collect comprehensive sequences to capture rich unstructured scenarios. It spans the spectrum of scope, terrain interactions, scene changes, ground-level properties, and dynamic robot characteristics. We benchmark several state-of-the-art SLAM methods against ground truth and provide performance validations. Corresponding challenges and limitations are also reported.
- 11 April 2024
- Published by Cambridge University Press (CUP) in Robotica
- Vol. 42 (7) , 2150-2168
Automatic extrinsic calibration for structured light camera and repetitive LiDARs
The integration of camera and LiDAR technologies has the potential to significantly enhance construction robots’ perception capabilities by providing complementary construction information. Structured light cameras (SLCs) are a desirable alternative as they provide comprehensive information on construction defects. However, fusing these two types of information depends largely on the sensors’ relative positions, which can only be established through extrinsic calibration. This paper introduces a novel calibration algorithm considering a customized board for SLCs and repetitive LiDARs, which are designed to facilitate the automation of construction robots. The calibration board is equipped with four symmetrically distributed hemispheres, whose centers are obtained by fitting the spheres and adoption with the geometric constraints. Subsequently, the spherical centers serve as reference features to estimate the relationship between the sensors. These distinctive features enable our proposed method to only require one calibration board pose and minimize human intervention. We conducted both simulation and real-world experiments to assess the performance of our algorithm. And the results demonstrate that our method exhibits enhanced accuracy and robustness.
- 11 April 2024
- Published by Cambridge University Press (CUP) in Robotica
- Vol. 42 (7) , 2150-2168
Automatic extrinsic calibration for structured light camera and repetitive LiDARs
The integration of camera and LiDAR technologies has the potential to significantly enhance construction robots’ perception capabilities by providing complementary construction information. Structured light cameras (SLCs) are a desirable alternative as they provide comprehensive information on construction defects. However, fusing these two types of information depends largely on the sensors’ relative positions, which can only be established through extrinsic calibration. This paper introduces a novel calibration algorithm considering a customized board for SLCs and repetitive LiDARs, which are designed to facilitate the automation of construction robots. The calibration board is equipped with four symmetrically distributed hemispheres, whose centers are obtained by fitting the spheres and adoption with the geometric constraints. Subsequently, the spherical centers serve as reference features to estimate the relationship between the sensors. These distinctive features enable our proposed method to only require one calibration board pose and minimize human intervention. We conducted both simulation and real-world experiments to assess the performance of our algorithm. And the results demonstrate that our method exhibits enhanced accuracy and robustness.
- 28 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (11) , 7639-7646
Wheel-Terrain Contact Geometry Estimation and Interaction Analysis Using Aside-Wheel Camera Over Deformable Terrains
Wheeled mobile robots (WMRs) have been proven to be quite competitive and useful in outdoor missions. However, they may face serious sinkage or slippage on deformable terrains, and even get stuck or damaged, thereby causing mission failure. To mitigate these risks, it is essential to closely monitor the robot's states and its interactions with soft terrains. In this letter, we propose an integrated wheel-terrain interaction detecting algorithm which can measure sinkage, wheel-terrain contact angles, and slip ratio simultaneously online. This vision-based algorithm requires only one fisheye camera as its input. It has strong versatility and can be applied to rovers with different suspensions or morphology variations. We use a single-wheel testbed to verify our proposed algorithm through various experiments. The algorithm achieves a frequency of over 30 Hz, while maintaining a high level of accuracy. The relative error of sinkage and contact angle measurement is around 2%, and the relative error of slip ratio is less than 0.7%. We also propose a semi-empirical model to estimate the wheel sinkage-slip ratio relationship. With its help, we can avoid potential risks to improve the safety and success rate of the robot.
- 28 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (11) , 7639-7646
Wheel-Terrain Contact Geometry Estimation and Interaction Analysis Using Aside-Wheel Camera Over Deformable Terrains
Wheeled mobile robots (WMRs) have been proven to be quite competitive and useful in outdoor missions. However, they may face serious sinkage or slippage on deformable terrains, and even get stuck or damaged, thereby causing mission failure. To mitigate these risks, it is essential to closely monitor the robot's states and its interactions with soft terrains. In this letter, we propose an integrated wheel-terrain interaction detecting algorithm which can measure sinkage, wheel-terrain contact angles, and slip ratio simultaneously online. This vision-based algorithm requires only one fisheye camera as its input. It has strong versatility and can be applied to rovers with different suspensions or morphology variations. We use a single-wheel testbed to verify our proposed algorithm through various experiments. The algorithm achieves a frequency of over 30 Hz, while maintaining a high level of accuracy. The relative error of sinkage and contact angle measurement is around 2%, and the relative error of slip ratio is less than 0.7%. We also propose a semi-empirical model to estimate the wheel sinkage-slip ratio relationship. With its help, we can avoid potential risks to improve the safety and success rate of the robot.