Xuejian Bai
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Xuejian Bai has a total of 35 co-authors. Here are the top co-authors by number of shared publications:
- Yu Wang
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
11 shared publications - Min Tan
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
10 shared publications - Shuo Wang
Chinese Academy of Sciences
9 shared publications - Jiaqi Lv
School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
4 shared publications - Rui Wang
Institute of Automation, State Key Laboratory of Multimodal Artificial Intelligence Systems, Chinese Academy of Sciences, Beijing, China
3 shared publications - Xiaolong Hui
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
3 shared publications
Latest Publications
- 12 September 2026
- Published by Elsevier in Ocean Engineering
- Vol. 367
Neuro-adaptive optimal tracking control for underwater tracked robot with guaranteed performance
- 12 September 2026
- Published by Elsevier in Ocean Engineering
- Vol. 367
Neuro-adaptive optimal tracking control for underwater tracked robot with guaranteed performance
- 6 February 2026
- Published by Elsevier in Ocean Engineering
- Vol. 352
Obstacle avoidance path tracking control for underwater tracked robots with path-dependent constraints
- 6 February 2026
- Published by Elsevier in Ocean Engineering
- Vol. 352
Obstacle avoidance path tracking control for underwater tracked robots with path-dependent constraints
- 11 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 37 (3) , 1107-1118
SAFT: Real-Time Tracking and Mapping With Self-Supervised Robust Stereo Matching for Underwater Vehicles
Robust and efficient tracking and mapping are critical for underwater vehicles, but remain challenging due to degraded visual quality, ambiguous features, and limited computational resources. Although recent deep learning-based stereo matching methods have significantly improved geometric perception for robots, most existing approaches struggle to simultaneously achieve high speed and strong generalization. To address these challenges, we propose SAFT, a tracking and mapping framework based on self-supervised, robust, and real-time stereo matching. SAFT introduces three key innovations: 1) SAFT-Stereo, a novel stereo matching network that integrates cost aggregation with iterative optimization to enable efficient disparity estimation in feature-sparse regions; 2) a spatiotemporal self-supervised loss that leverages both spatial and temporal constraints to provide stable training signals in textureless regions; and 3) SAFT-DSOL, a real-time tracking and mapping algorithm that integrates the self-supervised models to achieve robust localization and dense reconstruction. Extensive experiments on both public and custom underwater datasets demonstrate that SAFT-Stereo achieves the best generalization performance among all real-time methods, while requiring only 1/6 of the inference time of RT-IGEV++. Moreover, the proposed SAFT-DSOL enables stable and efficient tracking and achieves real-time dense reconstruction in indoor shipwreck scenarios. The code is available at github.com/c237814486/SAFT-Stereo
- 11 November 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 37 (3) , 1107-1118
SAFT: Real-Time Tracking and Mapping With Self-Supervised Robust Stereo Matching for Underwater Vehicles
Robust and efficient tracking and mapping are critical for underwater vehicles, but remain challenging due to degraded visual quality, ambiguous features, and limited computational resources. Although recent deep learning-based stereo matching methods have significantly improved geometric perception for robots, most existing approaches struggle to simultaneously achieve high speed and strong generalization. To address these challenges, we propose SAFT, a tracking and mapping framework based on self-supervised, robust, and real-time stereo matching. SAFT introduces three key innovations: 1) SAFT-Stereo, a novel stereo matching network that integrates cost aggregation with iterative optimization to enable efficient disparity estimation in feature-sparse regions; 2) a spatiotemporal self-supervised loss that leverages both spatial and temporal constraints to provide stable training signals in textureless regions; and 3) SAFT-DSOL, a real-time tracking and mapping algorithm that integrates the self-supervised models to achieve robust localization and dense reconstruction. Extensive experiments on both public and custom underwater datasets demonstrate that SAFT-Stereo achieves the best generalization performance among all real-time methods, while requiring only 1/6 of the inference time of RT-IGEV++. Moreover, the proposed SAFT-DSOL enables stable and efficient tracking and achieves real-time dense reconstruction in indoor shipwreck scenarios. The code is available at github.com/c237814486/SAFT-Stereo
- 31 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 23315-23325
ViTac-Gripper: A Vision-Based Tactile Gripper With Enhanced Multi-Physical Field Perception for Underwater Robots
Tactile sensing is indispensable for underwater operations, as it provides critical feedback on contact information and environmental interactions. Although existing sensors, such as optical, piezoelectric devices, have been employed for underwater tactile perception, they exhibit some limitations in multi-physical field contact perception. To address these challenges, this study introduces the ViTac-Gripper, a vision-based tactile sensing underwater gripper designed to enhance underwater perception and grasping capabilities. The Finite Element Method (FEM) is utilized to simulate the deformation and force distribution on the tactile surface, providing a high-fidelity model for contact behavior analysis. A domain-aligned multi-physical information perception network framework is proposed, which effectively bridges the simulation-to-reality gap and enables robust extraction of tactile information, including normal/shear force, contact position, 3D Reconstruction and dense force distribution. Experimental results demonstrate the system’s ability to accurately reconstruct multi-physical contact information, while the adaptive grasping strategy ensures stable and reliable object manipulation. The ViTac-Gripper represents a significant advancement in underwater robotics, offering a cost-effective and versatile solution for underwater manipulation tasks.
- 31 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 23315-23325
ViTac-Gripper: A Vision-Based Tactile Gripper With Enhanced Multi-Physical Field Perception for Underwater Robots
Tactile sensing is indispensable for underwater operations, as it provides critical feedback on contact information and environmental interactions. Although existing sensors, such as optical, piezoelectric devices, have been employed for underwater tactile perception, they exhibit some limitations in multi-physical field contact perception. To address these challenges, this study introduces the ViTac-Gripper, a vision-based tactile sensing underwater gripper designed to enhance underwater perception and grasping capabilities. The Finite Element Method (FEM) is utilized to simulate the deformation and force distribution on the tactile surface, providing a high-fidelity model for contact behavior analysis. A domain-aligned multi-physical information perception network framework is proposed, which effectively bridges the simulation-to-reality gap and enables robust extraction of tactile information, including normal/shear force, contact position, 3D Reconstruction and dense force distribution. Experimental results demonstrate the system’s ability to accurately reconstruct multi-physical contact information, while the adaptive grasping strategy ensures stable and reliable object manipulation. The ViTac-Gripper represents a significant advancement in underwater robotics, offering a cost-effective and versatile solution for underwater manipulation tasks.
- 2 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (11) , 11339-11346
OA-Stereo: Self-Supervised Opti-Acoustic Stereo for Robust 3D Perception of Underwater Vehicles
Accurate 3D perception is essential for underwater vehicles in tasks such as seabed mapping, structural reconstruction, and environmental monitoring. However, optical cameras struggle in underwater environments due to light attenuation, scattering, and blurring, while forward-looking sonar suffers from both acoustic noise and lack of elevation angle. Existing methods exploring opti-acoustic stereo imaging predominantly rely on cross-modal matching, yet they remain constrained by sparse reconstruction and exhibit low robustness. To address these limitations, we propose OA-Stereo, a novel self-supervised opti-acoustic stereo framework that integrates calibrated optical and acoustic images for dense depth map estimation, enabling robust 3D perception under adverse optical, acoustic, and calibration conditions. Our key contributions include: (1) OA-StereoNet, a novel architecture that iteratively refines disparity estimation through fusion of optical and acoustic lookup information; and (2) SIGC Loss, a cross-modal self-supervised loss that improves training by promoting consistency between reconstructed and observed sonar images. Extensive experiments conducted on both simulated and real-world underwater datasets demonstrate that OA-Stereo achieves state-of-the-art accuracy and stability under degraded visual conditions, sonar noise, and extrinsic calibration errors.
- 2 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (11) , 11339-11346
OA-Stereo: Self-Supervised Opti-Acoustic Stereo for Robust 3D Perception of Underwater Vehicles
Accurate 3D perception is essential for underwater vehicles in tasks such as seabed mapping, structural reconstruction, and environmental monitoring. However, optical cameras struggle in underwater environments due to light attenuation, scattering, and blurring, while forward-looking sonar suffers from both acoustic noise and lack of elevation angle. Existing methods exploring opti-acoustic stereo imaging predominantly rely on cross-modal matching, yet they remain constrained by sparse reconstruction and exhibit low robustness. To address these limitations, we propose OA-Stereo, a novel self-supervised opti-acoustic stereo framework that integrates calibrated optical and acoustic images for dense depth map estimation, enabling robust 3D perception under adverse optical, acoustic, and calibration conditions. Our key contributions include: (1) OA-StereoNet, a novel architecture that iteratively refines disparity estimation through fusion of optical and acoustic lookup information; and (2) SIGC Loss, a cross-modal self-supervised loss that improves training by promoting consistency between reconstructed and observed sonar images. Extensive experiments conducted on both simulated and real-world underwater datasets demonstrate that OA-Stereo achieves state-of-the-art accuracy and stability under degraded visual conditions, sonar noise, and extrinsic calibration errors.
- 28 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 55 (7) , 3073-3084
Design and Pipeline Tracking Control of an Underwater Biomimetic Vehicle-Manipulator System With Hybrid Propulsion
Underwater vehicle-manipulator systems (UVMSs) play crucial roles in the fields of underwater target monitoring and pipeline maintenance. However, achieving accurate tracking for underwater pipelines is challenging due to the complexity of UVMSs in terms of nonlinearity, strong coupling and underactuation. To solve the aforementioned problems, an underwater biomimetic vehicle-manipulator system (UBVMS) and an underwater pipeline tracking control method based on the robot vision are proposed. The UBVMS is equipped with the biomimetic undulatory fin propulsors and the biomimetic flipper propulsors, which are inspired by the median and/or paired fin propulsion mode and the body and/or caudal fin propulsion mode of fishes, respectively. The biomimetic undulatory fin propulsors provide the UBVMS with advantages of maneuverability and stability, while the biomimetic flipper propulsors enable the UBVMS to have improved acceleration ability. A tracking control algorithm with adaptive weight coefficients is designed to improve the pose stability of the UBVMS. A fuzzy rule mapping model is constructed to describe the nonlinear relationship between the biomimetic propulsors’ control parameters and the propulsive force/torque. Finally, four types of pipeline tracking experiments are conducted to verify the effectiveness and feasibility of the proposed UBVMS and control algorithm.
- 28 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 55 (7) , 3073-3084
Design and Pipeline Tracking Control of an Underwater Biomimetic Vehicle-Manipulator System With Hybrid Propulsion
Underwater vehicle-manipulator systems (UVMSs) play crucial roles in the fields of underwater target monitoring and pipeline maintenance. However, achieving accurate tracking for underwater pipelines is challenging due to the complexity of UVMSs in terms of nonlinearity, strong coupling and underactuation. To solve the aforementioned problems, an underwater biomimetic vehicle-manipulator system (UBVMS) and an underwater pipeline tracking control method based on the robot vision are proposed. The UBVMS is equipped with the biomimetic undulatory fin propulsors and the biomimetic flipper propulsors, which are inspired by the median and/or paired fin propulsion mode and the body and/or caudal fin propulsion mode of fishes, respectively. The biomimetic undulatory fin propulsors provide the UBVMS with advantages of maneuverability and stability, while the biomimetic flipper propulsors enable the UBVMS to have improved acceleration ability. A tracking control algorithm with adaptive weight coefficients is designed to improve the pose stability of the UBVMS. A fuzzy rule mapping model is constructed to describe the nonlinear relationship between the biomimetic propulsors’ control parameters and the propulsive force/torque. Finally, four types of pipeline tracking experiments are conducted to verify the effectiveness and feasibility of the proposed UBVMS and control algorithm.
- 22 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 72 (12) , 13561-13571
Autonomous Free-Floating Underwater Assembly Control for an Underwater Biomimetic Vehicle-Manipulator System
In this article, an improved coordinated control method based on the tracking differentiator with a median filter and dynamic surface control was proposed for an autonomous free-floating underwater assembly manipulation. In addition, the disturbances caused by the manipulator’s motion were considered and compensated by a feedforward controller of the manipulator. Furthermore, the inward counter-propagating sinusoidal waves of the biomimetic undulatory-finned propulsors were adopted and a fuzzy logic controller was designed to realize the transformation between the control parameters and the demanded propulsive forces. The stability of the proposed control scheme was proven by the Lyapunov theory. Finally, practical experiments verified that the control scheme can complete the autonomous free-floating underwater assembly manipulation task, which indicated the good feasibility and robustness of the proposed methods.
- 22 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 72 (12) , 13561-13571
Autonomous Free-Floating Underwater Assembly Control for an Underwater Biomimetic Vehicle-Manipulator System
In this article, an improved coordinated control method based on the tracking differentiator with a median filter and dynamic surface control was proposed for an autonomous free-floating underwater assembly manipulation. In addition, the disturbances caused by the manipulator’s motion were considered and compensated by a feedforward controller of the manipulator. Furthermore, the inward counter-propagating sinusoidal waves of the biomimetic undulatory-finned propulsors were adopted and a fuzzy logic controller was designed to realize the transformation between the control parameters and the demanded propulsive forces. The stability of the proposed control scheme was proven by the Lyapunov theory. Finally, practical experiments verified that the control scheme can complete the autonomous free-floating underwater assembly manipulation task, which indicated the good feasibility and robustness of the proposed methods.
- 18 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 41 (15523098) , 3099-3112
A Biomimetic Rigid-Soft Hybrid Underwater Gripper With Compliance, Stability, Precise Control, and High Load Capacity
The complex underwater environment presents numerous challenges for the design of soft grippers, which often suffer from limited load capacity, poor stability, low portability, and imprecise control. This paper proposes a novel rigid-soft hybrid gripper specifically designed for underwater use. The gripper's finger is constructed from silicone, reinforced with a multi-link rigid exoskeleton on the outside, and actuated by tendons. This design provides three key advantages: compliance (capable of handling fragile objects such as a piece of tofu), heavy lifting (demonstrated by lifting an 80 kg barbell with three fingers), and precise, stable operation (the hybrid gripper maintains its shape despite water flow disturbances). Additionally, the gripper is compact and lightweight, with the driving system powered by just four 23g servo motors, making it easy to mount on various underwater robots. To enable precise control, both specialized kinematic and mechanics models were developed, allowing accurate predictions of the relationships among tendon displacement, exoskeleton deformation, soft material deformation, and tendon tension. This study thoroughly considers the challenges of underwater environments, offering new insights for advancing the field of underwater soft grasping.
- 18 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Robotics
- Vol. 41 (15523098) , 3099-3112
A Biomimetic Rigid-Soft Hybrid Underwater Gripper With Compliance, Stability, Precise Control, and High Load Capacity
The complex underwater environment presents numerous challenges for the design of soft grippers, which often suffer from limited load capacity, poor stability, low portability, and imprecise control. This paper proposes a novel rigid-soft hybrid gripper specifically designed for underwater use. The gripper's finger is constructed from silicone, reinforced with a multi-link rigid exoskeleton on the outside, and actuated by tendons. This design provides three key advantages: compliance (capable of handling fragile objects such as a piece of tofu), heavy lifting (demonstrated by lifting an 80 kg barbell with three fingers), and precise, stable operation (the hybrid gripper maintains its shape despite water flow disturbances). Additionally, the gripper is compact and lightweight, with the driving system powered by just four 23g servo motors, making it easy to mount on various underwater robots. To enable precise control, both specialized kinematic and mechanics models were developed, allowing accurate predictions of the relationships among tendon displacement, exoskeleton deformation, soft material deformation, and tendon tension. This study thoroughly considers the challenges of underwater environments, offering new insights for advancing the field of underwater soft grasping.
- 6 November 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 72 (6) , 6114-6123
Cruise and Operation of a Biomimetic Underwater Vehicle via Parametrization Adaptive Model Predictive Control
Motivated by the need to replace the artificial collection of marine organisms, a bionic undulating fin-propelled biomimetic underwater vehicle (BUV) with low-speed stability is developed. A parametrization adaptive model predictive controller (PAMPC) algorithm is proposed for the control of the BUV. Active attitude stability control of roll and pitch angles and various practical constraints, such as the velocity, maximum angles, and control inputs saturation, are fully considered by the PAMPC. To stabilize the system states faster, nonlinear adaptive weight functions are designed for the state errors and the change of state errors, respectively. Furthermore, the change rate of the control inputs is considered in the optimization function to ensure the attitude stability of the BUV. Finally, comparative simulations and experiments between the PAMPC and the traditional MPC, and an experiment of the BUV autonomous depth-fixed cruising and collecting marine organisms with stable attitude angles are carried out to verify the performance.
- 6 November 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 72 (6) , 6114-6123
Cruise and Operation of a Biomimetic Underwater Vehicle via Parametrization Adaptive Model Predictive Control
Motivated by the need to replace the artificial collection of marine organisms, a bionic undulating fin-propelled biomimetic underwater vehicle (BUV) with low-speed stability is developed. A parametrization adaptive model predictive controller (PAMPC) algorithm is proposed for the control of the BUV. Active attitude stability control of roll and pitch angles and various practical constraints, such as the velocity, maximum angles, and control inputs saturation, are fully considered by the PAMPC. To stabilize the system states faster, nonlinear adaptive weight functions are designed for the state errors and the change of state errors, respectively. Furthermore, the change rate of the control inputs is considered in the optimization function to ensure the attitude stability of the BUV. Finally, comparative simulations and experiments between the PAMPC and the traditional MPC, and an experiment of the BUV autonomous depth-fixed cruising and collecting marine organisms with stable attitude angles are carried out to verify the performance.
- 8 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 28 (3) , 1415-1424
A Collision-Free Planning and Control Framework for a Biomimetic Underwater Vehicle in Dynamic Environments
In this article, a collision-free planning and control framework for a biomimetic underwater vehicle (BUV) in dynamic environments is presented. It consists of obstacle avoidance planning, arctangent nonsingularity terminal sliding mode (ANTSM) control, and fuzzy inference. A fuzzy artificial potential field with a velocity component is designed for obstacle avoidance planning. An ANTSM controller with an arctangent function is proposed to guarantee a shorter convergence time of system states. The stability of the system is analyzed by the Lyapunov theory. A fuzzy inference module is given to construct the nonlinear relationship between the control parameters of the flippers and force/torque. Finally, comparative simulations, robot operating system-based simulations, and underwater obstacle avoidance experiments of the BUV in a swimming pool are conducted to validate the performance of the proposed collision-free planning and control algorithm.
- 8 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ASME Transactions on Mechatronics
- Vol. 28 (3) , 1415-1424
A Collision-Free Planning and Control Framework for a Biomimetic Underwater Vehicle in Dynamic Environments
In this article, a collision-free planning and control framework for a biomimetic underwater vehicle (BUV) in dynamic environments is presented. It consists of obstacle avoidance planning, arctangent nonsingularity terminal sliding mode (ANTSM) control, and fuzzy inference. A fuzzy artificial potential field with a velocity component is designed for obstacle avoidance planning. An ANTSM controller with an arctangent function is proposed to guarantee a shorter convergence time of system states. The stability of the system is analyzed by the Lyapunov theory. A fuzzy inference module is given to construct the nonlinear relationship between the control parameters of the flippers and force/torque. Finally, comparative simulations, robot operating system-based simulations, and underwater obstacle avoidance experiments of the BUV in a swimming pool are conducted to validate the performance of the proposed collision-free planning and control algorithm.