Haolin Fei
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Haolin Fei has a total of 24 co-authors. Here are the top co-authors by number of shared publications:
- Ziwei Wang
Nanyang Technological University
4 shared publications - Allahyar Montazeri
School of Engineering, Lancaster University, Lancaster, U.K.
1 shared publication Andrew Kennedy
1 shared publication- Angela Faragasso
Department of Precision Engineering, The University of Tokyo, Tokyo, Japan
1 shared publication - Bo Xiao
Hamlyn Centre for Robotic Surgery, Imperial College London, London, U.K
1 shared publication - Elmira Yadollahi
School of Computing and Communications, Lancaster University, Lancaster, United Kingdom
1 shared publication
Latest Publications
- 29 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics & Automation Magazine
- Vol. 33 (1) , 74-84
Large-Language-Model-Aided Assistive Robot for Single-Operator Bimanual Teleoperation: Introduction and Validation of a Flexible Assistance System
Bimanual teleoperation tasks are highly demanding for human operators, requiring the simultaneous control of two robotic arms while managing complex coordination and cognitive load. Current approaches to this challenge often rely on rigid control schemes or task-specific automations that do not adapt well to dynamic environments or varied operator needs. This article presents a novel large language model (LLM)-aided bimanual teleoperation assistant (BTLA) that helps operators control dual-arm robots through an intuitive voice command interface and variable autonomy. The BTLA system enables a hybrid control paradigm by combining natural language interaction for an assistive robot arm with direct teleoperation of the dominant robotic arm. Our system implements six core manipulation skills with varying autonomy, ranging from direct mirroring to autonomous object manipulation. The BTLA leverages the LLM to interpret natural language commands and select an appropriate assistance mode based on task requirements and operator preferences. Experimental validation on bimanual object manipulation tasks demonstrates that the BTLA system yields a 240.8% increase in success rate over solo teleoperation and a 69.9% increase over dyadic teleoperation, while significantly reducing operator mental workload. In addition, we validate our approach on a physical dual-arm UR3e robot system, achieving a 90% success rate on challenging soft bottle handling and box transportation tasks.
- 29 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics & Automation Magazine
- Vol. 33 (1) , 74-84
Large-Language-Model-Aided Assistive Robot for Single-Operator Bimanual Teleoperation: Introduction and Validation of a Flexible Assistance System
Bimanual teleoperation tasks are highly demanding for human operators, requiring the simultaneous control of two robotic arms while managing complex coordination and cognitive load. Current approaches to this challenge often rely on rigid control schemes or task-specific automations that do not adapt well to dynamic environments or varied operator needs. This article presents a novel large language model (LLM)-aided bimanual teleoperation assistant (BTLA) that helps operators control dual-arm robots through an intuitive voice command interface and variable autonomy. The BTLA system enables a hybrid control paradigm by combining natural language interaction for an assistive robot arm with direct teleoperation of the dominant robotic arm. Our system implements six core manipulation skills with varying autonomy, ranging from direct mirroring to autonomous object manipulation. The BTLA leverages the LLM to interpret natural language commands and select an appropriate assistance mode based on task requirements and operator preferences. Experimental validation on bimanual object manipulation tasks demonstrates that the BTLA system yields a 240.8% increase in success rate over solo teleoperation and a 69.9% increase over dyadic teleoperation, while significantly reducing operator mental workload. In addition, we validate our approach on a physical dual-arm UR3e robot system, achieving a 90% success rate on challenging soft bottle handling and box transportation tasks.
- 26 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Cyber-Physical Systems
- Vol. 3, 588-596
Teleoperated Cyber-Physical System for Cable-Driven Hyper-Redundant Flexible Manipulation
Increased space missions rely on ground-based cyber-physical systems (CPS) to facilitate remote interventions during satellite anomalies. When solar panel deployment failures occur, integrating real-time sensing, computation, and precise robotic control becomes essential for recovery operations. To this end, this paper introduces a cable-driven hyper-redundant flexible manipulator (CHFM) for teleoperated intervention through ground control. To achieve continuous configuration control of the CHFM in constrained environments, we propose a novel planning approach to facilitate end-arm synchronization. Based on this planning strategy, a comprehensive teleoperation CPS architecture is developed, integrating operating, computing and processing, visualization, safety detection, and network modules. Experimental results demonstrate the system's ability to navigate through narrow satellite panel slits, verifying both the system's operational reliability and the effectiveness of the proposed planning method. The results indicate significant improvements in the accuracy of task completion for complex remote manipulation.
- 26 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Cyber-Physical Systems
- Vol. 3, 588-596
Teleoperated Cyber-Physical System for Cable-Driven Hyper-Redundant Flexible Manipulation
Increased space missions rely on ground-based cyber-physical systems (CPS) to facilitate remote interventions during satellite anomalies. When solar panel deployment failures occur, integrating real-time sensing, computation, and precise robotic control becomes essential for recovery operations. To this end, this paper introduces a cable-driven hyper-redundant flexible manipulator (CHFM) for teleoperated intervention through ground control. To achieve continuous configuration control of the CHFM in constrained environments, we propose a novel planning approach to facilitate end-arm synchronization. Based on this planning strategy, a comprehensive teleoperation CPS architecture is developed, integrating operating, computing and processing, visualization, safety detection, and network modules. Experimental results demonstrate the system's ability to navigate through narrow satellite panel slits, verifying both the system's operational reliability and the effectiveness of the proposed planning method. The results indicate significant improvements in the accuracy of task completion for complex remote manipulation.
- Open Access
Machine Learning-Driven Optimization of Micro-Textured Surfaces for Enhanced Tribological Performance: A Comparative Analysis of Predictive Models
Micro-textured surfaces show promise in improving tribological properties, but predicting their performance remains challenging due to complex relationships between surface features and frictional behavior. This study evaluates five algorithms—linear regression, decision tree, gradient boosting, support vector machine, and neural network—for their ability to predict load-carrying capacity and friction force based on texture parameters including depth, side length, surface ratio, and shape. The neural network model demonstrated superior performance, achieving the lowest MAE (24.01) and highest R-squared value (0.99) for friction force prediction. The results highlight the potential of machine learning techniques to enhance the understanding and prediction of friction-reducing micro-textures, contributing to the development of more efficient and durable tribological systems in industrial applications.
Open AccessMachine Learning-Driven Optimization of Micro-Textured Surfaces for Enhanced Tribological Performance: A Comparative Analysis of Predictive Models
Micro-textured surfaces show promise in improving tribological properties, but predicting their performance remains challenging due to complex relationships between surface features and frictional behavior. This study evaluates five algorithms—linear regression, decision tree, gradient boosting, support vector machine, and neural network—for their ability to predict load-carrying capacity and friction force based on texture parameters including depth, side length, surface ratio, and shape. The neural network model demonstrated superior performance, achieving the lowest MAE (24.01) and highest R-squared value (0.99) for friction force prediction. The results highlight the potential of machine learning techniques to enhance the understanding and prediction of friction-reducing micro-textures, contributing to the development of more efficient and durable tribological systems in industrial applications.
- Open Access
Dynamic Hand Gesture-Featured Human Motor Adaptation in Tool Delivery using Voice Recognition
Human-robot collaboration has benefited users with higher efficiency towards interactive tasks. Nevertheless, most collaborative schemes rely on complicated human-machine interfaces, which might lack the requisite intuitiveness compared with natural limb control. We also expect to understand human intent with low training data requirements. In response to these challenges, this paper introduces an innovative human-robot collaborative framework that seamlessly integrates hand gesture and dynamic movement recognition, voice recognition, and a switchable control adaptation strategy. These modules provide a user-friendly approach that enables the robot to deliver the tools as per user need, especially when the user is working with both hands. Therefore, users can focus on their task execution without additional training in the use of human-machine interfaces, while the robot interprets their intuitive gestures. The proposed multimodal interaction framework is executed in the UR5e robot platform equipped with a RealSense D435i camera, and the effectiveness is assessed through a soldering circuit board task. The experiment results have demonstrated superior performance in hand gesture recognition, where the static hand gesture recognition module achieves an accuracy of 94.3\%, while the dynamic motion recognition module reaches 97.6\% accuracy. Compared with human solo manipulation, the proposed approach facilitates higher efficiency tool delivery, without significantly distracting from human intents.
Open AccessDynamic Hand Gesture-Featured Human Motor Adaptation in Tool Delivery using Voice Recognition
Human-robot collaboration has benefited users with higher efficiency towards interactive tasks. Nevertheless, most collaborative schemes rely on complicated human-machine interfaces, which might lack the requisite intuitiveness compared with natural limb control. We also expect to understand human intent with low training data requirements. In response to these challenges, this paper introduces an innovative human-robot collaborative framework that seamlessly integrates hand gesture and dynamic movement recognition, voice recognition, and a switchable control adaptation strategy. These modules provide a user-friendly approach that enables the robot to deliver the tools as per user need, especially when the user is working with both hands. Therefore, users can focus on their task execution without additional training in the use of human-machine interfaces, while the robot interprets their intuitive gestures. The proposed multimodal interaction framework is executed in the UR5e robot platform equipped with a RealSense D435i camera, and the effectiveness is assessed through a soldering circuit board task. The experiment results have demonstrated superior performance in hand gesture recognition, where the static hand gesture recognition module achieves an accuracy of 94.3\%, while the dynamic motion recognition module reaches 97.6\% accuracy. Compared with human solo manipulation, the proposed approach facilitates higher efficiency tool delivery, without significantly distracting from human intents.
- 3 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive and Developmental Systems
- Vol. 16 (2) , 416-425
Learning to Assist Bimanual Teleoperation Using Interval Type-2 Polynomial Fuzzy Inference
Assisting humans in collaborative tasks is a promising application for robots, however effective assistance remains challenging. In this paper, we propose a method for providing intuitive robotic assistance based on learning from human natural limb coordination. To encode coupling between multiple-limb motions, we use a novel interval type-2 (IT2) polynomial fuzzy inference for modeling trajectory adaptation. The associated polynomial coefficients are estimated using a modified recursive least-square with a dynamic forgetting factor. We propose to employ a Gaussian process to produce robust human motion predictions, and thus address the uncertainty and measurement noise of the system caused by interactive environments. Experimental results on two types of interaction tasks demonstrate the effectiveness of this approach, which achieves high accuracy in predicting assistive limb motion and enables humans to perform bimanual tasks using only one limb.
- 3 May 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive and Developmental Systems
- Vol. 16 (2) , 416-425
Learning to Assist Bimanual Teleoperation Using Interval Type-2 Polynomial Fuzzy Inference
Assisting humans in collaborative tasks is a promising application for robots, however effective assistance remains challenging. In this paper, we propose a method for providing intuitive robotic assistance based on learning from human natural limb coordination. To encode coupling between multiple-limb motions, we use a novel interval type-2 (IT2) polynomial fuzzy inference for modeling trajectory adaptation. The associated polynomial coefficients are estimated using a modified recursive least-square with a dynamic forgetting factor. We propose to employ a Gaussian process to produce robust human motion predictions, and thus address the uncertainty and measurement noise of the system caused by interactive environments. Experimental results on two types of interaction tasks demonstrate the effectiveness of this approach, which achieves high accuracy in predicting assistive limb motion and enables humans to perform bimanual tasks using only one limb.