HFHaolin Fei

Haolin Fei

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Haolin Fei has a total of 24 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Large-Language-Model-Aided Assistive Robot for Single-Operator Bimanual Teleoperation: Introduction and Validation of a Flexible Assistance System

    by Haolin Fei, Songlin Ma, Guanglong Du, Elmira Yadollahi, Hak-Keung Lam, Angela Faragasso, Allahyar Montazeri, Ziwei Wang

    Bimanual teleoperation tasks are highly demanding for human operators, requiring the simultaneous control of two robotic arms while managing complex coordination and cognitive load. Current approaches to this challenge often rely on rigid control schemes or task-specific automations that do not adapt well to dynamic environments or varied operator needs. This article presents a novel large language model (LLM)-aided bimanual teleoperation assistant (BTLA) that helps operators control dual-arm robots through an intuitive voice command interface and variable autonomy. The BTLA system enables a hybrid control paradigm by combining natural language interaction for an assistive robot arm with direct teleoperation of the dominant robotic arm. Our system implements six core manipulation skills with varying autonomy, ranging from direct mirroring to autonomous object manipulation. The BTLA leverages the LLM to interpret natural language commands and select an appropriate assistance mode based on task requirements and operator preferences. Experimental validation on bimanual object manipulation tasks demonstrates that the BTLA system yields a 240.8% increase in success rate over solo teleoperation and a 69.9% increase over dyadic teleoperation, while significantly reducing operator mental workload. In addition, we validate our approach on a physical dual-arm UR3e robot system, achieving a 90% success rate on challenging soft bottle handling and box transportation tasks.


  • Teleoperated Cyber-Physical System for Cable-Driven Hyper-Redundant Flexible Manipulation

    by Yunxuan Ma, Xiaojun Zhu, Haolin Fei, Yiyang He, Xueqian Wang, Yu Liu

    Increased space missions rely on ground-based cyber-physical systems (CPS) to facilitate remote interventions during satellite anomalies. When solar panel deployment failures occur, integrating real-time sensing, computation, and precise robotic control becomes essential for recovery operations. To this end, this paper introduces a cable-driven hyper-redundant flexible manipulator (CHFM) for teleoperated intervention through ground control. To achieve continuous configuration control of the CHFM in constrained environments, we propose a novel planning approach to facilitate end-arm synchronization. Based on this planning strategy, a comprehensive teleoperation CPS architecture is developed, integrating operating, computing and processing, visualization, safety detection, and network modules. Experimental results demonstrate the system's ability to navigate through narrow satellite panel slits, verifying both the system's operational reliability and the effectiveness of the proposed planning method. The results indicate significant improvements in the accuracy of task completion for complex remote manipulation.

  • Open Access

    Machine Learning-Driven Optimization of Micro-Textured Surfaces for Enhanced Tribological Performance: A Comparative Analysis of Predictive Models

    by Zhenghui Ge, Qifan Hu, Rui Wang, Haolin Fei, Yongwei Zhu, Ziwei Wang

    Micro-textured surfaces show promise in improving tribological properties, but predicting their performance remains challenging due to complex relationships between surface features and frictional behavior. This study evaluates five algorithms—linear regression, decision tree, gradient boosting, support vector machine, and neural network—for their ability to predict load-carrying capacity and friction force based on texture parameters including depth, side length, surface ratio, and shape. The neural network model demonstrated superior performance, achieving the lowest MAE (24.01) and highest R-squared value (0.99) for friction force prediction. The results highlight the potential of machine learning techniques to enhance the understanding and prediction of friction-reducing micro-textures, contributing to the development of more efficient and durable tribological systems in industrial applications.


  • Open Access

    Dynamic Hand Gesture-Featured Human Motor Adaptation in Tool Delivery using Voice Recognition

    by Haolin Fei, Stefano Tedeschi, Yanpei Huang, Andrew Kennedy, Ziwei Wang

    Human-robot collaboration has benefited users with higher efficiency towards interactive tasks. Nevertheless, most collaborative schemes rely on complicated human-machine interfaces, which might lack the requisite intuitiveness compared with natural limb control. We also expect to understand human intent with low training data requirements. In response to these challenges, this paper introduces an innovative human-robot collaborative framework that seamlessly integrates hand gesture and dynamic movement recognition, voice recognition, and a switchable control adaptation strategy. These modules provide a user-friendly approach that enables the robot to deliver the tools as per user need, especially when the user is working with both hands. Therefore, users can focus on their task execution without additional training in the use of human-machine interfaces, while the robot interprets their intuitive gestures. The proposed multimodal interaction framework is executed in the UR5e robot platform equipped with a RealSense D435i camera, and the effectiveness is assessed through a soldering circuit board task. The experiment results have demonstrated superior performance in hand gesture recognition, where the static hand gesture recognition module achieves an accuracy of 94.3\%, while the dynamic motion recognition module reaches 97.6\% accuracy. Compared with human solo manipulation, the proposed approach facilitates higher efficiency tool delivery, without significantly distracting from human intents.

  • Learning to Assist Bimanual Teleoperation Using Interval Type-2 Polynomial Fuzzy Inference

    by Ziwei Wang, Haolin Fei, Yanpei Huang, Quentin Rouxel, Bo Xiao, Zhibin Li, Etienne Burdet

    Assisting humans in collaborative tasks is a promising application for robots, however effective assistance remains challenging. In this paper, we propose a method for providing intuitive robotic assistance based on learning from human natural limb coordination. To encode coupling between multiple-limb motions, we use a novel interval type-2 (IT2) polynomial fuzzy inference for modeling trajectory adaptation. The associated polynomial coefficients are estimated using a modified recursive least-square with a dynamic forgetting factor. We propose to employ a Gaussian process to produce robust human motion predictions, and thus address the uncertainty and measurement noise of the system caused by interactive environments. Experimental results on two types of interaction tasks demonstrate the effectiveness of this approach, which achieves high accuracy in predicting assistive limb motion and enables humans to perform bimanual tasks using only one limb.