Hengqiang Huan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Hengqiang Huan has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Chunsheng Liu
School of Control Science and Engineering, Shandong University, Jinan 250061, China
5 shared publications - Faliang Chang
School of Control Science and Engineering, Shandong University, Jinan 250061, China
5 shared publications - Dexin Wang
Shandong University
4 shared publications - Wenqian Wang
Pillar of Information Systems Technology and Design, Singapore University of Technology and Design, Singapore
2 shared publications - Yansha Lu
School of Control Science and Engineering, Shandong University, Jinan, China
2 shared publications - Dongmei Liu
Shandong Normal University
1 shared publication
Latest Publications
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 28, 15123-15136
OAG-Pose: Orientation-Aware and Guided Category-Level Object Pose Estimation
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 28, 15123-15136
OAG-Pose: Orientation-Aware and Guided Category-Level Object Pose Estimation
- 5 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-16
SynergyPose: Synergy Enhanced Feature and Projection Decoupling for 6-D Pose Estimation
Estimating the 6D pose of texture-sparse objects is critical in vision-guided robotic manipulation and measurement. Existing single-RGB-based methods typically rely on multiple intermediate representations to improve accuracy, which increases computational and annotation costs. Alternatively, adopting a singular representation can mitigate these issues but it still suffers from feature scarcity, resulting in unreliable intermediate representation and pose estimation accuracy. Embracing these challenges, we propose a novel single-RGB-based framework named SynergyPose, which achieves accurate pose estimation of texture-sparse objects using only one intermediate representation. SynergyPose consists of three innovative components: Geometric Enhancer (GEer), Coordinate Projection Decoupling (CPD), and Consistency Constraint Loss (CCLoss). Specifically, we design a novel clustering branch based on feature aggregation and allocation within GEer, which synergistically extracts complementary features with a convolution branch to enhance feature representation. Based on the inter-projection coordinate consistency, we propose the CPD to capture the geometry of the object from different projection planes, which implicitly introduces multiple constraints to accurately calculate the dense correspondence without relying on other representations. Afterwards, CCLoss enforces coordinate consistency between the projection planes, explicitly introducing an additional constraint. Extensive experiments demonstrate the effectiveness of SynergyPose, which achieves competitive results on four BOP benchmark datasets.
- 5 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-16
SynergyPose: Synergy Enhanced Feature and Projection Decoupling for 6-D Pose Estimation
Estimating the 6D pose of texture-sparse objects is critical in vision-guided robotic manipulation and measurement. Existing single-RGB-based methods typically rely on multiple intermediate representations to improve accuracy, which increases computational and annotation costs. Alternatively, adopting a singular representation can mitigate these issues but it still suffers from feature scarcity, resulting in unreliable intermediate representation and pose estimation accuracy. Embracing these challenges, we propose a novel single-RGB-based framework named SynergyPose, which achieves accurate pose estimation of texture-sparse objects using only one intermediate representation. SynergyPose consists of three innovative components: Geometric Enhancer (GEer), Coordinate Projection Decoupling (CPD), and Consistency Constraint Loss (CCLoss). Specifically, we design a novel clustering branch based on feature aggregation and allocation within GEer, which synergistically extracts complementary features with a convolution branch to enhance feature representation. Based on the inter-projection coordinate consistency, we propose the CPD to capture the geometry of the object from different projection planes, which implicitly introduces multiple constraints to accurately calculate the dense correspondence without relying on other representations. Afterwards, CCLoss enforces coordinate consistency between the projection planes, explicitly introducing an additional constraint. Extensive experiments demonstrate the effectiveness of SynergyPose, which achieves competitive results on four BOP benchmark datasets.
- 11 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (7) , 6712-6719
Multi-Stage Reinforcement Learning for Non-Prehensile Manipulation
Manipulating objects without grasping them facilitates complex tasks, known as non-prehensile manipulation. Most previous methods are limited to learning a single skill to manipulate objects with primitive shapes and are unserviceable for flexible object manipulation that requires a combination of multiple skills. We explore skill-unconstrained non-prehensile manipulation and propose a Multi-stage Reinforcement Learning for Non-prehensile Manipulation ( MRLNM ), which calculates an intermediate state between the initial and goal states and divides the task into multiple stages for sequential learning. At each stage, the policy takes the desired 6-DOF object pose as the goal, and proposes a spatially-continuous action, allowing the robot to explore arbitrary skills to accomplish the task. To handle objects with different shapes, we propose a State-Goal Fusion Representation (SGF-Representation) to represent observations and goals as point clouds with motion, which improves the policy's perception of scene layout and task goal. To improve sample efficiency, we propose a Spatially-Reachable Distance Metric (SR-Distance) to approximately measure the shortest distance between two points without intersecting the scene. We evaluate MRLNM on an occluded grasping task which aims to grasp the object in initially occluded configurations. MRLNM demonstrates generalization to unseen objects with shapes outside the training distribution and can be transferred to the real world with zero-shot transfer, achieving a 95% success rate.
- 11 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (7) , 6712-6719
Multi-Stage Reinforcement Learning for Non-Prehensile Manipulation
Manipulating objects without grasping them facilitates complex tasks, known as non-prehensile manipulation. Most previous methods are limited to learning a single skill to manipulate objects with primitive shapes and are unserviceable for flexible object manipulation that requires a combination of multiple skills. We explore skill-unconstrained non-prehensile manipulation and propose a Multi-stage Reinforcement Learning for Non-prehensile Manipulation ( MRLNM ), which calculates an intermediate state between the initial and goal states and divides the task into multiple stages for sequential learning. At each stage, the policy takes the desired 6-DOF object pose as the goal, and proposes a spatially-continuous action, allowing the robot to explore arbitrary skills to accomplish the task. To handle objects with different shapes, we propose a State-Goal Fusion Representation (SGF-Representation) to represent observations and goals as point clouds with motion, which improves the policy's perception of scene layout and task goal. To improve sample efficiency, we propose a Spatially-Reachable Distance Metric (SR-Distance) to approximately measure the shortest distance between two points without intersecting the scene. We evaluate MRLNM on an occluded grasping task which aims to grasp the object in initially occluded configurations. MRLNM demonstrates generalization to unseen objects with shapes outside the training distribution and can be transferred to the real world with zero-shot transfer, achieving a 95% success rate.
- 15 August 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 71 (7) , 7388-7399
On-Policy and Pixel-Level Grasping Across the Gap Between Simulation and Reality
Grasp detection in cluttered scenes is a very challenging task for robots. Generating synthetic grasping data is a popular way to train and test grasp methods, as is Dex-Net; yet, these methods sample training grasps on 3-D synthetic object models, but evaluate at images or point clouds with different sample distributions, which reduces performance due to covariate shift and sparse grasp labels. To solve existing problems, we propose a novel on-policy grasp detection method for parallel grippers, which can train and test on the approximate distribution with dense pixel-level grasp labels generated on RGB-D images. An Orthographic-Depth Grasp Generation (ODG-Generation) method is proposed to generate an orthographic depth image through a new imaging model of projecting points in orthographic; then this method generates multiple candidate grasps for each pixel and obtains robust positive grasps through flatness detection, force-closure metric and collision detection. Then, a comprehensive Pixel-Level Grasp Pose Dataset (PLGP-Dataset) is constructed, which is the first pixel-level grasp dataset, with the on-policy distribution. Lastly, we build a grasp detection network with a novel data augmentation process for imbalance training. Experiments show that our on-policy method can partially overcome the gap between simulation and reality, and achieves the best performance.
- 15 August 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 71 (7) , 7388-7399
On-Policy and Pixel-Level Grasping Across the Gap Between Simulation and Reality
Grasp detection in cluttered scenes is a very challenging task for robots. Generating synthetic grasping data is a popular way to train and test grasp methods, as is Dex-Net; yet, these methods sample training grasps on 3-D synthetic object models, but evaluate at images or point clouds with different sample distributions, which reduces performance due to covariate shift and sparse grasp labels. To solve existing problems, we propose a novel on-policy grasp detection method for parallel grippers, which can train and test on the approximate distribution with dense pixel-level grasp labels generated on RGB-D images. An Orthographic-Depth Grasp Generation (ODG-Generation) method is proposed to generate an orthographic depth image through a new imaging model of projecting points in orthographic; then this method generates multiple candidate grasps for each pixel and obtains robust positive grasps through flatness detection, force-closure metric and collision detection. Then, a comprehensive Pixel-Level Grasp Pose Dataset (PLGP-Dataset) is constructed, which is the first pixel-level grasp dataset, with the on-policy distribution. Lastly, we build a grasp detection network with a novel data augmentation process for imbalance training. Experiments show that our on-policy method can partially overcome the gap between simulation and reality, and achieves the best performance.
- 22 June 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 24 (11) , 11850-11863
JHPFA-Net: Joint Head Pose and Facial Action Network for Driver Yawning Detection Across Arbitrary Poses in Videos
Yawning detection is a key means in driver fatigue detection, which suffers difficulties including head poses, facial expressions, illumination variations, occlusions, etc. Yet, most previous methods mainly focus on frontal faces, and are deficient to deal with different facial actions under arbitrary poses in the actual driving environment. In this study, we propose a novel Joint Head Pose and Facial Action Network (JHPFA-Net) for driver yawning detection across arbitrary poses in videos, with three main parts including a Geometric-based Key-frame Selection Module (GK-Module), a Face Frontalization with Warp Attention Module (FF-Module) and a dual-channel classifier for Head Pose $\&$ Facial Action Fusion Module (HF-Module). Firstly, the GK-Module is proposed to extract geometric vectors and to construct a two-stage judgment mechanism, with the purpose of dealing with frame redundancy and improving the efficiency of JHPFA-Net structure. Secondly, distinguished with existing methods, the FF-Module is proposed to synthesize photo-realistic frontal faces, which can be used for capturing the facial actions under arbitrary poses. Finally, the HF-Module is proposed to fuse head pose attributes and facial modalities together, for the purpose of achieving pose-invariant detection and improving accuracy. Extensive experiments show that the proposed JHPFA-Net achieves state-of-the-art results comparing with some representative methods on the public YawDD benchmark, and it performs well in real-time application.
- 22 June 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 24 (11) , 11850-11863
JHPFA-Net: Joint Head Pose and Facial Action Network for Driver Yawning Detection Across Arbitrary Poses in Videos
Yawning detection is a key means in driver fatigue detection, which suffers difficulties including head poses, facial expressions, illumination variations, occlusions, etc. Yet, most previous methods mainly focus on frontal faces, and are deficient to deal with different facial actions under arbitrary poses in the actual driving environment. In this study, we propose a novel Joint Head Pose and Facial Action Network (JHPFA-Net) for driver yawning detection across arbitrary poses in videos, with three main parts including a Geometric-based Key-frame Selection Module (GK-Module), a Face Frontalization with Warp Attention Module (FF-Module) and a dual-channel classifier for Head Pose $\&$ Facial Action Fusion Module (HF-Module). Firstly, the GK-Module is proposed to extract geometric vectors and to construct a two-stage judgment mechanism, with the purpose of dealing with frame redundancy and improving the efficiency of JHPFA-Net structure. Secondly, distinguished with existing methods, the FF-Module is proposed to synthesize photo-realistic frontal faces, which can be used for capturing the facial actions under arbitrary poses. Finally, the HF-Module is proposed to fuse head pose attributes and facial modalities together, for the purpose of achieving pose-invariant detection and improving accuracy. Extensive experiments show that the proposed JHPFA-Net achieves state-of-the-art results comparing with some representative methods on the public YawDD benchmark, and it performs well in real-time application.