HHHengqiang Huan

Hengqiang Huan

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Hengqiang Huan has a total of 10 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • OAG-Pose: Orientation-Aware and Guided Category-Level Object Pose Estimation

    by Hengqiang Huan, Dongmei Liu, Faliang Chang, Chunsheng Liu, Dexin Wang, Wenqian Wang

  • SynergyPose: Synergy Enhanced Feature and Projection Decoupling for 6-D Pose Estimation

    by Hengqiang Huan, Faliang Chang, Chunsheng Liu, Wenqian Wang, Yansha Lu, Dexin Wang

    Estimating the 6D pose of texture-sparse objects is critical in vision-guided robotic manipulation and measurement. Existing single-RGB-based methods typically rely on multiple intermediate representations to improve accuracy, which increases computational and annotation costs. Alternatively, adopting a singular representation can mitigate these issues but it still suffers from feature scarcity, resulting in unreliable intermediate representation and pose estimation accuracy. Embracing these challenges, we propose a novel single-RGB-based framework named SynergyPose, which achieves accurate pose estimation of texture-sparse objects using only one intermediate representation. SynergyPose consists of three innovative components: Geometric Enhancer (GEer), Coordinate Projection Decoupling (CPD), and Consistency Constraint Loss (CCLoss). Specifically, we design a novel clustering branch based on feature aggregation and allocation within GEer, which synergistically extracts complementary features with a convolution branch to enhance feature representation. Based on the inter-projection coordinate consistency, we propose the CPD to capture the geometry of the object from different projection planes, which implicitly introduces multiple constraints to accurately calculate the dense correspondence without relying on other representations. Afterwards, CCLoss enforces coordinate consistency between the projection planes, explicitly introducing an additional constraint. Extensive experiments demonstrate the effectiveness of SynergyPose, which achieves competitive results on four BOP benchmark datasets.


  • Multi-Stage Reinforcement Learning for Non-Prehensile Manipulation

    by Dexin Wang, Chunsheng Liu, Faliang Chang, Hengqiang Huan, Kun Cheng

    Manipulating objects without grasping them facilitates complex tasks, known as non-prehensile manipulation. Most previous methods are limited to learning a single skill to manipulate objects with primitive shapes and are unserviceable for flexible object manipulation that requires a combination of multiple skills. We explore skill-unconstrained non-prehensile manipulation and propose a Multi-stage Reinforcement Learning for Non-prehensile Manipulation ( MRLNM ), which calculates an intermediate state between the initial and goal states and divides the task into multiple stages for sequential learning. At each stage, the policy takes the desired 6-DOF object pose as the goal, and proposes a spatially-continuous action, allowing the robot to explore arbitrary skills to accomplish the task. To handle objects with different shapes, we propose a State-Goal Fusion Representation (SGF-Representation) to represent observations and goals as point clouds with motion, which improves the policy's perception of scene layout and task goal. To improve sample efficiency, we propose a Spatially-Reachable Distance Metric (SR-Distance) to approximately measure the shortest distance between two points without intersecting the scene. We evaluate MRLNM on an occluded grasping task which aims to grasp the object in initially occluded configurations. MRLNM demonstrates generalization to unseen objects with shapes outside the training distribution and can be transferred to the real world with zero-shot transfer, achieving a 95% success rate.


  • On-Policy and Pixel-Level Grasping Across the Gap Between Simulation and Reality

    by Dexin Wang, Faliang Chang, Chunsheng Liu, Hengqiang Huan, Nanjun Li, Rurui Yang

    Grasp detection in cluttered scenes is a very challenging task for robots. Generating synthetic grasping data is a popular way to train and test grasp methods, as is Dex-Net; yet, these methods sample training grasps on 3-D synthetic object models, but evaluate at images or point clouds with different sample distributions, which reduces performance due to covariate shift and sparse grasp labels. To solve existing problems, we propose a novel on-policy grasp detection method for parallel grippers, which can train and test on the approximate distribution with dense pixel-level grasp labels generated on RGB-D images. An Orthographic-Depth Grasp Generation (ODG-Generation) method is proposed to generate an orthographic depth image through a new imaging model of projecting points in orthographic; then this method generates multiple candidate grasps for each pixel and obtains robust positive grasps through flatness detection, force-closure metric and collision detection. Then, a comprehensive Pixel-Level Grasp Pose Dataset (PLGP-Dataset) is constructed, which is the first pixel-level grasp dataset, with the on-policy distribution. Lastly, we build a grasp detection network with a novel data augmentation process for imbalance training. Experiments show that our on-policy method can partially overcome the gap between simulation and reality, and achieves the best performance.


  • JHPFA-Net: Joint Head Pose and Facial Action Network for Driver Yawning Detection Across Arbitrary Poses in Videos

    by Yansha Lu, Chunsheng Liu, Faliang Chang, Hui Liu, Hengqiang Huan

    Yawning detection is a key means in driver fatigue detection, which suffers difficulties including head poses, facial expressions, illumination variations, occlusions, etc. Yet, most previous methods mainly focus on frontal faces, and are deficient to deal with different facial actions under arbitrary poses in the actual driving environment. In this study, we propose a novel Joint Head Pose and Facial Action Network (JHPFA-Net) for driver yawning detection across arbitrary poses in videos, with three main parts including a Geometric-based Key-frame Selection Module (GK-Module), a Face Frontalization with Warp Attention Module (FF-Module) and a dual-channel classifier for Head Pose $\&$ Facial Action Fusion Module (HF-Module). Firstly, the GK-Module is proposed to extract geometric vectors and to construct a two-stage judgment mechanism, with the purpose of dealing with frame redundancy and improving the efficiency of JHPFA-Net structure. Secondly, distinguished with existing methods, the FF-Module is proposed to synthesize photo-realistic frontal faces, which can be used for capturing the facial actions under arbitrary poses. Finally, the HF-Module is proposed to fuse head pose attributes and facial modalities together, for the purpose of achieving pose-invariant detection and improving accuracy. Extensive experiments show that the proposed JHPFA-Net achieves state-of-the-art results comparing with some representative methods on the public YawDD benchmark, and it performs well in real-time application.