AMAnh-Truong Mai

Anh-Truong Mai

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Anh-Truong Mai has a total of 44 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Depth-Guided Monocular Object Pose Estimation for Warehouse Automation

    by Phan Xuan Tan, Dinh-Cuong Hoang, Anh-Nhat Nguyen, Eiji Kamioka, Ta Huu Anh Duong, Tuan-Minh Huynh, Duc-Manh Nguyen, Duc-Huy Ngo, Minh-Duc Cao, Thu-Uyen Nguyen, et al.

    Accurate object pose estimation is essential for warehouse automation, enabling tasks such as robotic picking, sorting, and inventory management. Current state-of-the-art approaches rely on both color (RGB) and depth (D) images, as depth information provides critical geometric cues that enhance object localization and improve robustness against occlusions. However, RGBD-based methods require specialized depth sensors, which can be costly and may not function reliably in warehouse environments with reflective surfaces, varying lighting conditions, or sensor occlusions. To address these limitations, researchers have explored RGB-only approaches, but the absence of depth cues makes it challenging to handle occlusions, estimate object geometry, and differentiate between textureless or highly similar objects, which are common in warehouses. In this paper, we propose a novel end-to-end depth-guided object pose estimation method tailored for warehouse automation. Our approach leverages both depth and color images during training but relies solely on RGB images during inference. Depth images are used to supervise the training of a depth estimation network, which generates initial depth-aware features. These features are then refined using our proposed depth-guided feature enhancement module to improve spatial understanding and robustness. The enhanced features are subsequently utilized for keypoint-based 6D object pose estimation. By integrating depth-guided feature learning, our method significantly enhances pose estimation accuracy, especially in cluttered warehouse environments with severe occlusions and textureless objects. Extensive experiments on warehouse-specific datasets, as well as standard benchmark datasets, demonstrate that our approach outperforms existing RGB-based methods while maintaining real-time inference speeds, making it a highly practical solution for real-world warehouse automation applications.


  • Open Access

    Visibility Aware In-Hand Object Pose Tracking in Videos With Transformers

    by Phan Xuan Tan, Dinh-Cuong Hoang, Eiji Kamioka, Anh-Nhat Nguyen, Duc-Thanh Tran, Van-Hiep Duong, Anh-Truong Mai, Duc-Long Pham, Khanh-Toan Phan, Xuan-Tung Dinh, et al.

    In-hand object pose estimation is essential in various engineering applications, such as quality inspection, reverse engineering, and automated manufacturing processes. However, achieving accurate pose estimation becomes difficult when objects are heavily occluded by the hand or blurred due to motion. To address these challenges, we propose a novel framework that leverages the power of transformers for spatial-temporal reasoning across video sequences. Our approach utilizes transformers to capture both spatial relationships within each frame and temporal dependencies across consecutive frames, allowing the model to aggregate information over time and improve pose predictions. A key innovation of our framework is the introduction of a visibility-aware module, which dynamically adjusts pose estimates based on the object's visibility. This module utilizes temporally-aware features extracted by the transformers, allowing the model to aggregate pose information across multiple frames. By integrating this aggregated information, the model can maintain high accuracy even when portions of the object are not visible in certain frames. This capability is particularly crucial in dynamic environments where the object's appearance can change rapidly due to hand movements or interactions with other objects. Extensive experiments demonstrate that our method significantly outperforms state-of-the-art techniques, achieving a 6% improvement in overall accuracy and over 11% better performance in handling occlusions.


  • Open Access

    Unsupervised Visual-to-Geometric Feature Reconstruction for Vision-Based Industrial Anomaly Detection

    by Dinh-Cuong Hoang, Phan Xuan Tan, Anh-Nhat Nguyen, Duc-Thanh Tran, Van-Hiep Duong, Anh-Truong Mai, Duc-Long Pham, Khanh-Toan Phan, Minh-Quang Do, Ta Huu Anh Duong, et al.

    Industrial anomaly detection involves identifying abnormal regions in products and plays a crucial role in quality inspection. While 2D image-based anomaly detection has been extensively explored, combining two-dimensional (2D) images with three-dimensional (3D) point clouds remains less studied. Existing multimodal methods often combine features from different modalities, leading to feature interference and degraded performance. To overcome this, we propose a novel framework for unsupervised industrial anomaly detection that leverages both visual and geometric information. Specifcally, we use pre-trained 2D and 3D models to extract visual features from color images and geometric features from 3D point clouds. Instead of directly fusing these features, we propose a geometric feature reconstruction network that predicts 3D geometric features from the 2D visual features. During training, we minimize the difference between the predicted geometric features and the extracted geometric features, enabling the model to learn how 2D appearance correlates with 3D structure in anomaly-free images. During inference, this learned relationship allows the model to detect anomalies: signifcant discrepancies between the reconstructed and actual geometric features indicate abnormal regions. Evaluated on the MVTec 3D-AD dataset, our method achieves state-of-the-art performance with an average image-level AUROC score of 0.968, surpassing previous approaches. Additionally, it provides fast inference at 8.2 frames per second with a memory footprint of only 1045 MB, making it highly effcient for industrial applications


  • Attention-based hand pose estimation with voting and dual modalities

    by Dinh-Cuong Hoang, Anh-Nhat Nguyen, Thu-Uyen Nguyen, Ngoc-Anh Hoang, Van-Duc Vu, Duy-Quang Vu, Phuc-Quan Ngo, Khanh-Toan Phan, Duc-Thanh Tran, Van-Thiep Nguyen, et al.


  • Open Access

    Attention-Based Grasp Detection With Monocular Depth Estimation

    by Phan Xuan Tan, Dinh-Cuong Hoang, Anh-Nhat Nguyen, Van-Thiep Nguyen, Van-Duc Vu, Thu-Uyen Nguyen, Ngoc-Anh Hoang, Khanh-Toan Phan, Duc-Thanh Tran, Duy-Quang Vu, et al.

    Grasp detection plays a pivotal role in robotic manipulation, allowing robots to interact with and manipulate objects in their surroundings. Traditionally, this has relied on three-dimensional (3D) point cloud data acquired from specialized depth cameras. However, the limited availability of such sensors in real-world scenarios poses a significant challenge. In many practical applications, robots operate in diverse environments where obtaining high-quality 3D point cloud data may be impractical or impossible. This paper introduces an innovative approach to grasp generation using color images, thereby eliminating the need for dedicated depth sensors. Our method capitalizes on advanced deep learning techniques for depth estimation directly from color images. Instead of relying on conventional depth sensors, our approach computes predicted point clouds based on estimated depth images derived directly from Red-Green-Blue (RGB) input data. To our knowledge, this is the first study to explore the use of predicted depth data for grasp detection, moving away from the traditional dependence on depth sensors. The novelty of this work is the development of a fusion module that seamlessly integrates features extracted from RGB images with those inferred from the predicted point clouds. Additionally, we adapt a voting mechanism from our previous work (VoteGrasp) to enhance robustness to occlusion and generate collision-free grasps. Experimental evaluations conducted on standard datasets validate the effectiveness of our approach, demonstrating its superior performance in generating grasp configurations compared to existing methods. With our proposed method, we achieved a significant 4% improvement in average precision compared to state-of-the-art grasp detection methods. Furthermore, our method demonstrates promising practical viability through real robot grasping experiments, achieving an impressive 84% success rate.


  • Open Access

    Grasp Generation with Depth Estimation from Color Images

    by Nguyen Van Thiep, Vu Van Duc, Hoang Ngoc Anh, Nguyen Thu Uyen, Vu Duy Quang, Tran Duc Thanh, Phan Khanh Toan, Mai Truong Anh, Duong Van Hiep, Tran Cong Trinh, et al.

    Grasp generation plays a fundamental role in robot manipulation, often relying on three-dimensional (3D) point cloud data acquired through specialized depth cameras. However, the limited availability of such sensors in practical scenarios emphasizes the necessity for alternative approaches. This paper introduces an innovative method for grasp generation directly from color (RGB) images, negating the reliance on dedicated depth sensors. The proposed method employs tailored deep learning techniques for depth estimation from color images. Instead of traditional depth sensors, our approach computes predicted point clouds from estimated depth images directly generated from RGB inputs. A significant contribution lies in the design of a fusion module adept at seamlessly integrating features extracted from RGB images with those inferred from the predicted point clouds. This fusion process significantly strengthens the grasp generation pipeline by strengthening the advantages of both modalities, yielding notably improved grasp configurations. Experimental evaluations on standard datasets validate the efficacy of our approach, demonstrating its superior performance in generating grasp configurations compared to existing methods.

  • Open Access

    Multi Task-Guided 6D Object Pose Estimation

    by Thu-Uyen Nguyen, Van-Duc Vu, Van-Thiep Nguyen, Ngoc-Anh Hoang, Duy-Quang Vu, Duc-Thanh Tran, Khanh-Toan Phan, Anh-Truong Mai, Van-Hiep Duong, Cong-Trinh Tran, et al.

    Object pose estimation remains a fundamental challenge in computer vision, with cutting-edge methods relying on both RGB and depth data. Depth information is pivotal, offering crucial geometric cues that enable algorithms to navigate occlusions, fostering a more comprehensive scene under- standing and precise pose estimation. However, RGBD-based methods often require specialized depth sensors, which can be costlier and less accessible compared to standard RGB cameras. Consequently, research has explored techniques aiming to estimate object pose solely from color images. Yet, the absence of depth cues poses challenges in handling occlusions, comprehending object geometry, and resolving ambiguities arising from similar colors or textures. This paper introduces a end-to-end multi-task-guided object pose estimation method, utilizing RGB images as input and producing the 6D pose of multiple object instances. While our approach employs both depth and color images during training, inference relies solely on color images. We incorporate depth images to supervise a depth estimation branch, generating depth-aware features further refined through a cross-task attention module. These enhanced features are pivotal for our object pose estimation. Our method's innovation lies in significantly enhancing feature discriminability and robustness for object pose estimation. Through extensive experiments, we demonstrate competitive performance compared to state-of-the-art methods in object pose estimation.

  • Graspability-Aware Object Pose Estimation in Cluttered Scenes

    by Dinh-Cuong Hoang, Anh-Nhat Nguyen, Van-Duc Vu, Thu-Uyen Nguyen, Duy-Quang Vu, Phuc-Quan Ngo, Ngoc-Anh Hoang, Khanh-Toan Phan, Duc-Thanh Tran, Van-Thiep Nguyen, et al.

    Object recognition and pose estimation are critical components in autonomous robot manipulation systems, playing a crucial role in enabling robots to interact effectively with the environment. During actual execution, the robot must recognize the object in the current scene, estimate its pose, and then select a feasible grasp pose from the pre-defined grasp configurations. While most existing methods primarily focus on pose estimation, they often neglect the graspability and reachability aspects. This oversight can lead to inefficiencies and failures during execution. In this study, we introduce an innovative graspability-aware object pose estimation framework. Our proposed approach not only estimates the poses of multiple objects in clustered scenes but also identifies graspable areas. This enables the system to concentrate its efforts on specific points or regions of an object that are suitable for grasping. It leverages both depth and color images to extract geometric and appearance features. To effectively combine these diverse features, we have developed an adaptive fusion module. In addition, the fused features are further enhanced through a graspability-aware feature enhancement module. The key innovation of our method lies in improving the discriminability and robustness of the features used for object pose estimation. We have achieved state-of-the-art results on public datasets when compared to several baseline methods. In real robot experiments conducted on a Franka Emika robot arm equipped with an Intel Realsense camera and a two-finger gripper, we consistently achieved high success rates, even in cluttered scenes.