DeepArUco++: Improved detection of square fiducial markers in challenging lighting conditions
Preprint
Abstract
Fiducial markers are a computer vision tool used for object pose estimation and detection. These markers are highly useful in fields such as industry, medicine and logistics. However, optimal lighting conditions are not always available,and other factors such as blur or sensor noise can affect image quality. Classical computer vision techniques that precisely locate and decode fiducial markers often fail under difficult illumination conditions (e.g. extreme variations of lighting within the same frame). Hence, we propose DeepArUco++, a deep learning-based framework that leverages the robustness of Convolutional Neural Networks to perform marker detection and decoding in challenging lighting conditions. The framework is based on a pipeline using different Neural Network models at each step, namely marker detection, corner refinement and marker decoding. Additionally, we propose a simple method for generating synthetic data for training the different models that compose the proposed pipeline, and we present a second, real-life dataset of ArUco markers in challenging lighting conditions used to evaluate our system. The developed method outperforms other state-of-the-art methods in such tasks and remains competitive even when testing on the datasets used to develop those methods. Code available in GitHub: https://github.com/AVAuco/deeparuco/Keywords
All Related Versions
- Version 1, 2024-11-08, ArXiv
- Published version: Image and Vision Computing, 152.
This publication has 31 references indexed in Scilit:
- DeepArUco: Marker Detection and Classification in Challenging Lighting Conditions2023
- Planar fiducial markers: a comparative studyVirtual Reality, 2023
- Joint scene and object tracking for cost-Effective augmented reality guided patient positioning in radiation therapyComputer Methods and Programs in Biomedicine, 2021
- Tracking fiducial markers with discriminative correlation filtersImage and Vision Computing, 2021
- 3D Reconstruction and alignment by consumer RGB-D sensors and fiducial planar markers for patient positioning in radiation therapyComputer Methods and Programs in Biomedicine, 2019
- Speeded up detection of squared fiducial markersImage and Vision Computing, 2018
- Robust identification of fiducial markers in challenging conditionsExpert Systems with Applications, 2018
- Stacked Hourglass Networks for Human Pose Estimation2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Microsoft COCO: Common Objects in Context2014