Abstract
To improve robot relocalization accuracy in both static and dynamic environments, we introduce a novel network, FusedNet, which incorporates a cross-attention to fuse global and local image features for end-to-end relocalization. This approach relies solely on a monocular camera sensor that is fixed on the mobile robot, and directly predicts the absolute pose from the input RGB image. Additionally, we have collected a mobile robot relocalization dataset, termed moBotReloc, consisting of dynamic large-scale scenes, using the Unity 3D simulation platform and a real mobile robot. Through extensive experiments on 7Scenes and moBotReloc, we demonstrate that FusedNet achieves significant accuracy in 6-DoF camera relocalization in static scenes, and exhibits superior relocalization performance in dynamic large-scale scenes for mobile robot applications, outperforming existing end-to-end methods that rely solely on a single global or local feature.
Funding Information
  • Guangdong Natural Science Fund-General Programme (2022A1515011234)
  • University Key Projects Stablely
  • Shenzhen Science and Technology Innovation Commission (WDZC20200821140447001)
  • Tsinghua-Pudu Joint Research Center of Intelligent Service Robots