Abstract
Autonomous mobile robots (AMRs) operating in real-world environments such as warehouses and hospitals require accurate environmental perception for safe navigation. This paper addresses the calibration of heterogeneous sensors – a Red-Green-Blue (RGB) USB camera and an Ouster OS1 Light Detection and Ranging (LiDAR) – and their fusion on a differential-drive AMR running under Robot Operating System version 1 (ROS1) Noetic. The core problem is the absence of pre-recorded extrinsic transforms and the impracticality of live calibration when only offline recorded data are available, rendering standard ROS-based workflows inapplicable. To solve this, a complete three-step pipeline is proposed: 1) offline camera intrinsic calibration from extracted .bag frames using a planar checkerboard method with automated farthest-point sampling for frame diversity; 2) interactive LiDAR-to-camera alignment via axis-mapping selection among 11 rotation candidates followed by fine-tuning with real-time visual feedback; 3) calibration verification by projecting the full LiDAR point cloud onto synchronized camera frames with depth-based colorization. Experiments on a 205-second, 10.5 GB .bag file demonstrate a reprojection error of 0.2748 px (RMS) – well below the 0.5 px excellence threshold – and an average of 7,000–7,500 LiDAR points projected per frame, reaching 12,428 points in optimal scenes. The low error is explained by diversity-based frame selection, which eliminates redundant frames and ensures broad spatial coverage. The pipeline is implemented entirely in Python using standard open-source libraries without GPU, making it suitable for resource-constrained onboard computers in practical robotic deployments.
Funding Information
  • University of Transport and Communications (T2026-DT-004)