Implementation of intrinsic and extrinsic calibration of RGB camera and ouster os1 lidar for autonomous mobile robot sensor fusion using ros1
Open Access
- 30 July 2026
- journal article
- Published by OU Scientific Route in EUREKA: Physics and Engineering
- No. 4,p. 86-100
Abstract
Autonomous mobile robots (AMRs) operating in real-world environments such as warehouses and hospitals require accurate environmental perception for safe navigation. This paper addresses the calibration of heterogeneous sensors – a Red-Green-Blue (RGB) USB camera and an Ouster OS1 Light Detection and Ranging (LiDAR) – and their fusion on a differential-drive AMR running under Robot Operating System version 1 (ROS1) Noetic. The core problem is the absence of pre-recorded extrinsic transforms and the impracticality of live calibration when only offline recorded data are available, rendering standard ROS-based workflows inapplicable. To solve this, a complete three-step pipeline is proposed: 1) offline camera intrinsic calibration from extracted .bag frames using a planar checkerboard method with automated farthest-point sampling for frame diversity; 2) interactive LiDAR-to-camera alignment via axis-mapping selection among 11 rotation candidates followed by fine-tuning with real-time visual feedback; 3) calibration verification by projecting the full LiDAR point cloud onto synchronized camera frames with depth-based colorization. Experiments on a 205-second, 10.5 GB .bag file demonstrate a reprojection error of 0.2748 px (RMS) – well below the 0.5 px excellence threshold – and an average of 7,000–7,500 LiDAR points projected per frame, reaching 12,428 points in optimal scenes. The low error is explained by diversity-based frame selection, which eliminates redundant frames and ensures broad spatial coverage. The pipeline is implemented entirely in Python using standard open-source libraries without GPU, making it suitable for resource-constrained onboard computers in practical robotic deployments.Keywords
Funding Information
- University of Transport and Communications (T2026-DT-004)
This publication has 14 references indexed in Scilit:
- Tightly Coupled Range Inertial Localization on a 3D Prior Map Based on Sliding Window Factor Graph Optimization2024
- Extrinsic 6DoF calibration of a radar–LiDAR–camera system enhanced by radar cross section estimates evaluationRobotics and Autonomous Systems, 2019
- PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimation2018
- Multi-view 3D Object Detection Network for Autonomous Driving2017
- Motion-based calibration of multimodal sensor arrays2015
- Are we ready for autonomous driving? The KITTI vision benchmark suite2012
- Automatic camera and range sensor calibration using a single shot2012
- EPnP: An Accurate O(n) Solution to the PnP ProblemInternational Journal of Computer Vision, 2008
- Extrinsic calibration of a camera and laser range finder (improves camera calibration)2005
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000