MapsHD: A Benchmark Suite for LiDAR Odometry Frameworks
Authors:
- Janusz BęDkowskiJBJanusz BęDkowski
- Michał PełkaMPMichał Pełka
- Karol MajekKMKarol Majek
- Marcin MateckiMMMarcin Matecki
- Adrian RadulescuARAdrian Radulescu
- Charles HamesseCHCharles Hamesse
- Ethan DecleynEDEthan Decleyn
- Przemysław LekstonPLPrzemysław Lekston
- Tomasz OwerkoTOTomasz Owerko
- Przemysław KurasPKPrzemysław Kuras
- Michał CiszewskiMCMichał Ciszewski
- Jakub KoleckiJKJakub Kolecki
Preprint
- 21 February 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
This paper describes a software toolbox for LiDAR and LiDAR-Inertial Odometry qualitative and quantitative evaluation. We provide software as https://github.com/MapsHD organization with all necessary information at https://github.com/MapsHD/HDMapping. Our software contributions are a) ground truth data processing tool, b) dockerized state-of-the-art LO and LIO algorithms, c) multi-session data registration to common coordinate system, d) Absolute Pose Error (APE) and Relative Pose Error (RPE) metrics, e) import/export tools for easier 3D data handling and visualizing e.g. in Cloud Compare software. This software is compatible with ROS1 (Robot Operating System) and ROS2 data formats. We shown an example benchmark of LeGO-LOAM, LIO-SAM, FAST-LIO, DLO, VoxelMap, Faster-LIO, KISS-ICP, CT-ICP, SLICT, DLIO, GLIM, iG-LIO, LIO-EKF, I2EKF-LO, GenZ-ICP, RESPLE, odometry_ros_wrapper, Point-LIO, LOAM-Livox algorithms. For all experiments we provide movies.Keywords
This publication has 42 references indexed in Scilit:
- GeoLLS: A LiDAR-based localization system with skeleton feature consistency constraint and weighted fixed-lag smoothingMeasurement, 2025
- GLIM: 3D range-inertial localization and mapping with GPU-accelerated scan matching factorsRobotics and Autonomous Systems, 2024
- Loam livox: A fast, robust, high-precision LiDAR odometry and mapping package for LiDARs of small FoV2020
- LAMP: Large-Scale Autonomous Mapping and Positioning for Exploration of Perceptually-Degraded Subterranean Environments2020
- Tightly Coupled 3D Lidar Inertial Odometry and Mapping2019
- Survey of Higher Order Rigid Body Motion Interpolation Methods for Keyframe Animation and Continuous-Time Trajectory Estimation2018
- Continuous-Time Three-Dimensional Mapping for Micro Aerial Vehicles with a Passively Actuated Rotating Laser ScannerJournal of Field Robotics, 2015
- Efficient Large‐scale Three‐dimensional Mobile Mapping for Underground MinesJournal of Field Robotics, 2014
- Continuous-time batch estimation using temporal basis functions2012
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992