Enhancing ROS Debugging: A User-Centric Diagnostic Framework
- 12 June 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 11 (8) , 9399-9406
Abstract
The Robot Operating System (ROS) is an open-source software framework often utilised in robotics, providing standardised libraries for building complex robotic systems. However, ROS's distributed architecture and messaging system create barriers for understanding robot status and diagnosing system anomalies, particularly for developers with limited ROS expertise. We propose ROS Help Desk (RosHD), an agentic AI system for autonomous anomaly detection and debugging of ROS-based robotic systems, with expertise-adaptive assistance. RosHD continuously monitors system logs and multimodal sensor streams (lidar, RGB cameras) to detect anomalies, and provides developers with customised debugging support via specialised sensor analysis tools, diagnostic tools, ROS diagnostic utilities, code analysis capabilities, and a unified chat interface. We present the first empirical evaluation of expertise-adaptive LLM-powered debugging for ROS through a controlled user study with novice through advanced developers ($N=28$). Participants using RosHD achieved $92.85\%$ task success compared to $17.86\%$ with baseline assistance, reducing debugging time by up to $72\%$ across experience levels.Keywords
This publication has 20 references indexed in Scilit:
- A cornerstone of adaptivity – A meta-analysis of the expertise reversal effectLearning and Instruction, 2025
- Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent2025
- Next‐generation human‐robot interaction with ChatGPT and robot operating systemSoftware: Practice and Experience, 2024
- OperateLLM: Integrating Robot Operating System (ROS) Tools in Large Language Models2024
- A survey on large language model based autonomous agentsFrontiers of Computer Science, 2024
- ROZZ: Property-based Fuzzing for Robotic Programs in ROS2022
- ROSDiscover: Statically Detecting Run-Time Architecture Misconfigurations in Robotics Systems2022
- ROSMonitoring: A Runtime Verification Framework for ROS2020
- Explanation in artificial intelligence: Insights from the social sciencesArtificial Intelligence, 2019
- An Empirical Evaluation of the System Usability ScaleInternational Journal of Human–Computer Interaction, 2008