When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors
- 4 June 2026
- journal article
- Published by Wiley in Computer Graphics Forum
Abstract
Current Large Language Models (LLMs), especially Large Reasoning Models, can generate Chain‐of‐Thought (CoT) reasoning traces to illustrate how they produce final outputs, thereby facilitating trust calibration for users. However, these CoT reasoning traces are usually lengthy and tedious, and can contain various issues, such as logical and factual errors, which make it difficult for users to interpret the reasoning traces efficiently and accurately. To address these challenges, we develop an error detection pipeline that combines external fact‐checking with symbolic formal logical validation to identify errors at the step level. Building on this pipeline, we propose ReasonDiag, an interactive visualization system for diagnosing CoT reasoning traces. ReasonDiag provides 1) an integrated arc diagram to show reasoning‐step distributions and error‐propagation patterns, and 2) a hierarchical node‐link diagram to visualize high‐level reasoning flows and premise dependencies. We evaluate Reason‐Diag through a technical evaluation for the error detection pipeline, two case studies, and user interviews with 16 participants. The results indicate that ReasonDiag helps users effectively understand CoT reasoning traces, identify erroneous steps, and determine their root causes.Keywords
All Related Versions
Funding Information
- Ministry of Education - Singapore
- Nottingham Trent University
This publication has 18 references indexed in Scilit:
- Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way2025
- LLM Attributor: Interactive Visual Attribution for LLM GenerationProceedings of the AAAI Conference on Artificial Intelligence, 2025
- Pluto: Authoring Semantically Aligned Text and Charts for Data-Driven Communication2025
- WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualization2024
- Graphologue: Exploring Large Language Model Responses with Interactive Diagrams2023
- CommonsenseVIS: Visualizing and Understanding Commonsense Reasoning Capabilities of Natural Language ModelsIEEE Transactions on Visualization and Computer Graphics, 2023
- Survey of Hallucination in Natural Language GenerationACM Computing Surveys, 2023
- Entailment Tree Explanations via Iterative Retrieval-Generation Reasoner2022
- Will You Accept an Imperfect AI?2019
- The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations2003