Bridging LLMs and Symbolic Reasoning in Educational QA Systems: Insights from the XAI Challenge at IJCNN 2025
Authors:
- Long S. T. NguyenLNLong S. T. Nguyen
- Thu H. A. NguyenTNThu H. A. Nguyen
- Tuan C. BuiTBTuan C. Bui
- Duc Q. NguyenDuc Q. Nguyen
- Thanh-Tung TranTTThanh-Tung Tran
- Minh L. NguyenMNMinh L. Nguyen
- Fabien BaldacciFBFabien Baldacci
- Thang H. BuiTBThang H. Bui
- Emanuel Di NardoEmanuel Di Nardo
- Angelo CiaramellaACAngelo Ciaramella
Preprint
Abstract
The growing integration of Artificial Intelligence (AI) into education has intensified the need for transparency and interpretability. While hackathons have long served as agile environments for rapid AI prototyping, few have directly addressed eXplainable AI (XAI) in real-world educational contexts. This paper presents a comprehensive analysis of the XAI Challenge 2025, a hackathon-style competition jointly organized by Ho Chi Minh City University of Technology (HCMUT) and the International Workshop on Trustworthiness and Reliability in Neurosymbolic AI (TRNS-AI), held as part of the International Joint Conference on Neural Networks (IJCNN 2025). The challenge tasked participants with building Question-Answering (QA) systems capable of answering student queries about university policies while generating clear, logic-based natural language explanations. To promote transparency and trustworthiness, solutions were required to use lightweight Large Language Models (LLMs) or hybrid LLM-symbolic systems. A high-quality dataset was provided, constructed via logic-based templates with Z3 validation and refined through expert student review to ensure alignment with real-world academic scenarios. We describe the challenge's motivation, structure, dataset construction, and evaluation protocol. Situating the competition within the broader evolution of AI hackathons, we argue that it represents a novel effort to bridge LLMs and symbolic reasoning in service of explainability. Our findings offer actionable insights for future XAI-centered educational systems and competitive research initiatives.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Integrating Generative AI in Hackathons: Opportunities, Challenges, and Educational ImplicationsBig Data and Cognitive Computing, 2024
- Solving olympiad geometry without human demonstrationsNature, 2024
- Chatbots in Education and Research: A Critical Examination of Ethical Implications and SolutionsSustainability, 2023
- Hackathons for Driving Service Innovation Strategies: The Evolution of a Digital Platform-Based EcosystemJournal of Open Innovation: Technology, Market, and Complexity, 2022
- Reconciling deep learning with symbolic artificial intelligence: representing objects and relationsCurrent Opinion in Behavioral Sciences, 2019
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)IEEE Access, 2018