Bridging Industrial Expertise and XR with LLM-Powered Conversational Agents
Authors:
- 9 June 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1050-1056
Abstract
This paper introduces a novel integration of Retrieval-Augmented Generation (RAG) enhanced Large Language Models (LLMs) with Extended Reality (XR) technologies to address knowledge transfer challenges in industrial environments. The proposed system embeds domain-specific industrial knowledge into XR environments through a natural language interface, enabling hands-free, context-aware expert guidance for workers. We present the architecture of the proposed system consisting of an LLM Chat Engine with dynamic tool orchestration and an XR application featuring voice-driven interaction. Performance evaluation of various chunking strategies, embedding models, and vector databases reveals that semantic chunking, balanced embedding models, and efficient vector stores deliver optimal performance for industrial knowledge retrieval. The system's potential is demonstrated through early implementation in multiple industrial use cases, including robotic assembly, smart infrastructure maintenance, and aerospace component servicing. Results indicate potential for enhancing training efficiency, remote assistance capabilities, and operational guidance in alignment with Industry 5.0's human-centric and resilient approach to industrial development.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Large Language Models (LLMs) for Smart Manufacturing and Industry X.02025
- Can Large Language Models beat wall street? Evaluating GPT-4’s impact on financial decision-making with MarketSenseAINeural Computing and Applications, 2024
- Transforming sentiment analysis in the financial domain with ChatGPTMachine Learning with Applications, 2023
- Samsung in Vietnam: FDI, Business–Government Relations, Industrial Parks, and Skills ShortagesThe Economic and Labour Relations Review, 2023
- A study on the factors causing bottleneck problems in the manufacturing industry using principal component analysisHeliyon, 2021
- Virtual and Augmented Reality Enhancements to Medical and Science Student Physiology and Anatomy Test Performance: A Systematic Review and Meta‐AnalysisAnatomical Sciences Education, 2020
- Enhancing smart shop floor management with ubiquitous augmented realityInternational Journal of Production Research, 2019
- A structural equation modeling investigation of the emotional value of immersive virtual reality in educationEducational Technology Research and Development, 2018
- A comprehensive survey of augmented reality assembly researchAdvances in Manufacturing, 2016
- Augmented reality technologies, systems and applicationsMultimedia Tools and Applications, 2010