SCSiyuan Chen

Siyuan Chen

*This is an algorithmically generated author record based on publicly available information.

Siyuan Chen has a total of 23 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    LLM-assisted hierarchical multi-agent reinforcement learning for prescriptive maintenance

    by Siyuan Chen, Ebru Turanoglu Bekar, Sunith Bandaru, Anders Skoogh

    Prescriptive maintenance requires equipment information to be translated into intervention decisions with operational and economic consequences. Numerical observations describe production status and equipment condition, while maintenance reports provide diagnostic context for a learned controller. This paper presents a large language model (LLM)-assisted hierarchical multi-agent reinforcement learning framework that connects these information sources. The proposed semantic layer converts maintenance text into a diagnostic vector and combines it with numerical observations. A Manager selects the station to prioritize, and a Worker selects a repair action from a predefined maintenance taxonomy. A production-cost model expresses intervention outcomes through equipment, material, downtime, maintenance, and related expenditure components. A discrete-event simulation of a drone assembly line provides the engineering setting. The case study includes reported diagnostic and control summaries, constructed control trajectories, and illustrative noise and cost profiles. The diagnostic summary ranks models differently for fault classification and health-score estimation, while the Manager comparison distinguishes reward level from trajectory variability. Cost decomposition illustrates the tradeoff between maintenance expenditure and production losses. Domain judgement enters through diagnostic definitions, assigned decision responsibilities, and economic objectives.

  • Open Access

    Blockchain-anchored Digital Twin Traceability for Prescriptive Maintenance: A Conceptual Framework and Proof-of-Concept

    by Siyuan Chen

    Prescriptive maintenance (PsM) recommends concrete interventions from asset condition and operational constraints, increasingly relying on digital twins (DTs). In multi-stakeholder industrial settings, however, twin states, prognostic models, prescriptions, and execution outcomes are rarely linked by a verifiable audit trail. This paper presents ChainTwin-PsM, a compact conceptual framework for blockchain-anchored digital twin traceability that supports auditable PsM decisions. We define a minimal set of Traceable Twin Events (TTEs) spanning twin instantiation, state commitment, model registration, prediction, prescription, and execution feedback, together with hybrid on-chain/off-chain anchoring principles. A lightweight proof-of-concept simulates a multi-asset fleet with limited maintenance capacity and conflicting operator-service-provider incentives. It demonstrates that blockchain-backed service-level commitments can lower system cost and risk relative to weakly enforced coordination. The work is intentionally scoped as a framework-plus-PoC contribution rather than a state-of-the-art prognostics study, and keeps a C-MAPSS-compatible health interface for a subsequent data-driven extension.

  • Open Access

    LLM-enhanced multi-agent reinforcement learning for human-centric prescriptive maintenance in manufacturing

    by Siyuan Chen, Ebru Turanoglu Bekar, Sunith Bandaru, Anders Skoogh

    Industry 5.0 emphasizes human-centric manufacturing and creates demand for maintenance systems that move beyond passive failure prediction toward economically grounded prescriptive decisions. Prescriptive maintenance strategies aim not only to anticipate failures but also to optimize intervention policies under practical economic and operational constraints. While deep reinforcement learning has shown promise in automating such decisions, existing approaches rely primarily on numerical data and cannot process the qualitative diagnostic information stored in maintenance logs. By missing these crucial historical fault patterns, they operate as opaque systems that are difficult for practitioners to interpret and trust. This paper addresses these gaps by proposing a large language model (LLM) enhanced hierarchical multi-agent reinforcement learning framework for prescriptive maintenance with three main contributions. First, it adopts a heterogeneous architecture where a policy-gradient Manager handles station-level maintenance prioritization and a value-based Worker selects from a predefined taxonomy of prescriptive maintenance actions, reflecting how real maintenance teams are organized. Second, locally deployed LLMs translate textual maintenance context, including short-form maintenance reports and technician notes, into diagnostic semantic state variables with no dependence on cloud services. Third, the framework introduces a six-component cost-model reward based on production economics, covering tool, material, equipment, downtime, maintenance, and handling costs, so that automated decisions can be understood in straightforward economic terms and the effect of reward design on maintenance behavior can be examined explicitly. The framework is evaluated on a calibrated digital shadow of a lab-scale drone assembly line. Semantic state augmentation is associated with a 25.1% higher converged reward and 42% lower learning variance compared to the numerical-only baseline for the strongest LLM configuration. Under joint noise at σ = 0.25, the LLM-augmented agent still retains a performance advantage over the baseline, indicating that text-derived semantic variables provide a relatively stable auxiliary signal when numerical observations become unreliable. The cost-model formulation also reduces total operational cost compared to the overall equipment effectiveness based alternative while making the resulting policies easier to interpret in economic terms. These results show that integrating human diagnostic knowledge, reflecting real maintenance workflows, and improving economic transparency can build the necessary trust to support effective human-AI teaming in industrial settings.

  • Open Access

    LLM-enhanced multi-agent reinforcement learning for human-centric prescriptive maintenance in manufacturing

    by Siyuan Chen, Ebru Turanoglu Bekar, Sunith Bandaru, Anders Skoogh

    Industry 5.0 emphasizes human-centric manufacturing and creates demand for maintenance systems that move beyond passive failure prediction toward economically grounded prescriptive decisions. Prescriptive maintenance strategies aim not only to anticipate failures but also to optimize intervention policies under practical economic and operational constraints. While deep reinforcement learning has shown promise in automating such decisions, existing approaches rely primarily on numerical data and cannot process the qualitative diagnostic information stored in maintenance logs. By missing these crucial historical fault patterns, they operate as opaque systems that are difficult for practitioners to interpret and trust. This paper addresses these gaps by proposing a large language model (LLM) enhanced hierarchical multi-agent reinforcement learning framework for prescriptive maintenance with three main contributions. First, it adopts a heterogeneous architecture where a policy-gradient Manager handles station-level maintenance prioritization and a value-based Worker selects from a predefined taxonomy of prescriptive maintenance actions, reflecting how real maintenance teams are organized. Second, locally deployed LLMs translate textual maintenance context, including short-form maintenance reports and technician notes, into diagnostic semantic state variables with no dependence on cloud services. Third, the framework introduces a six-component cost-model reward based on production economics, covering tool, material, equipment, downtime, maintenance, and handling costs, so that automated decisions can be understood in straightforward economic terms and the effect of reward design on maintenance behavior can be examined explicitly. The framework is evaluated on a calibrated digital shadow of a lab-scale drone assembly line. Semantic state augmentation is associated with a 25.1% higher converged reward and 42% lower learning variance compared to the numerical-only baseline for the strongest LLM configuration. Under joint noise at σ = 0.25, the LLM-augmented agent still retains a performance advantage over the baseline, indicating that text-derived semantic variables provide a relatively stable auxiliary signal when numerical observations become unreliable. The cost-model formulation also reduces total operational cost compared to the overall equipment effectiveness based alternative while making the resulting policies easier to interpret in economic terms. These results show that integrating human diagnostic knowledge, reflecting real maintenance workflows, and improving economic transparency can build the necessary trust to support effective human-AI teaming in industrial settings.

  • Implementation of ISO 23247 for Digital Twins in Production Systems: Towards AI-Based Sustainable and XR-Based Human-Centric Manufacturing

    by Huizhong Cao, Henrik Söderlund, Qi Fang, Siyuan Chen, Lejla Erdal, Ammar Gubartalla, Paulo Victor Lopes, Guodong Shao, Per Lonnehed, Henri Putto, et al.

    Since the introduction of Industry 4.0, digital twin technology has advanced dramatically, and its applications have been extensively discussed. Through digital twins, real-time connected production systems are anticipated to be more efficient, resilient, and sustainable, facilitating communication and connectivity between digital and physical systems. However, challenges remain in environmental performance and in integration of virtual reality (VR) and artificial intelligence (AI). Further exploration of digital twin technologies is needed to validate the real-world impact and benefits. This paper investigates these challenges by implementing a real-time digital twin based on the ISO 23247, Automation Systems and Integration - Digital Twin Framework for Manufacturing, (Digital twin framework for manufacturing), connecting the physical factory and simulation software with VR capabilities. This digital twin system provides cognitive assistance and a user-friendly interface for operators, thereby improving cognitive ergonomics. The connection of the Internet of Things platform allows the digital twin for real-time bidirectional communication, collaboration, monitoring, and assistance. A laboratory-scale drone factory was used as the digital twin application to test and evaluate the ISO 23247 standard as well as its potential benefits. Additionally, AI integration and environmental performance key performance indicators have been considered as the next stages to improve VR-integrated digital twins. This paper further discusses how digital twins contribute to the improvement of the environmental performance of production systems, primarily from the perspective of data inventory management. Supported by a solid theoretical foundation and a laboratory-scale demonstration of the VR-integrated digital twins in a drone framework, the paper bridges the gap between possible technological integrations and the advancement of digital twins framework based on ISO 23247.


  • Multi-AGVs path planning based on improved ant colony algorithm

    by Guohong Yi, Zhili Feng, Tiancan Mei, Pushan Li, Wang Jin, Siyuan Chen