Systems Engineering With Architecture Modeling, Formal Verification, and Human Interactions for Learning‐Enabled Autonomous Agent
- 3 April 2025
- journal article
- Published by Wiley in Systems Engineering
- Vol. 28 (5) , 648-658
Abstract
With the rapid advancements in Artificial Intelligence (AI), autonomous agents are expected to handle increasingly complex situations. However, learning‐enabled algorithms, which are critical to these systems, present significant challenges, including complexity, difficulty in verification, and a lack of certification pathways. A systematic approach integrating architectural analysis with human–machine interaction is crucial to ensuring the safety of these systems. This research emphasizes the early incorporation of human interactions in the design of architectural models to meet safety requirements. These interactions are modeled in the Soar cognitive architecture, which combines symbolic decision logic and numeric decision preferences, refined by reinforcement learning. The agent is then automatically translated into the formal verification environment, nuXmv, where its properties are verified. Our framework integrates systems modeling, formal verification, and simulation to check operational correctness, enhancing the reliability and safety of learning‐enabled autonomous agents.Keywords
This publication has 31 references indexed in Scilit:
- Reinforced model predictive control (RL-MPC) for building energy managementApplied Energy, 2022
- A software engineering perspective on engineering machine learning systems: State of the art and challengesJournal of Systems and Software, 2021
- Software Verification and Validation of Safe Autonomous Cars: A Systematic Literature ReviewIEEE Access, 2020
- An overview of current research and developments in urban air mobility – Setting the scene for UAM introductionJournal of Air Transport Management, 2020
- Urban air mobility2020
- Machine Learning Models to Enhance the Science of Cognitive Autonomy2018
- The JKind Model Checker2018
- Reinforcement and Systemic Machine Learning for Decision Making2012
- The SAE Architecture Analysis & Design Language (AADL) A Standard for Engineering Performance Critical Systems2006
- Soar-RL: integrating reinforcement learning with SoarCognitive Systems Research, 2005