Anahita Jamshidnejad
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Anahita Jamshidnejad has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Bart De Schutter
Delft Center for Systems and Control, Delft University of Technology, Delft, The Netherlands
4 shared publications - Filip Surma
Delft University of Technology Kluyverweg 1 2629 HS Delft South Holland The Netherlands
3 shared publications Bart De Schutter
2 shared publications- Maria L. Morão Patrício
Department of Control and Operations, Delft University of Technology, Delft, The Netherlands
2 shared publications Bernardo Esteves Henriques
Control and Operations Department, Delft University of Technology, Delft, The Netherlands
1 shared publicationChristopher de Koning
Control and Operations Department, Delft University of Technology, Delft, The Netherlands
1 shared publication
Latest Publications
- Open Access
- 30 December 2025
- Published by Elsevier in Results in Control and Optimization
- Vol. 22
Recursive feasibility without terminal constraints via parent–child MPC architecture
- 30 December 2025
- Published by Elsevier in Results in Control and Optimization
- Vol. 22
Open AccessRecursive feasibility without terminal constraints via parent–child MPC architecture
- Open Access
MPC-Guided Safe Reinforcement Learning and Lipschitz-Based Filtering for Structured Nonlinear Systems
Modern engineering systems, such as autonomous vehicles, flexible robotics, and intelligent aerospace platforms, require controllers that are robust to uncertainties, adaptive to environmental changes, and safety-aware under real-time constraints. RL offers powerful data-driven adaptability for systems with nonlinear dynamics that interact with uncertain environments. RL, however, lacks built-in mechanisms for dynamic constraint satisfaction during exploration. MPC offers structured constraint handling and robustness, but its reliance on accurate models and computationally demanding online optimization may pose significant challenges. This paper proposes an integrated MPC-RL framework that combines stability and safety guarantees of MPC with the adaptability of RL. During training, MPC defines safe control bounds that guide the RL component and that enable constraint-aware policy learning. At deployment, the learned policy operates in real time with a lightweight safety filter based on Lipschitz continuity to ensure constraint satisfaction without heavy online optimizations. The approach, which is validated on a nonlinear aeroelastic wing system, demonstrates improved disturbance rejection, reduced actuator effort, and robust performance under turbulence. The architecture generalizes to other domains with structured nonlinearities and bounded disturbances, offering a scalable solution for safe artificial-intelligence-driven control in engineering applications.
Open AccessMPC-Guided Safe Reinforcement Learning and Lipschitz-Based Filtering for Structured Nonlinear Systems
Modern engineering systems, such as autonomous vehicles, flexible robotics, and intelligent aerospace platforms, require controllers that are robust to uncertainties, adaptive to environmental changes, and safety-aware under real-time constraints. RL offers powerful data-driven adaptability for systems with nonlinear dynamics that interact with uncertain environments. RL, however, lacks built-in mechanisms for dynamic constraint satisfaction during exploration. MPC offers structured constraint handling and robustness, but its reliance on accurate models and computationally demanding online optimization may pose significant challenges. This paper proposes an integrated MPC-RL framework that combines stability and safety guarantees of MPC with the adaptability of RL. During training, MPC defines safe control bounds that guide the RL component and that enable constraint-aware policy learning. At deployment, the learned policy operates in real time with a lightweight safety filter based on Lipschitz continuity to ensure constraint satisfaction without heavy online optimizations. The approach, which is validated on a nonlinear aeroelastic wing system, demonstrates improved disturbance rejection, reduced actuator effort, and robust performance under turbulence. The architecture generalizes to other domains with structured nonlinearities and bounded disturbances, offering a scalable solution for safe artificial-intelligence-driven control in engineering applications.
- Open Access
- 8 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. PP, 1
A Systems-Theoretic Approach to Mental State Estimation for Theory-of-Mind-Aware Social Robots
Social robots are increasingly deployed in fields such as health care and education to support users through social interactions. Nonetheless, these robots mostly rely on black-box machine learning methods that lack awareness of the mental states of their users, which often leads to unnatural behavior. To address this, we propose three model-based techniques for real-time estimation of invisible mental states of humans. Each method adapts the extended Kalman filter and incorporates a validated dynamic model of human mental states. These mental state estimators are designed for human-robot social interactions and personalize their parameters using initial user data. When tested with 10 human participants interacting with a NAO robot, the mental state estimators reduced the average error in estimation and prediction of mental states across all participants by 3% (i.e., from 12% to 9%), with improvements of up to 13% for individual participants. These results demonstrate the potential of integrating such state estimators into the behavioral control systems of social robots to enhance their awareness of the mental states of users.
- 8 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. PP, 1
Open AccessA Systems-Theoretic Approach to Mental State Estimation for Theory-of-Mind-Aware Social Robots
Social robots are increasingly deployed in fields such as health care and education to support users through social interactions. Nonetheless, these robots mostly rely on black-box machine learning methods that lack awareness of the mental states of their users, which often leads to unnatural behavior. To address this, we propose three model-based techniques for real-time estimation of invisible mental states of humans. Each method adapts the extended Kalman filter and incorporates a validated dynamic model of human mental states. These mental state estimators are designed for human-robot social interactions and personalize their parameters using initial user data. When tested with 10 human participants interacting with a NAO robot, the mental state estimators reduced the average error in estimation and prediction of mental states across all participants by 3% (i.e., from 12% to 9%), with improvements of up to 13% for individual participants. These results demonstrate the potential of integrating such state estimators into the behavioral control systems of social robots to enhance their awareness of the mental states of users.
- Open Access
Recursive Feasibility without Terminal Constraints via Parent-Child MPC Architecture
This paper proposes a novel hierarchical model predictive control (MPC) framework, called the Parent-Child MPC architecture, to steer nonlinear systems under uncertainty towards a target set, balancing computational complexity and guaranteeing recursive feasibility and stability without relying on conservative terminal constraints in online decision-making. By coupling a small-horizon Child MPC layer with one or more large-horizon Parent MPC layers, the architecture ensures recursive feasibility and stability through adjustable stage-wise constraints derived from tube-based control. As is demonstrated in our case studies, compared to traditional MPC methods, the proposed Parent-Child MPC architecture enhances performance and computational efficiency, reduces conservativeness, and enables scalable planning for certain nonlinear systems.
Open AccessRecursive Feasibility without Terminal Constraints via Parent-Child MPC Architecture
This paper proposes a novel hierarchical model predictive control (MPC) framework, called the Parent-Child MPC architecture, to steer nonlinear systems under uncertainty towards a target set, balancing computational complexity and guaranteeing recursive feasibility and stability without relying on conservative terminal constraints in online decision-making. By coupling a small-horizon Child MPC layer with one or more large-horizon Parent MPC layers, the architecture ensures recursive feasibility and stability through adjustable stage-wise constraints derived from tube-based control. As is demonstrated in our case studies, compared to traditional MPC methods, the proposed Parent-Child MPC architecture enhances performance and computational efficiency, reduces conservativeness, and enables scalable planning for certain nonlinear systems.
- Open Access
- 30 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 112568-112593
Personalized Human-Robot Cognitive Interaction via a Novel Fuzzy Logic Control and Learning-Based Paradigm
Socially assistive robotics is an emerging field that, through effective human-robot cognitive interactions (HRCIs), offers potential solutions for personalized care, education, and entertainment. For improved impact and for acceptance by humans, socially assistive robots (SARs) should autonomously personalize and adapt their behavior to, respectively, the personality and the changes in the states-of-mind of people they interact with. Despite extensive research on the ethical, societal, and psychological aspects of SARs, bridging systems-and-control-based methods and socially assistive robotics for developing control approaches that automate the personalization and adaptation of HRCIs remains under-attended. We propose the first systematic and generalizable paradigm for personalization and adaptation of the social interactive behaviors of SARs, combining two highly promising modeling and decision making approaches, namely fuzzy logic control (FLC) and reinforcement learning (RL). By replicating the rule-based decision making of humans, FLC provides a highly effective personalization mechanism and warm-starts the RL algorithm, which takes care of adapting the behaviors of SARs to the dynamics of people’s state-of-mind. Fuzzy logic is also used to develop two consecutive processes inside the RL-based adaptation module that, from the emotional responses of humans, estimate their state-of-mind and assign a reward to the most recent action of the SAR. Our extensive experiments for validation of this combined paradigm and for comparing it with conventional RL methods show meaningful improvements in the criteria that assess the personalization, convergence of learning, and performance accuracy of the proposed steering system for SARs.
- 30 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 112568-112593
Open AccessPersonalized Human-Robot Cognitive Interaction via a Novel Fuzzy Logic Control and Learning-Based Paradigm
Socially assistive robotics is an emerging field that, through effective human-robot cognitive interactions (HRCIs), offers potential solutions for personalized care, education, and entertainment. For improved impact and for acceptance by humans, socially assistive robots (SARs) should autonomously personalize and adapt their behavior to, respectively, the personality and the changes in the states-of-mind of people they interact with. Despite extensive research on the ethical, societal, and psychological aspects of SARs, bridging systems-and-control-based methods and socially assistive robotics for developing control approaches that automate the personalization and adaptation of HRCIs remains under-attended. We propose the first systematic and generalizable paradigm for personalization and adaptation of the social interactive behaviors of SARs, combining two highly promising modeling and decision making approaches, namely fuzzy logic control (FLC) and reinforcement learning (RL). By replicating the rule-based decision making of humans, FLC provides a highly effective personalization mechanism and warm-starts the RL algorithm, which takes care of adapting the behaviors of SARs to the dynamics of people’s state-of-mind. Fuzzy logic is also used to develop two consecutive processes inside the RL-based adaptation module that, from the emotional responses of humans, estimate their state-of-mind and assign a reward to the most recent action of the SAR. Our extensive experiments for validation of this combined paradigm and for comparing it with conventional RL methods show meaningful improvements in the criteria that assess the personalization, convergence of learning, and performance accuracy of the proposed steering system for SARs.
- Open Access
Leveraging Systems and Control Theory for Social Robotics: A Model-Based Behavioral Control Approach to Human-Robot Interaction
Social robots (SRs) should autonomously interact with humans, while exhibiting proper social behaviors associated to their role. By contributing to health-care, education, and companionship, SRs will enhance life quality. However, personalization and sustaining user engagement remain a challenge for SRs, due to their limited understanding of human mental states. Accordingly, we leverage a recently introduced mathematical dynamic model of human perception, cognition, and decision-making for SRs. Identifying the parameters of this model and deploying it in behavioral steering system of SRs allows to effectively personalize the responses of SRs to evolving mental states of their users, enhancing long-term engagement and personalization. Our approach uniquely enables autonomous adaptability of SRs by modeling the dynamics of invisible mental states, significantly contributing to the transparency and awareness of SRs. We validated our model-based control system in experiments with 10 participants who interacted with a Nao robot over three chess puzzle sessions, 45 - 90 minutes each. The identified model achieved a mean squared error (MSE) of 0.067 (i.e., 1.675% of the maximum possible MSE) in tracking beliefs, goals, and emotions of participants. Compared to a model-free controller that did not track mental states of participants, our approach increased engagement by 16% on average. Post-interaction feedback of participants (provided via dedicated questionnaires) further confirmed the perceived engagement and awareness of the model-driven robot. These results highlight the unique potential of model-based approaches and control theory in advancing human-SR interactions.
Open AccessLeveraging Systems and Control Theory for Social Robotics: A Model-Based Behavioral Control Approach to Human-Robot Interaction
Social robots (SRs) should autonomously interact with humans, while exhibiting proper social behaviors associated to their role. By contributing to health-care, education, and companionship, SRs will enhance life quality. However, personalization and sustaining user engagement remain a challenge for SRs, due to their limited understanding of human mental states. Accordingly, we leverage a recently introduced mathematical dynamic model of human perception, cognition, and decision-making for SRs. Identifying the parameters of this model and deploying it in behavioral steering system of SRs allows to effectively personalize the responses of SRs to evolving mental states of their users, enhancing long-term engagement and personalization. Our approach uniquely enables autonomous adaptability of SRs by modeling the dynamics of invisible mental states, significantly contributing to the transparency and awareness of SRs. We validated our model-based control system in experiments with 10 participants who interacted with a Nao robot over three chess puzzle sessions, 45 - 90 minutes each. The identified model achieved a mean squared error (MSE) of 0.067 (i.e., 1.675% of the maximum possible MSE) in tracking beliefs, goals, and emotions of participants. Compared to a model-free controller that did not track mental states of participants, our approach increased engagement by 16% on average. Post-interaction feedback of participants (provided via dedicated questionnaires) further confirmed the perceived engagement and awareness of the model-driven robot. These results highlight the unique potential of model-based approaches and control theory in advancing human-SR interactions.
- Open Access
- 28 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 55398-55415
GT-BDI Model: A Combined Game-Theoretic and BDI-Based Computational Model for Emergency Evacuation With Search and Rescue Robots
The catastrophic impact of disasters on affected populations necessitates effective management practices to minimize the societal and economical damages caused by disasters. This pertains planning effective measures to find and rescue trapped victims in time. Search and rescue in general is very challenging, as the number of the trapped victims may be unknown and their behaviour while trying to evacuate the disaster area is prone to variations, depending on their individual cognition and social interactions. Evacuation robots have attracted attention for their role in assisting search and rescue teams to locate and save victims. A behavioural model of the victims can provide insights for both the staff and the robots in search and rescue missions on how the trapped victims act during an evacuation, and to plan the search and rescue mission accordingly. Such a model, after being validated, can also be used for analysis of the influence of the robots in search and rescue missions. This paper proposes a novel evacuation model that integrates game theory and the belief-desire-intention (BDI) framework, in order to incorporate both the interactions of the trapped victims and their cognitive processes at the individual level. The model is validated using existing benchmark models for evacuation behaviour. Furthermore, the validated model is used to assess the effectiveness of the evacuation robots within the evacuation procedure. It is found that the presence of evacuation robots does reduce the evacuation time, as a function of the trust of the victims in these robots.
- 28 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 55398-55415
Open AccessGT-BDI Model: A Combined Game-Theoretic and BDI-Based Computational Model for Emergency Evacuation With Search and Rescue Robots
The catastrophic impact of disasters on affected populations necessitates effective management practices to minimize the societal and economical damages caused by disasters. This pertains planning effective measures to find and rescue trapped victims in time. Search and rescue in general is very challenging, as the number of the trapped victims may be unknown and their behaviour while trying to evacuate the disaster area is prone to variations, depending on their individual cognition and social interactions. Evacuation robots have attracted attention for their role in assisting search and rescue teams to locate and save victims. A behavioural model of the victims can provide insights for both the staff and the robots in search and rescue missions on how the trapped victims act during an evacuation, and to plan the search and rescue mission accordingly. Such a model, after being validated, can also be used for analysis of the influence of the robots in search and rescue missions. This paper proposes a novel evacuation model that integrates game theory and the belief-desire-intention (BDI) framework, in order to incorporate both the interactions of the trapped victims and their cognitive processes at the individual level. The model is validated using existing benchmark models for evacuation behaviour. Furthermore, the validated model is used to assess the effectiveness of the evacuation robots within the evacuation procedure. It is found that the presence of evacuation robots does reduce the evacuation time, as a function of the trust of the victims in these robots.
- Open Access
Fuzzy-Logic-based model predictive control: A paradigm integrating optimal and common-sense decision making
This paper introduces a novel concept, fuzzy-logic-based model predictive control (FLMPC), along with a multi-robot control approach for exploring unknown environments and locating targets. Traditional model predictive control (MPC) methods rely on Bayesian theory to represent environmental knowledge and optimize a stochastic cost function, often leading to high computational costs and lack of effectiveness in locating all the targets. Our approach instead leverages FLMPC and extends it to a bi-level parent-child architecture for enhanced coordination and extended decision making horizon. Extracting high-level information from probability distributions and local observations, FLMPC simplifies the optimization problem and significantly extends its operational horizon compared to other MPC methods. We conducted extensive simulations in unknown 2-dimensional environments with randomly placed obstacles and humans. We compared the performance and computation time of FLMPC against MPC with a stochastic cost function, then evaluated the impact of integrating the high-level parent FLMPC layer. The results indicate that our approaches significantly improve both performance and computation time, enhancing coordination of robots and reducing the impact of uncertainty in large-scale search and rescue environments.
Open AccessFuzzy-Logic-based model predictive control: A paradigm integrating optimal and common-sense decision making
This paper introduces a novel concept, fuzzy-logic-based model predictive control (FLMPC), along with a multi-robot control approach for exploring unknown environments and locating targets. Traditional model predictive control (MPC) methods rely on Bayesian theory to represent environmental knowledge and optimize a stochastic cost function, often leading to high computational costs and lack of effectiveness in locating all the targets. Our approach instead leverages FLMPC and extends it to a bi-level parent-child architecture for enhanced coordination and extended decision making horizon. Extracting high-level information from probability distributions and local observations, FLMPC simplifies the optimization problem and significantly extends its operational horizon compared to other MPC methods. We conducted extensive simulations in unknown 2-dimensional environments with randomly placed obstacles and humans. We compared the performance and computation time of FLMPC against MPC with a stochastic cost function, then evaluated the impact of integrating the high-level parent FLMPC layer. The results indicate that our approaches significantly improve both performance and computation time, enhancing coordination of robots and reducing the impact of uncertainty in large-scale search and rescue environments.
- Open Access
- 1 October 2024
- Published by Springer Nature in International Journal of Social Robotics
- Vol. 16 (9-10) , 1969-2000
SONAR: An Adaptive Control Architecture for Social Norm Aware Robots
Recent advances in robotics and artificial intelligence have made it necessary or desired for humans to get involved in interactions with social robots. A key factor for the human acceptance of these robots is their awareness of environmental and social norms. In this paper, we introduce SONAR (for SOcial Norm Aware Robots), a novel robot-agnostic control architecture aimed at enabling social agents to autonomously recognize, act upon, and learn over time social norms during interactions with humans. SONAR integrates several state-of-the-art theories and technologies, including the belief-desire-intention (BDI) model of reasoning and decision making for rational agents, fuzzy logic theory, and large language models, to support adaptive and norm-aware autonomous decision making. We demonstrate the feasibility and applicability of SONAR via real-life experiments involving human-robot interactions (HRI) using a Nao robot for scenarios of casual conversations between the robot and each participant. The results of our experiments show that our SONAR implementation can effectively and efficiently be used in HRI to provide the robot with environmental and social and norm awareness. Compared to a robot with no explicit social and norm awareness, introducing social and norm awareness via SONAR results in interactions that are perceived as more positive and enjoyable by humans, as well as in higher perceived trust in the social robot. Moreover, we investigate, via computer-based simulations, the extent to which SONAR can be used to learn and adapt to the social norms of different societies. The results of these simulations illustrate that SONAR can successfully learn adequate behaviors in a society from a relatively small amount of data. We publicly release the source code of SONAR, along with data and experiments logs.
- 1 October 2024
- Published by Springer Nature in International Journal of Social Robotics
- Vol. 16 (9-10) , 1969-2000
Open AccessSONAR: An Adaptive Control Architecture for Social Norm Aware Robots
Recent advances in robotics and artificial intelligence have made it necessary or desired for humans to get involved in interactions with social robots. A key factor for the human acceptance of these robots is their awareness of environmental and social norms. In this paper, we introduce SONAR (for SOcial Norm Aware Robots), a novel robot-agnostic control architecture aimed at enabling social agents to autonomously recognize, act upon, and learn over time social norms during interactions with humans. SONAR integrates several state-of-the-art theories and technologies, including the belief-desire-intention (BDI) model of reasoning and decision making for rational agents, fuzzy logic theory, and large language models, to support adaptive and norm-aware autonomous decision making. We demonstrate the feasibility and applicability of SONAR via real-life experiments involving human-robot interactions (HRI) using a Nao robot for scenarios of casual conversations between the robot and each participant. The results of our experiments show that our SONAR implementation can effectively and efficiently be used in HRI to provide the robot with environmental and social and norm awareness. Compared to a robot with no explicit social and norm awareness, introducing social and norm awareness via SONAR results in interactions that are perceived as more positive and enjoyable by humans, as well as in higher perceived trust in the social robot. Moreover, we investigate, via computer-based simulations, the extent to which SONAR can be used to learn and adapt to the social norms of different societies. The results of these simulations illustrate that SONAR can successfully learn adequate behaviors in a society from a relatively small amount of data. We publicly release the source code of SONAR, along with data and experiments logs.
- Open Access
- 20 August 2024
- Published by Springer Nature in Machine Vision and Applications
- Vol. 35 (5) , 1-18
Camera-based mapping in search-and-rescue via flying and ground robot teams
Search and rescue (SaR) is challenging, due to the unknown environmental situation after disasters occur. Robotics has become indispensable for precise mapping of the environment and for locating the victims. Combining flying and ground robots more effectively serves this purpose, due to their complementary features in terms of viewpoint and maneuvering. To this end, a novel, cost-effective framework for mapping unknown environments is introduced that leverages You Only Look Once and video streams transmitted by a ground and a flying robot. The integrated mapping approach is for performing three crucial SaR tasks: localizing the victims, i.e., determining their position in the environment and their body pose, tracking the moving victims, and providing a map of the ground elevation that assists both the ground robot and the SaR crew in navigating the SaR environment. In real-life experiments at the CyberZoo of the Delft University of Technology, the framework proved very effective and precise for all these tasks, particularly in occluded and complex environments.
- 20 August 2024
- Published by Springer Nature in Machine Vision and Applications
- Vol. 35 (5) , 1-18
Open AccessCamera-based mapping in search-and-rescue via flying and ground robot teams
Search and rescue (SaR) is challenging, due to the unknown environmental situation after disasters occur. Robotics has become indispensable for precise mapping of the environment and for locating the victims. Combining flying and ground robots more effectively serves this purpose, due to their complementary features in terms of viewpoint and maneuvering. To this end, a novel, cost-effective framework for mapping unknown environments is introduced that leverages You Only Look Once and video streams transmitted by a ground and a flying robot. The integrated mapping approach is for performing three crucial SaR tasks: localizing the victims, i.e., determining their position in the environment and their body pose, tracking the moving victims, and providing a map of the ground elevation that assists both the ground robot and the SaR crew in navigating the SaR environment. In real-life experiments at the CyberZoo of the Delft University of Technology, the framework proved very effective and precise for all these tasks, particularly in occluded and complex environments.