Sooyung Byeon
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Sooyung Byeon has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Inseok Hwang
School of Aeronautics and Astronautics, Purdue University, West Lafayette, IN, USA
5 shared publications - Joonwon Choi
School of Aeronautics and Astronautics, Purdue University, West Lafayette, IN, USA
3 shared publications - Dawei Sun
School of Aeronautic Science and Engineering, Beihang University, Beijing, China
1 shared publication - Shanelle G. Clarke
School of Aeronautics and Astronautics, Purdue University, West Lafayette, IN, USA
1 shared publication - Yutong Zhang
Purdue University, West Lafayette, USA
1 shared publication
Latest Publications
- 24 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 33 (2) , 788-798
Data-Driven Closed-Loop Reachability Analysis for Nonlinear Human-in-the-Loop Systems Using Gaussian Mixture Model
This article presents data-driven algorithms to perform the reachability analysis of nonlinear human-in-the-loop (HITL) systems. Such systems require consideration of the human control policy, otherwise might result in a conservative reachable set. However, formulating the human control policy in a mathematically tractable form is challenging, and thus, it is commonly ignored or simplified in many applications. To tackle this problem, we propose Gaussian mixture model (GMM)-based data-driven algorithms that can explicitly consider the human control policy during the reachability analysis of an HITL system. The proposed algorithms learn the human control policy as a GMM using the given trajectory. Then, the control input from the human operator is predicted based on the trained GMM by leveraging the Gaussian mixture regression (GMR), thereby facilitating the closed-loop forward stochastic reachability analysis. In this article, we examine two types of human control policies, state-independent and state-dependent, and propose the respective algorithms. We also tested our proposed algorithms using the human subject experimental data and demonstrated to generate more accurate results compared with other existing algorithms.
- 24 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 33 (2) , 788-798
Data-Driven Closed-Loop Reachability Analysis for Nonlinear Human-in-the-Loop Systems Using Gaussian Mixture Model
This article presents data-driven algorithms to perform the reachability analysis of nonlinear human-in-the-loop (HITL) systems. Such systems require consideration of the human control policy, otherwise might result in a conservative reachable set. However, formulating the human control policy in a mathematically tractable form is challenging, and thus, it is commonly ignored or simplified in many applications. To tackle this problem, we propose Gaussian mixture model (GMM)-based data-driven algorithms that can explicitly consider the human control policy during the reachability analysis of an HITL system. The proposed algorithms learn the human control policy as a GMM using the given trajectory. Then, the control input from the human operator is predicted based on the trained GMM by leveraging the Gaussian mixture regression (GMR), thereby facilitating the closed-loop forward stochastic reachability analysis. In this article, we examine two types of human control policies, state-independent and state-dependent, and propose the respective algorithms. We also tested our proposed algorithms using the human subject experimental data and demonstrated to generate more accurate results compared with other existing algorithms.
- Open Access
- 26 August 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Human-Robot Interaction
- Vol. 13 (3) , 1-25
Stochastic-skill-level-based Shared Control for Human Training in Urban Air Mobility Scenario
This article proposes a novel stochastic-skill-level-based shared control framework to assist human novices to emulate human experts in complex dynamic control tasks. The proposed framework aims to infer stochastic-skill-levels (SSLs) of the human novices and provide personalized assistance based on the inferred SSLs. SSL can be assessed as a stochastic variable that denotes the probability that the novice will behave similarly to experts. We propose a data-driven method that can characterize novice demonstrations as a novice model and expert demonstrations as an expert model, respectively. Then, our SSL inference approach utilizes the novice and expert models to assess the SSL of the novices in complex dynamic control tasks. The shared control scheme is designed to dynamically adjust the level of assistance based on the inferred SSL to prevent frustration or tedium during human training due to poorly imposed assistance. The proposed framework is demonstrated by a human subject experiment in a human training scenario for a remotely piloted urban air mobility vehicle. The results show that the proposed framework can assess the SSL and tailor the assistance for an individual in real time. The proposed framework is compared to practice-only training (no assistance) and a baseline shared control approach to test the human learning rates in the designed training scenario with human subjects. A subjective survey is also examined to monitor the user experience of the proposed framework.
- 26 August 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Human-Robot Interaction
- Vol. 13 (3) , 1-25
Open AccessStochastic-skill-level-based Shared Control for Human Training in Urban Air Mobility Scenario
This article proposes a novel stochastic-skill-level-based shared control framework to assist human novices to emulate human experts in complex dynamic control tasks. The proposed framework aims to infer stochastic-skill-levels (SSLs) of the human novices and provide personalized assistance based on the inferred SSLs. SSL can be assessed as a stochastic variable that denotes the probability that the novice will behave similarly to experts. We propose a data-driven method that can characterize novice demonstrations as a novice model and expert demonstrations as an expert model, respectively. Then, our SSL inference approach utilizes the novice and expert models to assess the SSL of the novices in complex dynamic control tasks. The shared control scheme is designed to dynamically adjust the level of assistance based on the inferred SSL to prevent frustration or tedium during human training due to poorly imposed assistance. The proposed framework is demonstrated by a human subject experiment in a human training scenario for a remotely piloted urban air mobility vehicle. The results show that the proposed framework can assess the SSL and tailor the assistance for an individual in real time. The proposed framework is compared to practice-only training (no assistance) and a baseline shared control approach to test the human learning rates in the designed training scenario with human subjects. A subjective survey is also examined to monitor the user experience of the proposed framework.
- Open Access
- 6 December 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Control Systems
- Vol. 3, 32-44
A Computational Framework for Optimal Adaptive Function Allocation in a Human-Autonomy Teaming Scenario
This article proposes a quantitative framework for optimally allocating task functions in human-autonomy teaming (HAT). HAT involves cooperation between humans and autonomous agents to achieve common goals. As humans and autonomous agents possess different capabilities, function allocation plays a crucial role in ensuring effective HAT. However, designing the best adaptive function allocation remains a challenge, as existing methods often rely on qualitative rules and intensive human-subject studies. To address this limitation, we propose a computational function allocation approach that leverages cognitive engineering, computational work models, and optimization techniques. The proposed optimal adaptive function allocation method is composed of three main elements: 1) analyze the teamwork to identify a set of all possible function allocations within a team construction, 2) numerically simulate the teamwork in temporal semantics to explore the interaction of the team with complex environments using the identified function allocations in a trial-and-error manner, and 3) optimize the adaptive function allocation with respect to a given situation such as physical conditions, available information resources, and human mental workload. For the optimization, we utilize performance metrics such as task performance, human mental workload, and coherency in function allocations. To illustrate the effectiveness of the proposed framework, we present a simulated HAT scenario involving a human work model and drone fleet for last-mile delivery in disaster relief operations.
- 6 December 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of Control Systems
- Vol. 3, 32-44
Open AccessA Computational Framework for Optimal Adaptive Function Allocation in a Human-Autonomy Teaming Scenario
This article proposes a quantitative framework for optimally allocating task functions in human-autonomy teaming (HAT). HAT involves cooperation between humans and autonomous agents to achieve common goals. As humans and autonomous agents possess different capabilities, function allocation plays a crucial role in ensuring effective HAT. However, designing the best adaptive function allocation remains a challenge, as existing methods often rely on qualitative rules and intensive human-subject studies. To address this limitation, we propose a computational function allocation approach that leverages cognitive engineering, computational work models, and optimization techniques. The proposed optimal adaptive function allocation method is composed of three main elements: 1) analyze the teamwork to identify a set of all possible function allocations within a team construction, 2) numerically simulate the teamwork in temporal semantics to explore the interaction of the team with complex environments using the identified function allocations in a trial-and-error manner, and 3) optimize the adaptive function allocation with respect to a given situation such as physical conditions, available information resources, and human mental workload. For the optimization, we utilize performance metrics such as task performance, human mental workload, and coherency in function allocations. To illustrate the effectiveness of the proposed framework, we present a simulated HAT scenario involving a human work model and drone fleet for last-mile delivery in disaster relief operations.
- 6 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 7, 787-792
An Inverse Optimal Control Approach for Learning and Reproducing Under Uncertainties
This study presents a novel inverse optimal control (IOC) approach that can account for uncertainties in measurements and system models. The proposed IOC approach aims to recover an objective function including a time-varying term, called variability, from a given demonstration. All uncertainties of the demonstration and the system model can be lumped into the variability such that the optimality condition violation is further reduced. The inferred objective function including the variability has two advantages over the objective function inferred by existing IOC approaches: first, the variability can enhance the capability of describing the given demonstration since it represents how the uncertainties of the system affect the objective function; and second, the proposed IOC approach can reproduce the trajectories such that we can predict the behavior of the system even with system modeling errors. We show that the variability exists and is unique under attainable assumptions. Illustrative numerical examples are presented to demonstrate the proposed method.
- 6 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 7, 787-792
An Inverse Optimal Control Approach for Learning and Reproducing Under Uncertainties
This study presents a novel inverse optimal control (IOC) approach that can account for uncertainties in measurements and system models. The proposed IOC approach aims to recover an objective function including a time-varying term, called variability, from a given demonstration. All uncertainties of the demonstration and the system model can be lumped into the variability such that the optimality condition violation is further reduced. The inferred objective function including the variability has two advantages over the objective function inferred by existing IOC approaches: first, the variability can enhance the capability of describing the given demonstration since it represents how the uncertainties of the system affect the objective function; and second, the proposed IOC approach can reproduce the trajectories such that we can predict the behavior of the system even with system modeling errors. We show that the variability exists and is unique under attainable assumptions. Illustrative numerical examples are presented to demonstrate the proposed method.
- Open Access
- 19 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 9298-9308
A Low Complexity Approach to Model-Free Stochastic Inverse Linear Quadratic Control
In this paper, we present a Model-Free Stochastic Inverse Optimal Control (IOC) algorithm for the discrete-time infinite-horizon stochastic linear quadratic regulator (LQR). Our proposed algorithm exploits the richness of the available system trajectories to recover the control gain $K$ and cost function parameters $(Q,R)$ in a low (space, sample, and computational) complexity manner. By leveraging insights on the stochastic LQR, we guarantee well-posedness of the Model-Free Stochastic IOC LQR via satisfaction of the Certainty Equivalence optimality conditions. The exact solution of the control gain $K$ is recovered via a deterministic, low complexity Least Squares approach. Using $K$ , we solve a completely model-free non-iterative SemiDefinite Programming (SDP) problem to obtain a unique (up to a scalar ambiguity) $(Q,R)$ , in which optimality and feasibility are jointly ensured. Via derivation of the sample complexity bounds, we show that the non-asymptotic performance of the Model-Free Stochastic IOC LQR can be characterized by the signal-to-noise (SNR) ratio of the finite set of system state and input signals. We present a model-based version of the algorithm for the special case where $(A,B)$ is available, and we, further, provide the extension to the Stochastic Model-Free IOC linear quadratic tracking (LQT) case.
- 19 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 9298-9308
Open AccessA Low Complexity Approach to Model-Free Stochastic Inverse Linear Quadratic Control
In this paper, we present a Model-Free Stochastic Inverse Optimal Control (IOC) algorithm for the discrete-time infinite-horizon stochastic linear quadratic regulator (LQR). Our proposed algorithm exploits the richness of the available system trajectories to recover the control gain $K$ and cost function parameters $(Q,R)$ in a low (space, sample, and computational) complexity manner. By leveraging insights on the stochastic LQR, we guarantee well-posedness of the Model-Free Stochastic IOC LQR via satisfaction of the Certainty Equivalence optimality conditions. The exact solution of the control gain $K$ is recovered via a deterministic, low complexity Least Squares approach. Using $K$ , we solve a completely model-free non-iterative SemiDefinite Programming (SDP) problem to obtain a unique (up to a scalar ambiguity) $(Q,R)$ , in which optimality and feasibility are jointly ensured. Via derivation of the sample complexity bounds, we show that the non-asymptotic performance of the Model-Free Stochastic IOC LQR can be characterized by the signal-to-noise (SNR) ratio of the finite set of system state and input signals. We present a model-based version of the algorithm for the special case where $(A,B)$ is available, and we, further, provide the extension to the Stochastic Model-Free IOC linear quadratic tracking (LQT) case.