Young Sam Lee
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Young Sam Lee has a total of 33 co-authors. Here are the top co-authors by number of shared publications:
- Soohee Han
Pohang University of Science and Technology
6 shared publications - Doyoon Ju
Department of Electrical and Computer Engineering, Inha University, 100 Inha-ro, Michuhol-gu, Incheon 22212, Republic of Korea
5 shared publications - Taegun Lee
Department of Electrical and Computer Engineering, Inha University, Incheon, Korea
3 shared publications - Young-Jun Lee
Inha Univ. (Korea, Republic of)
3 shared publications - Heeseung Bang
School of Civil and Environmental Engineering, Cornell University, Ithaca, NY, USA
2 shared publications - Soo Jeon
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, Canada
2 shared publications
Latest Publications
- Open Access
- 12 September 2026
- Published by MDPI AG in Mathematics
- Vol. 14 (18) , 3319
Reinforcement Learning-Based Transition Control of a Mini Rotary Double Inverted Pendulum: A MuJoCo-Based Approach
This paper proposes a MuJoCo-based sim-to-real reinforcement learning approach for transition control of a mini rotary double inverted pendulum (MRDIP). Transition control between multiple equilibrium points of the MRDIP is challenging because of its underactuated, nonlinear, and strongly coupled dynamics. To address this problem, a direct-drive MRDIP system is developed to enable torque-controlled actuation, and a MuJoCo model is constructed using CAD-based physical parameters and experimentally identified dynamic parameters. Based on the identified model, transition control policies for multiple equilibrium points are trained using the Truncated Quantile Critics (TQC) algorithm. The trained policies are directly implemented on the physical MRDIP and evaluated through successive equilibrium-point transitions without resetting the system between transitions. Experimental results show that the policies trained in MuJoCo successfully perform the intended transitions on the physical system. These results demonstrate the feasibility of the proposed MuJoCo-based framework for sim-to-real transition control of the MRDIP.
- 12 September 2026
- Published by MDPI AG in Mathematics
- Vol. 14 (18) , 3319
Open AccessReinforcement Learning-Based Transition Control of a Mini Rotary Double Inverted Pendulum: A MuJoCo-Based Approach
This paper proposes a MuJoCo-based sim-to-real reinforcement learning approach for transition control of a mini rotary double inverted pendulum (MRDIP). Transition control between multiple equilibrium points of the MRDIP is challenging because of its underactuated, nonlinear, and strongly coupled dynamics. To address this problem, a direct-drive MRDIP system is developed to enable torque-controlled actuation, and a MuJoCo model is constructed using CAD-based physical parameters and experimentally identified dynamic parameters. Based on the identified model, transition control policies for multiple equilibrium points are trained using the Truncated Quantile Critics (TQC) algorithm. The trained policies are directly implemented on the physical MRDIP and evaluated through successive equilibrium-point transitions without resetting the system between transitions. Experimental results show that the policies trained in MuJoCo successfully perform the intended transitions on the physical system. These results demonstrate the feasibility of the proposed MuJoCo-based framework for sim-to-real transition control of the MRDIP.
- Open Access
- 7 September 2026
- Published by MDPI AG in Electronics
- Vol. 15 (17) , 4048
MuJoCo-Based Sim-to-Real Reinforcement Learning for Transition Control of a Triple Inverted Pendulum
This study presents an experimentally validated MuJoCo-based sim-to-real reinforcement learning framework for transition control among all eight equilibrium points (EPs) of a physical triple inverted pendulum (TIP). A multibody model is constructed from the apparatus properties, and uncertain actuation, damping, and friction parameters are identified by matching measured and simulated trajectories using the covariance matrix adaptation evolution strategy. The resulting effective parameter sets are sampled during training using truncated quantile critics to reduce policy dependence on a single model. The trained policies are transferred to the physical TIP without additional tuning or calibration. In the EP0-to-EP7 experiment, the policy trained without parameter identification failed in all ten trials, whereas the policy trained with the identified parameter sets succeeded in all ten. In the sequential experiment, all eight transitions were completed in each of ten trials, yielding 80 successful transitions with no observed failures while satisfying the cart travel and tangential force limits. These results demonstrate sim-to-real transition control across all eight EPs without state resets or precomputed trajectories.
- 7 September 2026
- Published by MDPI AG in Electronics
- Vol. 15 (17) , 4048
Open AccessMuJoCo-Based Sim-to-Real Reinforcement Learning for Transition Control of a Triple Inverted Pendulum
This study presents an experimentally validated MuJoCo-based sim-to-real reinforcement learning framework for transition control among all eight equilibrium points (EPs) of a physical triple inverted pendulum (TIP). A multibody model is constructed from the apparatus properties, and uncertain actuation, damping, and friction parameters are identified by matching measured and simulated trajectories using the covariance matrix adaptation evolution strategy. The resulting effective parameter sets are sampled during training using truncated quantile critics to reduce policy dependence on a single model. The trained policies are transferred to the physical TIP without additional tuning or calibration. In the EP0-to-EP7 experiment, the policy trained without parameter identification failed in all ten trials, whereas the policy trained with the identified parameter sets succeeded in all ten. In the sequential experiment, all eight transitions were completed in each of ten trials, yielding 80 successful transitions with no observed failures while satisfying the cart travel and tangential force limits. These results demonstrate sim-to-real transition control across all eight EPs without state resets or precomputed trajectories.
- 9 September 2025
- Published by Springer Nature in International Journal of Control, Automation, and Systems
- Vol. 23 (9) , 2797-2806
Reinforcement Learning to Achieve Real-time Control of a Quadruple Inverted Pendulum
- 9 September 2025
- Published by Springer Nature in International Journal of Control, Automation, and Systems
- Vol. 23 (9) , 2797-2806
Reinforcement Learning to Achieve Real-time Control of a Quadruple Inverted Pendulum
- Open Access
- 17 June 2025
- Published by MDPI AG in Mathematics
- Vol. 13 (12) , 1996
Sim-to-Real Reinforcement Learning for a Rotary Double-Inverted Pendulum Based on a Mathematical Model
This paper proposes a transition control strategy for a rotary double-inverted pendulum (RDIP) system using a sim-to-real reinforcement learning (RL) controller, built upon mathematical modeling and parameter estimation. High-resolution sensor data are used to estimate key physical parameters, ensuring model fidelity for simulation. The resulting mathematical model serves as the training environment in which the RL agent learns to perform transitions between various initial conditions and target equilibrium configurations. The training process adopts the Truncated Quantile Critics (TQC) algorithm, with a reward function specifically designed to reflect the nonlinear characteristics of the system. The learned policy is directly deployed on physical hardware without additional tuning or calibration, and the TQC-based controller successfully achieves all four equilibrium transitions. Furthermore, the controller exhibits robust recovery properties under external disturbances, demonstrating its effectiveness as a reliable sim-to-real control approach for high-dimensional nonlinear systems.
- 17 June 2025
- Published by MDPI AG in Mathematics
- Vol. 13 (12) , 1996
Open AccessSim-to-Real Reinforcement Learning for a Rotary Double-Inverted Pendulum Based on a Mathematical Model
This paper proposes a transition control strategy for a rotary double-inverted pendulum (RDIP) system using a sim-to-real reinforcement learning (RL) controller, built upon mathematical modeling and parameter estimation. High-resolution sensor data are used to estimate key physical parameters, ensuring model fidelity for simulation. The resulting mathematical model serves as the training environment in which the RL agent learns to perform transitions between various initial conditions and target equilibrium configurations. The training process adopts the Truncated Quantile Critics (TQC) algorithm, with a reward function specifically designed to reflect the nonlinear characteristics of the system. The learned policy is directly deployed on physical hardware without additional tuning or calibration, and the TQC-based controller successfully achieves all four equilibrium transitions. Furthermore, the controller exhibits robust recovery properties under external disturbances, demonstrating its effectiveness as a reliable sim-to-real control approach for high-dimensional nonlinear systems.
- Open Access
Transition Control of a Double-Inverted Pendulum System Using Sim2Real Reinforcement Learning
This study presents a sim2real reinforcement learning-based controller for transition control in a double-inverted pendulum system, addressing the limitations of traditional control methods that rely on precomputed trajectories and lack adaptability to strong external disturbances. By introducing the novel concept of ‘transition control’, this research expands the scope of inverted pendulum studies to tackle the challenging task of navigating between multiple equilibrium points. To overcome the reality gap—a persistent challenge in sim2real transfer—a hardware-centered approach was employed, aligning the physical system’s mechanical design with high-fidelity dynamic equations derived from the Euler–Lagrange equation. This design eliminates the need for software-based corrections, ensuring consistent and robust system performance across simulated and real-world environments. Experimental validation demonstrates the controller’s ability to reliably execute all 12 transition scenarios within the double-inverted pendulum system. Additionally, it exhibits recovery characteristics, enabling the system to stabilize and return to equilibrium point even under severe disturbances.
Open AccessTransition Control of a Double-Inverted Pendulum System Using Sim2Real Reinforcement Learning
This study presents a sim2real reinforcement learning-based controller for transition control in a double-inverted pendulum system, addressing the limitations of traditional control methods that rely on precomputed trajectories and lack adaptability to strong external disturbances. By introducing the novel concept of ‘transition control’, this research expands the scope of inverted pendulum studies to tackle the challenging task of navigating between multiple equilibrium points. To overcome the reality gap—a persistent challenge in sim2real transfer—a hardware-centered approach was employed, aligning the physical system’s mechanical design with high-fidelity dynamic equations derived from the Euler–Lagrange equation. This design eliminates the need for software-based corrections, ensuring consistent and robust system performance across simulated and real-world environments. Experimental validation demonstrates the controller’s ability to reliably execute all 12 transition scenarios within the double-inverted pendulum system. Additionally, it exhibits recovery characteristics, enabling the system to stabilize and return to equilibrium point even under severe disturbances.
- Open Access
- 15 February 2025
- Published by MDPI AG in Mathematics
- Vol. 13 (4) , 640
Transition Control of a Rotary Double Inverted Pendulum Using Direct Collocation
The rotary double inverted pendulum system is characterized by one stable equilibrium point and three unstable equilibrium points due to its kinematic properties. This paper defines the transition control problem between these equilibrium points to extend the conventional swing-up control problem and proposes an implementation method using a laboratory-developed rotary double inverted pendulum. To minimize energy consumption during the transition process while satisfying the boundary conditions of different equilibrium points, a two-point boundary value optimal control problem is formulated. The feedforward trajectory required for feedforward control is computed offline by solving this problem. The direct collocation method is employed to convert the constrained continuous optimal control problem into a nonlinear optimization problem. Furthermore, a time-varying linear–quadratic (LQ) controller is utilized as a feedback controller to accurately track the generated feedforward trajectory during real-time control, compensating for uncertainties in the feedforward control process. The proposed transition control strategy is experimentally implemented, and its effectiveness and practicality are validated through the successful tracking of 12 transition trajectories.
- 15 February 2025
- Published by MDPI AG in Mathematics
- Vol. 13 (4) , 640
Open AccessTransition Control of a Rotary Double Inverted Pendulum Using Direct Collocation
The rotary double inverted pendulum system is characterized by one stable equilibrium point and three unstable equilibrium points due to its kinematic properties. This paper defines the transition control problem between these equilibrium points to extend the conventional swing-up control problem and proposes an implementation method using a laboratory-developed rotary double inverted pendulum. To minimize energy consumption during the transition process while satisfying the boundary conditions of different equilibrium points, a two-point boundary value optimal control problem is formulated. The feedforward trajectory required for feedforward control is computed offline by solving this problem. The direct collocation method is employed to convert the constrained continuous optimal control problem into a nonlinear optimization problem. Furthermore, a time-varying linear–quadratic (LQ) controller is utilized as a feedback controller to accurately track the generated feedforward trajectory during real-time control, compensating for uncertainties in the feedforward control process. The proposed transition control strategy is experimentally implemented, and its effectiveness and practicality are validated through the successful tracking of 12 transition trajectories.
- 29 May 2024
- Published by Elsevier in Robotics and Autonomous Systems
- Vol. 179
Suppressing violent sloshing flow in food serving robots
- 29 May 2024
- Published by Elsevier in Robotics and Autonomous Systems
- Vol. 179
Suppressing violent sloshing flow in food serving robots
- 16 November 2023
- Published by Elsevier in Engineering Applications of Artificial Intelligence
- Vol. 128
Reinforcement learning to achieve real-time control of triple inverted pendulum
- 16 November 2023
- Published by Elsevier in Engineering Applications of Artificial Intelligence
- Vol. 128
Reinforcement learning to achieve real-time control of triple inverted pendulum
- Open Access
A Cost-Effective Lightning Current Measuring Instrument with Wide Current Range Detection Using Dual Signal Conditioning Circuits
Lightning strikes can cause significant damage to critical infrastructure and pose a serious threat to public safety. To ensure the safety of facilities and investigate the causes of lightning accidents, we propose a cost-effective design method for a lightning current measuring instrument that uses a Rogowski coil and dual signal conditioning circuits to detect a wide range of lightning currents, ranging from hundreds of A to hundreds of kA. To implement the proposed lightning current measuring instrument, we design signal conditioning circuits and software capable of detecting and analyzing lightning currents from ±500 A to ±100 kA. By employing dual signal conditioning circuits, it offers the advantage of detecting a wide range of lightning currents compared to existing lightning current measuring instruments. The proposed instrument has the following features: First, the peak current, polarity, (front time), (time to half value), and Q (amount of energy of the lightning current) can be analyzed and measured with a fast sampling time of 380 ns. Second, it can distinguish whether a lightning current is induced or direct. Third, a built-in SD card is provided to save the detected lightning data. Finally, it provides Ethernet communication capability for remote monitoring. The performance of the proposed instrument is evaluated and validated by applying induced and direct lightning using a lightning current generator.Open AccessA Cost-Effective Lightning Current Measuring Instrument with Wide Current Range Detection Using Dual Signal Conditioning Circuits
Lightning strikes can cause significant damage to critical infrastructure and pose a serious threat to public safety. To ensure the safety of facilities and investigate the causes of lightning accidents, we propose a cost-effective design method for a lightning current measuring instrument that uses a Rogowski coil and dual signal conditioning circuits to detect a wide range of lightning currents, ranging from hundreds of A to hundreds of kA. To implement the proposed lightning current measuring instrument, we design signal conditioning circuits and software capable of detecting and analyzing lightning currents from ±500 A to ±100 kA. By employing dual signal conditioning circuits, it offers the advantage of detecting a wide range of lightning currents compared to existing lightning current measuring instruments. The proposed instrument has the following features: First, the peak current, polarity, (front time), (time to half value), and Q (amount of energy of the lightning current) can be analyzed and measured with a fast sampling time of 380 ns. Second, it can distinguish whether a lightning current is induced or direct. Third, a built-in SD card is provided to save the detected lightning data. Finally, it provides Ethernet communication capability for remote monitoring. The performance of the proposed instrument is evaluated and validated by applying induced and direct lightning using a lightning current generator. - Open Access
- 7 September 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 169897-169907
Adaptive Model-Free Control With Nonsingular Terminal Sliding-Mode for Application to Robot Manipulators
An adaptive model-free control with nonsingular terminal sliding-mode (AMC-NTSM) is proposed for high precision motion control of robot manipulators. The proposed AMC-NTSM employs one-sample delayed measurements to cancel nonlinearities and uncertainties of manipulators and to subsequently obtain sufficiently simple models for easy control design. In order to maintain high gain controls even when the joint angles are close to the reference target values and accordingly achieve high precision and fast response control, a nonlinear sliding variable is also adopted instead of a linear one, asymptotically stabilizing controls by guaranteeing even a finite-time convergence. In addition, sliding variables are reflected on control inputs to support fast convergence while achieving uniform ultimate boundedness of tracking errors. The control gains of the proposed AMC-NTSM are adaptively adjusted over time according to the magnitude of the sliding variable. Such adaptive control gains become high for fast convergence or low for settling down to steady motion with better convergence precision, when necessary. The switching gains of the proposed AMC-NTSM are also adaptive to acceleration such that inherent time delay estimation (TDE) errors can be suppressed effectively regardless of their magnitudes. The simulation and experiment show that the proposed AMC-NTSM has good tracking performance.
- 7 September 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 169897-169907
Open AccessAdaptive Model-Free Control With Nonsingular Terminal Sliding-Mode for Application to Robot Manipulators
An adaptive model-free control with nonsingular terminal sliding-mode (AMC-NTSM) is proposed for high precision motion control of robot manipulators. The proposed AMC-NTSM employs one-sample delayed measurements to cancel nonlinearities and uncertainties of manipulators and to subsequently obtain sufficiently simple models for easy control design. In order to maintain high gain controls even when the joint angles are close to the reference target values and accordingly achieve high precision and fast response control, a nonlinear sliding variable is also adopted instead of a linear one, asymptotically stabilizing controls by guaranteeing even a finite-time convergence. In addition, sliding variables are reflected on control inputs to support fast convergence while achieving uniform ultimate boundedness of tracking errors. The control gains of the proposed AMC-NTSM are adaptively adjusted over time according to the magnitude of the sliding variable. Such adaptive control gains become high for fast convergence or low for settling down to steady motion with better convergence precision, when necessary. The switching gains of the proposed AMC-NTSM are also adaptive to acceleration such that inherent time delay estimation (TDE) errors can be suppressed effectively regardless of their magnitudes. The simulation and experiment show that the proposed AMC-NTSM has good tracking performance.