Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Young Sam Lee has a total of 33 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Reinforcement Learning-Based Transition Control of a Mini Rotary Double Inverted Pendulum: A MuJoCo-Based Approach

    by Sungwon Lee, Doyoon Ju, Young Sam Lee

    This paper proposes a MuJoCo-based sim-to-real reinforcement learning approach for transition control of a mini rotary double inverted pendulum (MRDIP). Transition control between multiple equilibrium points of the MRDIP is challenging because of its underactuated, nonlinear, and strongly coupled dynamics. To address this problem, a direct-drive MRDIP system is developed to enable torque-controlled actuation, and a MuJoCo model is constructed using CAD-based physical parameters and experimentally identified dynamic parameters. Based on the identified model, transition control policies for multiple equilibrium points are trained using the Truncated Quantile Critics (TQC) algorithm. The trained policies are directly implemented on the physical MRDIP and evaluated through successive equilibrium-point transitions without resetting the system between transitions. Experimental results show that the policies trained in MuJoCo successfully perform the intended transitions on the physical system. These results demonstrate the feasibility of the proposed MuJoCo-based framework for sim-to-real transition control of the MRDIP.

  • Open Access

    MuJoCo-Based Sim-to-Real Reinforcement Learning for Transition Control of a Triple Inverted Pendulum

    by Jihun Koo, Sungwon Lee, Doyoon Ju, Young Sam Lee

    This study presents an experimentally validated MuJoCo-based sim-to-real reinforcement learning framework for transition control among all eight equilibrium points (EPs) of a physical triple inverted pendulum (TIP). A multibody model is constructed from the apparatus properties, and uncertain actuation, damping, and friction parameters are identified by matching measured and simulated trajectories using the covariance matrix adaptation evolution strategy. The resulting effective parameter sets are sampled during training using truncated quantile critics to reduce policy dependence on a single model. The trained policies are transferred to the physical TIP without additional tuning or calibration. In the EP0-to-EP7 experiment, the policy trained without parameter identification failed in all ten trials, whereas the policy trained with the identified parameter sets succeeded in all ten. In the sequential experiment, all eight transitions were completed in each of ten trials, yielding 80 successful transitions with no observed failures while satisfying the cart travel and tangential force limits. These results demonstrate sim-to-real transition control across all eight EPs without state resets or precomputed trajectories.

  • Reinforcement Learning to Achieve Real-time Control of a Quadruple Inverted Pendulum

    by Yookyung Oh, Taegun Lee, Sanghyun Ryoo, Kyoung Chul Koh, Soohee Han, Young Sam Lee


  • Open Access

    Sim-to-Real Reinforcement Learning for a Rotary Double-Inverted Pendulum Based on a Mathematical Model

    by Doyoon Ju, Jongbeom Lee, Young Sam Lee

    This paper proposes a transition control strategy for a rotary double-inverted pendulum (RDIP) system using a sim-to-real reinforcement learning (RL) controller, built upon mathematical modeling and parameter estimation. High-resolution sensor data are used to estimate key physical parameters, ensuring model fidelity for simulation. The resulting mathematical model serves as the training environment in which the RL agent learns to perform transitions between various initial conditions and target equilibrium configurations. The training process adopts the Truncated Quantile Critics (TQC) algorithm, with a reward function specifically designed to reflect the nonlinear characteristics of the system. The learned policy is directly deployed on physical hardware without additional tuning or calibration, and the TQC-based controller successfully achieves all four equilibrium transitions. Furthermore, the controller exhibits robust recovery properties under external disturbances, demonstrating its effectiveness as a reliable sim-to-real control approach for high-dimensional nonlinear systems.


  • Open Access

    Transition Control of a Double-Inverted Pendulum System Using Sim2Real Reinforcement Learning

    by Taegun Lee, Doyoon Ju, Young Sam Lee

    This study presents a sim2real reinforcement learning-based controller for transition control in a double-inverted pendulum system, addressing the limitations of traditional control methods that rely on precomputed trajectories and lack adaptability to strong external disturbances. By introducing the novel concept of ‘transition control’, this research expands the scope of inverted pendulum studies to tackle the challenging task of navigating between multiple equilibrium points. To overcome the reality gap—a persistent challenge in sim2real transfer—a hardware-centered approach was employed, aligning the physical system’s mechanical design with high-fidelity dynamic equations derived from the Euler–Lagrange equation. This design eliminates the need for software-based corrections, ensuring consistent and robust system performance across simulated and real-world environments. Experimental validation demonstrates the controller’s ability to reliably execute all 12 transition scenarios within the double-inverted pendulum system. Additionally, it exhibits recovery characteristics, enabling the system to stabilize and return to equilibrium point even under severe disturbances.


  • Open Access

    Transition Control of a Rotary Double Inverted Pendulum Using Direct Collocation

    by Doyoon Ju, Taegun Lee, Young Sam Lee

    The rotary double inverted pendulum system is characterized by one stable equilibrium point and three unstable equilibrium points due to its kinematic properties. This paper defines the transition control problem between these equilibrium points to extend the conventional swing-up control problem and proposes an implementation method using a laboratory-developed rotary double inverted pendulum. To minimize energy consumption during the transition process while satisfying the boundary conditions of different equilibrium points, a two-point boundary value optimal control problem is formulated. The feedforward trajectory required for feedforward control is computed offline by solving this problem. The direct collocation method is employed to convert the constrained continuous optimal control problem into a nonlinear optimization problem. Furthermore, a time-varying linear–quadratic (LQ) controller is utilized as a feedback controller to accurately track the generated feedforward trajectory during real-time control, compensating for uncertainties in the feedforward control process. The proposed transition control strategy is experimentally implemented, and its effectiveness and practicality are validated through the successful tracking of 12 transition trajectories.


  • Suppressing violent sloshing flow in food serving robots

    by Jinsuk Choi, Wookyong Kwon, Kwanwoong Yoon, Seongwon Yoon, Young Sam Lee, Soo Jeon, Soohee Han


  • Open Access

    A Cost-Effective Lightning Current Measuring Instrument with Wide Current Range Detection Using Dual Signal Conditioning Circuits

    by Youngjun Lee, Young Sam Lee

    Lightning strikes can cause significant damage to critical infrastructure and pose a serious threat to public safety. To ensure the safety of facilities and investigate the causes of lightning accidents, we propose a cost-effective design method for a lightning current measuring instrument that uses a Rogowski coil and dual signal conditioning circuits to detect a wide range of lightning currents, ranging from hundreds of A to hundreds of kA. To implement the proposed lightning current measuring instrument, we design signal conditioning circuits and software capable of detecting and analyzing lightning currents from ±500 A to ±100 kA. By employing dual signal conditioning circuits, it offers the advantage of detecting a wide range of lightning currents compared to existing lightning current measuring instruments. The proposed instrument has the following features: First, the peak current, polarity, T1 (front time), T2 (time to half value), and Q (amount of energy of the lightning current) can be analyzed and measured with a fast sampling time of 380 ns. Second, it can distinguish whether a lightning current is induced or direct. Third, a built-in SD card is provided to save the detected lightning data. Finally, it provides Ethernet communication capability for remote monitoring. The performance of the proposed instrument is evaluated and validated by applying induced and direct lightning using a lightning current generator.


  • Open Access

    Adaptive Model-Free Control With Nonsingular Terminal Sliding-Mode for Application to Robot Manipulators

    by Jinsuk Choi, Jaemin Baek, Woongyong Lee, Young Sam Lee, Soohee Han

    An adaptive model-free control with nonsingular terminal sliding-mode (AMC-NTSM) is proposed for high precision motion control of robot manipulators. The proposed AMC-NTSM employs one-sample delayed measurements to cancel nonlinearities and uncertainties of manipulators and to subsequently obtain sufficiently simple models for easy control design. In order to maintain high gain controls even when the joint angles are close to the reference target values and accordingly achieve high precision and fast response control, a nonlinear sliding variable is also adopted instead of a linear one, asymptotically stabilizing controls by guaranteeing even a finite-time convergence. In addition, sliding variables are reflected on control inputs to support fast convergence while achieving uniform ultimate boundedness of tracking errors. The control gains of the proposed AMC-NTSM are adaptively adjusted over time according to the magnitude of the sliding variable. Such adaptive control gains become high for fast convergence or low for settling down to steady motion with better convergence precision, when necessary. The switching gains of the proposed AMC-NTSM are also adaptive to acceleration such that inherent time delay estimation (TDE) errors can be suppressed effectively regardless of their magnitudes. The simulation and experiment show that the proposed AMC-NTSM has good tracking performance.