Yi-Jen Mon
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Latest Publications
- Open Access
Decoupled Reinforcement Hybrid PPO–Sliding Control for Underactuated Systems: Application to Cart–Pole and Acrobot
Underactuated systems, such as the Cart–Pole and Acrobot, pose significant control challenges due to their inherent nonlinearity and limited actuation. Traditional control methods often struggle to achieve stable and optimal performance in these complex scenarios. This paper presents a novel stable reinforcement learning (RL) approach for underactuated systems, integrating advanced exploration–exploitation mechanisms and a refined policy optimization framework to address instability issues in RL-based control. The proposed method is validated through extensive experiments on two benchmark underactuated systems: the Cart–Pole and Acrobot. In the Cart–Pole task, the method achieves long-term balance with high stability, outperforming traditional RL algorithms such as the Proximal Policy Optimization (PPO) in average episode length and robustness to environmental disturbances. For the Acrobot, the approach enables reliable swing-up and near-vertical stabilization but cannot achieve sustained balance control beyond short time intervals due to residual dynamics and control limitations. A key contribution is the development of a hybrid PPO–sliding mode control strategy that enhances learning efficiency and stabilities for underactuated systems.
Open AccessDecoupled Reinforcement Hybrid PPO–Sliding Control for Underactuated Systems: Application to Cart–Pole and Acrobot
Underactuated systems, such as the Cart–Pole and Acrobot, pose significant control challenges due to their inherent nonlinearity and limited actuation. Traditional control methods often struggle to achieve stable and optimal performance in these complex scenarios. This paper presents a novel stable reinforcement learning (RL) approach for underactuated systems, integrating advanced exploration–exploitation mechanisms and a refined policy optimization framework to address instability issues in RL-based control. The proposed method is validated through extensive experiments on two benchmark underactuated systems: the Cart–Pole and Acrobot. In the Cart–Pole task, the method achieves long-term balance with high stability, outperforming traditional RL algorithms such as the Proximal Policy Optimization (PPO) in average episode length and robustness to environmental disturbances. For the Acrobot, the approach enables reliable swing-up and near-vertical stabilization but cannot achieve sustained balance control beyond short time intervals due to residual dynamics and control limitations. A key contribution is the development of a hybrid PPO–sliding mode control strategy that enhances learning efficiency and stabilities for underactuated systems.
- Open Access
LSTM-Based Music Generation Technologies
In deep learning, Long Short-Term Memory (LSTM) is a well-established and widely used approach for music generation. Nevertheless, creating musical compositions that match the quality of those created by human composers remains a formidable challenge. The intricate nature of musical components, including pitch, intensity, rhythm, notes, chords, and more, necessitates the extraction of these elements from extensive datasets, making the preliminary work arduous. To address this, we employed various tools to deconstruct the musical structure, conduct step-by-step learning, and then reconstruct it. This article primarily presents the techniques for dissecting musical components in the preliminary phase. Subsequently, it introduces the use of LSTM to build a deep learning network architecture, enabling the learning of musical features and temporal coherence. Finally, through in-depth analysis and comparative studies, this paper validates the efficacy of the proposed research methodology, demonstrating its ability to capture musical coherence and generate compositions with similar styles.
Open AccessLSTM-Based Music Generation Technologies
In deep learning, Long Short-Term Memory (LSTM) is a well-established and widely used approach for music generation. Nevertheless, creating musical compositions that match the quality of those created by human composers remains a formidable challenge. The intricate nature of musical components, including pitch, intensity, rhythm, notes, chords, and more, necessitates the extraction of these elements from extensive datasets, making the preliminary work arduous. To address this, we employed various tools to deconstruct the musical structure, conduct step-by-step learning, and then reconstruct it. This article primarily presents the techniques for dissecting musical components in the preliminary phase. Subsequently, it introduces the use of LSTM to build a deep learning network architecture, enabling the learning of musical features and temporal coherence. Finally, through in-depth analysis and comparative studies, this paper validates the efficacy of the proposed research methodology, demonstrating its ability to capture musical coherence and generate compositions with similar styles.
- Open Access
Image-Tracking-Driven Symmetrical Steering Control with Long Short-Term Memory for Linear Charge-Coupled-Device-Based Two-Wheeled Self-Balancing Cart
This paper presents a control framework for the image tracking of two-wheeled self-balancing carts, with the objective of achieving precise tracking control. Exploiting the remarkable memory capacity of the Long Short-Term Memory (LSTM) neural network for sequence signals, the framework conducts image memory judgment and memorization, aiming to enhance control accuracy. After the training phase, comprehensive simulations and real-world experiments are carried out based on the established model to verify the effectiveness and practicality of the proposed control strategy. The system utilizes the TSL1401 linear array CCD lens to detect black tapes on the ground and identify and memorize surrounding images. Through the establishment of a continuous set of training sample points, the LSTM network is trained using Python and TensorFlow. This training process optimizes the network’s weights and generates weight files, which can be readily converted into machine code for physical implementation. Initially, the effectiveness of the control law is verified through simulating the symmetrical steering control of the two-wheeled cart. The simulation results demonstrate the validity of the proposed design method and its superior performance. Finally, a physical two-wheeled self-balancing cart is developed to further validate the feasibility of the framework. Experimental results confirm that this method is highly effective, demonstrating robust image tracking capabilities and optimal tracking performance.
Open AccessImage-Tracking-Driven Symmetrical Steering Control with Long Short-Term Memory for Linear Charge-Coupled-Device-Based Two-Wheeled Self-Balancing Cart
This paper presents a control framework for the image tracking of two-wheeled self-balancing carts, with the objective of achieving precise tracking control. Exploiting the remarkable memory capacity of the Long Short-Term Memory (LSTM) neural network for sequence signals, the framework conducts image memory judgment and memorization, aiming to enhance control accuracy. After the training phase, comprehensive simulations and real-world experiments are carried out based on the established model to verify the effectiveness and practicality of the proposed control strategy. The system utilizes the TSL1401 linear array CCD lens to detect black tapes on the ground and identify and memorize surrounding images. Through the establishment of a continuous set of training sample points, the LSTM network is trained using Python and TensorFlow. This training process optimizes the network’s weights and generates weight files, which can be readily converted into machine code for physical implementation. Initially, the effectiveness of the control law is verified through simulating the symmetrical steering control of the two-wheeled cart. The simulation results demonstrate the validity of the proposed design method and its superior performance. Finally, a physical two-wheeled self-balancing cart is developed to further validate the feasibility of the framework. Experimental results confirm that this method is highly effective, demonstrating robust image tracking capabilities and optimal tracking performance.
- Open Access
- 30 April 2025
- Published by MDPI AG in Electronics
- Vol. 14 (9) , 1842
Fuzzy PDC-Based LQR Sliding Neural Network Control for Two-Wheeled Self-Balancing Cart
This paper proposes a fuzzy PDC (parallel distributed compensation)-based LQR (Linear Quadratic Regulator) sliding neural network methodology to control a two-wheeled self-balancing cart. Firstly, a mathematical model of a two-wheeled self-balancing cart is described to explain some parameter meanings. Then, we detail how a simulation was implemented according to these reasonable parameter settings under the fuzzy PDC-based LQR sliding neural network control algorithm. Secondly, the algorithm is developed by setting four controllable LQR controllers. Then, a ReLU-based neural network (ReNN) is developed to tune the fuzzy degrees for these four LQR controllers. This means that an intelligent controller is designed by using the fuzzy PDC concept. Subsequently, a sliding surface is designed, and the sliding mode is utilized to compensate and enhance its stability. Simulation was conducted to verify the feasibility of this proposed algorithm. The simulation results demonstrate good effectiveness and stability. Finally, a cart equipped with an STM32 MCU (microcontroller unit) was implemented to verify the feasibility of this proposed algorithm. The empirical experimental results show that the two-wheeled self-balancing cart exhibited good self-balancing performance and stability.
- 30 April 2025
- Published by MDPI AG in Electronics
- Vol. 14 (9) , 1842
Open AccessFuzzy PDC-Based LQR Sliding Neural Network Control for Two-Wheeled Self-Balancing Cart
This paper proposes a fuzzy PDC (parallel distributed compensation)-based LQR (Linear Quadratic Regulator) sliding neural network methodology to control a two-wheeled self-balancing cart. Firstly, a mathematical model of a two-wheeled self-balancing cart is described to explain some parameter meanings. Then, we detail how a simulation was implemented according to these reasonable parameter settings under the fuzzy PDC-based LQR sliding neural network control algorithm. Secondly, the algorithm is developed by setting four controllable LQR controllers. Then, a ReLU-based neural network (ReNN) is developed to tune the fuzzy degrees for these four LQR controllers. This means that an intelligent controller is designed by using the fuzzy PDC concept. Subsequently, a sliding surface is designed, and the sliding mode is utilized to compensate and enhance its stability. Simulation was conducted to verify the feasibility of this proposed algorithm. The simulation results demonstrate good effectiveness and stability. Finally, a cart equipped with an STM32 MCU (microcontroller unit) was implemented to verify the feasibility of this proposed algorithm. The empirical experimental results show that the two-wheeled self-balancing cart exhibited good self-balancing performance and stability.
- Open Access
- 23 January 2024
- Published by MDPI AG in Electronics
- Vol. 13 (3) , 468
Correction: Mon, Y.-J. Simulation and Implementation of Signal Processing for LFM Radar Using DSK 6713. Electronics 2023, 12, 3682
- 23 January 2024
- Published by MDPI AG in Electronics
- Vol. 13 (3) , 468
Open AccessCorrection: Mon, Y.-J. Simulation and Implementation of Signal Processing for LFM Radar Using DSK 6713. Electronics 2023, 12, 3682
- Open Access
- 26 October 2023
- Published by MDPI AG in Electronics
- Vol. 12 (21) , 4415
Tikhonov-Tuned Sliding Neural Network Decoupling Control for an Inverted Pendulum
This paper introduces the concept of intelligent control using Tikhonov regularization for nonlinear coupled systems. This research is driven by the increasing demand for advanced control techniques and aims to explore the impact of Tikhonov regularization on these systems. The primary objective is to determine the optimal regularization term and its integration with other control methods to enhance intelligent control for nonlinear coupled systems. Tikhonov regularization is a technique employed to adjust neural network weights and prevent overfitting. Additionally, the incorporation of ReLU activation function in the neural network simplifies thearchitecture, avoiding issues like gradient explosion, and optimizes controller performance. Furthermore, sliding surfaces are designed to improve control system stability and robustness. The proposed Tikhonov-tuned sliding neural network (TSN) controller ensures both stability and superior system performance. The methodology emphasizes the importance of determining optimal neural network weights and regularization terms to prevent overfitting, facilitating accurate predictions in inverted pendulum control system applications. To assess the functionality and stability of TSN, this paper employs simulations and experimental implementations to control both the rotary inverted pendulum and the arm-driven inverted pendulum. The results indicate that the proposed TSN methodologies are effective and feasible.
- 26 October 2023
- Published by MDPI AG in Electronics
- Vol. 12 (21) , 4415
Open AccessTikhonov-Tuned Sliding Neural Network Decoupling Control for an Inverted Pendulum
This paper introduces the concept of intelligent control using Tikhonov regularization for nonlinear coupled systems. This research is driven by the increasing demand for advanced control techniques and aims to explore the impact of Tikhonov regularization on these systems. The primary objective is to determine the optimal regularization term and its integration with other control methods to enhance intelligent control for nonlinear coupled systems. Tikhonov regularization is a technique employed to adjust neural network weights and prevent overfitting. Additionally, the incorporation of ReLU activation function in the neural network simplifies thearchitecture, avoiding issues like gradient explosion, and optimizes controller performance. Furthermore, sliding surfaces are designed to improve control system stability and robustness. The proposed Tikhonov-tuned sliding neural network (TSN) controller ensures both stability and superior system performance. The methodology emphasizes the importance of determining optimal neural network weights and regularization terms to prevent overfitting, facilitating accurate predictions in inverted pendulum control system applications. To assess the functionality and stability of TSN, this paper employs simulations and experimental implementations to control both the rotary inverted pendulum and the arm-driven inverted pendulum. The results indicate that the proposed TSN methodologies are effective and feasible.
- Open Access
- 31 August 2023
- Published by MDPI AG in Electronics
- Vol. 12 (17) , 3682
Simulation and Implementation of Signal Processing for LFM Radar Using DSK 6713
This research aims to propose a comprehensive simulation and implementation methodology for LFM (Linear Frequency Modulated) Radar Signal Processing and its application, using digital signal processing techniques on the DSP Starter Kit (DSK) 6713 board. The motivation behind this study is to develop control software based on MATLAB R14 and SIMULINK to model various system software tasks, including detection, A/D conversion, Fast Fourier Transform (FFT), modulation, accumulation, decision-making, and target detection. The simulations are categorized into two groups: ideal beat frequency and parameterized beat frequency. We introduce several important terminologies for consideration, including pulse compression, SNR, matched filter, Doppler effect, and more. The use of real-time data exchange (RTDX) will facilitate the generation of input data and enable real-time calculations for outputs, leading to the creation of machine code for the DSP chip. This process aims to ensure data verification calculations and enhance the credibility and performance of the proposed methodology. By conducting thorough simulations, verification, and practical testing, the study demonstrates the satisfactory credibility and performance of the developed method. Using this research, we aim to contribute to the advancement of LFM Radar Signal Processing and enable its efficient implementation using digital signal processing techniques on the DSP Starter Kit (DSK) 6713 board.
- 31 August 2023
- Published by MDPI AG in Electronics
- Vol. 12 (17) , 3682
Open AccessSimulation and Implementation of Signal Processing for LFM Radar Using DSK 6713
This research aims to propose a comprehensive simulation and implementation methodology for LFM (Linear Frequency Modulated) Radar Signal Processing and its application, using digital signal processing techniques on the DSP Starter Kit (DSK) 6713 board. The motivation behind this study is to develop control software based on MATLAB R14 and SIMULINK to model various system software tasks, including detection, A/D conversion, Fast Fourier Transform (FFT), modulation, accumulation, decision-making, and target detection. The simulations are categorized into two groups: ideal beat frequency and parameterized beat frequency. We introduce several important terminologies for consideration, including pulse compression, SNR, matched filter, Doppler effect, and more. The use of real-time data exchange (RTDX) will facilitate the generation of input data and enable real-time calculations for outputs, leading to the creation of machine code for the DSP chip. This process aims to ensure data verification calculations and enhance the credibility and performance of the proposed methodology. By conducting thorough simulations, verification, and practical testing, the study demonstrates the satisfactory credibility and performance of the developed method. Using this research, we aim to contribute to the advancement of LFM Radar Signal Processing and enable its efficient implementation using digital signal processing techniques on the DSP Starter Kit (DSK) 6713 board.
- Open Access
- 28 April 2022
- Published by MDPI AG in Sustainability
- Vol. 14 (9) , 5335
Vision Robot Path Control Based on Artificial Intelligence Image Classification and Sustainable Ultrasonic Signal Transformation Technology
The unsupervised algorithm of artificial intelligence (AI), named ART (Adaptive Resonance Theory), is used to first roughly classify an image, that is, after the image is processed by the edge filtering technology, the image window is divided into 25 square areas of 5 rows and 5 columns, and then, according to the location of the edge of the image, it determines whether the robot should go straight (represented by S), turn around (represented by A), stop (T), turn left (represented by L), or turn right (represented by R). Then, after sustainable ultrasonic signal acquisition and transformation into digital signals are completed, the sustainable supervised neural network named SGAFNN (Supervised Gaussian adaptive fuzzy neural network) will perform an optimal path control that can accurately control the traveling speed and turning of the robot to avoid hitting walls or obstacles. Based on the above, this paper proposes the use of the ART operation after image processing to judge the rough direction, followed by the use of the ultrasonic signal to carry out the sustainable development of artificial intelligence and to carry out accurate speed and direction SGAFNN control to avoid obstacles. After simulation and practical evaluations, the proposed method is proved to be feasible and to exhibit good performance.
- 28 April 2022
- Published by MDPI AG in Sustainability
- Vol. 14 (9) , 5335
Open AccessVision Robot Path Control Based on Artificial Intelligence Image Classification and Sustainable Ultrasonic Signal Transformation Technology
The unsupervised algorithm of artificial intelligence (AI), named ART (Adaptive Resonance Theory), is used to first roughly classify an image, that is, after the image is processed by the edge filtering technology, the image window is divided into 25 square areas of 5 rows and 5 columns, and then, according to the location of the edge of the image, it determines whether the robot should go straight (represented by S), turn around (represented by A), stop (T), turn left (represented by L), or turn right (represented by R). Then, after sustainable ultrasonic signal acquisition and transformation into digital signals are completed, the sustainable supervised neural network named SGAFNN (Supervised Gaussian adaptive fuzzy neural network) will perform an optimal path control that can accurately control the traveling speed and turning of the robot to avoid hitting walls or obstacles. Based on the above, this paper proposes the use of the ART operation after image processing to judge the rough direction, followed by the use of the ultrasonic signal to carry out the sustainable development of artificial intelligence and to carry out accurate speed and direction SGAFNN control to avoid obstacles. After simulation and practical evaluations, the proposed method is proved to be feasible and to exhibit good performance.