Enhancing Ride Comfort and Reducing Energy Consumption of Ultra–High–Speed Elevators Using Deep Reinforcement Learning With Multivariate State Observation Reward Mechanism
- 25 April 2025
- journal article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Structural Stability and Dynamics
- Vol. 26 (23)
Abstract
Horizontal vibration of cars and high energy consumption of active controllers are two major problems in ultra-high-speed elevators, which will seriously affect ride comfort and cost. To address these issues, a novel active control method with deep reinforcement learning (DRL) based on a multivariate state observation (MSO) reward mechanism was proposed in this study. An eight-degree-of-freedom nonlinear dynamics model for horizontal vibration of cars in ultra-high-speed elevators was first established with precise simulation of the random guide rail excitation and the lateral aerodynamic forces. Subsequently, an MSO reward mechanism integrating multi-scale information such as vibration velocity, deflection angular velocity, and control force, was developed and added to the Softmax deep double deterministic policy gradients (SD3) algorithm. Finally, active control strategies for horizontal vibration were trained on the dynamics model using the SD3-MSO algorithm and three other DRL algorithms including deep deterministic policy gradient (DDPG), Twin delayed DDPG, and SD3. The results indicate that the active control using SD3-MSO algorithm could significantly reduce the horizontal vibration acceleration and deflection angular acceleration of the car. Vibration reduction performance is further improved by utilizing a smaller active control force. The root mean square (RMS) value of the active control force decreases by over 26% compared to the traditional fuzzy logic controller, demonstrating its superior energy-saving capacity.Keywords
Funding Information
- Natural Science Foundation of Shandong Province (ZR2023ME174)
This publication has 28 references indexed in Scilit:
- Research on anti‐saturation horizontal vibration model and neural network adaptive integral terminal sliding mode control strategy for high‐speed elevator car systemInternational Journal of Robust and Nonlinear Control, 2024
- Investigation of the aerodynamic characteristics of the entire operation process of the car–counterweight system within the annular flow field of ultra-high-speed elevatorsPhysics of Fluids, 2024
- Study on the aerodynamic characteristics and ventilation effects of ultra-high-speed elevator car-counterweight system under the influence of multiple parametersPhysics of Fluids, 2024
- Non-linear Energy Sink Applied in the Vibration Suppression of a High-Speed Elevator System and Energy HarvestingJournal of Vibration Engineering & Technologies, 2023
- Analysis of the aerodynamic characteristics of the entire operation process of an ultra-high-speed elevator under the influence of high blockage ratio, hoistway, and car height parametersPhysics of Fluids, 2023
- Analysis of the gas-solid coupling horizontal vibration response and aerodynamic characteristics of a high-speed elevatorMechanics Based Design of Structures and Machines, 2021
- Safe, efficient, and comfortable velocity control based on reinforcement learning for autonomous drivingTransportation Research Part C: Emerging Technologies, 2020
- Robust Control of High-Speed Elevator Transverse Vibration Based on LMI OptimizationIOP Conference Series: Materials Science and Engineering, 2019
- Design and experimental study of a Nonlinear Energy Sink coupled to an electromagnetic energy harvesterJournal of Sound and Vibration, 2018
- Response analysis of the composite random vibration of a high-speed elevator considering the nonlinearity of guide shoeJournal of the Brazilian Society of Mechanical Sciences and Engineering, 2018