Mengzhe Huang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Mengzhe Huang has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
- Zhong-Ping Jiang
New York University
6 shared publications - Yebin Wang
Mitsubishi Electric Research Laboratories
3 shared publications - Weihua Gui
Central South University
2 shared publications - Weinan Gao
Northeastern University
2 shared publications - Zhongmei Li
State Key Laboratory of Industrial Control Technology and the Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, China
2 shared publications - Jianyong Zhu
School Electrical and Automation Engineering, East China Jiaotong University, Nanchang 330013, China
1 shared publication
Latest Publications
- 9 May 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 31 (1) , 252-264
Learning-Based Adaptive Optimal Control for Flotation Processes Subject to Input Constraints
This article presents a learning-based adaptive optimal control approach for flotation processes subject to input constraints and disturbances using adaptive dynamic programming (ADP) along with double-loop iteration. First, the principle of the operational pattern is adopted to preset reagents’ addition based on the feeding condition. Then, this article leverages a deep learning model, which is composed of multiple neural layers to detect flotation indexes directly from the raw froth images. After that, the tracking error between the detected flotation indexes and the reference values can be minimized by using ADP-based double-loop iteration. Particularly, a policy-iteration (PI) method is utilized for the proposed learning-based ADP algorithm. In the inner loop, the optimal control problem is formulated as a linear quadratic regulator (LQR) problem using the low-gain feedback design method. In the outer loop, the design parameters, i.e., weighting matrices, are tuned automatically to satisfy the input constraints. Finally, the analytical results demonstrate that the proposed scheme can guarantee asymptotic tracking in the presence of actuator saturation and disturbances.
- 9 May 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 31 (1) , 252-264
Learning-Based Adaptive Optimal Control for Flotation Processes Subject to Input Constraints
This article presents a learning-based adaptive optimal control approach for flotation processes subject to input constraints and disturbances using adaptive dynamic programming (ADP) along with double-loop iteration. First, the principle of the operational pattern is adopted to preset reagents’ addition based on the feeding condition. Then, this article leverages a deep learning model, which is composed of multiple neural layers to detect flotation indexes directly from the raw froth images. After that, the tracking error between the detected flotation indexes and the reference values can be minimized by using ADP-based double-loop iteration. Particularly, a policy-iteration (PI) method is utilized for the proposed learning-based ADP algorithm. In the inner loop, the optimal control problem is formulated as a linear quadratic regulator (LQR) problem using the low-gain feedback design method. In the outer loop, the design parameters, i.e., weighting matrices, are tuned automatically to satisfy the input constraints. Finally, the analytical results demonstrate that the proposed scheme can guarantee asymptotic tracking in the presence of actuator saturation and disturbances.
- 10 November 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 52 (6) , 5267-5277
Learning-Based Adaptive Optimal Control for Connected Vehicles in Mixed Traffic: Robustness to Driver Reaction Time
Through vehicle-to-vehicle (V2V) communication, both human-driven and autonomous vehicles can actively exchange data, such as velocities and bumper-to-bumper distances. Employing the shared data, control laws with improved performance can be designed for connected and autonomous vehicles (CAVs). In this article, taking into account human-vehicle interaction and heterogeneous driver behavior, an adaptive optimal control design method is proposed for a platoon mixed with multiple preceding human-driven vehicles and one CAV at the tail. It is shown that by using reinforcement learning and adaptive dynamic programming techniques, a near-optimal controller can be learned from real-time data for the CAV with V2V communications, but without the precise knowledge of the accurate car-following parameters of any driver in the platoon. The proposed method allows the CAV controller to adapt to different platoon dynamics caused by the unknown and heterogeneous driver-dependent parameters. To improve the safety performance during the learning process, our off-policy learning algorithm can leverage both the historical data and the data collected in real time, which leads to considerably reduced learning time duration. The effectiveness and efficiency of our proposed method is demonstrated by rigorous proofs and microscopic traffic simulations.
- 10 November 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 52 (6) , 5267-5277
Learning-Based Adaptive Optimal Control for Connected Vehicles in Mixed Traffic: Robustness to Driver Reaction Time
Through vehicle-to-vehicle (V2V) communication, both human-driven and autonomous vehicles can actively exchange data, such as velocities and bumper-to-bumper distances. Employing the shared data, control laws with improved performance can be designed for connected and autonomous vehicles (CAVs). In this article, taking into account human-vehicle interaction and heterogeneous driver behavior, an adaptive optimal control design method is proposed for a platoon mixed with multiple preceding human-driven vehicles and one CAV at the tail. It is shown that by using reinforcement learning and adaptive dynamic programming techniques, a near-optimal controller can be learned from real-time data for the CAV with V2V communications, but without the precise knowledge of the accurate car-following parameters of any driver in the platoon. The proposed method allows the CAV controller to adapt to different platoon dynamics caused by the unknown and heterogeneous driver-dependent parameters. To improve the safety performance during the learning process, our off-policy learning algorithm can leverage both the historical data and the data collected in real time, which leads to considerably reduced learning time duration. The effectiveness and efficiency of our proposed method is demonstrated by rigorous proofs and microscopic traffic simulations.
- Open Access
- 8 November 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 163138-163149
Data-Driven Adaptive Optimal Control for Flotation Processes With Delayed Feedback and Disturbance
- 8 November 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 163138-163149
Open AccessData-Driven Adaptive Optimal Control for Flotation Processes With Delayed Feedback and Disturbance
- 1 July 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1126-1131
Reinforcement Learning for Vision-Based Lateral Control of a Self-Driving Car
Lateral control design is one of the fundamental components for self-driving cars. In this paper, we propose a learning-based control strategy that enables a mobile car equipped with a camera to perfectly perform lane keeping in a road on the ground. Using the method of adaptive dynamic programming, the proposed control algorithm exploits the structural knowledge of the car kinematics as well as the collected data (images) about the lane information. An adaptive optimal lateral controller is obtained through a data-driven learning algorithm. The effectiveness of the proposed method is demonstrated by theoretical stability proofs and experimental evaluations.
- 1 July 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1126-1131
Reinforcement Learning for Vision-Based Lateral Control of a Self-Driving Car
Lateral control design is one of the fundamental components for self-driving cars. In this paper, we propose a learning-based control strategy that enables a mobile car equipped with a camera to perfectly perform lane keeping in a road on the ground. Using the method of adaptive dynamic programming, the proposed control algorithm exploits the structural knowledge of the car kinematics as well as the collected data (images) about the lane information. An adaptive optimal lateral controller is obtained through a data-driven learning algorithm. The effectiveness of the proposed method is demonstrated by theoretical stability proofs and experimental evaluations.
- 8 March 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 49 (4) , 350-361
Data-Driven Shared Steering Control of Semi-Autonomous Vehicles
This paper presents a cooperative/shared framework of the driver and his/her semi-autonomous vehicle in order to achieve desired steering performance. In particular, a copilot controller and the driver together operate and control the vehicle. Exploiting the classical small-gain theory, our proposed shared steering controller is developed independent of the unmeasurable internal states of the human driver, and only relies on his/her steering torque. Furthermore, by adopting data-driven adaptive dynamic programming and an iterative learning scheme, the shared steering controller is studied from the measurable data of the driver and the vehicle. Meanwhile, the accurate knowledge of the driver and the vehicle dynamics is unnecessary, which settles the problem of their potential parametric variations/uncertainties in practice. The effectiveness of the proposed method is validated by rigorous analysis and demonstrated by numerical simulations.
- 8 March 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Human-Machine Systems
- Vol. 49 (4) , 350-361
Data-Driven Shared Steering Control of Semi-Autonomous Vehicles
This paper presents a cooperative/shared framework of the driver and his/her semi-autonomous vehicle in order to achieve desired steering performance. In particular, a copilot controller and the driver together operate and control the vehicle. Exploiting the classical small-gain theory, our proposed shared steering controller is developed independent of the unmeasurable internal states of the human driver, and only relies on his/her steering torque. Furthermore, by adopting data-driven adaptive dynamic programming and an iterative learning scheme, the shared steering controller is studied from the measurable data of the driver and the vehicle. Meanwhile, the accurate knowledge of the driver and the vehicle dynamics is unnecessary, which settles the problem of their potential parametric variations/uncertainties in practice. The effectiveness of the proposed method is validated by rigorous analysis and demonstrated by numerical simulations.
- 31 August 2018
- Published by Elsevier in IFAC-PapersOnLine
- Vol. 51 (13) , 155-160
Data-driven Shared Steering Control Design for Lane Keeping
- 31 August 2018
- Published by Elsevier in IFAC-PapersOnLine
- Vol. 51 (13) , 155-160
Data-driven Shared Steering Control Design for Lane Keeping
- 27 October 2017
- Published by Wiley in International Journal of Adaptive Control and Signal Processing
- Vol. 33 (2) , 356-370
Connected cruise control with delayed feedback and disturbance: An adaptive dynamic programming approach
Summary: This paper studies the connected cruise control problem for a platoon of human‐operated and autonomous vehicles. The autonomous vehicles can receive motional data, ie, headway and velocity information from other vehicles by wireless vehicle‐to‐vehicle communication. The use of wireless communications in information exchange between vehicles inevitably causes input delay in the platooning system. Meanwhile, unpredictable behaviors of the leading vehicle constitute exogenous disturbance for the system. An adaptive optimal control problem with input delay and disturbance is formulated, and a novel data‐driven control solution is proposed such that each vehicle in the platoon can achieve safe distance and desired velocity. By adopting an adaptive dynamic programming technique with sampled‐data system theory, a data‐driven adaptive optimal control approach is proposed for autonomous vehicles by the learning strategies of policy iteration without the accurate knowledge of the dynamics of all human drivers and vehicles. The efficacy of the proposed controller is substantiated by rigorous analysis and validated by simulation results in different scenarios.
- 27 October 2017
- Published by Wiley in International Journal of Adaptive Control and Signal Processing
- Vol. 33 (2) , 356-370
Connected cruise control with delayed feedback and disturbance: An adaptive dynamic programming approach
Summary: This paper studies the connected cruise control problem for a platoon of human‐operated and autonomous vehicles. The autonomous vehicles can receive motional data, ie, headway and velocity information from other vehicles by wireless vehicle‐to‐vehicle communication. The use of wireless communications in information exchange between vehicles inevitably causes input delay in the platooning system. Meanwhile, unpredictable behaviors of the leading vehicle constitute exogenous disturbance for the system. An adaptive optimal control problem with input delay and disturbance is formulated, and a novel data‐driven control solution is proposed such that each vehicle in the platoon can achieve safe distance and desired velocity. By adopting an adaptive dynamic programming technique with sampled‐data system theory, a data‐driven adaptive optimal control approach is proposed for autonomous vehicles by the learning strategies of policy iteration without the accurate knowledge of the dynamics of all human drivers and vehicles. The efficacy of the proposed controller is substantiated by rigorous analysis and validated by simulation results in different scenarios.