Max L. Greene
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Max L. Greene has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Warren E. Dixon
Department of Mechanical and Aerospace Engineering, University of Florida, Gainesville, FL, USA
7 shared publications - Duc M. Le
Department of Mechanical and Aerospace Engineering, University of Florida, Gainesville, FL, USA
2 shared publications - Patryk Deptula
Charles Stark Draper Laboratory, Inc., Cambridge, MA, USA
2 shared publications - Scott Nivison
Johns Hopkins University Applied Physics Laboratory, Fort Walton Beach, FL, USA
2 shared publications - Zachary Ian Bell
Munitions Directorate, Air Force Research Laboratory, Eglin Air Force Base, FL, USA
2 shared publications - Anuradha M. Annaswamy
Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, MA, USA
1 shared publication
Latest Publications
- Open Access
- 5 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 33 (6) , 2334-2349
Safe Autonomy for Uncrewed Surface Vehicles Using Adaptive Control and Reachability Analysis
Marine robots must maintain precise control and ensure safety during tasks such as navigating narrow waterways, even when they encounter unpredictable disturbances that impact performance. Designing algorithms for uncrewed surface vehicles (USVs) requires accounting for these disturbances to control the vehicle and ensure it avoids obstacles. While adaptive control has addressed USV control challenges, real-world applications are limited, and certifying USV safety amidst unexpected disturbances remains difficult. To tackle control issues, we employ a model reference adaptive controller (MRAC) to stabilize the USV along a desired trajectory. For safety certification, we developed a reachability module with a moving horizon estimator (MHE) to estimate disturbances affecting the USV. This estimate is propagated through a forward reachable set calculation, predicting future states and enabling real-time safety certification. We tested our safe autonomy pipeline on a Clearpath Heron USV in the Charles River, near MIT. Our experiments demonstrated that the USV’s MRAC controller and reachability module could adapt to disturbances like thruster failures and drag forces. The MRAC controller outperformed a proportional–integral–derivative (PID) baseline, showing a 45%–81% reduction in position root mean squared error. In addition, the reachability module provided real-time safety certification, ensuring the USV’s safety. We further validated our pipeline’s effectiveness in underway replenishment and canal scenarios.
- 5 September 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Control Systems Technology
- Vol. 33 (6) , 2334-2349
Open AccessSafe Autonomy for Uncrewed Surface Vehicles Using Adaptive Control and Reachability Analysis
Marine robots must maintain precise control and ensure safety during tasks such as navigating narrow waterways, even when they encounter unpredictable disturbances that impact performance. Designing algorithms for uncrewed surface vehicles (USVs) requires accounting for these disturbances to control the vehicle and ensure it avoids obstacles. While adaptive control has addressed USV control challenges, real-world applications are limited, and certifying USV safety amidst unexpected disturbances remains difficult. To tackle control issues, we employ a model reference adaptive controller (MRAC) to stabilize the USV along a desired trajectory. For safety certification, we developed a reachability module with a moving horizon estimator (MHE) to estimate disturbances affecting the USV. This estimate is propagated through a forward reachable set calculation, predicting future states and enabling real-time safety certification. We tested our safe autonomy pipeline on a Clearpath Heron USV in the Charles River, near MIT. Our experiments demonstrated that the USV’s MRAC controller and reachability module could adapt to disturbances like thruster failures and drag forces. The MRAC controller outperformed a proportional–integral–derivative (PID) baseline, showing a 45%–81% reduction in position root mean squared error. In addition, the reachability module provided real-time safety certification, ensuring the USV’s safety. We further validated our pipeline’s effectiveness in underway replenishment and canal scenarios.
- 3 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 70 (2) , 1024-1037
Approximate Dynamic Programming for Trajectory Tracking of Switched Systems
This article develops a technique for online approximate optimization of tracking control policies for a family of switched nonlinear dynamical systems. Optimization is realized via approximate dynamic programming, and integral concurrent learning is used for robustness to parametric uncertainties. The family of switched systems is composed of finitely many subsystems, which may have differing characteristics, such as dynamics and cost functions. This article develops a new result on the analysis of switched systems comprised of locally practically stable subsystems using multiple Lyapunov-like functions. Local practical stability of the overall switched system and convergence of the applied tracking control policies to a neighborhood of the optimal tracking control policies is then proven for an arbitrary switching sequence provided that a set of sufficient gain conditions and a minimum dwell-time condition are satisfied. Simulation results are presented for the optimal control of an autonomous underwater vehicle in the presence of a set of discretely varying irrotational currents to show the efficacy of the developed technique.
- 3 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 70 (2) , 1024-1037
Approximate Dynamic Programming for Trajectory Tracking of Switched Systems
This article develops a technique for online approximate optimization of tracking control policies for a family of switched nonlinear dynamical systems. Optimization is realized via approximate dynamic programming, and integral concurrent learning is used for robustness to parametric uncertainties. The family of switched systems is composed of finitely many subsystems, which may have differing characteristics, such as dynamics and cost functions. This article develops a new result on the analysis of switched systems comprised of locally practically stable subsystems using multiple Lyapunov-like functions. Local practical stability of the overall switched system and convergence of the applied tracking control policies to a neighborhood of the optimal tracking control policies is then proven for an arbitrary switching sequence provided that a set of sufficient gain conditions and a minimum dwell-time condition are satisfied. Simulation results are presented for the optimal control of an autonomous underwater vehicle in the presence of a set of discretely varying irrotational currents to show the efficacy of the developed technique.
- 20 February 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 68 (5) , 3171-3177
Deep Neural Network-Based Approximate Optimal Tracking for Unknown Nonlinear Systems
The infinite horizon optimal tracking problem is solved for a deterministic, control-affine, unknown nonlinear dynamical system. A deep neural network (DNN) is updated in real time to approximate the unknown nonlinear system dynamics. The developed framework uses a multitimescale concurrent learning-based weight update policy, with which the output layer DNN weights are updated in real time, but the internal DNN features are updated discretely and at a slower timescale (i.e., with batch-like updates). The design of the output layer weight update policy is motivated by a Lyapunov-based analysis, and the inner features are updated according to existing DNN optimization algorithms. Simulation results demonstrate the efficacy of the developed technique and compare its performance to existing techniques.
- 20 February 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 68 (5) , 3171-3177
Deep Neural Network-Based Approximate Optimal Tracking for Unknown Nonlinear Systems
The infinite horizon optimal tracking problem is solved for a deterministic, control-affine, unknown nonlinear dynamical system. A deep neural network (DNN) is updated in real time to approximate the unknown nonlinear system dynamics. The developed framework uses a multitimescale concurrent learning-based weight update policy, with which the output layer DNN weights are updated in real time, but the internal DNN features are updated discretely and at a slower timescale (i.e., with batch-like updates). The design of the output layer weight update policy is motivated by a Lyapunov-based analysis, and the inner features are updated according to existing DNN optimization algorithms. Simulation results demonstrate the efficacy of the developed technique and compare its performance to existing techniques.
- 27 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 68 (6) , 3618-3624
Approximate Optimal Trajectory Tracking With Sparse Bellman Error Extrapolation
This article provides an approximate online adaptive solution to the infinite-horizon optimal tracking problem for control-affine continuous-time nonlinear systems with uncertain drift dynamics. A model-based approximate dynamic programming (ADP) approach, which is facilitated using a concurrent learning-based system identifier, approximates the optimal value function. To reduce the computational complexity of model-based ADP, the state space is segmented into user-defined segments (i.e., regions). Off-policy trajectories are selected within each segment to facilitate learning of the value function weight estimates; this process is called Bellman error (BE) extrapolation. Within certain segments of the state space, sparse neural networks are used to reduce the computational expense of BE extrapolation. Discontinuities occur in the weight update laws since different groupings of extrapolated BE trajectories are active in certain regions of the state space. A Lyapunov-like stability analysis is presented to prove boundedness of the overall system in the presence of discontinuities. Simulation results are included to demonstrate the performance and validity of the developed method. The simulation results demonstrate that using the sparse, switched BE extrapolation method developed in this article reduces the computation time by 85.6% when compared to the traditional BE extrapolation method.
- 27 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 68 (6) , 3618-3624
Approximate Optimal Trajectory Tracking With Sparse Bellman Error Extrapolation
This article provides an approximate online adaptive solution to the infinite-horizon optimal tracking problem for control-affine continuous-time nonlinear systems with uncertain drift dynamics. A model-based approximate dynamic programming (ADP) approach, which is facilitated using a concurrent learning-based system identifier, approximates the optimal value function. To reduce the computational complexity of model-based ADP, the state space is segmented into user-defined segments (i.e., regions). Off-policy trajectories are selected within each segment to facilitate learning of the value function weight estimates; this process is called Bellman error (BE) extrapolation. Within certain segments of the state space, sparse neural networks are used to reduce the computational expense of BE extrapolation. Discontinuities occur in the weight update laws since different groupings of extrapolated BE trajectories are active in certain regions of the state space. A Lyapunov-like stability analysis is presented to prove boundedness of the overall system in the presence of discontinuities. Simulation results are included to demonstrate the performance and validity of the developed method. The simulation results demonstrate that using the sparse, switched BE extrapolation method developed in this article reduces the computation time by 85.6% when compared to the traditional BE extrapolation method.
- 14 December 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 6, 1855-1860
Lyapunov-Derived Control and Adaptive Update Laws for Inner and Outer Layer Weights of a Deep Neural Network
Lyapunov-based real-time update laws are well-known for neural network (NN)-based adaptive controllers that control nonlinear dynamical systems using single-hidden-layer NNs. However, developing real-time weight update laws for deep NNs (DNNs) remains an open question. This letter presents the first result with Lyapunov-based real-time weight adaptation laws for each layer of a feedforward DNN-based control architecture, with stability guarantees. Additionally, the developed method allows nonsmooth activation functions to be used in the DNN to facilitate improved transient performance. A nonsmooth Lyapunov-based stability analysis proves global asymptotic tracking error convergence. Simulation results are provided for a nonlinear system using DNNs with leaky rectified linear unit (LReLU) and hyperbolic tangent activation functions to demonstrate the efficacy of the developed method.
- 14 December 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 6, 1855-1860
Lyapunov-Derived Control and Adaptive Update Laws for Inner and Outer Layer Weights of a Deep Neural Network
Lyapunov-based real-time update laws are well-known for neural network (NN)-based adaptive controllers that control nonlinear dynamical systems using single-hidden-layer NNs. However, developing real-time weight update laws for deep NNs (DNNs) remains an open question. This letter presents the first result with Lyapunov-based real-time weight adaptation laws for each layer of a feedforward DNN-based control architecture, with stability guarantees. Additionally, the developed method allows nonsmooth activation functions to be used in the DNN to facilitate improved transient performance. A nonsmooth Lyapunov-based stability analysis proves global asymptotic tracking error convergence. Simulation results are provided for a nonlinear system using DNNs with leaky rectified linear unit (LReLU) and hyperbolic tangent activation functions to demonstrate the efficacy of the developed method.
- 17 May 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 6, 476-481
Real-Time Modular Deep Neural Network-Based Adaptive Control of Nonlinear Systems
A real-time deep neural network (DNN) adaptive control architecture is developed for uncertain control-affine nonlinear systems to track a time-varying desired trajectory. A Lyapunov-based analysis is used to develop adaptation laws for the output-layer weights and develop constraints for inner-layer weight adaptation laws. Unlike existing works in neural network and DNN-based control, the developed method establishes a framework to simultaneously update the weights of multiple layers for a DNN of arbitrary depth in real-time. The real-time controller and weight update laws enable the system to track a time-varying trajectory while compensating for unknown drift dynamics and parametric DNN uncertainties. A nonsmooth Lyapunov-based analysis is used to guarantee semi-global asymptotic tracking. Comparative numerical simulation results are included to demonstrate the efficacy of the developed method.
- 17 May 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 6, 476-481
Real-Time Modular Deep Neural Network-Based Adaptive Control of Nonlinear Systems
A real-time deep neural network (DNN) adaptive control architecture is developed for uncertain control-affine nonlinear systems to track a time-varying desired trajectory. A Lyapunov-based analysis is used to develop adaptation laws for the output-layer weights and develop constraints for inner-layer weight adaptation laws. Unlike existing works in neural network and DNN-based control, the developed method establishes a framework to simultaneously update the weights of multiple layers for a DNN of arbitrary depth in real-time. The real-time controller and weight update laws enable the system to track a time-varying trajectory while compensating for unknown drift dynamics and parametric DNN uncertainties. A nonsmooth Lyapunov-based analysis is used to guarantee semi-global asymptotic tracking. Comparative numerical simulation results are included to demonstrate the efficacy of the developed method.
- 28 January 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 6, 193-198
Lyapunov-Based Real-Time and Iterative Adjustment of Deep Neural Networks
A real-time Deep Neural Network (DNN) adaptive control architecture is developed for general uncertain nonlinear dynamical systems to track a desired time-varying trajectory. A Lyapunov-based method is leveraged to develop adaptation laws for the output-layer weights of a DNN model in real-time while a data-driven supervised learning algorithm is used to update the inner-layer weights of the DNN. Specifically, the output-layer weights of the DNN are estimated using an unsupervised learning algorithm to provide responsiveness and guaranteed tracking performance with real-time feedback. The inner-layer weights of the DNN are trained with collected data sets to increase performance, and the adaptation laws are updated once a sufficient amount of data is collected. Building on the results in (Joshi and Chowdhary, 2019) and (Joshi et al., 2020), which focus on deep model reference adaptive control for linear systems with known drift dynamics and control effectiveness matrices, this letter considers general control-affine uncertain nonlinear systems. The real-time controller and adaptation laws enable the system to track a desired time-varying trajectory while compensating for the unknown drift dynamics and parameter uncertainties in the control effectiveness. A nonsmooth Lyapunov-based analysis is used to prove semi-global asymptotic tracking of the desired trajectory. Numerical simulation examples are included to validate the results, and the Levenberg-Marquardt algorithm is used to train the weights of the DNN.
- 28 January 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 6, 193-198
Lyapunov-Based Real-Time and Iterative Adjustment of Deep Neural Networks
A real-time Deep Neural Network (DNN) adaptive control architecture is developed for general uncertain nonlinear dynamical systems to track a desired time-varying trajectory. A Lyapunov-based method is leveraged to develop adaptation laws for the output-layer weights of a DNN model in real-time while a data-driven supervised learning algorithm is used to update the inner-layer weights of the DNN. Specifically, the output-layer weights of the DNN are estimated using an unsupervised learning algorithm to provide responsiveness and guaranteed tracking performance with real-time feedback. The inner-layer weights of the DNN are trained with collected data sets to increase performance, and the adaptation laws are updated once a sufficient amount of data is collected. Building on the results in (Joshi and Chowdhary, 2019) and (Joshi et al., 2020), which focus on deep model reference adaptive control for linear systems with known drift dynamics and control effectiveness matrices, this letter considers general control-affine uncertain nonlinear systems. The real-time controller and adaptation laws enable the system to track a desired time-varying trajectory while compensating for the unknown drift dynamics and parameter uncertainties in the control effectiveness. A nonsmooth Lyapunov-based analysis is used to prove semi-global asymptotic tracking of the desired trajectory. Numerical simulation examples are included to validate the results, and the Levenberg-Marquardt algorithm is used to train the weights of the DNN.
- 3 March 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 4 (3) , 743-748
Sparse Learning-Based Approximate Dynamic Programming With Barrier Constraints
This letter provides an approximate online adaptive solution to the infinite-horizon optimal control problem for control-affine continuous-time nonlinear systems while formalizing system safety using barrier certificates. The use of a barrier function transform provides safety certificates to formalize system behavior. Specifically, using a barrier function, the system is transformed to aid in developing a controller which maintains the system in a pre-defined constrained region. To aid in online learning of the value function, the state-space is segmented into a number of user-defined segments. Off-policy trajectories are selected in each segment, and sparse Bellman error extrapolation is performed within each respective segment to generate an optimal policy within each segment. A Lyapunov-like stability analysis is included which proves uniformly ultimately bounded regulation in the presence of the barrier function transform and discontinuities. Simulation results are provided for a two-state dynamical system to compare the performance of the developed method to existing methods.
- 3 March 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 4 (3) , 743-748
Sparse Learning-Based Approximate Dynamic Programming With Barrier Constraints
This letter provides an approximate online adaptive solution to the infinite-horizon optimal control problem for control-affine continuous-time nonlinear systems while formalizing system safety using barrier certificates. The use of a barrier function transform provides safety certificates to formalize system behavior. Specifically, using a barrier function, the system is transformed to aid in developing a controller which maintains the system in a pre-defined constrained region. To aid in online learning of the value function, the state-space is segmented into a number of user-defined segments. Off-policy trajectories are selected in each segment, and sparse Bellman error extrapolation is performed within each respective segment to generate an optimal policy within each segment. A Lyapunov-like stability analysis is included which proves uniformly ultimately bounded regulation in the presence of the barrier function transform and discontinuities. Simulation results are provided for a two-state dynamical system to compare the performance of the developed method to existing methods.