Amanda Pertzborn
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Amanda Pertzborn has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Jin Wen
Drexel University
3 shared publications - Syed Ali Asad Rizvi
Department of Electrical and Computer Engineering Tennessee Technological University Cookeville Tennessee USA
2 shared publications - Yangyang Fu
J. Mike Walker’66 Department of Mechanical Engineering, Texas A&M University
2 shared publications - Zheng O'NEill
Texas A&M University
2 shared publications - Zongli Lin
Charles L. Brown Department of Electrical and Computer Engineering, University of Virginia, Charlottesville, USA
2 shared publications Afshin Faramarzi
1 shared publication
Latest Publications
- 24 January 2025
- Published by Taylor & Francis in Journal of Building Performance Simulation
- Vol. 19 (6) , 1057-1077
A framework for calibrating and validating an HVAC system in Modelica
- 24 January 2025
- Published by Taylor & Francis in Journal of Building Performance Simulation
- Vol. 19 (6) , 1057-1077
A framework for calibrating and validating an HVAC system in Modelica
- 23 July 2024
- Published by Elsevier in International Journal of Refrigeration
- Vol. 167, 70-89
Forecasting operation of a chiller plant facility using data-driven models
- 23 July 2024
- Published by Elsevier in International Journal of Refrigeration
- Vol. 167, 70-89
Forecasting operation of a chiller plant facility using data-driven models
- 25 January 2024
- Published by National Institute of Standards and Technology (NIST)
Intelligent building agents laboratory :
The National Institute of Standards and Technology has constructed the Intelligent Building Agents Laboratory (IBAL) to demonstrate the potential for distributed, intelligent software agents to optimize the control of heating, ventilation, and air-conditioning systems in commercial buildings. The goal of the optimization is to improve the economic and energy performance of building systems while maintaining occupant comfort. This paper describes the design of, and the equipment in, the airside system of the IBAL.
- 25 January 2024
- Published by National Institute of Standards and Technology (NIST)
Intelligent building agents laboratory :
The National Institute of Standards and Technology has constructed the Intelligent Building Agents Laboratory (IBAL) to demonstrate the potential for distributed, intelligent software agents to optimize the control of heating, ventilation, and air-conditioning systems in commercial buildings. The goal of the optimization is to improve the economic and energy performance of building systems while maintaining occupant comfort. This paper describes the design of, and the equipment in, the airside system of the IBAL.
- 13 September 2023
- Published by National Institute of Standards and Technology (NIST)
Comparison of ice-on-coil thermal energy storage models
- 13 September 2023
- Published by National Institute of Standards and Technology (NIST)
Comparison of ice-on-coil thermal energy storage models
- 25 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/CAA Journal of Automatica Sinica
- Vol. 10 (8) , 1704-1715
Development of a Bias Compensating Q-Learning Controller for a Multi-Zone HVAC Facility
We present the development of a bias compensating reinforcement learning (RL) algorithm that optimizes thermal comfort (by minimizing tracking error) and control utilization (by penalizing setpoint deviations) in a multi-zone heating, ventilation, and air-conditioning (HVAC) lab facility subject to unmeasurable disturbances and unknown dynamics. It is shown that the presence of unmeasurable disturbance results in an inconsistent learning equation in traditional RL controllers leading to parameter estimation bias (even with integral action support), and in the extreme case, the divergence of the learning algorithm. We demonstrate this issue by applying the popular Q-learning algorithm to linear quadratic regulation (LQR) of a multi-zone HVAC environment and showing that, even with integral support, the algorithm exhibits bias issue during the learning phase when the HVAC disturbance is unmeasurable due to unknown heat gains, occupancy variations, light sources, and outside weather changes. To address this difficulty, we present a bias compensating learning equation that learns a lumped bias term as a result of disturbances (and possibly other sources) in conjunction with the optimal control parameters. Experimental results show that the proposed scheme not only recovers the bias-free optimal control parameters but it does so without explicitly learning the dynamic model or estimating the disturbances, demonstrating the effectiveness of the algorithm in addressing the above challenges.
- 25 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/CAA Journal of Automatica Sinica
- Vol. 10 (8) , 1704-1715
Development of a Bias Compensating Q-Learning Controller for a Multi-Zone HVAC Facility
We present the development of a bias compensating reinforcement learning (RL) algorithm that optimizes thermal comfort (by minimizing tracking error) and control utilization (by penalizing setpoint deviations) in a multi-zone heating, ventilation, and air-conditioning (HVAC) lab facility subject to unmeasurable disturbances and unknown dynamics. It is shown that the presence of unmeasurable disturbance results in an inconsistent learning equation in traditional RL controllers leading to parameter estimation bias (even with integral action support), and in the extreme case, the divergence of the learning algorithm. We demonstrate this issue by applying the popular Q-learning algorithm to linear quadratic regulation (LQR) of a multi-zone HVAC environment and showing that, even with integral support, the algorithm exhibits bias issue during the learning phase when the HVAC disturbance is unmeasurable due to unknown heat gains, occupancy variations, light sources, and outside weather changes. To address this difficulty, we present a bias compensating learning equation that learns a lumped bias term as a result of disturbances (and possibly other sources) in conjunction with the optimal control parameters. Experimental results show that the proposed scheme not only recovers the bias-free optimal control parameters but it does so without explicitly learning the dynamic model or estimating the disturbances, demonstrating the effectiveness of the algorithm in addressing the above challenges.
- 30 November 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 33 (12) , 7523-7533
Reinforcement Learning Based Optimal Tracking Control Under Unmeasurable Disturbances With Application to HVAC Systems
This paper presents the design of an optimal controller for solving tracking problems subject to unmeasurable disturbances and unknown system dynamics using reinforcement learning (RL). Many existing RL control methods take disturbance into account by directly measuring it and manipulating it for exploration during the learning process, thereby preventing any disturbance induced bias in the control estimates. However, in most practical scenarios, disturbance is neither measurable nor manipulable. The main contribution of this article is the introduction of a combination of a bias compensation mechanism and the integral action in the Q-learning framework to remove the need to measure or manipulate the disturbance, while preventing disturbance induced bias in the optimal control estimates. A bias compensated Q-learning scheme is presented that learns the disturbance induced bias terms separately from the optimal control parameters and ensures the convergence of the control parameters to the optimal solution even in the presence of unmeasurable disturbances. Both state feedback and output feedback algorithms are developed based on policy iteration (PI) and value iteration (VI) that guarantee the convergence of the tracking error to zero. The feasibility of the design is validated on a practical optimal control application of a heating, ventilating, and air conditioning (HVAC) zone controller.
- 30 November 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 33 (12) , 7523-7533
Reinforcement Learning Based Optimal Tracking Control Under Unmeasurable Disturbances With Application to HVAC Systems
This paper presents the design of an optimal controller for solving tracking problems subject to unmeasurable disturbances and unknown system dynamics using reinforcement learning (RL). Many existing RL control methods take disturbance into account by directly measuring it and manipulating it for exploration during the learning process, thereby preventing any disturbance induced bias in the control estimates. However, in most practical scenarios, disturbance is neither measurable nor manipulable. The main contribution of this article is the introduction of a combination of a bias compensation mechanism and the integral action in the Q-learning framework to remove the need to measure or manipulate the disturbance, while preventing disturbance induced bias in the optimal control estimates. A bias compensated Q-learning scheme is presented that learns the disturbance induced bias terms separately from the optimal control parameters and ensures the convergence of the control parameters to the optimal solution even in the presence of unmeasurable disturbances. Both state feedback and output feedback algorithms are developed based on policy iteration (PI) and value iteration (VI) that guarantee the convergence of the tracking error to zero. The feasibility of the design is validated on a practical optimal control application of a heating, ventilating, and air conditioning (HVAC) zone controller.
- Open Access
- 27 September 2021
- Published by Linkoping University Electronic Press in Swedish Aerospace Conference, FT2025
- Vol. 181, 177-185
An Ice Storage Tank Modelica Model: Implementation and Validation
Energy storage systems have been gaining attention as a means of load management in grid-interactive efficient buildings. This study investigated the physics of the ice storage tank (IST) and implemented an IST model in Modelica. The developed IST Modelica model was compared with a similar model in EnergyPlus and was validated against experimental data from a testbed at the National Institute of Standards and Technology. Three statistical performance metrics were used to quantify the accuracy of the IST model. Validation results (CV(RMSE) ≤ 10.20 %, NMBE ≤ 0.44 %) show that the proposed model has a good prediction accuracy according to ASHRAE Guideline 14.
- 27 September 2021
- Published by Linkoping University Electronic Press in Swedish Aerospace Conference, FT2025
- Vol. 181, 177-185
Open AccessAn Ice Storage Tank Modelica Model: Implementation and Validation
Energy storage systems have been gaining attention as a means of load management in grid-interactive efficient buildings. This study investigated the physics of the ice storage tank (IST) and implemented an IST model in Modelica. The developed IST Modelica model was compared with a similar model in EnergyPlus and was validated against experimental data from a testbed at the National Institute of Standards and Technology. Three statistical performance metrics were used to quantify the accuracy of the IST model. Validation results (CV(RMSE) ≤ 10.20 %, NMBE ≤ 0.44 %) show that the proposed model has a good prediction accuracy according to ASHRAE Guideline 14.
- 1 June 2016
- Published by Elsevier in Energy and Buildings
- Vol. 122, 53-62
Efficient and robust optimization for building energy simulation
- 1 June 2016
- Published by Elsevier in Energy and Buildings
- Vol. 122, 53-62
Efficient and robust optimization for building energy simulation