Grower-in-the-Loop Interactive Reinforcement Learning for Greenhouse Climate Control
Authors:
Preprint
Abstract
Climate control is crucial for greenhouse production as it directly affects crop growth and resource use. Reinforcement learning (RL) has received increasing attention in this field, but still faces challenges, including limited training efficiency and high reliance on initial learning conditions. Interactive RL, which combines human (grower) input with the RL agent's learning, offers a potential solution to overcome these challenges. However, interactive RL has not yet been applied to greenhouse climate control and may face challenges related to imperfect inputs. Therefore, this paper aims to explore the possibility and performance of applying interactive RL with imperfect inputs into greenhouse climate control, by: (1) developing three representative interactive RL algorithms tailored for greenhouse climate control (reward shaping, policy shaping and control sharing); (2) analyzing how input characteristics are often contradicting, and how the trade-offs between them make grower's inputs difficult to perfect; (3) proposing a neural network-based approach to enhance the robustness of interactive RL agents under limited input availability; (4) conducting a comprehensive evaluation of the three interactive RL algorithms with imperfect inputs in a simulated greenhouse environment. The demonstration shows that interactive RL incorporating imperfect grower inputs has the potential to improve the performance of the RL agent. RL algorithms that influence action selection, such as policy shaping and control sharing, perform better when dealing with imperfect inputs, achieving 8.4% and 6.8% improvement in profit, respectively. In contrast, reward shaping, an algorithm that manipulates the reward function, is sensitive to imperfect inputs and leads to a 9.4% decrease in profit. This highlights the importance of selecting an appropriate mechanism when incorporating imperfect inputs.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Intentionally-underestimated value function at terminal state for temporal-difference learning with mis-designed rewardResults in Control and Optimization, 2025
- Active learning for data streams: a surveyMachine Learning, 2023
- Reinforcement Learning versus Model Predictive Control on greenhouse climate controlComputers and Electronics in Agriculture, 2023
- How greenhouse horticulture in arid regions can contribute to climate-resilient and sustainable food securityGlobal Food Security, 2023
- Data-driven robust model predictive control for greenhouse temperature control and energy utilisation assessmentApplied Energy, 2023
- Energy-efficient AI-based Control of Semi-closed Greenhouses Leveraging Robust Optimization in Deep Reinforcement LearningAdvances in Applied Energy, 2022
- Energy-saving design and control strategy towards modern sustainable greenhouse: A reviewRenewable and Sustainable Energy Reviews, 2022
- A Review on Interactive Reinforcement Learning From Human Social FeedbackIEEE Access, 2020
- TAMER: Training an Agent Manually via Evaluative Reinforcement2008
- Real-time greenhouse monitoring and control with an expert systemComputers and Electronics in Agriculture, 1989