A Reinforcement Learning Model Equipped with Sensors for Generating Perception Patterns: Implementation of a Simulated Air Navigation System Using ADS-B (Automatic Dependent Surveillance-Broadcast) Technology
Open Access
Abstract
Over the last few decades, a number of reinforcement learning techniques have emerged, and different reinforcement learning-based applications have proliferated. However, such techniques tend to specialize in a particular field. This is an obstacle to their generalization and extrapolation to other areas. Besides, neither the reward-punishment (r-p) learning process nor the convergence of results is fast and efficient enough. To address these obstacles, this research proposes a general reinforcement learning model. This model is independent of input and output types and based on general bioinspired principles that help to speed up the learning process. The model is composed of a perception module based on sensors whose specific perceptions are mapped as perception patterns. In this manner, similar perceptions (even if perceived at different positions in the environment) are accounted for by the same perception pattern. Additionally, the model includes a procedure that statistically associates perception-action pattern pairs depending on the positive or negative results output by executing the respective action in response to a particular perception during the learning process. To do this, the model is fitted with a mechanism that reacts positively or negatively to particular sensory stimuli in order to rate results. The model is supplemented by an action module that can be configured depending on the maneuverability of each specific agent. The model has been applied in the air navigation domain, a field with strong safety restrictions, which led us to implement a simulated system equipped with the proposed model. Accordingly, the perception sensors were based on Automatic Dependent Surveillance-Broadcast (ADS-B) technology, which is described in this paper. The results were quite satisfactory, and it outperformed traditional methods existing in the literature with respect to learning reliability and efficiency.Keywords
This publication has 15 references indexed in Scilit:
- Online least-squares policy iteration for reinforcement learning control2010
- Regularized Fitted Q-Iteration for planning in continuous-space Markovian decision problems2009
- Reinforcement learning with replacing eligibility tracesMachine Learning, 1996
- Asynchronous stochastic approximation and Q-learningMachine Learning, 1994
- TD-Gammon, a Self-Teaching Backgammon Program, Achieves Master-Level PlayNeural Computation, 1994
- Q-learningMachine Learning, 1992
- Building and Understanding Adaptive Systems: A Statistical/Numerical Approach to Factory Automation and Brain ResearchIEEE Transactions on Systems, Man, and Cybernetics, 1987
- Monte Carlo Methods1986
- Neuronlike adaptive elements that can solve difficult learning control problemsIEEE Transactions on Systems, Man, and Cybernetics, 1983
- Simulation and the Monte Carlo Method1981