An Adaptive Strategy Selection Method With Reinforcement Learning for Robotic Soccer Games
Open Access
- 23 February 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 6, 8376-8386
Abstract
Robotic soccer games, which have become popular, require timely and precise decisionmaking in a dynamic environment. To address the problems of complexity in a critical situation, policy improvement in robotic soccer games must occur. This paper proposes an adaptive decisionmaking method that uses reinforcement learning (RL), and the decision-making system for a robotic soccer game is composed of two subsystems. The first subsystem in the architecture for the proposed method criticizes the situation, and the second subsystem implements decision-making policy. Inspired by the support vector machine (SVM), a situation classification method, which is called an improved SVM, embeds a decision tree structure and simultaneously addresses the problems of a large scale and multiple classifications. When a variety of situations that are collected in the field are classified and congregated into the tree structure, the problem of local strategy selection for each individual class of situations over time is regarded as a RL problem and is solved using a Q-learning method. The results of simulations and experiments demonstrate that the proposed method allows satisfactory decision-making.Keywords
Funding Information
- National Research and Development Plan of China (2017YFB1001900)
- Fund of national ministries (2016ZC53022)
- Fundamental Research Funds for the Central Universities (3102017JSJ0005)
This publication has 35 references indexed in Scilit:
- SMC Design for Robust Stabilization of Nonlinear Markovian Jump Singular SystemsIEEE Transactions on Automatic Control, 2017
- Optimizations of the energy grid search algorithm in continuous-energy Monte Carlo particle transport codesComputer Physics Communications, 2015
- LogDet Divergence-Based Metric Learning With Triplet Constraints and Its ApplicationsIEEE Transactions on Image Processing, 2014
- Study on Support Vector Machine-Based Fault Detection in Tennessee Eastman ProcessAbstract and Applied Analysis, 2014
- Fault Detection and Diagnosis in Process Data Using Support Vector MachinesJournal of Applied Mathematics, 2014
- Cooperative ARQ With Relay Selection: An Analytical Framework Using Semi-Markov ProcessesIEEE Transactions on Vehicular Technology, 2013
- Application of learning pallets for real-time scheduling by the use of radial basis function networkNeurocomputing, 2013
- Enhancing directed binary trees for multi-class classificationInformation Sciences, 2013
- A model of fuzzy spatio-temporal knowledge representation and reasoning based on high-level Petri netsInformation Systems, 2012
- A Tutorial on Support Vector Machines for Pattern RecognitionData Mining and Knowledge Discovery, 1998