An online scalarization multi-objective reinforcement learning algorithm: TOPSIS Q-learning
- 13 June 2022
- journal article
- research article
- Published by Maximum Academic Press in The Knowledge Engineering Review
- Vol. 37
Abstract
Conventional reinforcement learning focuses on problems with single objective. However, many problems have multiple objectives or criteria that may be independent, related, or contradictory. In such cases, multi-objective reinforcement learning is used to propose a compromise among the solutions to balance the objectives. TOPSIS is a multi-criteria decision method that selects the alternative with minimum distance from the positive ideal solution and the maximum distance from the negative ideal solution, so it can be used effectively in the decision-making process to select the next action. In this research a single-policy algorithm called TOPSIS Q-Learning is provided with focus on its performance in online mode. Unlike all single-policy methods, in the first version of the algorithm, there is no need for the user to specify the weights of the objectives. The user’s preferences may not be completely definite, so all weight preferences are combined together as decision criteria and a solution is generated by considering all these preferences at once and user can model the uncertainty and weight changes of objectives around their specified preferences of objectives. If the user only wants to apply the algorithm for a specific set of weights the second version of the algorithm efficiently accomplishes that.Keywords
This publication has 10 references indexed in Scilit:
- Interactive Multi-objective Reinforcement Learning in Multi-armed Bandits with Gaussian Process Utility Models2021
- Softmax exploration strategies for multiobjective reinforcement learningNeurocomputing, 2017
- Steering approaches to Pareto-optimal multiobjective reinforcement learningNeurocomputing, 2017
- Interactive Thompson Sampling for Multi-objective Multi-armed Bandits2017
- A Survey of Multi-Objective Sequential Decision-MakingJournal of Artificial Intelligence Research, 2013
- Empirical evaluation methods for multiobjective reinforcement learning algorithmsMachine Learning, 2010
- Learning all optimal policies with multiple criteria2008
- Asynchronous stochastic approximation and Q-learningMachine Learning, 1994
- Multiple Attribute Decision Making1981
- The Experimental Determination of Indifference CurvesReview of Economic Studies, 1969