Traded Control of Human–Machine Systems for Sequential Decision-Making Based on Reinforcement Learning
- 12 November 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Artificial Intelligence
- Vol. 3 (4) , 553-566
Abstract
Sequential decision-making (SDM) is a common type of decision-making problem with sequential and multistage characteristics. Among them, the learning and updating of policy are the main challenges in solving SDM problems. Unlike previous machine autonomy driven by artificial intelligence alone, we improve the control performance of SDM tasks by combining human intelligence and machine intelligence. Specifically, this article presents a paradigm of a human–machine traded control systems based on reinforcement learning methods to optimize the solution process of sequential decision problems. By designing the idea of autonomous boundary and credibility assessment, we enable humans and machines at the decision-making level of the systems to collaborate more effectively. And the arbitration in the human–machine traded control systems introduces the Bayesian neural network and the dropout mechanism to consider the uncertainty and security constraints. Finally, experiments involving machine traded control, human traded control were implemented. The preliminary experimental results of this article show that our traded control method improves decision-making performance and verifies the effectiveness for SDM problems.Keywords
Funding Information
- National Key Research and Development Program of China (2018AAA0100801)
This publication has 22 references indexed in Scilit:
- Artificial intelligence in medicineMetabolism, 2017
- Neutron holography makes its debutPhysics Today, 2016
- From Autonomy to Cooperative Traded Control of Humanoid Manipulation Tasks with Unreliable CommunicationJournal of Intelligent & Robotic Systems, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Markov Decision Processes: A Tool for Sequential Decision Making under UncertaintyMedical Decision Making, 2009
- Minimally Invasive SurgeryEndoscopy, 2002
- Bayesian Learning for Neural Networks1996
- Trust in automation: Part I. Theoretical issues in the study of trust and human intervention in automated systemsErgonomics, 1994
- Robot Motion Planning1991
- A Markovian Decision ProcessIndiana University Mathematics Journal, 1957