A PSO-Optimized Fuzzy Reinforcement Learning Method for Making the Minimally Invasive Surgical Arm Cleverer
Open Access
- 9 April 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 48655-48670
Abstract
For robotic-assisted surgery, the preoperative preparation procedure within which the surgical arms need to be adjusted manually to their expected configuration can pose interlocking problems in terms of accuracy, system robustness, and human-robot interaction experience. Previous work about variable impedance/admittance control methods did improve the smoothness of this procedure while individual characteristics of different operating personnel haven’t yet been adequately considered. To further improve this process on the basis of existing methods, a novel strategy based on fuzzy Sarsa( $\lambda $ )-learning algorithm is both proposed and incorporated into the virtual parameter adjustment strategy to achieve physical human–robot interaction (pHRI) so that the robot can acclimatize various handling characteristics of different operators through enough online learning. To also shorten the online training cycle, reduce the undesirable subjective factors and improve the overall training performance, a particle-swarm-optimization-based (PSO-based) algorithm is as well employed for optimizing the partition of state variable space and the distribution of discrete actions. Several groups of experiments have demonstrated the validity of this scheme and the effectiveness of the PSO optimization element.Keywords
Funding Information
- National Natural Science Foundation of China (61773141)
- Natural Science Foundation of Heilongjiang Province (F2018016)
This publication has 32 references indexed in Scilit:
- Pareto Design of State Feedback Tracking Control of a Biped Robot via Multiobjective PSO in Comparison with Sigma Method and Genetic Algorithms: Modified NSGAII and MATLAB’s ToolboxThe Scientific World Journal, 2014
- Assisting manual welding with robotRobotics and Computer-Integrated Manufacturing, 2011
- Efficacy of the Da Vinci Surgical System in Abdominal Surgery Compared With That of LaparoscopyAnnals of Surgery, 2010
- Forcefree control with independent compensation for industrial articulated robot armsControl Engineering Practice, 2006
- Human direct teaching of industrial articulated robot arms based on force-free controlArtificial Life and Robotics, 2001
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Design of fuzzy logic controllers based on generalized T-operatorsFuzzy Sets and Systems, 1991
- Theory of T-norms and fuzzy inference methodsFuzzy Sets and Systems, 1991
- Impedance Control: An Approach to Manipulation: Part I—TheoryJournal of Dynamic Systems, Measurement, and Control, 1985
- Adaptive control of mechanical impedance by coactivation of antagonist musclesIEEE Transactions on Automatic Control, 1984