Efficient Navigation of Colloidal Robots in an Unknown Environment via Deep Reinforcement Learning
Open Access
- 30 September 2019
- journal article
- research article
- Published by Wiley in Advanced Intelligent Systems
- Vol. 2 (1)
Abstract
Equipping micro‐/nanoscale colloidal robots with artificial intelligence (AI) such that they can efficiently navigate in unknown complex environments can dramatically impact their use in emerging applications such as precision surgery and targeted nanodrug delivery. Herein, a model‐free deep reinforcement learning algorithm is developed that trains colloidal robots to efficiently navigate in unknown environments with random obstacles. A deep neural network architecture is used that enables the colloidal robots to mimic animal navigation decision‐making by directly processing raw sensor input and decomposing long‐range navigations to short‐range ones. The trained robot agents learn to make navigation decisions regarding both obstacle avoidance and travel time minimization, based solely on local sensory inputs without prior knowledge of the global environment. Such agents with biologically inspired mechanisms can acquire competitive navigation capabilities in large‐scale, complex environments containing obstacles of diverse shapes, sizes, and configurations. Herein, the potential of AI to enable colloidal robots in extensive applications is illustrated.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (11961131005, 11672161)
This publication has 46 references indexed in Scilit:
- Rapid transport of deformation-tuned nanoparticles across biological hydrogels and cellular barriersNature Communications, 2018
- A DNA nanorobot functions as a cancer therapeutic in response to a molecular trigger in vivoNature Biotechnology, 2018
- Micro/nanorobots for biomedicine: Delivery, surgery, sensing, and detoxificationScience Robotics, 2017
- Using active colloids as machines to weave and braid on the micrometer scaleProceedings of the National Academy of Sciences, 2016
- Active Particles in Complex and Crowded EnvironmentsReviews of Modern Physics, 2016
- Rocket Science at the NanoscaleACS Nano, 2016
- Conformal Cytocompatible Ferrite Coatings Facilitate the Realization of a Nanovoyager in Human BloodNano Letters, 2014
- Self-Propelled Micromotors for Cleaning Polluted WaterACS Nano, 2013
- pH‐Responsive On‐Off Motion of a Superhydrophobic Boat: Towards the Design of a MinirobotSmall, 2013
- Powering NanorobotsScientific American, 2009