AI-driven actuation-compatible tracking for closed-loop navigation of miniature robots in vivo
- 23 September 2026
- journal article
- research article
- Published by American Association for the Advancement of Science (AAAS) in Science Robotics
- Vol. 11 (118)
Abstract
Miniature wireless magnetic robots (MWMRs) hold immense potential for minimally invasive interventions. Real-time tracking of MWMRs is essential for precise in vivo navigation but remains challenging. Tracking MWMRs via their emitted magnetic signals offers a viable solution, yet it has been limited to centimeter-scale robots because isolating weak MWMR signals from overwhelming actuation-induced interference becomes increasingly difficult with miniaturization. Here, we present an artificial intelligence (AI)–driven tracking system to overcome these challenges, enabling precise localization of millimeter-scale MWMRs in the presence of actuation fields. Our approach integrates a sensor array design with a transformer to accurately model and filter the interference, followed by a spatiotemporal transformer that interprets the extracted MWMR signals over a short time window to corresponding three-dimensional coordinates. Our system has been validated in a range of in vitro and in vivo experiments, demonstrating its applicability to closed-loop navigation of MWMRs in unshielded clinical settings.Keywords
Funding Information
- Hong Kong Research Grants Council (R4015-21)
- Hong Kong Research Grants Council (RFS2122-4S03)
- Hong Kong Research Grants Council (STG1/E-401/23-N)
- Hong Kong Jockey Club Charities Trust
This publication has 50 references indexed in Scilit:
- Robust magnetic tracking and navigation in robotic surgery2024
- THE MAGNETIC FLEXIBLE ENDOSCOPE: PHASE 1 FIRST-IN-HUMAN TRIALGastrointestinal Endoscopy, 2024
- Robotic wireless capsule endoscopy: recent advances and upcoming technologiesNature Communications, 2024
- Generating Frequency Selective Vibrations in Remote Moving MagnetsAdvanced Intelligent Systems, 2024
- Location-aware ingestible microdevices for wireless monitoring of gastrointestinal dynamicsNature Electronics, 2023
- Magnetic helical micro-/nanomachines: Recent progress and perspectiveMatter, 2022
- Enabling the future of colonoscopy with intelligent and autonomous magnetic manipulationNature Machine Intelligence, 2020
- Ingestible electronics for diagnostics and therapyNature Reviews Materials, 2018
- A human pilot trial of ingestible electronic capsules capable of sensing different gases in the gutNature Electronics, 2018
- Localization of microscale devices in vivo using addressable transmitters operated as magnetic spinsNature Biomedical Engineering, 2017