Abstract
Miniature wireless magnetic robots (MWMRs) hold immense potential for minimally invasive interventions. Real-time tracking of MWMRs is essential for precise in vivo navigation but remains challenging. Tracking MWMRs via their emitted magnetic signals offers a viable solution, yet it has been limited to centimeter-scale robots because isolating weak MWMR signals from overwhelming actuation-induced interference becomes increasingly difficult with miniaturization. Here, we present an artificial intelligence (AI)–driven tracking system to overcome these challenges, enabling precise localization of millimeter-scale MWMRs in the presence of actuation fields. Our approach integrates a sensor array design with a transformer to accurately model and filter the interference, followed by a spatiotemporal transformer that interprets the extracted MWMR signals over a short time window to corresponding three-dimensional coordinates. Our system has been validated in a range of in vitro and in vivo experiments, demonstrating its applicability to closed-loop navigation of MWMRs in unshielded clinical settings.
Funding Information
  • Hong Kong Research Grants Council (R4015-21)
  • Hong Kong Research Grants Council (RFS2122-4S03)
  • Hong Kong Research Grants Council (STG1/E-401/23-N)
  • Hong Kong Jockey Club Charities Trust

This publication has 50 references indexed in Scilit: