Visual Servo Control for Workspace Navigation of Nanorobot End-Effector Inside SEM
- 5 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 21 (3) , 3472-3482
Abstract
Despite of the promising advancements in the last decade, the majority of scanning electron microscope (SEM)-based nanomanipulation tasks remain manually performed. Even in automated tasks, human intervention is required, at least during the task preparatory stage, where both the object of interest and robot end-effector are adequately enclosed in the field of view (FOV) of SEM at moderate magnification. This paper proposes a fully automated visual servo control method for workspace navigation of nanorobot end-effector that actively maintains the end-effector position offset from the center of FOV during passive working scene zooming and translation operations. We also propose using the scaling image Jacobian matrix theory to adaptively establish the hand-eye relationship of the nanorobotic system at uncalibrated magnifications, without the need for hardware regulation. This proposed method for workspace navigation is applicable to almost all commercial nanomanipulation systems. To the authors’ best knowledge, there has been no dedicated research on this problem in the literature. Experiments show that the proposed method significantly improves workspace navigation efficiency by about two-thirds, even for a skilled operator. Note to Practitioners —Workspace navigation refers to the process of moving the FOV to visually enclose the object or feature of interest at a moderate magnification, which is prerequisite for initializing either an automated or manual nanomanipulation task. This process involves consecutive zooming of the SEM in and out, as well as translating the sample stage, which can cause the end-effector to move out of the FOV. Therefore, it is necessary to move the robot end-effector with visual assistance along workspace navigation to avoid unexpected collisions. Typically, skilled operators perform this process manually in almost all nanomanipulation tasks, which is tedious and time-consuming. Therefore, developing an automated visual servo control method for workspace navigation of end-effector will significantly contribute to the nanomanipulation community.Keywords
Funding Information
- Shanghai Pujiang talents Program (21PJ1410500)
This publication has 40 references indexed in Scilit:
- Autofocus on moving object in scanning electron microscopeUltramicroscopy, 2017
- Calibration of a scanning electron microscope from two coordinatesJournal of Surface Investigation: X-Ray, Synchrotron and Neutron Techniques, 2017
- Nanorobotic System iTRo for Controllable 1D Micro/nano Material Twisting TestScientific Reports, 2017
- Automatic Sample Alignment Under Microscopy for 360° Imaging Based on the Nanorobotic Manipulation SystemIEEE Transactions on Robotics, 2016
- Visual Servoing-Based Depth-Estimation Technique for Manipulation Inside SEMIEEE Transactions on Instrumentation and Measurement, 2016
- Recent advances in nanorobotic manipulation inside scanning electron microscopesMicrosystems & Nanoengineering, 2016
- A Closed-Loop Controlled Nanomanipulation System for Probing Nanostructures Inside Scanning Electron MicroscopesIEEE/ASME Transactions on Mechatronics, 2016
- A statistical model of signal–noise in scanning electron microscopyScanning, 2011
- Tutorial - Robotics in the small Part II: NanoroboticsIEEE Robotics & Automation Magazine, 2007
- Nanorobots, NEMS, and NanoassemblyProceedings of the IEEE, 2003