Visual Tracking With Motion Distortion Removal for Nanomanipulation Inside SEM
- 25 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-12
Abstract
The paper investigates the problem of visual tracking on moving object in nanomanipulation inside scanning electron microscope (SEM). Image noise is a primary concern when dealing with the problem, which includes the inherent statistical noise and that induced by the motion distortion. A visual tracking method with SEM image denoising algorithm is proposed. The denoising algorithm is well incorporated with robot motion by innovatively leveraging the image Jacobian matrix technique. The denosing algorithm removes image noise and provides more realistic image. On the basis, template matching is utilized to achieve visual tracking on image plane. Experimental results show that the visual tracking performance on image plane was well improved by 31.4% for point feature, 60.6% for line feature, and 52.1% for area feature in terms of root mean square (RMSE) compared to that without motion distortion removal. Comparison experiments validate the state-of-the-art performance achieved by the proposed method and thus the superiority.Keywords
Funding Information
- Shanghai Pujiang talents Program (21PJ1410500)
This publication has 38 references indexed in Scilit:
- Robotic Probing of Nanostructures inside Scanning Electron MicroscopyIEEE Transactions on Robotics, 2014
- Applications of the image processing method on the structure measurements in porous GaNJournal of Experimental Nanoscience, 2013
- An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistencyJournal of Visual Communication and Image Representation, 2013
- An Improved Visual Tracking Method in Scanning Electron MicroscopeMicroscopy and Microanalysis, 2012
- LSD: a Line Segment DetectorImage Processing On Line, 2012
- DCT Image Denoising: a Simple and Effective Image Denoising AlgorithmImage Processing On Line, 2011
- A statistical model of signal–noise in scanning electron microscopyScanning, 2011
- SURF: Speeded Up Robust Features2006
- Nanorobots, NEMS, and NanoassemblyProceedings of the IEEE, 2003
- SIFT: predicting amino acid changes that affect protein functionNucleic Acids Research, 2003