Joint state recognition in scanning probe microscopy using spatial-frequency and scan-context learning
- 13 November 2026
- journal article
- Published by IOP Publishing in Measurement Science and Technology
- Vol. 37 (45) , 455409
Abstract
Accurate image state recognition is essential for autonomous scanning probe microscopy (SPM), where a single image may simultaneously reflect imaging quality, surface morphology, sample condition and probe-tip state. However, these state attributes are strongly coupled in real SPM acquisition tasks, making conventional single-task or purely spatial-domain classifiers insufficient for reliable joint multi-task recognition. To address this problem, we propose SFDR-ResMamba, a four-task multi-output SPM image classification framework for jointly predicting image quality, image type, sample state, and tip state. The proposed method first constructs a spatial-frequency dual-domain representation (SFDR), which integrates a spatial-enhanced view, a full-band Fourier amplitude view, and a scan-line-direction high-pass reconstruction view to encode local morphology, global periodicity, and scan-related frequency cues. A residual scan-context Mamba encoder is then designed to combine the local inductive bias of residual convolution with row-wise and column-wise Mamba context modeling, enabling efficient representation of raster-scan dependencies and two-dimensional structural continuity. To reduce semantic interference among the four tasks, a task-aware residual gated decoupling module further generates task-specific residual features from multi-level representations. Experiments on the MSPM-10 K dataset demonstrate that SFDR-ResMamba outperforms representative CNN, efficient CNN, Transformer and Mamba-based baselines, achieving a mean accuracy of 92.6% and a mean Macro- F 1 of 90.9%. Ablation studies, conditional performance analysis, and joint correctness evaluation support the contributions of the proposed spatial-frequency representation, scan-context modeling, and task-aware decoupling strategy, while feature visualization provides a qualitative view of the learned tip-state representations.Keywords
This publication has 21 references indexed in Scilit:
- Artificial intelligence-empowered scanning probe microscopy: Recent advances and future perspectivesAdvanced Scientific Instruments, 2026
- GCNet-Mamba: Leveraging state space models and CNN for medical image classificationExpert Systems with Applications, 2025
- Gated parallel feature fusion multi-task learning for motor imagery EEG classificationExpert Systems with Applications, 2025
- Dual-domain guided vision Mamba network for medical image segmentationExpert Systems with Applications, 2025
- Machine Vision Automated Chiral Molecule Detection and Classification in Molecular ImagingJournal of the American Chemical Society, 2021
- Automated Tip Conditioning for Scanning Tunneling SpectroscopyThe Journal of Physical Chemistry A, 2021
- Autonomous Scanning Probe Microscopy in Situ Tip Conditioning through Machine LearningACS Nano, 2018
- Double‐tip effects on scanning tunneling microscopy imaging of 2D periodic objects: unambiguous detection and limits of their removal by crystallographic averaging in the spatial frequency domainCrystal Research and Technology, 2014
- A review of atomic force microscopy imaging systems: application to molecular metrology and biological sciencesMechatronics, 2004
- Multitask LearningMachine Learning, 1997