Self-Attention-Powered Graph Convolution Network for Image Reconstruction in ERT/UTT Dual-Modality Tomography
- 29 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 25 (22) , 41582-41593
Abstract
A self-attention powered graph convolution network (GCN) is proposed for electrical resistance tomography (ERT) and ultrasonic transmission tomography (UTT) dual-modality tomography. It’s promising to improve the imaging accuracy in cross-sectional media distribution detection. The proposed model uses polynomial feature generation to pre-process the two input layers of measurement data. The dual-branch measurement spatial information is fused by the feature level at the dense layer with the same dimension. The proposed model calculates attention scores to extract contrasts from complex non-Euclidean distance measurement data structures. The GCN with an attention mechanism (GCNAM) identifies expressive complementary features from the combined ERT/UTT measurement data, improving prediction accuracy. During training, the attention mechanism predicts the various modal features using learnable parameters; the model then adapts to the good reconstruction target. It promotes the effective fusion and image reconstruction of dual-modal information between different modal features. The optimizer RMSprop further fine-tunes the proposed model to enhance the generalization ability. The simulation and experiment tests are carried out to evaluate the proposed model’s performance. Furthermore, it conducts generalization and robustness tests on all state-of-the-art models to evaluate their performance under varying conditions. The results demonstrate that the proposed model maintains higher imaging accuracy and stability using structural similarity (SSIM) index and root mean square error (RMSE) metrics.Keywords
Funding Information
- National Natural Science Foundation of China (62201381)
This publication has 36 references indexed in Scilit:
- Convolutional Concatenation Fusion Imaging Method for ERT/UTT Dual-Modality TomographyIEEE Access, 2024
- Self-attention empowered graph convolutional network for structure learning and node embeddingPattern Recognition, 2024
- Deep Kernel Principal Component Analysis for multi-level feature learningNeural Networks, 2023
- Multimodal graph attention network for COVID-19 outcome predictionScientific Reports, 2023
- Attention-based spatio-temporal graph convolutional network considering external factors for multi-step traffic flow predictionDigital Communications and Networks, 2022
- Convergence of the RMSProp deep learning method with penalty for nonconvex optimizationNeural Networks, 2021
- An augmented Lagrangian trust region method for inclusion boundary reconstruction using ultrasound/electrical dual-modality tomographyMeasurement Science and Technology, 2018
- Multi-modal Image Registration Using Polynomial Expansion and Mutual InformationLecture Notes in Computer Science, 2012
- Engineering and application of a dual-modality process tomography systemFlow Measurement and Instrumentation, 2007
- Dual-modality imagingNuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, 2001