Implementing Graph Neural Networks Over Wireless Networks via Over-the-Air Computing: A Joint Communication and Computation Framework
Authors:
- 1 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Wireless Communications
- Vol. 30 (3) , 62-69
Abstract
A Graph Neural Network (GNN) conducts the graph convolution for structured data and obtains the weighted sum over the vertices according to its graph structure. However, in the context of a wireless network, the traditional separate implementation of a GNN usually requires the full channel state information, which is hard to obtain in practice, especially for the underlying interference channels. On the other hand, Over-the-Air Computing (OAC) is an efficient analog wireless technique in which the weighted sum can be simultaneously calculated over an equivalent wireless superposition channel. Since the main goal of a distributed learning-based system is the fulfillment of the overall learning task instead of its communication rate, OAC is of great potential for implementing such a system. In this article, we exploit some specific features of the wireless interference graphs and propose a novel task-ori-ented OAC-based framework to deploy GNNs more efficiently in wireless networks. In particu-lar, we take advantage of the structural similarity between OAC and the graph convolution oper-ation over an interference graph, and the chan-nel prediction procedure can be merged into the weight updating procedure. Moreover, the inher-ent noise tolerance of a neural network further ensures its convergence and performance. We also conduct case studies based on the proposed framework and discuss the comprehensive future research directions and open problems.Keywords
Funding Information
- National Key R&D Pro-gram of China (2020YFB18071 01,2018YFB18011 04)
- National Natural Science Foundation of China (U20A20158,61725104,62101492)
- China National Key R&D Program (2021YFA1000500)
This publication has 12 references indexed in Scilit:
- Over-the-Air Split Machine Learning in Wireless MIMO NetworksIEEE Journal on Selected Areas in Communications, 2023
- Edge Learning for B5G Networks With Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless SensingIEEE Journal of Selected Topics in Signal Processing, 2023
- Over-the-Air Split Learning with MIMO-Based Neural Network and Constellation-Based Activation2022
- Over-the-Air Federated Learning via Second-Order OptimizationIEEE Transactions on Wireless Communications, 2022
- An Overview on the Application of Graph Neural Networks in Wireless NetworksIEEE Open Journal of the Communications Society, 2021
- Learning Power Allocation for Multi-Cell-Multi-User Systems With Heterogeneous Graph Neural NetworksIEEE Transactions on Wireless Communications, 2021
- Heterogeneous Network Representation Learning: A Unified Framework With Survey and BenchmarkIEEE Transactions on Knowledge and Data Engineering, 2020
- Optimal Wireless Resource Allocation With Random Edge Graph Neural NetworksIEEE Transactions on Signal Processing, 2020
- Deep Learning Based Communication Over the AirIEEE Journal of Selected Topics in Signal Processing, 2017
- 1-bit stochastic gradient descent and its application to data-parallel distributed training of speech DNNs2014