Graph U-Nets
Top Cited Papers
- 17 May 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 44 (01628828) , 1
Abstract
We consider the problem of representation learning for graph data. Given images are special cases of graphs with nodes lie on 2D lattices, graph embedding tasks have a natural correspondence with image pixel-wise prediction tasks such as segmentation. While encoder-decoder architectures like U-Nets have been successfully applied to image pixel-wise prediction tasks, similar methods are lacking for graph data. This is because pooling and up-sampling operations are not natural on graph data. To address these challenges, we propose novel graph pooling and unpooling operations. The gPool layer adaptively selects some nodes to form a smaller graph based on their scalar projection values. We further propose the gUnpool layer as the inverse operation of the gPool layer. Based on our proposed methods, we develop an encoder-decoder model, known as the graph U-Nets. Experimental results on node classification and graph classification tasks demonstrate that our methods achieve consistently better performance than previous models. Along this direction, we extend our methods by integrating attention mechanisms. Based on attention operators, we proposed attention-based pooling and unpooling layers, which can better capture graph topology information. The empirical results on graph classification tasks demonstrate the promising capability of our methods.Keywords
Funding Information
- Division of Information and Intelligent Systems (IIS-1908166 and IIS-1908198)
This publication has 30 references indexed in Scilit:
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Subsampling for graph power spectrum estimation2016
- Fully convolutional networks for semantic segmentation2015
- Effective Approaches to Attention-based Neural Machine Translation2015
- DeepWalk2014
- A Convolutional Neural Network for Modelling Sentences2014
- Efficient BackProp2012
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008
- Protein function prediction via graph kernelsBioinformatics, 2005
- Distinguishing Enzyme Structures from Non-enzymes Without AlignmentsJournal of Molecular Biology, 2003