Untrained Graph Neural Networks for Denoising
- 23 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Signal Processing
- Vol. 70 (1053587X) , 5708-5723
Abstract
A fundamental problem in signal processing is to denoise a signal. While there are many well-performing methods for denoising signals defined on regular domains, including images defined on a two-dimensional pixel grid, many important classes of signals are defined over irregular domains that can be conveniently represented by a graph. This paper introduces two untrained graph neural network architectures for graph signal denoising, develops theoretical guarantees for their denoising capabilities in a simple setup, and provides empirical evidence in more general scenarios. The two architectures differ on how they incorporate the information encoded in the graph, with one relying on graph convolutions and the other employing graph upsampling operators based on hierarchical clustering. Each architecture implements a different prior over the targeted signals. Finally, we provide numerical experiments with synthetic and real datasets that i) asses the denoising behavior predicted by our theoretical results and ii) compare the denoising performance of our architectures with that of existing alternatives.Keywords
All Related Versions
Funding Information
- Spanish AEI (PID2019-105032GB-I00/AEI/10.13039/501100011033, FPU17/04520, EST21/00420, F661-MAPPING-UCI CAM-URJC, F663-AAGNCS CAM-URJC, F861 AUTO-BA-GRAPH CAM-URJC)
- National Science Foundation (CCF-2008555)
- Institute of Advanced Studies at the Technical University of Munich
- Deutsche Forschungsgemeinschaft (456465471, 464123524)
This publication has 43 references indexed in Scilit:
- Graph Signal Denoising via Trilateral Filter on Graph Spectral DomainIEEE Transactions on Signal and Information Processing over Networks, 2016
- Discrete Signal Processing on Graphs: Sampling TheoryIEEE Transactions on Signal Processing, 2015
- Total generalized variation for graph signals2015
- Discrete Signal Processing on Graphs: Frequency AnalysisIEEE Transactions on Signal Processing, 2014
- A useful variant of the Davis–Kahan theorem for statisticiansBiometrika, 2014
- The Graph Neural Network ModelIEEE Transactions on Neural Networks, 2008
- Growing scale-free networks with tunable clusteringPhysical Review E, 2002
- Networks, Dynamics, and the Small‐World PhenomenonAmerican Journal of Sociology, 1999
- Collective dynamics of ‘small-world’ networksNature, 1998
- An Information Flow Model for Conflict and Fission in Small GroupsJournal of Anthropological Research, 1977