Ada-LISTA: Learned Solvers Adaptive to Varying Models
- 4 November 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 44 (12) , 9222-9235
Abstract
Neural networks that are based on the unfolding of iterative solvers as LISTA (Learned Iterative Soft Shrinkage), are widely used due to their accelerated performance. These networks, trained with a fixed dictionary, are inapplicable in varying model scenarios, as opposed to their flexible non-learned counterparts. We introduce, Ada-LISTA, an adaptive learned solver which receives as input both the signal and its corresponding dictionary, and learns a universal architecture to serve them all. This scheme allows solving sparse coding in linear rate, under varying models, including permutations and perturbations of the dictionary. We provide an extensive theoretical and numerical study, demonstrating the adaptation capabilities of our approach, and its application to the task of natural image inpainting.Keywords
All Related Versions
Funding Information
- Israel Science Foundation (335/18)
- Technion Hiroshi Fujiwara Cyber Security Research Center
- Israel Cyber Bureau
This publication has 22 references indexed in Scilit:
- Deep Networks for Image Super-Resolution with Sparse Prior2015
- Learning Efficient Sparse and Low Rank ModelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Non-blind image deblurring method by local and nonlocal total variation modelsSignal Processing, 2014
- Online detection of unusual events in videos via dynamic sparse coding2011
- From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and ImagesSIAM Review, 2009
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- Image Sequence Denoising via Sparse and Redundant RepresentationsIEEE Transactions on Image Processing, 2008
- Signal Recovery by Proximal Forward-Backward SplittingMultiscale Modeling & Simulation, 2005
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraintCommunications on Pure and Applied Mathematics, 2004
- Atomic Decomposition by Basis PursuitSIAM Review, 2001