Abstract
Sparse modeling for signal processing and machine learning, in general, has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning (SAL) consists of two major paths paved by 1) discriminative methods that establish direct input–output mapping based on a regularized cost function optimization and 2) generative methods that learn the underlying distributions. The latter, more widely known as Bayesian methods , enable uncertainty evaluation with respect to the performed predictions. Furthermore, they can better exploit related prior information and also, in principle, can naturally introduce robustness into the model, due to their unique capacity to marginalize out uncertainties related to the parameter estimates. Moreover, hyperparameters (tuning parameters) associated with the adopted priors, which correspond to cost function regularizers, can be learned via the training data and not via costly cross-validation techniques, which is, in general, the case with the discriminative methods.
Funding Information
  • National Natural Science Foundation of China (62001309)
  • Science and Technology on Sonar Laboratory (6142109KF212204)
  • National Natural Science Foundation of China (62271433)
  • Shenzhen Science and Technology Program (JCYJ20190813171003723)
  • National Natural Science Foundation of China (62071409, 61731018)
  • European Union’s Horizon 2020 Research and Innovation Program (872139)

This publication has 54 references indexed in Scilit: