Abstract
Most existing diffusion-based estimation algorithms require the explicit expression of the cost function in order to evaluate the stochastic gradient. In this work, we first discuss the zeroth-order (ZO) gradient for diffusion strategies, and present the ZO-diffusion algorithm that is suitable for applications where the explicit expression of the cost function is unavailable. In addition, to improve the convergence rate of the ZO-diffusion algorithm, we introduce a time-averaging stochastic variance reduced gradient (TA-SVRG) strategy, which is a variant of SVRG algorithm and designed to address online learning problems, and propose a ZO-TA-SVRG diffusion algorithm. Then, we analyze the mean and mean-square stability of the proposed ZO-TA-SVRG diffusion algorithm. Finally, simulation results are provided that demonstrate the performance and effectiveness of the proposed algorithms.
Funding Information
  • National Key Research and Development Program of China Stem Cell and Translational Research (2018AAA0102200)
  • National Natural Science Foundation of China (61671382, 61811530283, 61901318)
  • Higher Education Discipline Innovation Project (B18041)
  • Natural Science Foundation of Jiangsu Province (BK20191419)
  • Northwestern Polytechnical University

This publication has 36 references indexed in Scilit: