Non-Convex Exact Community Recovery in Stochastic Block Model
Authors:
- Zirui ZhouZZZirui Zhou
- Anthony Man-Cho SoASAnthony Man-Cho So
Preprint
Abstract
Learning community structures in graphs that are randomly generated by stochastic block models (SBMs) has received much attention lately. In this paper, we focus on the problem of exactly recovering the communities in a binary symmetric SBM, where a graph of $n$ vertices is partitioned into two equal-sized communities and the vertices are connected with probability $p = \alpha\log(n)/n$ within communities and $q = \beta\log(n)/n$ across communities for some $\alpha>\beta>0$. We propose a two-stage iterative algorithm for solving this problem, which employs the power method with a random starting point in the first stage and turns to a generalized power method that can identify the communities in a finite number of iterations in the second stage. It is shown that for any fixed $\alpha$ and $\beta$ such that $\sqrt{\alpha} - \sqrt{\beta} > \sqrt{2}$, which is known to be the information-theoretic limit for exact recovery, the proposed algorithm exactly identifies the underlying communities in $\tilde{O}(n)$ running time with probability tending to one as $n\rightarrow\infty$. As far as we know, this is the first algorithm with nearly-linear running time that achieves exact recovery at the information-theoretic limit. We also present numerical results of the proposed algorithm to support and complement our theoretical development.
Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Global rates of convergence for nonconvex optimization on manifoldsIMA Journal of Numerical Analysis, 2018
- Random Laplacian Matrices and Convex RelaxationsFoundations of Computational Mathematics, 2016
- Achieving Exact Cluster Recovery Threshold via Semidefinite ProgrammingIEEE Transactions on Information Theory, 2016
- Exact Recovery in the Stochastic Block ModelIEEE Transactions on Information Theory, 2015
- Consistency of spectral clustering in stochastic block modelsThe Annals of Statistics, 2015
- Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applicationsPhysical Review E, 2011
- Integration of biological networks and gene expression data using CytoscapeNature Protocols, 2007
- Finding and evaluating community structure in networksPhysical Review E, 2004
- A nonlinear programming algorithm for solving semidefinite programs via low-rank factorizationMathematical Programming, 2003
- Estimating the Largest Eigenvalue by the Power and Lanczos Algorithms with a Random StartSIAM Journal on Matrix Analysis and Applications, 1992