Qi-Man Shao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Qi-Man Shao has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Wen-Xin Zhou
College of Business Administration, University of Illinois Chicago, Chicago, Illinois 60607
3 shared publications - Louis H. Y. Chen
Department of Mathematics National University of Singapore 10 Lower Kent Ridge Road 119076 Singapore
2 shared publications - Xiao Fang
National University of Singapore
2 shared publications - Jianqing Fan
Department of Operations Research and Financial Engineering, Princeton University, Princeton, New Jersey 08544
1 shared publication Kan Zhang
Hong Kong Univ Sci & Technol, Dept Math, Kowloon, Hong Kong, Peoples R China
1 shared publication- Mengchen Zhang
Department of Computer Science and Engineering, Hong Kong University of Science and Technology Department of Electronic and Computer Engineering, 191607 Kowloon, Hong Kong Hong Kong
1 shared publication
Latest Publications
- Open Access
Cramér-type Moderate Deviation Theorems for Nonnormal Approximation
A Cram\'er-type moderate deviation theorem quantifies the relative error of the tail probability approximation. It provides theoretical justification when the limiting tail probability can be used to estimate the tail probability under study. Chen Fang and Shao (2013) obtained a general Cram\'er-type moderate result using Stein's method when the limiting was a normal distribution. In this paper, Cram\'er-type moderate deviation theorems are established for nonnormal approximation under a general Stein identity, which is satisfied via the exchangeable pair approach and Stein's coupling. In particular, a Cram\'er-type moderate deviation theorem is obtained for the general Curie--Weiss model and the imitative monomer-dimer mean-field model.
Open AccessCramér-type Moderate Deviation Theorems for Nonnormal Approximation
A Cram\'er-type moderate deviation theorem quantifies the relative error of the tail probability approximation. It provides theoretical justification when the limiting tail probability can be used to estimate the tail probability under study. Chen Fang and Shao (2013) obtained a general Cram\'er-type moderate result using Stein's method when the limiting was a normal distribution. In this paper, Cram\'er-type moderate deviation theorems are established for nonnormal approximation under a general Stein identity, which is satisfied via the exchangeable pair approach and Stein's coupling. In particular, a Cram\'er-type moderate deviation theorem is obtained for the general Curie--Weiss model and the imitative monomer-dimer mean-field model.
- 1 June 2018
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 46 (3) , 989-1017
Are discoveries spurious? Distributions of maximum spurious correlations and their applications
Over the last two decades, many exciting variable selection methods have been developed for finding a small group of covariates that are associated with the response from a large pool. Can the discoveries from these data mining approaches be spurious due to high dimensionality and limited sample size? Can our fundamental assumptions about the exogeneity of the covariates needed for such variable selection be validated with the data? To answer these questions, we need to derive the distributions of the maximum spurious correlations given a certain number of predictors, namely, the distribution of the correlation of a response variable $Y$ with the best $s$ linear combinations of $p$ covariates $\mathbf{X}$, even when $\mathbf{X}$ and $Y$ are independent. When the covariance matrix of $\mathbf{X}$ possesses the restricted eigenvalue property, we derive such distributions for both a finite $s$ and a diverging $s$, using Gaussian approximation and empirical process techniques. However, such a distribution depends on the unknown covariance matrix of $\mathbf{X}$. Hence, we use the multiplier bootstrap procedure to approximate the unknown distributions and establish the consistency of such a simple bootstrap approach. The results are further extended to the situation where the residuals are from regularized fits. Our approach is then used to construct the upper confidence limit for the maximum spurious correlation and to test the exogeneity of the covariates. The former provides a baseline for guarding against false discoveries and the latter tests whether our fundamental assumptions for high-dimensional model selection are statistically valid. Our techniques and results are illustrated with both numerical examples and real data analysis.- 1 June 2018
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 46 (3) , 989-1017
Are discoveries spurious? Distributions of maximum spurious correlations and their applications
Over the last two decades, many exciting variable selection methods have been developed for finding a small group of covariates that are associated with the response from a large pool. Can the discoveries from these data mining approaches be spurious due to high dimensionality and limited sample size? Can our fundamental assumptions about the exogeneity of the covariates needed for such variable selection be validated with the data? To answer these questions, we need to derive the distributions of the maximum spurious correlations given a certain number of predictors, namely, the distribution of the correlation of a response variable $Y$ with the best $s$ linear combinations of $p$ covariates $\mathbf{X}$, even when $\mathbf{X}$ and $Y$ are independent. When the covariance matrix of $\mathbf{X}$ possesses the restricted eigenvalue property, we derive such distributions for both a finite $s$ and a diverging $s$, using Gaussian approximation and empirical process techniques. However, such a distribution depends on the unknown covariance matrix of $\mathbf{X}$. Hence, we use the multiplier bootstrap procedure to approximate the unknown distributions and establish the consistency of such a simple bootstrap approach. The results are further extended to the situation where the residuals are from regularized fits. Our approach is then used to construct the upper confidence limit for the maximum spurious correlation and to test the exogeneity of the covariates. The former provides a baseline for guarding against false discoveries and the latter tests whether our fundamental assumptions for high-dimensional model selection are statistically valid. Our techniques and results are illustrated with both numerical examples and real data analysis.- Open Access
Berry-Esseen Bounds of Normal and Non-normal Approximation for Unbounded Exchangeable Pairs
An exchangeable pair approach is commonly taken in the normal and non-normal approximation using Stein's method. It has been successfully used to identify the limiting distribution and provide an error of approximation. However, when the difference of the exchangeable pair is not bounded by a small deterministic constant, the error bound is often not optimal. In this paper, using the exchangeable pair approach of Stein's method, a new Berry-Esseen bound for an arbitrary random variable is established without a bound on the difference of the exchangeable pair. An optimal convergence rate for normal and non-normal approximation is achieved when the result is applied to various examples including the quadratic forms, general Curie-Weiss model, mean field Heisenberg model and colored graph model.
Open AccessBerry-Esseen Bounds of Normal and Non-normal Approximation for Unbounded Exchangeable Pairs
An exchangeable pair approach is commonly taken in the normal and non-normal approximation using Stein's method. It has been successfully used to identify the limiting distribution and provide an error of approximation. However, when the difference of the exchangeable pair is not bounded by a small deterministic constant, the error bound is often not optimal. In this paper, using the exchangeable pair approach of Stein's method, a new Berry-Esseen bound for an arbitrary random variable is established without a bound on the difference of the exchangeable pair. An optimal convergence rate for normal and non-normal approximation is achieved when the result is applied to various examples including the quadratic forms, general Curie-Weiss model, mean field Heisenberg model and colored graph model.
- 7 September 2017
- Published by Springer Nature in Applied Mathematics-A Journal of Chinese Universities
- Vol. 32 (3) , 253-269
Self-normalization: Taming a wild population in a heavy-tailed world
- 7 September 2017
- Published by Springer Nature in Applied Mathematics-A Journal of Chinese Universities
- Vol. 32 (3) , 253-269
Self-normalization: Taming a wild population in a heavy-tailed world
- 1 January 2016
- Published by Elsevier in Journal of Statistical Planning and Inference
- Vol. 168, 68-89
Stein’s method for nonlinear statistics: A brief survey and recent progress
- 1 January 2016
- Published by Elsevier in Journal of Statistical Planning and Inference
- Vol. 168, 68-89
Stein’s method for nonlinear statistics: A brief survey and recent progress
- 1 January 2014
- Published by Statistica Sinica (Institute of Statistical Science) in Statistica Sinica
- Vol. 23 (4) , 1523-1540
Moderate deviations in Poisson approximation: a first attempt
- 1 January 2014
- Published by Statistica Sinica (Institute of Statistical Science) in Statistica Sinica
- Vol. 23 (4) , 1523-1540
Moderate deviations in Poisson approximation: a first attempt
- Open Access
Moderate deviations in Poisson approximation: a first attempt
Poisson approximation using Stein's method has been extensively studied in the literature. The main focus has been on bounding the total variation distance. This paper is a first attempt on moderate deviations in Poisson approximation for right-tail probabilities of sums of dependent indicators. We obtain results under certain general conditions for local dependence as well as for size-bias coupling. These results are then applied to independent indicators, 2-runs, and the matching problem.
Open AccessModerate deviations in Poisson approximation: a first attempt
Poisson approximation using Stein's method has been extensively studied in the literature. The main focus has been on bounding the total variation distance. This paper is a first attempt on moderate deviations in Poisson approximation for right-tail probabilities of sums of dependent indicators. We obtain results under certain general conditions for local dependence as well as for size-bias coupling. These results are then applied to independent indicators, 2-runs, and the matching problem.