Optimal and fast detection of spatial clusters with scan statistics
Author:
Open Access
- 1 April 2010
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 38 (2) , 1010-1033
Abstract
We consider the detection of multivariate spatial clusters in the Bernoulli model with N locations, where the design distribution has weakly dependent marginals. The locations are scanned with a rectangular window with sides parallel to the axes and with varying sizes and aspect ratios. Multivariate scan statistics pose a statistical problem due to the multiple testing over many scan windows, as well as a computational problem because statistics have to be evaluated on many windows. This paper introduces methodology that leads to both statistically optimal inference and computationally efficient algorithms. The main difference to the traditional calibration of scan statistics is the concept of grouping scan windows according to their sizes, and then applying different critical values to different groups. It is shown that this calibration of the scan statistic results in optimal inference for spatial clusters on both small scales and on large scales, as well as in the case where the cluster lives on one of the marginals. Methodology is introduced that allows for an efficient approximation of the set of all rectangles while still guaranteeing the statistical optimality results described above. It is shown that the resulting scan statistic has a computational complexity that is almost linear in N.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- Multiscale inference about a densityThe Annals of Statistics, 2008
- Multiscale Testing of Qualitative HypothesesThe Annals of Statistics, 2001
- Asymptotically exact nonparametric hypothesis testing in sup-norm and at a fixed pointProbability Theory and Related Fields, 2000
- On the Distributions of Scan Statistics of a Two-Dimensional Poisson ProcessAdvances in Applied Probability, 1997
- A spatial scan statisticCommunications in Statistics - Theory and Methods, 1997
- Some Methods for Investigating Spatial Clustering, with Epidemiological ApplicationsJournal of the Royal Statistical Society Series A: Statistics in Society, 1997
- Two-dimensional discrete scan statisticsStatistics & Probability Letters, 1996
- Large-deviation approximations to the distribution of scan statisticsAdvances in Applied Probability, 1991
- Clustering of Random Points in Two DimensionsBiometrika, 1965
- Probability Inequalities for Sums of Bounded Random VariablesJournal of the American Statistical Association, 1963