On Statistical Tests for Randomness Included in the NIST SP800-22 Test Suite and Based on the Binomial Distribution
- 23 January 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 7 (2) , 491-505
Abstract
In this paper we review some statistical tests included in the NIST SP 800-22 suite, which is a collection of tests for the evaluation of both true-random (physical) and pseudorandom (algorithmic) number generators for cryptographic applications. The output of these tests is the so-called p-value which is a random variable whose distribution converges to the uniform distribution in the interval [0,1] when testing an increasing number of samples from an ideal generator. Here, we compute the exact non-asymptotic distribution of p-values produced by few of the tests in the suite, and propose some computation-friendly approximations. This allows us to explain why intensive testing produces false-positives with a probability much higher than the expected one when considering asymptotic distribution instead of the true one. We also propose a new approximation for the Spectral Test reference distribution, which is more coherent with experimental results.Keywords
This publication has 14 references indexed in Scilit:
- Computing the Two-Sided Kolmogorov-Smirnov DistributionJournal of Statistical Software, 2011
- Implementation and Testing of High-Speed CMOS True Random Number Generators Based on Chaotic SystemsIEEE Transactions on Circuits and Systems I: Regular Papers, 2010
- TestU01ACM Transactions on Mathematical Software, 2007
- Second-level NIST Randomness Tests for Improving Test Reliability2007
- About Polynomial-Ttime "Unpredictable" Generators2005
- The Distribution of the Spectrum for the Discrete Fourier Transform Test Included in SP800-22IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2005
- P Values as Random Variables—Expected P ValuesThe American Statistician, 1999
- P Values: What They Are and What They Are NotThe American Statistician, 1996
- A Simple Unpredictable Pseudo-Random Number GeneratorSIAM Journal on Computing, 1986
- P-Values: Interpretation and MethodologyThe American Statistician, 1975