Algorithm for error-free determination of the variance of all contiguous subsequences and fixed-length contiguous subsequences for a sequence of industrial measurement data
Open Access
- 19 March 2021
- journal article
- research article
- Published by Springer Nature in Computational Statistics
- Vol. 36 (4) , 2813-2840
Abstract
The article presents an algorithm for fast and error-free determination of statistics such as the arithmetic mean and variance of all contiguous subsequences and fixed-length contiguous subsequences for a sequence of industrial measurement data. Additionally, it shows that both floating-point and integer representation can be used to perform this kind of statistical calculations. The author proves a theorem on the number of bits of precision that an arithmetic type must have to guarantee error-free determination of the arithmetic mean and variance. The article also presents the extension of Welford’s formula for determining variance for the sliding window method—determining the variance of fixed-length contiguous subsequences. The section dedicated to implementation tests shows the running times of individual algorithms depending on the arithmetic type used. The research shows that the use of integers in calculations makes the determination of the aforementioned statistics much faster.Keywords
This publication has 35 references indexed in Scilit:
- Updating mean and variance estimatesCommunications of the ACM, 1979
- Computing standard deviationsCommunications of the ACM, 1979
- Remark on stably updating mean and standard deviation of dataCommunications of the ACM, 1975
- Stably updating mean and standard deviation of dataCommunications of the ACM, 1975
- Comparison of Several Algorithms for Computing Sample Means and VariancesJournal of the American Statistical Association, 1974
- Some Results Relevant to Choice of Sum and Sum-of-Product AlgorithmsTechnometrics, 1971
- Letters to the editor: Dealing with Neely's algorithmsCommunications of the ACM, 1968
- Error-free methods for statistical computationsCommunications of the ACM, 1967
- Comparison of several algorithms for computation of means, standard deviations and correlation coefficientsCommunications of the ACM, 1966
- Condensed Calculations for Evolutionary Operation ProgramsTechnometrics, 1959