Abstract
For arbitrary Borel probability measures with compact support on the real line, characterizations are established of the best finitely supported approximations, relative to three familiar probability metrics (Lévy, Kantorovich, and Kolmogorov), given any number of atoms, and allowing for additional constraints regarding weights or positions of atoms. As an application, best (constrained or unconstrained) approximations are identified for Benford’s Law (logarithmic distribution of significands) and other familiar distributions. The results complement and extend known facts in the literature; they also provide new rigorous benchmarks against which to evaluate empirical observations regarding Benford’s law.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Allaart, P.C.: An invariant-sum characterization of Benford’s law. J. Appl. Probab. 34, 288–291 (1997)
Benford, F.: The law of anomalous numbers. Proc. Am. Philos. Soc. 78, 551–572 (1938)
Berger, A., Hill, T.P.: Benfords law strikes back: no simple explanation in sight for mathematical gem. Math. Intell. 33, 85–91 (2011)
Berger, A., Hill, T.P.: An Introduction to Benford’s Law. Princeton University Press, Princeton (2015)
Berger, A., Hill, T.P., Morrison, K.E.: Scale-distortion inequalities for mantissas of finite data sets. J. Theoret. Probab. 21, 97–117 (2008)
Berger, A., Hill, T.P., Rogers, E.: Benford Online Bibliography. http://www.benfordonline.net (2009). Accessed 16 March 2018
Berger, A., Twelves, I.: On the significands of uniform random variables, to appear in: J. Appl. Probab. (2018)
Bloch, I., Atif, J.: Defining and computing Hausdorff distances between distributions on the real line and on the circle: link between optimal transport and morphological dilations. Math. Morphol. Theory Appl. 1, 79–99 (2016)
Dereich, S., Vormoor, C.: The high resolution vector quantization problem with Orlicz norm distortion. J. Theoret. Probab. 24, 517–544 (2011)
Diaconis, P.: The distribution of leading digits and uniform distribution \({\rm mod}\) \(1\). Ann. Probab. 5, 72–81 (1977)
Dudley, R.: Real Analysis and Probability. Wadsworth & Brooks/Cole Advanced Books & Software, Pacific Grove (2004)
Dümbgen, L., Leuenberger, C.: Explicit bounds for the approximation error in Benford’s law. Elect. Commun. Probab. 13, 99–112 (2008)
Feller, W.: An Introduction to Probability Theory and Its Applications, vol. II. Wiley, New York (1966)
Gauvrit, N., Delahaye, J.-P.: Scatter and regularity imply Benford’s law... and more. In: Zenil, H. (ed.) Randomness Through Complexity, pp. 53–69. World Scientific, Singapore (2011)
Gibbs, A.L., Su, F.E.: On choosing and bounding probability metrics. Int. Stat. Rev. 70, 419–435 (2002)
Graf, S., Luschgy, H.: Foundations of Quantization for Probability Distributions. Lecture Notes in Mathematics, vol. 1730. Springer, Berlin (2000)
Graf, S., Luschgy, H.: Quantization for probability measures in the Prokhorov metric. Theory Probab. Appl. 53, 216–241 (2009)
Hill, T.P.: A statistical derivation of the significant-digit law. Stat. Sci. 10, 354–363 (1995)
Hill, T.P.: Base-invariance implies Benford’s law. Proc. Am. Math. Soc. 123, 887–895 (1995)
Knuth, D.E.: The Art of Computer Programming. Addison-Wesley, Reading (1975)
Miller, S.J.: Benford’s Law: Theory and Applications. Princeton University Press, Princeton (2015)
Mori, Y., Takashima, K.: On the distribution of the leading digit of \(a^n\): a study via \(\chi ^2\) statistics. Period. Math. Hung. 73, 224–239 (2016)
Newcomb, S.: Note on the frequency of use of the different digits in natural numbers. Am. J. Math. 4, 39–40 (1881)
Pflug, G.C., Pichler, A.: Approximations for probability distributions and stochastic optimization problems, Int. Ser. Oper. Res. Manage. Sci. 1633, Springer, New York, 343–387 (2011)
Pinkham, R.S.: On the distribution of first significant digits. Ann. Math. Statist. 32, 1223–1230 (1961)
Rachev, S.T.: Probability Metrics and the Stability of Stochastic Models. Wiley, New York (1991)
Rachev, S.T., Klebanov, L.B., Stoyanov, S.V., Fabozzi, F.J.: A structural classification of probability distances. In: The Methods of Distances in the Theory of Probability and Statistics. Springer, New York (2013)
Raimi, R.A.: The first digit problem. Am. Math. Mon. 83, 521–538 (1976)
Schatte, P.: On mantissa distributions in computing and Benford’s law. J. Inform. Process. Cybernet. 24, 443–455 (1988)
Xu, C., Berger, A.: Best finite constrained approximations of one-dimensional probabilities, preprint (2017). arXiv:1704.07871
Acknowledgements
The first author was partially supported by an Nserc Discovery Grant. Both authors gratefully acknowledge helpful suggestions made by F. Dai, B. Han, T.P. Hill, and an anonymous referee.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Berger, A., Xu, C. Best Finite Approximations of Benford’s Law. J Theor Probab 32, 1525–1553 (2019). https://doi.org/10.1007/s10959-018-0827-z
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10959-018-0827-z
Keywords
- Benford’s law
- Best uniform approximation
- Asymptotically best approximation
- Lévy distance
- Kantorovich distance
- Kolmogorov distance