Abstract
This chapter presents an algorithm for computing the PDF of the sum of two independent discrete random variables, along with an implementation of the algorithm in APPL. Some examples illustrate the utility of this algorithm.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abate J, Whitt W (1988) Transient behavior of the M∕M∕1 queue via Laplace transforms. Adv Appl Probab 20:145–178
Adlakha VG, Kulkarni VG (1989) A classified bibliography of research on stochastic PERT networks: 1966–1987. INFOR 27:272–296
Andrews DWK, Buchinsky M (2000) A three-step method for choosing the number of bootstrap repetitions. Econometrica 68:23–51
Andrews DWK, Buchinsky M (2002) On the number of bootstrap repetitions for BCa confidence intervals. Econometric Theory 18:962–984
Arnold BC, Balakrishnan N, Nagaraja HN (1992) A first course in order statistics. SIAM, Philadelphia
Balakrishnan N, Chen WWS (1997) CRC handbook of tables for order statistics from inverse Gaussian distributions with applications. CRC Press, Boca Raton
Banks J, Carson JS, Nelson BL, Nicol DM (2005) Discrete-event system simulation, 4th edn. Prentice-Hall, Upper Saddle River, New Jersey
Barr D, Zehna PW (1971) Probability. Brooks/Cole
Benford F (1938) The law of anomalous numbers. Proc Am Philos Soc 78: 551–572
Berger A, Hill, TP (2015) An introduction to Benford’s law. Princeton University Press, Princeton
Billingsley P (1995) Probability and measure, 3rd edn. Wiley, New York
Birnbaum ZW (1952) Numerical tabulation of the distribution of Kolomogorov’s statistic for finite sample size. J Am Stat Assoc 47:425–441
Box GEP, Jenkins GM (1994) Time series analysis: forecasting & control, 3rd edn. Prentice-Hall
Burr IW (1955) Calculation of exact sampling distribution of ranges from a discrete population. Ann Math Stat 26:530–532 (correction, volume 38, 280)
Carrano FM, Helman P, Veroff R (1998) Data abstraction and problem solving with C++: walls and mirrors, 2nd edn. Addison-Wesley Longman, Reading, Massachusetts
Casella G, Berger R (2002) Statistical inference, 2nd edn. Duxbury, Pacific Grove, California
Ciardo G, Leemis LM, Nicol D (1995) On the minimum of independent geometrically distributed random variables. Stat Probab Lett 23:313–326
Cook P, Broemeling LD (1995) Bayesian statistics using mathematica. Am Stat 49:70–76
D’Agostino RB, Stephens MA (1986) Goodness-of-fit techniques. Marcel Dekker, New York
David HA, Nagaraja HN (2003) Order statistics, 3rd edn. Wiley, New York
Devroye L (1996) Random variate generation in one line of code. In: Charnes J, Morrice D, Brunner D, Swain J (eds) Proceedings of the 1996 winter simulation conference. Institute of Electrical and Electronics Engineers, Coronado, CA, pp 265–272
Doss H, Chiang Y (1994) Choosing the resampling scheme when bootstrapping: a case study in reliability. J Am Stat Assoc 89:298–308
Drew JH, Glen AG, Leemis LM (2000) Computing the cumulative distribution function of the Kolmogorov–Smirnov statistic. Comput Stat Data Anal 34: 1–15
Duggan MJ, Drew JH, Leemis LM (2005) A test of randomness based on the distance between consecutive random number pairs. In: Kuhl ME, Steiger NM, Armstrong FB, Joines JA (eds) Proceedings of the 2005 winter simulation conference. Institute of Electrical and Electronics Engineers, Piscataway, New Jersey, pp 741–748
e Silva ES, Gail HR, Campos RV (1995) Calculating transient distributions of cumulative reward. In: Proceedings of the 1995 ACM SIGMETRICS joint international conference on measurement and modeling of computer systems, pp 231–240
Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman & Hall, New York
Elmaghraby SE (1977) Activity networks: project planning and control by network models. Wiley, New York
Evans DL, Leemis LM (2000) Input modeling using a computer algebra system. In: Joines J, Barton R, Fishwick P, Kang K. (eds) Proceedings of the 2000 winter simulation conference. Institute of Electrical and Electronics Engineers, Piscataway, New Jersey, pp 577–586
Evans DL, Leemis LM (2004) Algorithms for determining the distributions of sums of discrete random variables. Math Comput Modell 40:1429–1452
Evans DL, Leemis LM, Drew JH (2006) The distribution of order statistics for discrete random variables with applications to bootstrapping. INFORMS J Comput 18:19–30
Evans DL, Drew JH, Leemis, LM (2008) The distribution of the Kolmogorov–Smirnov, Cramer–von Mises, and Anderson–Darling test statistics for exponential populations with estimated parameters. Commun Stat–Simul Comput 37:1396–1421
Fisher DL, Saisi D, Goldstein WM (1985) Stochastic PERT networks: OP diagrams, critical paths and the project completion time. Comput Oper Res 12:471–482
Fishman GS (2001) Discrete-event simulation: modeling, programming, and analysis. Springer, Berlin
Gafarian AV, Ancker CJ Jr, Morisaku T (1976) The problem of the initial transient in digital computer simulation. In: Proceedings of the 76 bicentennial conference on winter simulation, pp 49–51
Gehan EA (1965) A generalized Wilcoxon test for comparing arbitrarily singly-censored samples. Biometrika 52(parts 1 and 2):203–223
Ghosal S, Ghosh JK, Ramamoorthi RV (1999) Consistency issues in Bayesian nonparametrics. In: Ghosh S (ed) Asymptotics, nonparametrics and time series: a tribute to Madan Lal Puri. Statistics textbooks and monographs, vol 158. Marcel Dekker, New York, pp 639–667
Glen AG, Drew JH, Leemis LM (1997) A generalized univariate change-of-variable transformation technique. INFORMS J Comput 9:288–295
Glen AG, Evans DL, Leemis LM (2001) APPL: a probability programming language. Am Stat 55:156–166
Glen AG, Leemis LM, Drew JH (2004) Computing the distribution of the product of two continuous random variables. Comput Stat Data Anal 44: 451–464
Grassmann WK (1977) Transient solutions in Markovian queueing systems. Comput Oper Res 4:47–53
Grassmann WK (2008) Warm-up periods in simulation can be detrimental. Probab Eng Inform Sci 22:415–429
Grinstead CM, Snell JL (1997) Introduction to probability, 2nd rev. edn. American Mathematical Society, Providence, Rhode Island
Hagwood C (2009) An application of the residue calculus: the distribution of the sum of nonhomogeneous gamma variates. Am Stat 63:37–39
Hamilton JD (1994) Time series analysis. Princeton University Press, Princeton
Harter HL, Balakrishnan N (1996) CRC handbook of tables for the use of order statistics in estimation. CRC Press, Boca Raton
Hasting KJ (2006) Introduction to the mathematics of operations research with mathematica, 2nd edn. CRC Press, Boca Raton
Hill TP (1995) A statistical derivation of the significant-digit law. Stat Sci 86:354–363
Hill TP (1998) The first digit phenomenon. Am Sci 86:358–363
Hillier FS, Lieberman GJ (2010) Introduction to operations research, 9th edn. McGraw–Hill, New York
Hogg RV, Craig AT (1995) Introduction to the mathematical statistics, 5th edn. Prentice-Hall, Upper Saddle River, New Jersey
Hogg RV, Tanis EA (2001) Probability and statistical inference, 6th edn. Prentice-Hall, Upper Saddle River, New Jersey
Hogg RV, McKean JW, Craig AT (2005) Introduction to the mathematical statistics, 6th edn. Prentice-Hall, Upper Saddle River, New Jersey
Hutson AD, Ernst MD (2000) The exact bootstrap mean and variance of an L-estimator. J R Stat Soc Ser B 62:89–94
Jaakkola TS, Jordan MI (2000) Bayesian parameter estimation via variational methods. Stat Comput 10:25–37
Johnson NL, Kotz S, Balakrishnan N (1995) Continuous univariate distributions, vol 2, 2nd ed. Wiley, New York
Kaczynski WH, Leemis LM, Drew JH (2012) Transient queueing analysis. INFORMS J Comput 24:10–28
Kalbfleisch JD, Prentice RL (2002) The statistical analysis of failure time data, 2nd edn. Wiley, Hoboken, New Jersey
Karian ZA, Tanis EA (1999) Probability and statistics: explorations with Maple, 2nd edn. Prentice-Hall, Upper Saddle River, New Jersey
Kelton WD (1985) Transient exponential-Erlang queues and steady-state simulation. Commun ACM 28:741–749
Kelton WD, Law AM (1985) The transient behavior of the M∕M∕s queue, with implications for steady-state simulation. Oper Res 33:378–396
Khoshkenara A, Mahloojia H. (2013) A new test of randomness for Lehmer generators based on the Manhattan Distance Between Pairs. Commun Stat–Simul Comput 42:202–214
Kleinrock L (1975) Queueing systems. Wiley, New York
Knuth DE (1998) The art of computer programming, volume 2: seminumerical algorithms, 3rd edn. Addison-Wesley, Reading, Massachusetts
Kossovsky AE (2015) Benford’s law: theory, the general law of relative quantities, and forensic fraud detection applications. World Scientific, Singapore
L’Écuyer P, Cordeau J-F, Simard R (2000) Close-point spatial tests and their application to random number generators. Oper Res 48:308–317
Law AM (1975) A comparison of two techniques for determining the accuracy of simulation output. Technical Report 75–11, University of Wisconsin at Madison
Laplante PA (ed) (2001) Dictionary of computer science, engineering and technology. CRC Press
Larsen RJ, Marx ML (2001) An introduction to mathematical statistics and its applications, 3rd edn. Prentice-Hall, Upper Saddle River, New Jersey
Larsen RJ, Marx ML (2006) An introduction to mathematical statistics and its applications, 4th edn. Prentice-Hall, Upper Saddle River, New Jersey
Law AM (2015) Simulation modeling and analysis, 5th edn. McGraw-Hill, New York
Lawless JF (2003) Statistical models and methods for lifetime data, 2nd edn. Wiley, Hoboken, New Jersey
Leemis L (1995) Reliability: probabilistic models and statistical methods. Prentice-Hall, Upper Saddle River, New Jersey
Leemis L (2006) Lower system reliability bounds from binary failure data using bootstrapping. J Qual Technol 38:2–13
Leemis L, Schmeiser B, Evans D (2000) Survival distributions satisfying Benford’s law. Am Stat 54:236–241
Leemis LM, Duggan MJ, Drew JH, Mallozzi JA, Connell KW (2006) Algorithms to calculate the distribution of the longest path length of a stochastic activity network with continuous activity durations. Networks 48:143–165
Leguesdron P, Pellaumail J, Rubino G, Sericola B (1993) Transient analysis of the M∕M∕1 queue. Adv Appl Probab 25:702–713
Lehmer DH (1951) Mathematical methods in large-scale computing units. In: Proceedings of the 2nd symposium on large-scale calculating machinery. Harvard University Press, pp 141–146
Ley E (1996) On the peculiar distribution of the U.S. stock indices digits. Am Stat 50:311–313
Lieblein J, Zelen M (1956) Statistical investigation of the fatigue life of deep-groove ball bearings. J Res Natl Bur Stand 57:273–316
Maplesoft (2013) Maple, Version 17. Waterloo
Margolin BH, Winokur HS (1967) Exact moments of the order statistics of the geometric distribution and their relation to inverse sampling and reliability of redundant systems. J Am Stat Assoc 62:915–925
Marks CE, Glen AG, Robinson MW, Leemis LM (2014) Applying bootstrap methods to system reliability. Am Stat 68:174–182
Marsaglia G (1968) Random numbers fall mainly in the planes. Proc Natl Acad Sci 61:25–28
Martin JJ (1965) Distribution of the time through a directed, acyclic network. Oper Res 13:44–66
Martin MA (1990) On bootstrap iteration for coverage correction in confidence intervals. J Am Stat Assoc 85:1105–1118
Meeker WQ, Escobar LA (1998) Statistical methods for reliability data. Wiley, New York
Miller LH (1956) Table of percentage points of Kolmogorov statistics. J Am Stat Assoc 51:111–121
Miller S (ed) (2015) Benford’s law: theory & applications. Princeton University Press, Princeton
Miller I, Miller M (2004) John E. Freund’s mathematical statistics, 7th edn. Prentice-Hall, Upper Saddle River, New Jersey
Morisaku T (1976) Techniques for data-truncation in digital computer simulation. Ph.D. thesis, University of Southern California, Los Angeles
Nelson BL, Yamnitsky M (1998) Input modeling tools for complex problems. In: Medeiros DJ, Watson EF, Carson JS, Manivannan, MS (eds) Proceedings of the 1998 winter simulation conference. Institute of Electrical and Electronics Engineers, pp 105–112
Nicol D (2000) Personal communication
Nigrini M (1996) A taxpayer compliance application of Benford’s law. J Am Taxat Assoc 18:72–91
Odoni AR, Roth E (1983) Empirical investigation of the transient behavior of stationary queueing systems. Oper Res 31:432–455
Owen DB (1962) Handbook of statistical tables. Addison-Wesley, Reading, Massachusetts
Padgett WJ, Tomlinson MA (2003) Lower confidence bounds for percentiles of Weibull and Birnbaum–Saunders distributions. J Stat Comput Simul 73: 429–443
Park SK, Miller KW (1988) Random number generators: good ones are hard to find. Commun ACM 31:1192–1201
Parlar M (2000) Interactive operations research with Maple. Birkhäuser, Boston
Parthasarathy PR (1987) A transient solution to an M∕M∕1 queue: a simple approach. Adv Appl Probab 19:997–998
Parzen E (1960) Modern probability theory and its applications. Wiley, New York
Pegden CD, Rosenshine M (1982) Some new results for the M∕M∕1 queue. Manage Sci 28:821–828
Port SC (1994) Theoretical probability for applications. Wiley
Rice JA (2007) Mathematical statistics and data analysis, 3rd edn. Thompson and Brooks/Cole, Belmont, California
Rohatgi VK (1976) An introduction to probability theory and mathematical statistics. Wiley, New York
Rose C, Smith MD (2002) Mathematical statistics and mathematica. Springer, New York
Ross S (2006) A first course in probability, 7th edn. Prentice Hall, Upper Saddle River, New Jersey
Ruskey F, Williams A (2008) Generating balanced parentheses and binary trees by prefix shifts. In: Proceedings of the 12th computing: the Australasian theory symposium (CATS2008), CRPIT, vol 77, pp 107–115
Shier DR (1991) Network reliability and algebraic structures. Oxford University Press, New York
Springer MD (1979) The algebra of random variables. Wiley, New York
Srivastava RC (1974) Two characterizations of the geometric distribution. J Am Stat Assoc 69:267–269
Stanley RP (1999) Enumerative combinatorics. Volume 62 of Cambridge studies in advanced mathematics. Cambridge University Press, Cambridge
Thompson P (2000) Getting normal probability approximations without using normal tables. College Math J 31:51–54
Trosset M (2001) Personal communication
Vargo E, Pasupathy R, Leemis L (2010) Moment-ratio diagrams for univariate distributions. J Qual Technol 42:276–286
Webb KH, Leemis LM (2014) Symbolic ARMA model analysis. Comput Econ 43:313–330
Weiss MA (1994) Data structures and algorithm analysis in C++. Addison-Wesley Publishing Company, Menlo Park, California
Weisstein EW (2016) “Generalized Hypergeometric Function” from MathWorld–A Wolfram Web Resource. http://mathworld.wolfram.com/GeneralizedHypergeometricFunction.html
Winston WL (2004) Operations research: applications and algorithms, 4th edn. Thompson, Belmont, California
Wolfram Research, Inc. (2013) Mathematica, Version 10, Champaign, IL
Woodward WA, Gray HL (1981) On the relationship between the S array and the Box–Jenkins method of ARMA model identification. J Am Stat Assoc 76:579–587
Woodward JA, Palmer CGS (1997) On the exact convolution of discrete random variables. Appl Math Comput 83:69–77
Yang JX, Drew JH, Leemis LM (2012) Automating bivariate transformations. INFORMS J Comput 24:1–9
Young DH (1970) The order statistics of the negative binomial distribution. Biometrika 57:181–186
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this chapter
Cite this chapter
Drew, J.H., Evans, D.L., Glen, A.G., Leemis, L.M. (2017). Sums of Independent Discrete Random Variables. In: Computational Probability. International Series in Operations Research & Management Science, vol 246. Springer, Cham. https://doi.org/10.1007/978-3-319-43323-3_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-43323-3_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-43321-9
Online ISBN: 978-3-319-43323-3
eBook Packages: Business and ManagementBusiness and Management (R0)