Skip to main content

The Exact and Near-Exact Distributions for the Statistic Used to Test the Reality of Covariance Matrix in a Complex Normal Distribution

  • Conference paper
  • First Online:
Applied and Computational Matrix Analysis (MAT-TRIAD 2015)

Part of the book series: Springer Proceedings in Mathematics & Statistics ((PROMS,volume 192))

Included in the following conference series:

Abstract

The authors start by approximating the exact distribution of the negative logarithm of the likelihood ratio statistic, used to test the reality of the covariance matrix in a certain complex multivariate normal distribution , by an infinite mixture of Generalized Near-Integer Gamma (GNIG) distributions. Based on this representation they develop a family of near-exact distributions for the likelihood ratio statistic, which are finite mixtures of GNIG distributions and match, by construction, some of the first exact moments. Using a proximity measure based on characteristic functions the authors illustrate the excellent properties of the near-exact distributions . They are very close to the exact distribution but far more manageable and have very good asymptotic properties both for increasing sample sizes as well as for increasing number of variables. These near-exact distributions are much more accurate than the asymptotic approximation considered, namely when the sample size is small and the number of variables involved is large. Furthermore, the corresponding cumulative distribution functions allow for an easy computation of very accurate near-exact quantiles.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Anderson, T.W.: An Introduction to Multivariate Statistical Analysis, 3rd edn. Wiley, New York (2003)

    MATH  Google Scholar 

  2. Berry, A.: The accuracy of the Gaussian approximation to the sum of independent variates. Trans. Am. Math. Soc. 49, 122–136 (1941)

    Article  MathSciNet  MATH  Google Scholar 

  3. Brillinger, D.R.: Time Series: Data Analysis and Theory. SIAM, Philadelphia (2001)

    Book  MATH  Google Scholar 

  4. Carter, E.M., Khatri, C.G., Srivastava, M.S.: Nonnull distribution of likelihood ratio criterion for reality of covariance matrix. J. Multivar. Anal. 6, 176–184 (1976)

    Article  MathSciNet  MATH  Google Scholar 

  5. Coelho, C.A.: The generalized integer gamma distribution - a basis for distributions in multivariate statistics. J. Multivar. Anal. 64, 86–102 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  6. Coelho, C.A.: The generalized near-integer gamma distribution: a basis for “near-exact” approximations to the distribution of statistics which are the product of an odd number of independent beta random variables. J. Multivar. Anal. 89, 191–218 (2004)

    Google Scholar 

  7. Coelho, C.A.: Near-exact distributions: What are they and why do we need them? In: Proceedings 59th ISI World Statistics Congress, 25–30 August 2013, Hong Kong (Session STS084), pp. 2879–2884 (2013)

    Google Scholar 

  8. Coelho, C.A., Marques, F.J.: Near-exact distributions for the likelihood ratio test statistic to test equality of several variance-covariance matrices in elliptically contoured distributions. Commun. Stat. Theory Methods 27, 627–659 (2012)

    MathSciNet  MATH  Google Scholar 

  9. Esseen, C.-G.: Fourier analysis of distribution functions. A mathematical study of the Laplace-Gaussian Law. Acta Mathematica 77, 1–125 (1945)

    Article  MathSciNet  MATH  Google Scholar 

  10. Gil-Pelaez, J.: Note on the inversion theorem. Biometrika 38, 481–482 (1951)

    Article  MathSciNet  MATH  Google Scholar 

  11. Goodman, N.R.: On the joint estimation of the spectra, cospectrum and quadrature spectrum of a two-dimensional stationary Gaussian process. Scientific Paper No. 10, Engineering Statistics Laboratory, New York University/Ph.D. Dissertation, Princeton University (1957)

    Google Scholar 

  12. Goodman, N.R.: Statistical analysis based on a certain multivariate complex Gaussian distribution (an introduction). Ann. Math. Stat. 34, 152–177 (1963)

    Article  MathSciNet  MATH  Google Scholar 

  13. Grilo, L.M.: Development of near-exact distributions for different scenarios of application of the Wilks Lambda statistic (in Portuguese). Ph.D. thesis, Lisbon University of Technology, Lisbon (2005)

    Google Scholar 

  14. Grilo, L.M., Coelho, C.A.: Development and comparative study of two near exact approximations to the distribution of the product of an odd number of independent beta random variables. J. Stat. Plan. Inference 137, 1560–1575 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  15. Grilo, L.M., Coelho, C.A.: Near-exact distributions for the generalized Wilks Lambda statistic. Discuss. Math. Probab. Stat. 30, 53–86 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  16. Grilo, L.M., Coelho, C.A.: The exact and near-exact distribution for the Wilks Lambda statistic used in the test of independence of two sets of variables. Am. J. Math. Manag. Sci. 30, 111–140 (2010)

    MathSciNet  MATH  Google Scholar 

  17. Grilo, L.M., Coelho, C.A.: A family of near-exact distributions based on truncations of the exact distribution for the generalized Wilks Lambda statistic. Commun. Stat. Theory Methods 41, 2321–2341 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  18. Grilo, L.M., Coelho, C.A.: Near-exact distributions for the likelihood ratio statistic used to test the reality of a covariance matrix. AIP Conf. Proc. 1558, 797–800 (2013)

    Article  Google Scholar 

  19. Hwang, H.-K.: On convergence rates in the central limit theorems for combinatorial structures. Eur. J. Comb. 19, 329–343 (1998)

    Article  MathSciNet  MATH  Google Scholar 

  20. James, A.T.: Distributions of matrix variates and latent roots derived from normal samples. Ann. Math. Stat. 35, 475–501 (1964)

    Article  MathSciNet  MATH  Google Scholar 

  21. Johnson, N.L., Kotz, S., Balakrishnan, N.: Continuous Univariate Distributions, vol. 2. Wiley, New York (1995)

    MATH  Google Scholar 

  22. Khatri, C.G.: Classical statistical analysis based on a certain multivariate complex Gaussian distribution. Ann. Math. Stat. 36, 98–114 (1965)

    Article  MathSciNet  MATH  Google Scholar 

  23. Khatri, C.G.: A test for reality of a covariance matrix in a certain complex Gaussian distribution. Ann. Math. Stat. 36, 115–119 (1965)

    Article  MathSciNet  MATH  Google Scholar 

  24. Marques, F.J., Coelho, C.A., Arnold, B.C.: A general near-exact distribution theory for the most common likelihood ratio test statistics used in multivariate analysis. TEST 20, 180–203 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  25. Tricomi, F.G., Erdélyi, A.: The asymptotic expansion of a ratio of gamma functions. Pac. J. Math. 1, 133–142 (1951)

    Article  MathSciNet  MATH  Google Scholar 

  26. Wald, A., Brookner, R.J.: On the distribution of Wilk’s statistic for testing the independence of several groups of variates. Ann. Math. Stat. 12, 137–152 (1941)

    Article  MathSciNet  MATH  Google Scholar 

  27. Wooding, R.A.: The multivariate distribution of complex normal variables. Biometrika 43, 212–215 (1956)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This work was partially supported by Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology) through project UID/MAT/00297/2013 (Centro de Matemática e Aplicações – CMA).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luís M. Grilo .

Editor information

Editors and Affiliations

Appendices

Appendix A

Derivation of the Measure \(\varDelta \) in (18) from the Gil–Pelaez Inversion Formula

The measure \(\varDelta \) in (18) may be directly derived from the Gil–Pelaez [10] inversion formula for the c.d.f., which may be written in a number of equivalent forms, as for example

$$ F_W(w)=\frac{1}{2}-\frac{1}{2\pi }\int _{-\infty }^{+\infty }\frac{e^{-\mathrm{i}tw}\,\varPhi _W(t)}{\mathrm{i}t}\,dt\,. $$

Then, if we take \(F_W(\,\cdot \,)\) and \(F^+_W(\,\cdot \,)\) as the c.d.f.’s corresponding to the cf.’s \(\varPhi _W(\,\cdot \,)\) and \(\varPhi _W^+(\,\cdot \,)\) respectively, we have

$$ \begin{array}{rcl} \left| F_W(w)-F_W^+(w)\right| &{} = &{} \displaystyle \frac{1}{2\pi }\left| \int _{-\infty }^{+\infty }\frac{e^{-\mathrm{i}tw}}{\mathrm{i}t}\left( \varPhi _W(t)^+-\varPhi _W(t)\right) \,dt\right| \\ &{} \le &{} \displaystyle \frac{1}{2\pi }\int _{-\infty }^{+\infty }\left| \frac{e^{-\mathrm{i}tw}}{\mathrm{i}t}\left( \varPhi _W(t)^+-\varPhi _W(t)\right) \right| \,dt \end{array}$$

where, for any \({t\in \mathbb {R}}\) and any \({w\in \mathbb {R}}\),

$$ \left| \frac{e^{-\mathrm{i}tw}}{\mathrm{i}}\right| =1\,, $$

so that we may write

$$ \sup _w \left| F_W(w)-F_W^+(w)\right| \le \frac{1}{2\pi }\int _{-\infty }^{+\infty }\left| \frac{\varPhi _W(t)-\varPhi ^+_W(t)}{t}\right| dt\,. $$

The measure \(\varDelta \) gives thus very sharp upper-bounds on the difference between the c.d.f.’s \(F_W(\,\cdot \,)\) and \(F_W^+(\,\cdot \,)\), indeed much sharper than any similar measure that would be based on the more common inversion formula for the c.d.f..

The measure \(\varDelta \) clearly verifies the triangular inequality since if we take

$$ \varDelta _1=\frac{1}{2\pi }\int _{-\infty }^{+\infty }\left| \frac{\varPhi _1(t)-\varPhi _2(t)}{t}\right| dt\,,~~~~~~~~\varDelta _2=\frac{1}{2\pi }\int _{-\infty }^{+\infty }\left| \frac{\varPhi _1(t)-\varPhi _3(t)}{t}\right| dt $$

and

$$ \varDelta _3=\frac{1}{2\pi }\int _{-\infty }^{+\infty }\left| \frac{\varPhi _2(t)-\varPhi _3(t)}{t}\right| dt $$

we have \({\varDelta _1\le \varDelta _2+\varDelta _3}\) since

$$ \begin{array}{rcl} \displaystyle \left| \varPhi _1(t)-\varPhi _2(t)\right| &{} = &{} \displaystyle \left| \varPhi _1(t)-\varPhi _3(t)+\varPhi _3(t)-\varPhi _2(t)\right| \\ &{} \le &{} \displaystyle \left| \varPhi _1(t)-\varPhi _3(t)\right| +\left| \varPhi _3(t)-\varPhi _2(t)\right| \end{array}$$

and, in a similar manner, also \(\varDelta _2\le \varDelta _1+\varDelta _3\) and \(\varDelta _3\le \varDelta _1+\varDelta _2\).

Appendix B

Median, 0.95 and 0.99 Quantiles for the Statistic \(\varLambda \)

Table B.1 Median (0.5 quantile) for \(\varLambda \) for \({p=6}\) \({(n=6,7,8,9,10)}\), \({p=35}\) \({(n=36,70,105)}\) and \({p=55}\) \({(n=56,110,165)}\), for the near-exact distributions that match \(m^*=2,4,6\) and 10 exact moments
Table B.2 0.95 quantiles for \(\varLambda \) for \({p=6}\) \({(n=6,7,8,9,10)}\), \({p=35}\) \({(n=36,70,105)}\) and \({p=55}\) \({(n=56,110,165)}\), for the near-exact distributions that match \(m^*=2,4,6\) and 10 exact moments
Table B.3 0.99 quantiles for \(\varLambda \) for \({p=6}\) \({(n=6,7,8,9,10)}\), \({p=35}\) \({(n=36,70,105)}\) and \({p=55}\) \({(n=56,110,165)}\), for the near-exact distributions that match \(m^*=2,4,6\) and 10 exact moments

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Grilo, L.M., Coelho, C.A. (2017). The Exact and Near-Exact Distributions for the Statistic Used to Test the Reality of Covariance Matrix in a Complex Normal Distribution. In: Bebiano, N. (eds) Applied and Computational Matrix Analysis. MAT-TRIAD 2015. Springer Proceedings in Mathematics & Statistics, vol 192. Springer, Cham. https://doi.org/10.1007/978-3-319-49984-0_20

Download citation

Publish with us

Policies and ethics