Skip to main content

On Robust Gaussian Graphical Modeling

  • Chapter

Abstract

The objective of this exposition is to give an overview of the existing approaches to robust Gaussian graphical modeling. We start by thoroughly introducing Gaussian graphical models (also known as covariance selection models or concentration graph models) and then review the established, likelihood-based statistical theory (estimation, testing and model selection). Afterwards we describe robust methods and compare them to the classical approaches.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Baba, K., Shibata, R., Sibuya, M.: Partial correlation and conditional correlation as measures of conditional independence. Aust. N. Z. J. Stat. 46(4), 657–664 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  • Becker, C.: Iterative proportional scaling based on a robust start estimator. In: Weihs, C., Gaul, W. (eds.) Classification—The Ubiquitous Challenge, pp. 248–255. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  • Bilodeau, M., Brenner, D.: Theory of Multivariate Statistics. Springer Texts in Statistics. Springer, New York (1999)

    MATH  Google Scholar 

  • Buhl, S.L.: On the existence of maximum likelihood estimators for graphical Gaussian models. Scand. J. Stat. 20(3), 263–270 (1993)

    MathSciNet  MATH  Google Scholar 

  • Butler, R.W., Davies, P.L., Jhun, M.: Asymptotics for the minimum covariance determinant estimator. Ann. Stat. 21(3), 1385–1400 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  • Castelo, R., Roverato, A.: A robust procedure for Gaussian graphical model search from microarray data with p larger than n. J. Mach. Learn. Res. 7, 2621–2650 (2006)

    MathSciNet  Google Scholar 

  • Cox, D.R., Wermuth, N.: Multivariate Dependencies: Models, Analysis and Interpretation. Monographs on Statistics and Applied Probability, vol. 67. Chapman and Hall, London (1996)

    MATH  Google Scholar 

  • Croux, C., Haesbroeck, G.: Influence function and efficiency of the minimum covariance determinant scatter matrix estimator. J. Multivar. Anal. 71(2), 161–190 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  • Davies, P.L.: Asymptotic behaviour of S-estimates of multivariate location parameters and dispersion matrices. Ann. Stat. 15, 1269–1292 (1987)

    Article  MATH  Google Scholar 

  • Davies, P.L.: The asymptotics of Rousseeuw’s minimum volume ellipsoid estimator. Ann. Stat. 20(4), 1828–1843 (1992)

    Article  Google Scholar 

  • Davies, P.L., Gather, U.: The identification of multiple outliers. J. Am. Stat. Assoc. 88(423), 782–801 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  • Davies, P.L., Gather, U.: Breakdown and groups. Ann. Stat. 33(3), 977–1035 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  • Dawid, A.P., Lauritzen, S.L.: Hyper Markov laws in the statistical analysis of decomposable graphical models. Ann. Stat. 21(3), 1272–1317 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  • Deming, W.E., Stephan, F.F.: On a least squares adjustment of a sampled frequency table when the expected marginal totals are known. Ann. Math. Stat. 11, 427–444 (1940)

    Article  MathSciNet  MATH  Google Scholar 

  • Dempster, A.P.: Covariance selection. Biometrics 28, 157–175 (1972)

    Article  Google Scholar 

  • Donoho, D.L.: Breakdown properties of multivariate location estimators. PhD thesis, Harvard University (1982)

    Google Scholar 

  • Donoho, D.L., Huber, P.J.: The notion of breakdown point. In: Bickel, P.J., Doksum, K.A., Hodges, J.L. (eds.): Festschrift for Erich L. Lehmann, pp. 157–183. Wadsworth, Belmont (1983)

    Google Scholar 

  • Drton, M., Perlman, M.D.: Model selection for Gaussian concentration graphs. Biometrika 91(3), 591–602 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  • Drton, M., Perlman, M.D.: A SINful approach to Gaussian graphical model selection. J. Stat. Plan. Inference 138(4), 1179–1200 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  • Edwards, D.: Introduction to graphical modeling. Springer Texts in Statistics. Springer, New York (2000)

    Google Scholar 

  • Edwards, D., Havránek, T.: A fast procedure for model search in multidimensional contingency tables. Biometrika 72, 339–351 (1985)

    Article  MathSciNet  MATH  Google Scholar 

  • Edwards, D., Havránek, T.: A fast model selection procedure for large families of models. J. Am. Stat. Assoc. 82, 205–213 (1987)

    Article  MATH  Google Scholar 

  • Eriksen, P.S.: Tests in covariance selection models. Scand. J. Stat. 23(3), 275–284 (1996)

    MathSciNet  MATH  Google Scholar 

  • Gervini, D.: The influence function of the Stahel–Donoho estimator of multivariate location and scatter. Stat. Probab. Lett. 60(4), 425–435 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  • Gervini, D.: A robust and efficient adaptive reweighted estimator of multivariate location and scatter. J. Multivar. Anal. 84(1), 116–144 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  • Gnanadesikan, R., Kettenring, J.R.: Robust estimates, residuals, and outlier detection with multiresponse data. Biometrics 28(1), 81–124 (1972)

    Article  Google Scholar 

  • Gottard, A., Pacillo, S.: On the impact of contaminations in graphical Gaussian models. Stat. Methods Appl. 15(3), 343–354 (2007)

    Article  MathSciNet  Google Scholar 

  • Gottard, A., Pacillo, S.: Robust concentration graph model selection. Comput. Stat. Data Anal. (2008). doi:10.1016/j.csda.2008.11.021

    Google Scholar 

  • Hampel, F.R.: A general qualitative definition of robustness. Ann. Math. Stat. 42, 1887–1896 (1971)

    Article  MathSciNet  Google Scholar 

  • Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A.: Robust Statistics. The Approach Based on Influence Functions. Wiley Series in Probability and Mathematical Statistics. Wiley, New York (1986)

    MATH  Google Scholar 

  • Huber, P.J., Ronchetti, E.M.: Robust Statistics, 2nd edn. Wiley Series in Probability and Statistics. Wiley, Hoboken (2009)

    MATH  Google Scholar 

  • Kent, J.T., Tyler, D.E.: Constrained M-estimation for multivariate location and scatter. Ann. Stat. 24(3), 1346–1370 (1996)

    Article  MathSciNet  MATH  Google Scholar 

  • Kuhnt, S., Becker, C.: Sensitivity of graphical modeling against contamination. In: Schader, Martin, et al. (eds.) Between Data Science and Applied Data Analysis, Proceedings of the 26th Annual Conference of the Gesellschaft für Klassifikation e. V., Mannheim, Germany, July 22–24, 2002, pp. 279–287. Springer, Berlin (2003)

    Google Scholar 

  • Lauritzen, S.L.: Graphical Models. Oxford Statistical Science Series, vol. 17. Oxford University Press, Oxford (1996)

    Google Scholar 

  • Lopuhaä, H.P.: On the relation between S-estimators and M-estimators of multivariate location and covariance. Ann. Stat. 17(4), 1662–1683 (1989)

    Article  MATH  Google Scholar 

  • Lopuhaä, H.P.: Multivariate τ-estimators for location and scatter. Can. J. Stat. 19(3), 307–321 (1991)

    Article  MATH  Google Scholar 

  • Lopuhaä, H.P.: Asymptotics of reweighted estimators of multivariate location and scatter. Ann. Stat. 27(5), 1638–1665 (1999)

    Article  MATH  Google Scholar 

  • Magnus, J.R., Neudecker, H.: Matrix Differential Calculus with Applications in Statistics and Econometrics, 2nd edn. Wiley Series in Probability and Statistics. Wiley, Chichester (1999)

    MATH  Google Scholar 

  • Maronna, R.A.: Robust M-estimators of multivariate location and scatter. Ann. Stat. 4, 51–67 (1976)

    Article  MathSciNet  MATH  Google Scholar 

  • Maronna, R.A., Yohai, V.J.: The behavior of the Stahel-Donoho robust multivariate estimator. J. Am. Stat. Assoc. 90(429), 330–341 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  • Maronna, R.A., Zamar, R.H.: Robust estimates of location and dispersion for high-dimen sional datasets. Technometrics 44, 307–317 (2002)

    Article  MathSciNet  Google Scholar 

  • Maronna, R.A., Martin, D.R., Yohai, V.J.: Robust Statistics: Theory and Methods. Wiley Series in Probability and Statistics. Wiley, Chichester (2006)

    Book  MATH  Google Scholar 

  • Meinshausen, N., Bühlmann, P.: High-dimensional graphs and variable selection with the Lasso. Ann. Stat. 34(3), 1436–1462 (2006)

    Article  MATH  Google Scholar 

  • Miyamura, M., Kano, Y.: Robust Gaussian graphical modeling. J. Multivar. Anal. 97(7), 1525–1550 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  • Paindaveine, D.: A canonical definition of shape. Stat. Probab. Lett. 78(14), 2240–2247 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  • Porteous, B.T.: Stochastic inequalities relating a class of log-likelihood ratio statistics to their asymptotic χ 2 distribution. Ann. Stat. 17(4), 1723–1734 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  • Rocke, D.M.: Robustness properties of S-estimators of multivariate location and shape in high dimension. Ann. Stat. 24(3), 1327–1345 (1996)

    Article  MathSciNet  MATH  Google Scholar 

  • Rousseeuw, P.J.: Multivariate estimation with high breakdown point. In: Grossmann, W., Pflug, G.C., Vincze, I., Wertz, W. (eds.) Mathematical Statistics and Applications, Vol. B, Proc. 4th Pannonian Symp. Math. Stat., Bad Tatzmannsdorf, Austria, September 4–10, 1983, pp. 283–297. Reidel, Dordrecht (1985)

    Google Scholar 

  • Rousseeuw, P.J., Van Driessen, K.: A fast algorithm for the minimum covariance determinant estimator. Technometrics 41, 212–233 (1999)

    Article  Google Scholar 

  • Roverato, A.: Cholesky decomposition of a hyper inverse Wishart matrix. Biometrika 87(1), 99–112 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  • Smith, P.W.F.: Assessing the power of model selection procedures used when graphical modeling. In: Dodge, Y., Whittaker, J. (eds.) Computational Statistics, vol. I, pp. 275–280. Physica, Heidelberg (1992)

    Google Scholar 

  • Speed, T.P., Kiiveri, H.T.: Gaussian Markov distributions over finite graphs. Ann. Stat. 14, 138–150 (1986)

    Article  MathSciNet  MATH  Google Scholar 

  • Srivastava, M., Khatri, C.: An Introduction to Multivariate Statistics. North Holland, New York (1979)

    MATH  Google Scholar 

  • Stahel, W.: Robust estimation: Infinitesimal optimality and covariance matrix estimation. PhD thesis, ETH Zürich (1981)

    Google Scholar 

  • Tyler, D.E.: Robustness and efficiency properties of scatter matrices. Biometrika 70, 411–420 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  • Tyler, D.E.: A distribution-free M-estimator of multivariate scatter. Ann. Stat. 15, 234–251 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  • Visuri, S., Koivunen, V., Oja, H.: Sign and rank covariance matrices. J. Stat. Plan. Inference 91(2), 557–575 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  • Vogel, D., Köllmann, C., Fried, R.: Partial correlation estimates based on signs. In Heikkonen, J. (ed.) Proceedings of the 1st Workshop on Information Theoretic Methods in Science and Engineering. TICSP series # 43 (2008)

    Google Scholar 

  • Vogel, D.: On generalizing Gaussian graphical models. In: Ciumara, R., Bădin, L. (eds.) Proceedings of the 16th European Young Statisticians Meeting, University of Bucharest, pp. 149–153 (2009)

    Google Scholar 

  • Whittaker, J.: Graphical Models in Applied Multivariate Statistics. Wiley Series in Probability and Mathematical Statistics. Wiley, Chichester (1990)

    Google Scholar 

  • Zuo, Y.: Robust location and scatter estimators in multivariate analysis. In: Fan, J., Koul, H. (eds.) Frontiers in Statistics. Dedicated to Peter John Bickel on Honor of his 65th Birthday, pp. 467–490. Imperial College Press, London (2006)

    Google Scholar 

  • Zuo, Y., Cui, H.: Depth weighted scatter estimators. Ann. Stat. 33(1), 381–413 (2005)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel Vogel .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Vogel, D., Fried, R. (2010). On Robust Gaussian Graphical Modeling. In: Devroye, L., Karasözen, B., Kohler, M., Korn, R. (eds) Recent Developments in Applied Probability and Statistics. Physica-Verlag HD. https://doi.org/10.1007/978-3-7908-2598-5_7

Download citation

Publish with us

Policies and ethics