Skip to main content

A B-Robust Non-Iterative Scatter Matrix Estimator: Asymptotics and Application to Cluster Detection Using Invariant Coordinate Selection

  • Chapter
  • 1736 Accesses

Abstract

In Ruiz-Gazen (Comput Stat Data Anal 21:149–162, 1996), a simple B-robust estimator was introduced. Its definition is explicit and takes into account the empirical covariance matrix together with a one-step M-estimator. In the present paper, we derive the asymptotics and some robustness properties of this estimator. We compare its performance to the usual M- and S-estimators by means of a Monte-Carlo study. We also illustrate its use for cluster detection using Invariant Coordinate Selection on a small example.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Bedall, F.K., Zimmerman, H.: Algorithm AS 143, the mediancenter. App. Stat. 28, 325–328 (1979)

    Article  Google Scholar 

  • Béguin, C., Hulliger, B.: Multivariate outlier detection in incomplete survey data: the epidemic algorithm and transformed rank correlations. J. R. Stat. Soc. Ser. A (Stat. Soc.) 167(2), 275–294 (2004)

    Google Scholar 

  • Cator, E.A., Lopuhaä, H.P.: Central limit theorem and influence function for the MCD estimators at general multivariate distributions. Bernoulli 18(2), 520–551 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  • Caussinus, H., Hakam, S., Ruiz-Gazen, A.: Projections révélatrices contrôlées: groupements et structures diverses. Rev. Stat. Appl. 51(1), 37–58 (2003)

    MathSciNet  Google Scholar 

  • Critchley, F.: Influence in principal components analysis. Biometrika 72, 627–636 (1985)

    Article  MathSciNet  MATH  Google Scholar 

  • Croux, C., Haesbroeck, G.: Principal component analysis based on robust estimators of the covariance or correlation matrix : influence functions and efficiencies. Biometrika 87(3), 603–618 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  • Dauxois, J., Pousse, A., Romain, Y.: Asymptotic theory for the principal component analysis of a vector random function: some applications to statistical inference. J. Multivar. Anal. 12, 136–154 (1982)

    Article  MathSciNet  MATH  Google Scholar 

  • Davies, P.L.: Asymptotic behaviour of S-estimates of multivariate location parameters and dispersion matrices. Ann. Stat. 15(3), 1269–1292 (1987)

    Article  MathSciNet  MATH  Google Scholar 

  • Davies, L.: The asymptotics of Rousseeuw’s minimum volume ellipsoid estimator. Ann. Stat. 20, 1828–1843 (1992)

    Article  MATH  Google Scholar 

  • Devlin, S.J., Gnanadesikan, R., Kettenring, J.R.: Robust estimation of dispersion matrices and principal components. J. Am. Stat. Assoc. 76, 354–362 (1981)

    Article  MATH  Google Scholar 

  • Donoho, D.L.: Breakdown properties of multivariate location estimators. Ph.D. Qualifying Paper. Department of Statistics, Harvard University (1982)

    Google Scholar 

  • Dossou-Gbete, S., Pousse, A.: Asymptotic study of eigenelements of a sequence of random selfadjoint operators. Statistics 3, 479–491 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  • Dümbgen, L., Pauly, M., Schweizer, T.: A survey of M-functionals of multivariate location and scatter. arXiv preprint arXiv:1312.5594 (2013a)

    Google Scholar 

  • Dümbgen, L., Nordhausen, K., Schuhmacher, H.: New algorithms for M-estimation of multivariate location and scatter. arXiv preprint arXiv:1312.6489 (2013b)

    Google Scholar 

  • Fekri, M., Fine, J.: Matrice aléatoire dont l’espérance est de rang réduit. Propriétés asymptotiques des estimateurs moindres carrés et choix de métriques. Pub. Inst. Stat. Univ. Paris XXXIX(1), 67–88 (1995)

    Google Scholar 

  • Fekri, M., Ruiz-Gazen, A.: Propriétés asymptotiques et fonction d’influence d’un estimateur simple et robuste de matrice de dispersion. C. R. Acad. Sci. Paris t. 330 série I, 565–568 (2000)

    Google Scholar 

  • Fischer, D., Möttönen, J., Nordhausen, K., Vogel, H.: OjaNP: multivariate methods based on the Oja median and related concepts. R package vesion 0.9-6. http://cran.r-project.org/web/packages/OjaNP/index.html (2013)

  • Gervini, D.: The influence function of the Stahel-Donoho estimator of multivariate location and scatter. Stat. Probab. Lett. 60(4), 425–435 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  • Hampel, F.R., Ronchetti, E.M., Rousseeuw, P.J., Stahel, W.A.: Robust Statistics. Wiley, New York (1986)

    MATH  Google Scholar 

  • Kato, T.: Perturbation Theory for Linear Operators. Springer, New York (1966)

    Book  MATH  Google Scholar 

  • Le Cam, L.: On some asymptotic properties of maximum likelihood estimates and related Bayes estimates. Univ. Calif. Public Stat. 1, 277–330 (1953)

    MathSciNet  Google Scholar 

  • Lopuhaä, H.P.: Asymptotics of reweighted estimators of multivariate location and scatter. Ann. Stat. 27(5), 1638–1665 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  • Lubischew, A.A.: On the use of discriminant functions in taxonomy. Biometrics 18(4), 455–477 (1962)

    Article  MATH  Google Scholar 

  • Ma, Y., Genton, M.G.: Highly robust estimation of dispersion matrices. J. Multiv. Anal. 78(1), 11–36 (2001)

    Article  MathSciNet  MATH  Google Scholar 

  • Maronna, R.A.: Robust M-estimators of multivariate location and scatter. Ann. Stat. 4, 51–67 (1976)

    Article  MathSciNet  MATH  Google Scholar 

  • Maronna, R.A., Stahel, W.A., Yohai, V.J.: Bias-robust estimators of multivariate scatter based on projections. J. Multiv. Anal. 42(1), 141–161 (1992)

    Article  MathSciNet  MATH  Google Scholar 

  • Maronna, R.A., Yohai, V.J.: Robust estimation of multivariate location and scatter. In: Kotz, S., Read, C., Banks, D. (eds.) Encyclopedia of Statistical Sciences, Update vol. 2, pp. 589–596. Wiley, New York (1988)

    Google Scholar 

  • Maronna, R.A., Yohai, V.J.: The behavior of the Stahel-Donoho robust multivariate estimator. J. Am. Stat. Assoc. 90, 330–341 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  • Maronna, R.A., Zamar, R.H.: Robust estimates of location and dispersion for high-dimensional datasets. Technometrics 44(4), 307–317 (2002)

    Article  MathSciNet  Google Scholar 

  • Meshalkin, L.D.: Approximation of multidimensional densities by normal distributions. In: Proceedings of 7th International Biometric Conference, Hannover (1970)

    Google Scholar 

  • Oja, H.: Descriptive statistics for multivariate distributions. Stat. Probab. Lett. 1(6), 327–332 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  • Ollila, E., Croux, C., Oja, H.: Influence function and asymptotic efficiency of the affine equivariant rank covariance matrix. DTEW Research Report 0210, 1–19 (2002)

    MATH  Google Scholar 

  • Ollila, E., Oja, H., Croux, C.: The affine equivariant sign covariance matrix: asymptotic behavior and efficiencies. J. Multiv. Anal. 87(2), 328–355 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  • Peña, D., Prieto, F.J.: Cluster identification using projections. J. Am. Stat. Assoc. 96(456), 14433–1445 (2001)

    MathSciNet  MATH  Google Scholar 

  • Rousseeuw, P.J.: Multivariate estimation with high breakdown point. In: Grossmann, W., G. Pflug, G., I. Vincze, I., W. Wertz, W. (eds.) Mathematical Statistics and Applications, pp. 283–297. Reidel, Dordrecht (1985)

    Google Scholar 

  • Rousseeuw, P.J., Croux, C.: The bias of k-step M-estimators. Stat. Probab. Lett. 20(5), 411–420 (1994)

    Article  MathSciNet  MATH  Google Scholar 

  • Rousseeuw, P.J., Leroy, A.M.: Robust Regression and Outlier Detection. Wiley, New York (1987)

    Book  MATH  Google Scholar 

  • Ruiz-Gazen, A.: A very simple robust estimator of a dispersion matrix. Comput. Stat. Data Anal. 21, 149–162 (1996)

    Article  MathSciNet  MATH  Google Scholar 

  • Stahel, W.A.: Breakdown of covariance estimators. Research Report 31. Fachgruppe für Statistik. ETH, Zürich (1981)

    Google Scholar 

  • Tanaka, Y.: Sensitivity analysis in PCA: influence on the subspace spanned by principal components. Commun. Stat. Theory Methods 17, 3157–3175 (1988)

    Article  MATH  Google Scholar 

  • Tyler, D.E., Critchley, F., Dümbgen, L., Oja, H.: Invariant co-ordinate selection. J. R. Stat. Soc. Ser. B (Stat. Methodol.) 71(3), 549–592 (2009)

    Google Scholar 

  • Visuri, S., Koivunen, V., Oja, H.: Sign and rank covariance matrices. J. Stat. Plann. Inf. 91(2), 557–575 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  • Zuo, Y., Cui, H., He, X.: On the Stahel–Donoho estimators and depth-weighted means for multivariate data. Ann. Stat. 32(1), 167–188 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  • Zuo, Y., Lai, S.: Exact computation of bivariate projection depth and the Stahel–Donoho estimator. Comput. Stat. Data Anal. 55(3), 1173–1179 (2011)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anne Ruiz-Gazen .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Fekri, M., Ruiz-Gazen, A. (2015). A B-Robust Non-Iterative Scatter Matrix Estimator: Asymptotics and Application to Cluster Detection Using Invariant Coordinate Selection. In: Nordhausen, K., Taskinen, S. (eds) Modern Nonparametric, Robust and Multivariate Methods. Springer, Cham. https://doi.org/10.1007/978-3-319-22404-6_22

Download citation

Publish with us

Policies and ethics