Computing the halfspace depth with multiple try algorithm and simulated annealing algorithm
- 7 Downloads
The halfspace depth is a powerful tool for the nonparametric multivariate analysis. However, its computation is very challenging for it involves the infimum over infinitely many directional vectors. The exact computation of the halfspace depth is a NP-hard problem if both sample size n and dimension d are parts of input. The approximate algorithms often can not get accurate (exact) results in high dimensional cases within limited time. In this paper, we propose a new general stochastic optimization algorithm, which is the combination of simulated annealing and the multiple try Metropolis algorithm. As a by product of the new algorithm, it is then successfully applied to the computation of the halfspace depth of data sets which are not necessarily in general position. The simulation and real data examples indicate that the new algorithm is highly competitive to, especially in the high dimension and large sample cases, other (exact and approximate) algorithms, including the simulated annealing and the quasi-Newton method and so on, both in accuracy and efficiency.
KeywordsHalf-space depth computation Multiple try Metropolis Simulated annealing Markov Chain Monte Carlo (MCMC)
The authors would like to thank the Editor, Associate Editor and reviewers for their insightful comments and constructive suggestions, which led to distinctive improvements in this paper. The first author’s research was partially supported by the National Natural Science Foundation of China (11501320, 71471101, 11426143), the Natural Science Foundation of Shandong Province (ZR2014AP008) and the Natural Science Foundation of Qufu Normal University (bsqd20130114).
- Pandolfi S, Bartolucci F, Friel N (2010) A generalization of the multiple-try Metropolis algorithm for Bayesian estimation and model selection. J Mach Learn Res 9:581–588Google Scholar
- R Core Team (2016) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna. https://www.R-project.org/
- Tukey JW (1975) Mathematrics and the picturing of data. Proc Int Cong Math 2:523–531Google Scholar