Imprecise Dirichlet Process With Application to the Hypothesis Test on the Probability That X ≤ Y
The Dirichlet process (DP) is one of the most popular Bayesian nonparametric models. An open problem with the DP is how to choose its infinite-dimensional parameter (base measure) in case of lack of prior information. In this work, we present the imprecise DP (IDP)—a prior near-ignorance DP-based model that does not require any choice of this probability measure. It consists of a class of DPs obtained by letting the normalized base measure of the DP vary in the set of all probability measures. We discuss the tight connections of this approach with Bayesian robustness and in particular prior near-ignorance modeling via sets of probabilities. We use this model to perform a Bayesian hypothesis test on the probability P(X ≤ Y). We study the theoretical properties of the IDP test (e.g., asymptotic consistency), and compare it with the frequentist Mann-Whitney-Wilcoxon rank test that is commonly employed as a test on P(X ≤ Y). In particular, we show that our method is more robust, in the sense that it is able to isolate instances in which the aforementioned test is virtually guessing at random.
KeywordsBayesian nonparametric test Imprecise Dirichlet process Wilcoxon rank sum
AMS Subject Classification62G10 62G35
Unable to display preview. Download preview PDF.
- Benavoli, A., F. Mangili, G. Corani, M. Zaffalon, and F. Ruggeri. 2014. A Bayesian Wilcoxon signed-rank test based on the Dirichlet process. Proceedings of the 32th International Conference on Machine Learning (ICML), 1026–1034.Google Scholar
- Borgwardt, K. M., and Z. Ghahramani. n.d. Bayesian two-sample tests. arXiv preprint arXiv:0906.4032.Google Scholar
- Holmes, C., F. Caron, J. Griffin, and D. A. Stephens. n.d. Two-sample Bayesian nonparametric hypothesis testing. arXiv preprint arXiv:0910.5060.Google Scholar
- Lehmann, E. 1998. Elements of large-sample theory, New York, NY: Springer-Verlag.Google Scholar
- Rossi, P., and R. McCulloch. 2010. Bayesm: Bayesian inference for marketing/micro-econometrics, R package version 2-2. http://www.perossi.org/home/bsm-1
- Sethuraman, J., and R. C. Tiwari. 1981. Convergence of Dirichlet measures and the interpretation of their parameter. Defense Technical Information Center.Google Scholar