Abstract
In 1946, Sir Harold Jeffreys introduced a prior distribution whose density is the square root of the determinant of Fisher information. The motivation for suggesting this prior distribution is that the method results in a posterior that is invariant under reparametrization. For invariant statistical models when there is a transitive group action on the parameter space, it is shown that all relatively invariant priors have this “Jeffreys Invariance” property. However, this invariance may not prevail when using a subtle modification suggested by an alternative argument.
Similar content being viewed by others
References
Box, G.E.P. and Tiao, G.C. (1973). Bayesian Inference in Statistical Analysis. Addison-Wesley, Reading, MA.
Eaton, M.L. (1983, 2007). Multivariate Statistics: A Vector Space Approach. Originally published by Wiley, New York. Reprinted by Institute of Mathematical Statistics as LMNS, 53, Beachwood, Ohio.
Eaton, M.L. (1989). Group Invariance Applications in Statistics. Regional Conference Series in Probability and Statistics, 1. Institute of Mathematical Statistics, Beachwood, Ohio.
Eaton, M.L. and Freedman, D.A. (2004). Dutch book against some “objective” priors. Bernoulli, 10, 861–872.
Eaton, M.L., Muirhead, R.J. and Pickering, E.H. (2006). Assessing a vector of clinical observations. J. Statist. Plann. Inference, 136, 3383–3414.
Eaton, M.L. and Sudderth, W.D. (1993). Prediction in a multivariate normal setting: coherence and incoherence. Sankhyā, Ser. A, 55, 481–493.
Eaton, M.L. and Sudderth, W.D. (1995). The formal posterior of a standard flat prior in MANOVA is incoherent. J. Italian Statist. Soc., 4. 251–270.
Eaton, M.L. and Sudderth, W.D. (2001). Best invariant predictive inferences. In Algebraic Methods in Statistics and Probability, (M. Viana and D. Richards, eds.). Contemporary Mathematics, 287. American Mathematical Society, Providence, Rhode Island, 49–62.
Eaton, M.L. and Sudderth, W.D. (2004). Properties of right Haar predictive inference. Sankhyā, 66, 487–512.
Halmos, P.R. (1950). Measure Theory. Van Nostrand, New York.
James, W. and Stein, C. (1961). Estimation with quadratic loss. In Proceedings of Fourth Berkeley Symposium on Mathematical Statistics and Probability, 1, (J. Neyman, ed.). Univ. California Press, Berkeley, 361–380.
Jeffreys, H. (1946). An invariant form for the prior probability in estimation problems. Proc. Roy. Soc. London Ser. A, 186, 453–461.
Kass, R.E. and Wasserman, L. (1996). The selection of prior distributions by formal rules. J. Amer. Statist. Assoc., 91, 1343–1370.
Nachbin, L. (1965). The Haar Integral. Van Nostrand, New York.
Robert, C.P. (1994). The Bayesian Choice. Springer-Verlag, New York.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Eaton, M.L., Sudderth, W.D. Invariance of posterior distributions under reparametrization. Sankhya 72, 101–118 (2010). https://doi.org/10.1007/s13171-010-0001-x
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13171-010-0001-x