Skip to main content

Advanced Topics in MCMC

  • Chapter
  • First Online:
Numerical Analysis for Statisticians

Part of the book series: Statistics and Computing ((SCO))

  • 8221 Accesses

Abstract

The pace of research on MCMC methods is so quick that any survey of advanced topics is immediately obsolete. The highly eclectic and decidedly biased coverage in our final chapter begins with a discussion of Markov random fields. Our limited aims here are to prove the Hammersley-Clifford theorem and introduce the Swendsen-Wang algorithm, a clever form of slice sampling. In the Ising model, the Swendsen-Wang algorithm is much more efficient than standard Gibbs sampling.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Akhiezer NI, Glazman IM (1993) Theory of Linear Operators in Hilbert Space. Dover, New York

    MATH  Google Scholar 

  2. Brémaud P (1999) Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues. Springer

    Google Scholar 

  3. Brook D (1964) On the distinction between the conditional and the joint probability approaches in the specification of nearest-neighbor systems. Biometrika 51:481-483

    MATH  MathSciNet  Google Scholar 

  4. Conway JB (1985) A Course on Functional Analysis. Springer, New York

    Google Scholar 

  5. Diaconis P (1988) Group Representations in Probability and Statistics. Institute of Mathematical Statistics, Hayward, CA

    MATH  Google Scholar 

  6. Diaconis P, Khare K, Saloff-Coste L (2008) Gibbs sampling, exponen- tial families and orthogonal polynomials. Stat Science 23:151-178

    Article  MathSciNet  Google Scholar 

  7. Edwards RG, Sokal AD (1988) Generalizations of the Fortuin-Kasteleyn-Swendsen-Wang representation and Monte Carlo algorithm. Physical Review D 38:2009-2012

    Article  MathSciNet  Google Scholar 

  8. Green PJ (1995) Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82:711-732

    Article  MATH  MathSciNet  Google Scholar 

  9. Hastie D, Green PJ (2009) Reversible jump MCMC. (unpublished lecture notes)

    Google Scholar 

  10. Jones GL (2004) On the Markov chain central limit theorem. Prob Surveys 1:299-320

    Article  Google Scholar 

  11. Levin DA, Peres Y, Wilmer EL (2008) Markov Chains and Mixing Times. Amer Math Soc, Providence, RI

    Google Scholar 

  12. Liu JS (1996) Metropolized independent sampling with comparisons to rejection sampling and importance sampling. Stat and Computing 6:113-119

    Article  Google Scholar 

  13. Liu JS (2001) Monte Carlo Strategies in Scientific Computing. Springer, New York

    MATH  Google Scholar 

  14. Richardson S, Green PJ (1997) On Bayesian analysis of mixtures with an unknown number of components. J Royal Stat Soc B 59:731-792

    Article  MATH  MathSciNet  Google Scholar 

  15. Robert CP, Casella G (2004) Monte Carlo Statistical Methods, 2nd ed. Springer, New York

    MATH  Google Scholar 

  16. Rosenthal JS (1995) Convergence rates of Markov chains. SIAM Review 37:387-405

    Article  MATH  MathSciNet  Google Scholar 

  17. Rynne BP, Youngson MA (2008) Linear Functional Analysis. Springer, New York

    Book  MATH  Google Scholar 

  18. Stein EM, Shakarchi R (2005) Real Analysis: Measure Theory, Integration, and Hilbert Spaces. Princeton University Press, Princeton, NJ

    MATH  Google Scholar 

  19. Swendsen RH, Wang JS (1987) Nonuniversal critical dynamics in Monte Carlo simulations. Physical Review Letters 58:86-88

    Article  Google Scholar 

  20. Tierney L (1994) Markov chains for exploring posterior distributions (with discussion). Ann Stat 22:1701-1762

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kenneth Lange .

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer New York

About this chapter

Cite this chapter

Lange, K. (2010). Advanced Topics in MCMC. In: Numerical Analysis for Statisticians. Statistics and Computing. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-5945-4_27

Download citation

Publish with us

Policies and ethics