Abstract
Markov chain Monte Carlo is often particularly challenging in dynamic models. In state space models, the data augmentation algorithm (Tanner and Hung Wong, J. Am. Stat. Assoc. 82(398):528–540, 1987) is a commonly used approach, e.g. (Carter and Kohn, Biometrika 81(3):541–553, 1994) and (Frühwirth-Schnatter, J. Time Ser. Anal. 15(2):183–202, 1994) in dynamic linear models. Using two data augmentations, Yu and Meng (J. Comput. Graph. Stat. 20(3): 531–570, 2011) introduces a method of “interweaving” between the two augmentations in order to construct an improved algorithm. Picking up on this, Simpson et al. (Interweaving Markov chain Monte Carlo strategies for efficient estimation of dynamic linear models, Working Paper, 2014) introduces several new augmentations for the dynamic linear model and builds interweaving algorithms based on these augmentations. In the context of a multivariate model using data from an economic experiment intended to study the disequilibrium dynamics of economic efficiency under a variety of conditions, we use these interweaving ideas and show how to implement them simply despite complications that arise because the model has latent states with a higher dimension than the data.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bos, C.S., Shephard, N.: Inference for adaptive time series models: Stochastic volatility and conditionally Gaussian state space form. Econ. Rev. 25(2–3), 219–244 (2006)
Brooks, S.P., Gelman, A.: General methods for monitoring convergence of iterative simulations. J. Comput. Graph. Stat. 7(4), 434–455 (1998)
Carter, C.K., Kohn, R.: On Gibbs sampling for state space models. Biometrika 81(3), 541–553 (1994)
Crockett, S., Smith, V.L., Wilson, B.J. Exchange and specialisation as a discovery process. Econ. J. 119(539), 1162–1188 (2009)
Frühwirth-Schnatter, S.: Data augmentation and dynamic linear models. J. Time Ser. Anal. 15(2), 183–202 (1994)
Frühwirth-Schnatter, S.: Efficient Bayesian parameter estimation for state space models based on reparameterizations. In: State Space and Unobserved Component Models: Theory and Applications, pp. 123–151. Cambridge University Press, Cambridge (2004)
Frühwirth-Schnatter, S., Sögner, L.: Bayesian estimation of the Heston stochastic volatility model. In: Harvey, A., Koopman, S.J., Shephard, N. (eds.) Operations Research Proceedings 2002, pp. 480–485. Springer, Berlin (2003)
Frühwirth-Schnatter, S., Sögner, L.: Bayesian estimation of the multi-factor Heston stochastic volatility model. Commun. Dependability Qual. Manag. 11(4), 5–25 (2008)
Frühwirth-Schnatter, S., Wagner, H.: Stochastic model specification search for Gaussian and partial non-Gaussian state space models. J. Econ. 154(1), 85–100 (2010)
Gelman, A.: Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper). Bayesian Anal. 1(3), 515–534 (2006)
Gelman, A., Carlin, J.B., Stern, H.S., Dunson, D.B., Vehtari, A., Rubin, D.B.: Bayesian Data Analysis, 3rd edn. CRC press, New York (2013)
Gilks, W.R., Wild, P.: Adaptive rejection sampling for Gibbs sampling. Appl. Stat. 41(2), 337–348 (1992)
Huang, A., Wand, M.P.: Simple marginally noninformative prior distributions for covariance matrices. Bayesian Anal. 8(2), 439–452 (2013)
Kaldor, N.: Welfare propositions of economics and interpersonal comparisons of utility. Econ. J. 49, 549–552 (1939)
Kastner, G., Frühwirth-Schnatter, S.: Ancillarity-sufficiency interweaving strategy (ASIS) for boosting MCMC estimation of stochastic volatility models. Comput. Stat. Data Anal. 76, 408–423 (2014)
Kimbrough, E.O., Smith, V.L., Wilson, B.J.: Exchange, theft, and the social formation of property. J. Econ. Behav. Organ. 74(3), 206–229 (2010)
Mas-Colell, A., Whinston, M.D., Green, J.R., et al.: Microeconomic Theory, vol. 1. Oxford university press, New York (1995)
McCausland, W.J., Miller, S., Pelletier, D.: Simulation smoothing for state–space models: a computational efficiency analysis. Comput. Stat. Data Anal. 55(1), 199–212 (2011)
Pitt, M.K., Shephard, N.: Analytic convergence rates and parameterization issues for the Gibbs sampler applied to state space models. J. Time Ser. Anal. 20(1), 63–85 (1999)
Roberts, G.O., Papaspiliopoulos, O., Dellaportas, P.: Bayesian inference for non-Gaussian Ornstein–Uhlenbeck stochastic volatility processes. J. R. Stat. Soc. Ser. B Stat. Methodol. 66(2), 369–393 (2004)
Rue, H.: Fast sampling of Gaussian markov random fields. J. R. Stat. Soc. Ser. B Stat. Methodol. 63(2), 325–338 (2001)
Shephard, N.: Statistical Aspects of ARCH and Stochastic Volatility. Springer, London (1996)
Simpson, M., Niemi, J., Roy, V.: Interweaving Markov chain Monte Carlo strategies for efficient estimation of dynamic linear models. Working Paper (2014)
Strickland, C.M., Martin, G.M., Forbes, C.S.: Parameterisation and efficient MCMC estimation of non-Gaussian state space models. Comput. Stat. Data Anal. 52(6), 2911–2930 (2008)
Tanner, M.A., Hung Wong, W.: The calculation of posterior distributions by data augmentation. J. Am. Stat. Assoc. 82(398), 528–540 (1987)
Van Dyk, D., Meng, X.L.: The art of data augmentation. J. Comput. Graph. Stat. 10(1), 1–50 (2001)
Yu, Y., Meng, X.L.: To center or not to center: That is not the question - an ancillarity–sufficiency interweaving strategy (ASIS) for boosting MCMC efficiency. J. Comput. Graph. Stat. 20(3), 531–570 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Simpson, M. (2015). Application of Interweaving in DLMs to an Exchange and Specialization Experiment. In: Frühwirth-Schnatter, S., Bitto, A., Kastner, G., Posekany, A. (eds) Bayesian Statistics from Methods to Models and Applications. Springer Proceedings in Mathematics & Statistics, vol 126. Springer, Cham. https://doi.org/10.1007/978-3-319-16238-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-16238-6_7
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16237-9
Online ISBN: 978-3-319-16238-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)