Simulated Annealing in Bayesian Decision Theory

  • José M. Bernardo
Conference paper


Since the seminal paper by Kirkpatrick, Gelatt and Vechhi (1983), a number of papers in the scientific literature refer to simulated annealing as a powerful random optimization method which promises to deliver, within reasonable computing times, optimal or nearly optimal solutions to complex decision problems hitherto forbidding. The algorithm, which uses the physical process of annealing as a metaphor, is special in that, at each iteration, one may move with positive probability to solutions with higher values of the function to minimize, rather than directly jumping to the point with the smallest value within the neighborhood, thus drastically reducing the chances of getting trapped in local minima. This paper describes a variation of this algorithm within the Bayesian context of minimizing the expected loss in complex decision problems. The procedure is then applied to the identification of good designs for political sample surveys, aimed at predicting the behaviour of the electorate in future elections.


Simulated Annealing Global Result Expected Loss Logarithmic Divergence Reasonable Computing Time 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bernardo, J. M. (1979). Expected information as expected utility. Ann. Statist. 7. 636–690.CrossRefGoogle Scholar
  2. Bernardo, J. M., Ferrándiz, J. R. and Smith, A. F. M. (1985). The foundations of decision theory: An intuitive, operational approach with mathematical extensions. Theory and Decision 19, 127–150.CrossRefGoogle Scholar
  3. Bernardo, J. M. and Girón, F. J. (1992). Robust sequential prediction form non-random samples: the election night forecasting case. Bayesian Statistics 4 (J. M. Bernardo, J. O. Berger, A. P. Dawid and A. F. M. Smith, eds.), Oxford: University Press, 61–77, (with discussion).Google Scholar
  4. Fishburn, P. C. (1981). Subjective expected utility: a review of normative theories. Theory and Decision 13, 139–199.CrossRefGoogle Scholar
  5. Good, I. J. (1952). Rational decisions. J. Roy. Statist. Soc. B 14, 107–114.Google Scholar
  6. Haines, L. M. (1987). The application of the annealing algorithm to the construction of exact optimal designs for linear regression models. Technometrics 29, 439–447.Google Scholar
  7. Kirkpatrick, S., Gelati, C. D. and Vecchi, M. P. (1983). Optimization by simulated annealing. Science 220, 671–680.CrossRefGoogle Scholar
  8. Lundy, M. (1985). Applications of the annealing algorithm to combinatorial problems in statistics. Biometrika 72, 191–198.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1992

Authors and Affiliations

  • José M. Bernardo
    • 1
  1. 1.Centro de Documentación y Análisis, Presidencia de la Generalidad. Departamento de EstadísticaUniversidad de ValenciaValenciaSpain

Personalised recommendations