Skip to main content

Independent Bernoulli arms

  • Chapter

Part of the book series: Monographs on Statistics and Applied Probability ((MSAP))

Abstract

Many of the examples in the first three chapters assume independent arms: G = F 1 × ... × F k. In this chapter we consider independent Bernoulli arms. As has been our convention in the Bernoulli case, we regard F i as a distribution on the Bernoulli parameter θ i ∈ [0, 1] rather than on Q i ∈ D; and consistent with an earlier modification of notation, we write the conditional distribution of (θ 1, θ 2,...,θ k ) given success on arm 1, say, as

$$ {\sigma _1}\left( {{F_1},{F_2},...,{F_k}} \right) = \left( {\sigma {F_1},{F_2},...,{F_k}} \right), $$

and given a failure on arm 1 and as

$$ {\varphi _1}\left( {{F_1},{F_2},...,{F_k}} \right) = \left( {\varphi {F_1},{F_2},...,{F_k}} \right). $$

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Berry, D. A. (1972) A Bernoulli two-armed bandit. Ann. Math. Statist. 43: 871–897.

    Article  MathSciNet  MATH  Google Scholar 

  • DeGroot, M. H. (1970) Optimal Statistical Decisions, McGraw-Hill, New York.

    MATH  Google Scholar 

  • Fabius, J. and van Zwet, W. R. (1970) Some remarks on the two-armed bandit. Ann. Math. Statist. 41: 1906–1916.

    Article  MathSciNet  MATH  Google Scholar 

  • Feldman, D. (1962) Contributions to the `two-armed bandit’ problem. Ann. Math. Statist. 33: 847–856.

    Article  MathSciNet  MATH  Google Scholar 

  • Kadane, J. B. (1969) Personal communication.

    Google Scholar 

  • Kelley, T. A. (1974) A note on the Bernoulli two-armed bandit problem. Ann. Statist. 2: 1056–1062.

    Article  MathSciNet  MATH  Google Scholar 

  • Nordbrock, E. (1976) An improved play-the-winner sampling procedure for selecting the better of two binomial populations. J. Amer. Statist. Assoc. 71: 137–139.

    Article  MathSciNet  MATH  Google Scholar 

  • Quisel, K. (1965) Extensions of the two-armed bandit and related processes with on-line experimentation. Tech. Rep. No. 137, Institute for Mathematical Studies in the Social Sciences, Stanford Univ., USA.

    Google Scholar 

  • Robbins, H. (1952) Some aspects of the sequential design of experiments. Bull. Amer. Math. Soc. 58: 527–535.

    Article  MathSciNet  MATH  Google Scholar 

  • Rodman, L. (1978) Or: the many-armed bandit problem. Ann. Prob. 6: 491–498.

    Article  MathSciNet  MATH  Google Scholar 

  • Sobel, M. and Weiss, G. H. (1970) Play-the-winner sampling for selecting the better of two binomial populations. Biometrika 57: 357–365.

    Article  MathSciNet  MATH  Google Scholar 

  • Zaborskis, A. A. (1976) Sequential Bayesian plan for choosing the best method of medical treatment. Avtomatika i Telemekhanika 2: 144–153.

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 1985 D. A. Berry and B. Fristedt

About this chapter

Cite this chapter

Berry, D.A., Fristedt, B. (1985). Independent Bernoulli arms. In: Bandit problems. Monographs on Statistics and Applied Probability. Springer, Dordrecht. https://doi.org/10.1007/978-94-015-3711-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-94-015-3711-7_4

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-015-3713-1

  • Online ISBN: 978-94-015-3711-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics