Abstract
Many of the examples in the first three chapters assume independent arms: G = F 1 × ... × F k. In this chapter we consider independent Bernoulli arms. As has been our convention in the Bernoulli case, we regard F i as a distribution on the Bernoulli parameter θ i ∈ [0, 1] rather than on Q i ∈ D; and consistent with an earlier modification of notation, we write the conditional distribution of (θ 1, θ 2,...,θ k ) given success on arm 1, say, as
and given a failure on arm 1 and as
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Berry, D. A. (1972) A Bernoulli two-armed bandit. Ann. Math. Statist. 43: 871–897.
DeGroot, M. H. (1970) Optimal Statistical Decisions, McGraw-Hill, New York.
Fabius, J. and van Zwet, W. R. (1970) Some remarks on the two-armed bandit. Ann. Math. Statist. 41: 1906–1916.
Feldman, D. (1962) Contributions to the `two-armed bandit’ problem. Ann. Math. Statist. 33: 847–856.
Kadane, J. B. (1969) Personal communication.
Kelley, T. A. (1974) A note on the Bernoulli two-armed bandit problem. Ann. Statist. 2: 1056–1062.
Nordbrock, E. (1976) An improved play-the-winner sampling procedure for selecting the better of two binomial populations. J. Amer. Statist. Assoc. 71: 137–139.
Quisel, K. (1965) Extensions of the two-armed bandit and related processes with on-line experimentation. Tech. Rep. No. 137, Institute for Mathematical Studies in the Social Sciences, Stanford Univ., USA.
Robbins, H. (1952) Some aspects of the sequential design of experiments. Bull. Amer. Math. Soc. 58: 527–535.
Rodman, L. (1978) Or: the many-armed bandit problem. Ann. Prob. 6: 491–498.
Sobel, M. and Weiss, G. H. (1970) Play-the-winner sampling for selecting the better of two binomial populations. Biometrika 57: 357–365.
Zaborskis, A. A. (1976) Sequential Bayesian plan for choosing the best method of medical treatment. Avtomatika i Telemekhanika 2: 144–153.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 1985 D. A. Berry and B. Fristedt
About this chapter
Cite this chapter
Berry, D.A., Fristedt, B. (1985). Independent Bernoulli arms. In: Bandit problems. Monographs on Statistics and Applied Probability. Springer, Dordrecht. https://doi.org/10.1007/978-94-015-3711-7_4
Download citation
DOI: https://doi.org/10.1007/978-94-015-3711-7_4
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-015-3713-1
Online ISBN: 978-94-015-3711-7
eBook Packages: Springer Book Archive