Randomized Experiments

  • Paul R. Rosenbaum
Part of the Springer Series in Statistics book series (SSS)


Observational studies and controlled experiments have the same goal, inference about treatment effects, but random assignment of treatments is present only in experiments. This chapter reviews the role of randomization in experiments, and so prepares for discussion of observational studies in later chapters. A theory of observational studies must have a clear view of the role of randomization, so it can have an equally clear view of the consequences of its absence. Sections 2.1 and 2.2 give two examples, first a large controlled clinical trial, and then a small but famous example due to Sir Ronald Fisher, who is usually credited with the invention of randomization, which he called the “reasoned basis for inference” in experiments. Later sections discuss the meaning of this phrase, that is, the link between randomization and statistical methods. Most of the material in this chapter is quite old.


Partial Order Random Assignment Treatment Assignment Isotonic Function Adjusted Response 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Ahlswede, R. and Daykin, D. (1978). An inequality for the weights of two families of sets, their unions, and intersections. Z. Wahrsch. Verus Gebiete, 43, 183–185.MathSciNetCrossRefzbMATHGoogle Scholar
  2. Anderson, I. (1987). Combinatorics of Finite Sets. New York: Oxford University Press.zbMATHGoogle Scholar
  3. Birch, M.W. (1964). The detection of partial association, I: The 2 x 2 case. Journal of the Royal Statistical Society, Series B, 26, 313–324.MathSciNetzbMATHGoogle Scholar
  4. Birch, M.W. (1965). The detection of partial association, II: The general case. Journal of the Royal Statistical Society, Series B, 27, 111–124.MathSciNetzbMATHGoogle Scholar
  5. Bollobas, B. (1986). Combinatorics. New York: Cambridge University Press.zbMATHGoogle Scholar
  6. Campbell, D. and Stanley, J. (1963). Experimental and Quasi-Experimental Designs for Research. Chicago: Rand McNally.Google Scholar
  7. Cochran, W.G. (1963). Sampling Techniques. New York: Wiley.Google Scholar
  8. Cox, D.R. (1958a). Planning of Experiments. New York: Wiley.zbMATHGoogle Scholar
  9. Cox, D.R. (1958b). The interpretation of the effects of non-additivity in the Latin square. Biometrika, 45, 69–73.zbMATHGoogle Scholar
  10. Cox, D.R. (1966). A simple example of a comparison involving quantal data. Biometrika, 53, 215–220.MathSciNetCrossRefGoogle Scholar
  11. Cox, D.R. (1970). The Analysis of Binary Data. London: Methuen.zbMATHGoogle Scholar
  12. Cox, D.R. and Hinkley, D.V. (1974). Theoretical Statistics. London: Chapman & Hall.zbMATHGoogle Scholar
  13. Eaton, M. (1967). Some optimum properties of ranking procedures. Annals of Mathematical Statistics, 38, 124–137.MathSciNetCrossRefzbMATHGoogle Scholar
  14. Eaton, M. (1982). A review of selected topics in probability inequalities. Annals of Statistics, 10, 11–43.MathSciNetCrossRefzbMATHGoogle Scholar
  15. Eaton, M. (1987). Lectures on Topics in Probability Inequalities. Amsterdam: Centrum voor Wiskunde en Informatica.zbMATHGoogle Scholar
  16. Efron, B. (1971). Forcing a sequential experiment to be balanced. Biometrika, 58, 403–417.MathSciNetCrossRefzbMATHGoogle Scholar
  17. Fisher, R.A. (1935, 1949). The Design of Experiments. Edinburgh: Oliver & Boyd.Google Scholar
  18. Fortuin, C., Kasteleyn, P., and Ginibre, J. (1971). Correlation inequalities on some partially ordered sets. Communications in Mathematical Physics, 22, 89–103.MathSciNetCrossRefzbMATHGoogle Scholar
  19. Gehan, E. (1965). A generalized Wilcoxon test for comparing arbitrarily singlycensored samples. Biometrika, 52, 203–223.MathSciNetzbMATHGoogle Scholar
  20. Hamilton, M. (1979). Choosing a parameter for 2 x 2 table or 2 x 2 x 2 table analysis. American Journal of Epidemiology, 109, 362–375.Google Scholar
  21. Hettmansperger, T. (1984). Statistical Inference Based on Ranks. New York: Wiley.zbMATHGoogle Scholar
  22. Hodges, J. and Lehmann, E. (1962). Rank methods for combination of independent experiments in the analysis of variance. Annals of Mathematical Statistics, 33, 482–497.MathSciNetCrossRefzbMATHGoogle Scholar
  23. Hodges, J. and Lehmann, E. (1963). Estimates of location based on rank tests. Annals of Mathematical Statistics, 34, 598–611.MathSciNetCrossRefzbMATHGoogle Scholar
  24. Holland, P. (1986). Statistics and causal inference (with Discussion). Journal of the American Statistical Association, 81, 945–970.MathSciNetCrossRefzbMATHGoogle Scholar
  25. Hollander, M., Proschan, F., and Sethuraman, J. (1977). Functions decreasing in transposition and their applications in ranking problems. Annals of Statistics, 5, 722–733.MathSciNetCrossRefzbMATHGoogle Scholar
  26. Hollander, M. and Wolfe, D. (1973). Nonparametric Statistical Methods. New York: Wiley.zbMATHGoogle Scholar
  27. Holley, R. (1974). Remarks on the FKG inequalities. Communications in Mathematical Physics, 36, 227–231.MathSciNetCrossRefGoogle Scholar
  28. Kempthorne, O. (1952). The Design and Analysis of Experiments. New York: Wiley.zbMATHGoogle Scholar
  29. Lehmann, E.L. (1959). Testing Statistical Hypotheses. New York: Wiley.zbMATHGoogle Scholar
  30. Lehmann, E.L. (1975). Nonparametrics: Statistical Methods Based on Ranks. San Francisco: Holden-Day.zbMATHGoogle Scholar
  31. MacLane, S. and Birkoff, G. (1988). Algebra. New York: Chelsea.zbMATHGoogle Scholar
  32. Mann, H. and Whitney, D. (1947). On a test of whether one of two random variables is stochastically larger than the other. Annals of Mathematical Statistics, 18, 50–60.MathSciNetCrossRefzbMATHGoogle Scholar
  33. Mantel, N. (1963). Chi-square tests with one degree of freedom: Extensions of the Mantel-Haenszel procedure. Journal of the American Statistical Association, 58, 690–700.MathSciNetzbMATHGoogle Scholar
  34. Mantel, N. and Haenszel, W. (1959). Statistical aspects of retrospective studies of disease. Journal of the National Cancer Institute, 22, 719–748.Google Scholar
  35. Mantel, N. (1967). Ranking procedures for arbitrarily restricted observations. Biometrics, 23, 65–78.CrossRefGoogle Scholar
  36. Maritz, J. (1981). Distribution-Free Statistical Methods. London: Chapman & Hall.zbMATHGoogle Scholar
  37. Marshall, A. and Olkin, I. (1979). Inequalities: Theory of Majorization and Its Applications. New York: Academic Press.zbMATHGoogle Scholar
  38. McNemar, Q. (1947). Note on the sampling error of the differences between correlated proportions or percentage. Psychometrika, 12, 153–157.CrossRefGoogle Scholar
  39. Murphy, M., Hultgren, H., Detre, K., Thomsen, J., and Takaro, T. (1977). Treatment of chronic stable angina: A preliminary report of survival data of the randomized Veterans Administration Cooperative study. New England Journal of Medicine, 297, 621–627.CrossRefGoogle Scholar
  40. Neyman, J. (1923). On the application of probability theory to agricultural experiments. Essay on principles. Section 9. (In Polish) Roczniki Nauk Roiniczych, Tom X, pp. 1–51. Reprinted in Statistical Science 1990, 5, 463–480, with discussion by T. Speed and D. Rubin.MathSciNetGoogle Scholar
  41. Pagano, M. and Tritchler, D. (1983). Obtaining permutation distributions in polynomial time. Journal of the American Statistical Association, 78, 435–440.MathSciNetCrossRefzbMATHGoogle Scholar
  42. Robinson, J. (1973). The large sample power of permutation tests for randomization models. Annals of Statistics, 1, 291–296.MathSciNetCrossRefzbMATHGoogle Scholar
  43. Rosenbaum, P.R. (1988). Sensitivity analysis for matching with multiple controls. Biometrika, 75, 577–581.MathSciNetCrossRefzbMATHGoogle Scholar
  44. Rosenbaum, P.R. (1989). On permutation tests for hidden biases in observational studies: An application of Holley’s inequality to the Savage lattice. Annals of Statistics, 17, 643–653.MathSciNetCrossRefzbMATHGoogle Scholar
  45. Rosenbaum, P.R. (1991). Some poset statistics. Annals of Statistics, 19, 1091–1097.MathSciNetCrossRefzbMATHGoogle Scholar
  46. Rosenbaum, P.R. (1994). Coherence in observational studies. Biometrics, 50, 368–374.CrossRefzbMATHGoogle Scholar
  47. Rubin, D.B. (1974). Estimating the causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66, 688–701.CrossRefGoogle Scholar
  48. Rubin, D.B. (1977). Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics, 2, 1–26.CrossRefGoogle Scholar
  49. Rubin, D.B. (1986). Which ifs have causal answers? Journal of the American Statistical Association, 81, 961–962.Google Scholar
  50. Savage, I.R. (1957). Contributions to the theory of rank order statistics: The trend case. Annals of Mathematical Statistics, 28, 968–977.MathSciNetCrossRefzbMATHGoogle Scholar
  51. Savage, I.R. (1964). Contributions to the theory of rank order statistics: Applications of lattice theory. Review of the International Statistical Institute, 32, 52–63.MathSciNetCrossRefzbMATHGoogle Scholar
  52. Tukey, J.W. (1985). Improving crucial randomized experiments—especially in weather modification—by double randomization and rank combination. In: Proceedings of the Berkeley Conference in Honor of Jerzy Neyman and Jack Kiefer (eds., L. Le Cam and R. Olshen), Volume 1, Belmont, CA: Wadsworth, pp. 79–108.Google Scholar
  53. Welch, B.L. (1937). On the z-test in randomized blocks and Latin squares. Biometrika, 29, 21–52.zbMATHGoogle Scholar
  54. Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics, 1, 80–83.CrossRefGoogle Scholar
  55. Wilk, M.B. (1955). The randomization analysis of a generalized randomized block design. Biometrika, 42, 70–79.MathSciNetzbMATHGoogle Scholar
  56. Zelen, M. (1974). The randomization and stratification of patients to clinical trials. Journal of Chronic Diseases, 27, 365–375.MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1995

Authors and Affiliations

  • Paul R. Rosenbaum
    • 1
  1. 1.Department of StatisticsUniversity of PennsylvaniaPhiladelphiaUSA

Personalised recommendations