Known Effects

  • Paul R. Rosenbaum
Part of the Springer Series in Statistics book series (SSS)


As seen in Chapter 4, observational studies vary considerably in their sensitivity to hidden bias. The study of coffee and myocardial infarction in §4.4.5 is sensitive to small biases while the studies of smoking and lung cancer in §4.3.3 or DES and vaginal cancer in §4.4.5 are sensitive only to biases that are many times larger. If sensitive to small biases, a study is especially open to the criticism that a particular unrecorded covariate was not controlled because, in this case, small differences in an important covariate can readily explain the difference in outcomes in treated and control groups. Still, all observational studies are sensitive to sufficiently large biases, and large biases have occurred on occasion; see §4.4.3. A sensitivity analysis shows how biases of various magnitudes might alter conclusions, but it does not indicate whether biases are present or what magnitudes are plausible.


Childhood Cancer Disincentive Effect Nuclear Testing Disability Insurance Arrest Rate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Beck, H. L. and Krey, P. W. (1983) Radiation exposures in Utah from Nevada nuclear tests. Science, 220, 18–24.CrossRefGoogle Scholar
  2. Bound, J. (1989) The health and earnings of rejected disability insurance applicants. American Economic Review, 79, 482–503.Google Scholar
  3. Bound, J. (1991) The health and earnings of rejected disability insurance applicants: Reply. American Economic Review, 81, 1427–1434.Google Scholar
  4. Campbell, D. T. (1966) Pattern matching as an essential in distal knowing. In: The Psychology of Egon Brunswik, Kenneth Hammond, ed., New York: Holt, Rinehart and Winston, pp. 81–106.Google Scholar
  5. Campbell, D. T. (1969) Reforms as experiments. American Psychologist, 24, 409–429.CrossRefGoogle Scholar
  6. Campbell, D. T. and Stanley, J. (1963) Experimental and Quasi Experimental Designs for Research. Chicago: Rand McNally.Google Scholar
  7. Cook, T. D. (1991) Clarifying the warrant for generalized causal inferences in quasi-experimentation. In: Evaluation and Education at Quarter Century, M. W. McLaughlin and D. Phillips, eds., NSSE 1991 Yearbook, pp. 115–144.Google Scholar
  8. Cook, T. D., Campbell, D. T. and Peracchio, L. (1990) Quasi Experimentation. In: Handbook of Industrial and Organizational Psychology, M. Dunnette and L. Hough, eds., Palo Alto, CA: Consulting Psychologists Press, Chapter 9, pp. 491–576.Google Scholar
  9. D’Abadie, C. and Proschan, F. (1984) Stochastic versions of rearrangement inequalities. In Inequalities in Statistics and Probability, Y. L. Tong, ed., Hayward, CA: Institute of Mathematical Statistics, pp. 4–12.CrossRefGoogle Scholar
  10. Donohue, J. J. and Levitt, S. D. (2001) Legalized abortion and crime. Quarterly Journal of Economics, 116, 379–420.CrossRefGoogle Scholar
  11. Gastwirth, J. (1988) Statistical Reasoning in Law and Public Policy. New York: Academic.zbMATHGoogle Scholar
  12. Hill, A. B. (1965) The environment and disease: Association or causation? Proceedings of the Royal Society of Medicine, 58, 295–300.Google Scholar
  13. Hollander, M., Proschan, F., and Sethuraman, J. (1977) Functions decreasing in transposition and their applications in ranking problems. Annals of Statistics, 5, 722–733.MathSciNetzbMATHCrossRefGoogle Scholar
  14. Infante, P., Rinsky, R., Wagoner, J., and Young, R. (1977) Leukemia in benzene workers. Lancet, July 9, 76–78.CrossRefGoogle Scholar
  15. Kreiger, N., Kelsey, J., Holford, T., and O’Connor, T. (1982) An epidemiologic study of hip fracture in postmenopausal women. American Journal of Epidemiology, 116, 141–148.Google Scholar
  16. Krieger, A. M. and Rosenbaum, P. R. (1994) A stochastic comparison for arrangement increasing functions. Combinatorics, Probability and Computing, 3, 345–348.MathSciNetzbMATHCrossRefGoogle Scholar
  17. Land, C. E. (1979) The hazards of fallout or of epidemiologic research. New England Journal of Medicine, 300, 431–432.CrossRefGoogle Scholar
  18. Legorreta, A. P., Silber, J. H., Costantino, G. N., Kobylinski, R. W., and Zatz, S. L. (1993) Increased cholecystectomy rate after the introduction of laparoscopic cholecystectomy. Journal of the American Medical Association, 270, 1429–1432.CrossRefGoogle Scholar
  19. Lilienfeld, A. (1959) On the methodology of investigations of etiologic factors in chronic diseases-Some comments. Journal of Chronic Diseases, 10, 41–46.CrossRefGoogle Scholar
  20. Lyon, J. L., Klauber, M. R., Gardner, J. W., and Udall, K. S. (1979) Childhood leukemias associated with fallout from nuclear testing. New England Journal of Medicine, 300, 397–402.CrossRefGoogle Scholar
  21. Mittleman, M. A., Maclure, M., Sherwood, J. B., Mulry, R. P., Tofler, G. H., Jacobs, S. C., Friedman, R., Benson, H., and Muller, J. E. (1995) Triggering of acute myocardial infaction onset by episodes of anger. Circulation, 92, 1720–1725.CrossRefGoogle Scholar
  22. Parsons, D. O. (1980) The decline of male labor force participation. Journal of Political Economy, 88, 117–134.CrossRefGoogle Scholar
  23. Parsons, D. O. (1991) The health and earnings of rejected disability insurance applicants: Comment. American Economic Review, 81, 1419–1426.Google Scholar
  24. Petitti, D., Perlman, J., and Sidney, S. (1986) Postmenopausal estrogen use and heart disease. New England Journal of Medicine, 315, 131–132.CrossRefGoogle Scholar
  25. Rosenbaum, P. R. (1984a) From association to causation in observational studies. Journal of the American Statistical Association, 79, 41–48.MathSciNetzbMATHCrossRefGoogle Scholar
  26. Rosenbaum, P. R. (1984b) The consequences of adjustment for a concomitant variable that has been affected by the treatment. Journal of the Royal Statistical Society, Series A,147, 656–666.CrossRefGoogle Scholar
  27. Rosenbaum, P. R. (1989a) On permutation tests for hidden biases in observational studies: An application of Holley’s inequality to the Savage lattice. Annals of Statistics, 17, 643–653.MathSciNetzbMATHCrossRefGoogle Scholar
  28. Rosenbaum, P. R. (1989b) The role of known effects in observational studies. Biometrics, 45, 557–569.MathSciNetzbMATHCrossRefGoogle Scholar
  29. Rosenbaum, P. R. (1992) Detecting bias with confidence in observational studies. Biometrika, 79, 367–374.zbMATHCrossRefGoogle Scholar
  30. Ross, H. L., Campbell, D. T., and Glass, G. V. (1970) Determining the social effects of a legal reform: The British “Breathalyser” crackdown of 1967. American Behavioral Scientist, 13, 493–509.CrossRefGoogle Scholar
  31. Rothman, K. (1986) Modern Epidemiology. Boston: Little, Brown.Google Scholar
  32. Sackett, D. (1979) Bias in analytic research. Journal of Chronic Diseases, 32, 51–68.CrossRefGoogle Scholar
  33. Sartwell, P. (1960) On the methodology of investigations of etiologic factors in chronic diseases: Further comments. Journal of Chronic Diseases, 11, 61–63.CrossRefGoogle Scholar
  34. Shadish, W. R. and Cook, T. D. (1999) Design rules: More steps toward a complete theory of quasi-experimentation. Statistical Science, 14, 294–300.Google Scholar
  35. Shadish, W. R., Cook, T. D., and Campbell, D. T. (2002) Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton-Mifflin.Google Scholar
  36. Skerfving, S., Hansson, K., Mangs, C., Lindsten, J., and Ryman, N. (1974) Methylmercury-induced chromosome damage in man. Environmental Research, 7, 83–98.CrossRefGoogle Scholar
  37. Susser, M. (1973) Causal Thinking in the Health Sciences: Concepts and Strategies in Epidemiology. New York: Oxford University Press.Google Scholar
  38. Trichopoulos, D., Katsouyanni, K., Zavitsanos, X., Tzonou, A., and DallaVorgia, P. (1983) Psychological stress and fatal heart attack: The Athens 1981 earthquake natural experiment. Lancet, 26 February, 441–444.CrossRefGoogle Scholar
  39. Yerushalmy, J. and Palmer, C. (1959) On the methodology of investigations of etiologic factors in chronic diseases. Journal of Chronic Diseases, 10, 27–40.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2002

Authors and Affiliations

  • Paul R. Rosenbaum
    • 1
  1. 1.Department of Statistics, The Wharton SchoolUniversity of PennsylvaniaPhiladelphiaUSA

Personalised recommendations