Skip to main content
SpringerLink
Log in
SpringerLink
Log in

The Use of Matching Methods in Higher Education Research: Answering Whether Attendance at a 2-Year Institution Results in Differences in Educational Attainment

  • Chapter
Higher Education: Handbook of Theory and Research

Part of the book series: Higher Education: Handbook of Theory and Research ((HATR,volume 24))

Abstract

This chapter provides readers with the conceptual and statistical underpinnings of matching methods. These methods have gained in popularity in recent years given the push to make stronger inferential statements about the impact of educational interventions and policies. Given the likelihood of nonrandom assignment into “treatments” in higher education, matching methods seem particularly well suited to apply in many educational research contexts. We demonstrate the use of these methods by examining whether there are differences in educational outcomes depending on whether students begin their postsecondary careers in a 2- or 4-year institution. Our results indicate that estimates of the educational outcomes examined are sensitive to the choice of analytic methods employed. These results provide evidence that remedying nonrandom assignment problems that are often encountered in higher education research is important if we hope to provide accurate information to our colleagues and educational policymakers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Abadie, A., & Imbens, G. W. (2006a). Large sample properties of matching estimators for average treatment effects. Econometrica, 74(1), 235–267.

    Article  Google Scholar 

  • Abadie, A., & Imbens, G. W. (2006b). On the failure of the bootstrap for matching estimators. National Bureau of Economic Research Working Paper, 0325

    Google Scholar 

  • Abadie, A., Drukker, D., Leber Herr, J., & Imbens, G. W. (2004). Implementing matching estimators for average treatment effects in STATA. The Stata Journal, 4(3), 290–311.

    Google Scholar 

  • Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91(434), 444–455.

    Article  Google Scholar 

  • Ashenfelter, O., & Krueger, A. (1994). Estimates of the economic return to schooling from a new sample of twins. American Economic Review, 84(5), 1157–1173

    Google Scholar 

  • Azevedo, J. P., Dolton, P., & Smith, J. (2005). The Econometric Evaluation of the New Deal for Lone Parents. UK Department of Work and Pensions Research Report no. 356

    Google Scholar 

  • Becker, S. O., & Ichino, A. (2002). Estimation of average treatment effects based on propensity scores. The Stata Journal, 2(4), 358–377.

    Google Scholar 

  • Behrman, J. R., Cheng, Y., & Todd, P. E. (2004). Evaluating preschool programs when length of exposure to the program varies: A nonparametric approach. Review of Economics and Statistics, 86(1), 108–132.

    Article  Google Scholar 

  • Black, D. A., & Smith, J. A. (2004). How robust is the evidence on the effects of college quality? Evidence from matching. Journal of Econometrics, 121(1–2), 99–124.

    Article  Google Scholar 

  • Bound, J., Jaeger, D. A., & Baker, R. M. (1995). Problems with instrumental variables estimation when the correlation between the instruments and the endogeneous explanatory variable is weak. Journal of the American Statistical Association, 90(430), 443–450.

    Article  Google Scholar 

  • Brownstone, D., & Valletta, R. (2001). The bootstrap and multiple imputations: Harnessing increased computing power for improved statistical tests. Journal of Economic Perspectives, 15(4), 129–141.

    Article  Google Scholar 

  • Caliendo, M., & Kopeinig, S. (2008). Some practical guidance for the implementation of propensity score matching. Journal of Economic Surveys, 22(1), 31–72.

    Article  Google Scholar 

  • Card, D. (1995). Using geographic variation in college proximity to estimate the return to schooling. In Aspects of Labour Market Behaviour: Essays in Honour of John Vanderkamp (pp. 201–222). Toronto/Buffalo/London: University of Toronto Press,.

    Google Scholar 

  • Cochran, W. G. (1968). The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics, 24(2), 295–313.

    Article  Google Scholar 

  • Cook, T. D. (2002). Randomized experiments in educational policy research: A critical examination of the reasons the educational evaluation community has offered for not doing them. Educational Evaluation and Policy Analysis, 24(3), 175–199.

    Article  Google Scholar 

  • Crump, R. K., Hotz, V. J., Imbens, G. W., & Mitnik, O. A. (2006). Moving the Goalposts: Addressing Limited Overlap in the Estimation of Average Treatment Effects by Changing the Estimand. National Bureau of Economic Research Working Paper, 0330.

    Google Scholar 

  • Dehejia, R. (2005). Practical propensity score matching: A reply to Smith and Todd. Journal of Econometrics, 125(1–2), 355–364.

    Article  Google Scholar 

  • Dehejia, R. H., & Wahba, S. (1999). Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association, 94(448), 1053–1062.

    Article  Google Scholar 

  • Dehejia, R. H., & Wahba, S. (2002). Propensity score-matching methods for nonexperimental causal studies. Review of Economics and Statistics, 84(1), 151–161.

    Article  Google Scholar 

  • DesJardins, S. L., & McCall, B. P. (2006). Investigating the Causal Impact of the Gates Millennium Scholars Program on the Correlates of College Completion, Graduation from College, and Future Educational Aspirations of Low-Income Minority Students. A Report to the Bill and Melinda Gates Foundation.

    Google Scholar 

  • DesJardins, S. L., & McCall, B. P. (2008). The Impact of the Gates Millennium Scholars Program on the College Enrollment, Borrowing and Work Behavior of Low-Income Minority Students. A Report to the Bill and Melinda Gates Foundation.

    Google Scholar 

  • Frolich, M. (2004). Finite-sample properties of propensity-score matching and weighting estimators. Review of Economics and Statistics, 86(1), 77–90.

    Article  Google Scholar 

  • Hahn, J., Todd, P. & Van der Klaauw, W. (2002). Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica, 69(1), 201–209.

    Article  Google Scholar 

  • Heckman, J. (2008). Econometric Causality. National Bureau of Economic Research Working Paper, 13934.

    Google Scholar 

  • Heckman, J., & Navarro-Lozano, S. (2004). Using matching, instrumental variables, and control functions to estimate economic choice models. Review of Economics and Statistics, 86(1), 30–57.

    Article  Google Scholar 

  • Heckman, J. J., & Robb, R., Jr. (1985). Alternative methods for evaluating the impact of interventions. Longitudinal Analysis of Labor Market Data, Econometric Society Monographs series, no. 10. 156–245.

    Google Scholar 

  • Heckman, J. J., Ichimura, H., & Todd, P. E. (1997). Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme. Review of Economic Studies, 64(4), 605–654.

    Article  Google Scholar 

  • Heckman, J. J., Ichimura, H., Smith, J., & Todd, P. E. (1998a). Characterizing selection bias using experimental data. Econometrica, 66(5), 1017–1098.

    Article  Google Scholar 

  • Heckman, J. J., Ichimura, H., & Todd, P. E. (1998b). Matching as an econometric evaluation estimator. Review of Economic Studies, 65(2), 261–294.

    Article  Google Scholar 

  • Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81(396), 945–960.

    Article  Google Scholar 

  • Imbens, G. W., & Angrist, J. D. (1994). Identification and estimation of local average treatment effects. Econometrica, 62(2), 467–475.

    Article  Google Scholar 

  • Kaestle, C. F. (1993). The awful reputation of educational research. Educational Researcher, 22, 23–31.

    Google Scholar 

  • Kaplan, D. (n.d.). Causal Inference in Educational Policy Research. Working paper, Wisconsin Center for Education Research, WI.

    Google Scholar 

  • Kennedy, P. (2003). A Guide to Econometrics: Fifth Edition. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Lagemann, E. C. (1999). An auspicious moment for education research? In E. C. Lagemann & L. S. Shulman (Eds.), Issues in Education Research: Problems and Possibilities (pp. 3–16). San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Lagemann, E. C. (2000). An Elusive Science: The Troubling History of Education Research. Chicago, IL: University of Chicago Press.

    Google Scholar 

  • Lechner, M. (2000). A Note on the Common Support Problem in Applied Evaluation Studies. Discussion paper 2001–01, Department of Economics, University of St. Gallen, Switzerland.

    Google Scholar 

  • Lechner, M. (2001). Identification and Estimation of Causal Effects of Multiple. Treaments under the Conditional Independence Assumption. Econometric evaluation of labour market policies (pp. 43–58). Zew Economic Studies, vol. 13.

    Google Scholar 

  • Leigh, D. E., & Gill, A. M. (2003). Do community colleges really divert students from earning bachelor's degrees? Economics of Education Review, 22(1), 23–30.

    Article  Google Scholar 

  • Leuven, E., & Sianesi, B. (2003). PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing. http:// ideas.repec.org/c/boc/bocode/s432001.html. Version 3.0.0.

  • Levin, J. R., & O'Donnell, A. M. (1999). What to do about educational research's credibility gaps? Issues in Education, 5(2), 177–229.

    Article  Google Scholar 

  • Morgan, S. L., & Harding, D. J. (2006). Matching estimators of causal effects: Prospects and pitfalls in theory and practice. Sociological Methods and Research, 35(1), 3–60.

    Article  Google Scholar 

  • Morgan, S. L., & Winship, C. (2007). Counterfactuals and Causal Inference: Methods and Principles for Social Research. Cambridge: Cambridge University Press.

    Google Scholar 

  • Neyman, J. (1923). On the application of probability theory to agricultural experiments: Principles (in Polish with German Summary). Roczniki Nauk Rolniczch, 10, 21–51.

    Google Scholar 

  • Pagan, A.R., & Ullah, A. (1999). Nonparametric econometrics/Adrian Pagan, Aman Ullah. Cambridge, UK; New York, NY: Cambridge University Press.

    Google Scholar 

  • Reynolds, C. L. (2007). Three Essays on Policies and Politics in Higher Education. Unpublished Dissertation, University of Michigan, Ann Arbor, MI.

    Google Scholar 

  • Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55.

    Article  Google Scholar 

  • Rosenbaum, P. R., & Rubin, D. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. The American Statistician, 39(1), 33–38.

    Article  Google Scholar 

  • Rouse, C. E. (1995). Democratization or diversion? The effect of community colleges on educational attainment. Journal of Business and Economic Statistics, 13(2), 217–224.

    Article  Google Scholar 

  • Rouse, C. E. (1998). Do two-year colleges increase overall educational attainment? Evidence from the states. Journal of Policy Analysis and Management, 17(4), 595–620.

    Article  Google Scholar 

  • Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688–701.

    Article  Google Scholar 

  • Schneider, B., Carnoy, M., Kilpatrick, J., Schmidt, W. H., & Shavelson, R. J. (2007). Estimating Causal Effects Using Experimental and Observational Designs. Washington, DC: American Educational Research Association.

    Google Scholar 

  • Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston, MA: Houghton-Mifflin.

    Google Scholar 

  • Shavelson, R. J., & Berliner, D. C. (1988). Erosion of the education research infrastructure. Educational Researcher, 17(1), 9–12.

    Google Scholar 

  • Silverman, B. W. (1986). Density estimation for statistics and data analysis. London; New York: Chapman and Hall.

    Google Scholar 

  • Smith, J. A., & Todd, P. E. (2005a). Does matching overcome LaLonde's critique of nonexperimental estimators? Journal of Econometrics, 125(1–2), 305–353.

    Article  Google Scholar 

  • Smith, J. A., & Todd, P. E. (2005b). Does matching overcome LaLonde's critique of nonexperimental estimators? Rejoinder. Journal of Econometrics, 125(1–2), 365–375.

    Article  Google Scholar 

  • Sroufe, G. E. (1997). Improving the “Awful Reputation” of education research. Educational Researcher, 26(7), 26–28.

    Google Scholar 

  • Thistlethwaite, D. L., & Campbell, D. T. (1960). Regression discontinuity analysis: An alternative to the ex post facto experiment. Journal of Educational Psychology, 51, 309–317.

    Article  Google Scholar 

  • Weiss, C. H. (1999). Research-policy linkages: How much influence does social science research have? In UNESCO, World Social Science Report 1999 (pp. 194–205). Paris: UNESCO/ Elsevier.

    Google Scholar 

  • Whitehurst, G. J. (2003). The Institute of Education Sciences: New Wine, New Bottles. Speech to the American Educational Research Association's Annual Conference, April 22, 2003. Retrieved from http://ies.ed.gov/director/pdf/2003_04_22.pdf, April 22, 2008.

  • Winship, C., & Morgan, S. L. (1999). The estimation of causal effects from observational data. Annual Review of Sociology, 25, 659–707.

    Article  Google Scholar 

  • Wooldridge, J. M. (2002). Econometric Analysis of Cross Section and Panel Data. Cambridge, MA: MIT Press.

    Google Scholar 

  • Zanutto, E. L. (2006). A comparison of propensity score and linear regression analysis of complex survey data. Journal of Data Science, 4(1), 67–91.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Economics, College of Business Administration, Kent State University, USA

    C. Lockwood Reynolds

  2. Center for the Study of Higher and Postsecondary Education, School of Education, University of Michigan, USA

    Stephen L. DesJardins

Authors
  1. C. Lockwood Reynolds
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stephen L. DesJardins
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. College of Education, University of Memphis, USA

    John C. Smart

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Reynolds, C.L., DesJardins, S.L. (2009). The Use of Matching Methods in Higher Education Research: Answering Whether Attendance at a 2-Year Institution Results in Differences in Educational Attainment. In: Smart, J.C. (eds) Higher Education: Handbook of Theory and Research. Higher Education: Handbook of Theory and Research, vol 24. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-9628-0_2

Download citation

Publish with us

Policies and ethics

Search

Navigation