Advertisement

Research in Higher Education

, Volume 50, Issue 6, pp 608–622 | Cite as

A Note on the Calculation and Interpretation of the Delta-p Statistic for Categorical Independent Variables

  • Ty M. Cruce
Article

Abstract

This methodological note illustrates how a commonly used calculation of the Delta-p statistic is inappropriate for categorical independent variables, and this note provides users of logistic regression with a revised calculation of the Delta-p statistic that is more meaningful when studying the differences in the predicted probability of an outcome between two or more groups. Although one cannot fully document the extent to which this error in the current calculation of the Delta-p statistic has spread across the field, the potential for error is far reaching as an increasing number of researchers use logistic regression to study categorical outcomes and as researchers look more closely at the Delta-p statistic as a means to communicate the results of logistic regression models to policy makers and administrators. It is recommended that higher education scholars and institutional researchers use caution when reporting the Delta-p statistic from prior studies and that they adopt the revised calculation of the Delta-p statistic presented in this methodological note when estimating logistic regression models with categorical independent variables.

Keywords

Delta-p statistic Logistic regression Predictor variables Higher education research Multivariate statistics 

Notes

Acknowledgements

I would like to thank J. Scott Long, Thomas F. Nelson Laird, Stephen R. Porter, Robert K. Toutkoushian and two anonymous reviewers for commenting on previous drafts of this manuscript. Any errors are my own.

References

  1. Agresti, A. (2002). Categorical data analysis (2nd ed.). New Jersey: John Wiley and Sons, Inc.Google Scholar
  2. Arbona, C., & Nora, A. (2007). The influence of academic and environmental factors on Hispanic college degree attainment. The Review of Higher Education, 30, 247–269.CrossRefGoogle Scholar
  3. Cabrera, A. F. (1994). Logistic regression analysis in higher education: An applied perspective. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. X, pp. 225–256). New York: Agathon Press.Google Scholar
  4. Cheng, S., & Long, J. S. (2000). XPost: Excel workbooks for the post-estimation interpretation of regression models for categorical dependent variables. Retrieved June 10, 2008 from http://www.indiana.edu/~jslsoc/web_spost/sp_xpost.htm
  5. DesJardins, S. L. (2001). Assessing the effects of changing institutional aid policy. Research in Higher Education, 42, 653–678.CrossRefGoogle Scholar
  6. Hu, S., & Hossler, D. (2000). Willingness to pay and preference for private institutions. Research in Higher Education, 41, 685–701.CrossRefGoogle Scholar
  7. Hu, S., & St. John, E. P. (2001). Student persistence in a public higher education system: Understanding racial and ethnic differences. The Journal of Higher Education, 72, 265–286.CrossRefGoogle Scholar
  8. Kauffman, R. L. (1996). Comparing effects in dichotomous logistic regression: A variety of standardized coefficients. Social Science Quarterly, 77, 90–109.Google Scholar
  9. Kim, D. (2004). The effect of financial aid on students’ college choice: Differences by racial groups. Research in Higher Education, 45, 43–70.CrossRefGoogle Scholar
  10. Kulis, S., Sicotte, D., & Collins, S. (2002). More than a pipeline problem: Labor supply constraints and gender stratification across academic science disciplines. Research in Higher Education, 43, 657–691.CrossRefGoogle Scholar
  11. Long, J. S. (1997). Regression models for categorical and limited dependent variables. Thousand Oaks, CA: Sage Publications, Inc.Google Scholar
  12. Long, J. S., & Freese, J. (2003). Regression models for categorical dependent variables using Stata. College Station, TX: Stata Press.Google Scholar
  13. McLendon, M. K., Heller, D. E., & Young, S. P. (2005). State postsecondary policy innovation: Politics, competition, and the interstate migration of policy ideas. The Journal of Higher Education, 76, 363–400.CrossRefGoogle Scholar
  14. Millett, C. M. (2003). How undergraduate loan debt affects application and enrollment in graduate or first professional school. The Journal of Higher Education, 74, 386–427.CrossRefGoogle Scholar
  15. Paulsen, M. B., & St. John, E. P. (2002). Social class and college costs: Examining the financial nexus between college choice and persistence. The Journal of Higher Education, 73, 189–236.CrossRefGoogle Scholar
  16. Peng, C. J., So, T. H., Stage, F. K., & St. John, E. P. (2002). The use and interpretation of logistic regression in higher education journals: 1988–1999. Research in Higher Education, 43, 259–293.CrossRefGoogle Scholar
  17. Perna, L. W. (2000). Differences in the decision to attend college among African Americans, Hispanics, and Whites. The Journal of Higher Education, 71, 117–141.CrossRefGoogle Scholar
  18. Perna, L. W. (2001a). The contributions of historically black colleges and universities to the preparation of African Americans for faculty careers. Research in Higher Education, 42, 267–294.CrossRefGoogle Scholar
  19. Perna, L. W. (2001b). Sex and race differences in faculty tenure and promotion. Research in Higher Education, 42, 541–567.CrossRefGoogle Scholar
  20. Perna, L. W. (2002). Sex differences in the supplemental earnings of college and university faculty. Research in Higher Education, 43, 31–58.CrossRefGoogle Scholar
  21. Perna, L. W. (2003). The status of women and minorities among community college faculty. Research in Higher Education, 44, 205–240.CrossRefGoogle Scholar
  22. Perna, L. W. (2005). The benefits of higher education: Sex, racial/ethnic, and socioeconomic group differences. The Review of Higher Education, 29, 23–52.CrossRefGoogle Scholar
  23. Petersen, T. (1985). A comment on presenting results from logit and probit models. American Sociological Review, 50, 130–131.CrossRefGoogle Scholar
  24. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd). Advanced quantitatie techniques in the social sciences series 1. Thousand Oaks, CA: Sage Publications.Google Scholar
  25. Smith, J. S., Szelest, B. P., & Downey, J. P. (2004). Implementing outcomes assessment in an academic affairs support unit. Research in Higher Education, 45, 405–427.CrossRefGoogle Scholar
  26. St. John, E. P., Hu, S., Simmons, A., Carter, D. E., & Weber, J. (2004). What difference does a major make? The influence of college major field on persistence by African American and White students. Research in Higher Education, 45, 209–232.CrossRefGoogle Scholar
  27. St. John, E. P., Hu, S., Simmons, A., & Musoba, G. D. (2001). Aptitude vs. merit: What matters in persistence. The Review of Higher Education, 24, 131–152.Google Scholar
  28. St. John, E. P., Musoba, G. D., & Simmons, A. (2003). Keeping the promise: The impact of Indiana’s twenty-first century scholars program. The Review of Higher Education, 27, 103–123.CrossRefGoogle Scholar
  29. St. John, E. P., Paulsen, M. B., & Carter, D. F. (2005). Diversity, college costs, and postsecondary opportunity: An examination of the financial nexus between college choice and persistence for African Americans and Whites. The Journal of Higher Education, 76, 545–569.CrossRefGoogle Scholar
  30. Titus, M. A. (2004). An examination of the influence of institutional context on student persistence at 4-year colleges and universities: a multilevel approach. Research in Higher Education, 45, 673–699.CrossRefGoogle Scholar
  31. Wolniak, G. C., & Engberg, M. E. (2007). The effects of high school feeder networks on college enrollment. The Review of Higher Education, 31, 27–53.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.University Planning, Institutional Research, and AccountabilityIndiana UniversityBloomingtonUSA

Personalised recommendations