Advertisement

Partitioning Variance Into Constituents in Multiple Regression Models: Commonality Analysis

  • Burhanettin OzdemirEmail author
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 89)

Abstract

Commonality analysis is a method of partitioning the explained variance in a multiple regression analysis into variance constituents associated with each independent variable uniquely and variance associated with common effects of one or more independent variables in various combinations. By partitioning variance, commonality analysis helps to determine accurately the degree of multicollinearity between the independent variables, suppressor variable and related importance of independent variables. In addition, commonality analysis provides regression effects (R 2) of all possible simple and multiple regression models that can be constructed by the independent variables and thus helps researchers choose the most appropriate regression model. The purposes of this study are to (a) provide a general overview of multiple regression analysis and its application, (b) explain how to conduct commonality analysis in a regression model, and (c) determine the degree of multicollinearity between independent variables and suppressor variable in the model by means of commonality analysis results. For these purposes, OBBS data set which was collected during a project in Turkey was used to provide a heuristic example. In this example, three independent variables that are assumed to predict students’ academic performance were selected to create model and then multiple regression analysis and commonality analysis were conducted.

Keywords

Variance analysis Commonality analysis Multiple regression models 

References

  1. Amado AJ (2003) Partitioning predicted variance into constituent parts: a primer on regression commonality analysis. Res Schools 10(1):91–97Google Scholar
  2. Courville T, Thompson B (2001) Use of structure coefficients in published multiple regression articles: B is not enough. Educ Psychol Meas 61:229–248. doi: 10.1177/0013164401612006 MathSciNetGoogle Scholar
  3. Eğitim, Araştırma ve Geliştirmesi Daire Başkanlığı (EARGED) (2010) İlköğretim ÖBBS raporu 2005. Ankara, Milli Eğitim Bakanlığı. http://yegitek.meb.gov.tr/dosyalar/obbs/2005/matematik.pdf
  4. Gill CS, Barrio Minton CA, Myers JE (2010) Spirituality and religiosity: factors affecting wellness among low-income, rural women. J Couns Dev 77:293–303CrossRefGoogle Scholar
  5. Harlow LL (2005) What is multivariate thinking? The essence of multivariate thinking. Lawrence Erlbaums, Mahwah, pp 3–27Google Scholar
  6. Mood AM (1971) Partitioning variance in multiple regression analyses as a tool for developing learning models. Am Educ Res J 8:191–202CrossRefGoogle Scholar
  7. Nimon K, Gavrilova M (2010, February) Commonality analysis: Demonstration of an SPSS solution for regression analysis. Poster presented at the 2010 Conference, University of Illinois at Urbana-ChampaignGoogle Scholar
  8. Nimon K, Reio TG Jr (2011) Regression commonality analysis: a technique for quantitative theory. Hum Resource Dev Rev 10:329. doi: 10.1177/1534484311411077 CrossRefGoogle Scholar
  9. Nimon K, Lewis M, Kane R, Haynes RM (2008) An R package to compute commonality coefficients in the multiple regression case: an introduction to the package and a practical example. Behav Res Methods 40:457–466. doi:  10.3758/BKM204020220457
  10. Nimon K, Gavrilova M, Roberts JK (2010) Regression results in human resource development research: Are we reporting enough? In: Graham C, Dirani K (eds) Proceedings of the human resource development 2010 international conference, AHRD, Knoxville, TN, pp. 803–812Google Scholar
  11. Pedhazur EJ (1997) Multiple regression in behavioral research: explanation and prediction, 3rd edn. Harcourt Brace, Ft WorthzbMATHGoogle Scholar
  12. Seibold DR, McPhee RD (1979) Commonality analysis: a method for decomposing explained variance in multiple regression analysis. Hum Commun Res 5:355–363CrossRefGoogle Scholar
  13. Smith RL, Ager JW Jr, Williams DL (1992) Suppressor variables in multiple regression/correlation. Educ Psychol Meas 52:17–29. doi: 10.1177/001316449205200102 CrossRefGoogle Scholar
  14. Sorice MG, Conner JR (2010) Predicting private landowner intentions to enroll in an incentive program to protect endangered species. Hum Dimens Wildl 15(2):77–89CrossRefGoogle Scholar
  15. Stevens JP (2009) Applied multivariate statistics for the social sciences, 5th edn. Routledge, New YorkGoogle Scholar
  16. Thompson B (1995) Stepwise regression and stepwise discriminant analysis need not apply here: a guidelines editorial. Educ Psychol Meas 55(4):525–534CrossRefGoogle Scholar
  17. Thompson B (2006) Foundations of behavioral statistics: an insight-based approach. The Guilford Press, New YorkGoogle Scholar
  18. Thompson B, Borrello GM (1985) The importance of structure coefficients in regression research. Educ Psychol Meas 45:203–209Google Scholar
  19. Warne RT (2011) Beyond multiple regression: using commonality analysis to better understand R2 results. Gift Child Q 55:313–318. doi: 10.1177/0016986211422217 CrossRefGoogle Scholar
  20. Zientek LR, Thomspon B (2006) Commonality analysis: partitioning variance to facilitate better understanding of data. J Early Interv 28(4):299–307CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Hacettepe UniversityAnkaraTurkey

Personalised recommendations