Advertisement

International Journal of Clinical Pharmacy

, Volume 38, Issue 3, pp 731–737 | Cite as

Using confirmatory factor analysis to manage discriminant validity issues in social pharmacy research

  • Stephen R. CarterEmail author
Commentary for the Methodology special

Abstract

Background Confirmatory factory analysis (CFA) and structural equation modelling (SEM) are increasingly used in social pharmacy research. One of the key benefits of CFA is that it allows researchers to provide evidence for the validity of internal factor structure of measurement scales. In particular, CFA can be used to provide evidence for the validity of the assertion that a hypothesized multi-dimensional scale discriminates between sub-scales. Aim This manuscript aims to provide guidance for researchers who wish to use CFA to provide evidence for the internal factor structure of measurement scales. Methods The manuscript places discriminant validity in the context of providing overall validity evidence for measurement scales. Four examples from the recent social pharmacy literature are used to critically examine the various methods which are used to establish discriminant validity. Using a hypothetical scenario, the manuscript demonstrates how commonly used output from CFA computer programs can be used to provide evidence for separateness of sub-scales within a multi-dimensional scale. Conclusion The manuscript concludes with recommendations for the conduct and reporting of studies which use CFA to provide evidence of internal factor structure of measurement scales.

Keywords

Average variance extracted Discriminant validity Structural equation modelling 

Notes

Funding

None.

Conflicts of interest

There are no conflicts of interest in authorship of this article.

References

  1. 1.
    Nelson EC, Eftimovska E, Lind C, Hager A, Wasson JH, Lindblad S. Patient reported outcome measures in practice. BMJ. 2015;350. doi: 10.1136/bmj.g7818.
  2. 2.
    Martin BA, Chui MA, Thorpe JM, Mott DA, Kreling DH. Development of a scale to measure pharmacists’ self-efficacy in performing medication therapy management services. Res Soc Adm Pharm. 2010;6(2):155–61.CrossRefGoogle Scholar
  3. 3.
    Dahl JR, Hall AM. A scale to measure pharmacy students’ self-efficacy in performing medication therapy management services. Am J Pharm Educ. 2013;77(9):191.CrossRefPubMedPubMedCentralGoogle Scholar
  4. 4.
    American Educational Research Association APA. National Council on Measurement in Education Standards for educational and psychological testing. Washington: American Psychological Association; 2014.Google Scholar
  5. 5.
    Dunn TJ, Baguley T, Brunsden V. From alpha to omega: a practical solution to the pervasive problem of internal consistency estimation. Br J Psychol. 2014;105(3):399–412.CrossRefPubMedGoogle Scholar
  6. 6.
    Gjalt-Jorn Y. Peters. The alpha and the omega of scale reliability and validity: why and how to abandon Cronbach’s alpha and the route towards more comprehensive assessment of scale quality. Eur Health Psychol. 2015;16(2). http://www.ehps.net/ehp/index.php/contents/article/view/ehp.v16.i2.p56. Accessed 8 Apr 2016.
  7. 7.
    Crutzen R, Peters G-JY. Scale quality: alpha is an inadequate estimate and factor-analytic evidence is needed first of all. Health Psychol Rev. 2015;1–6. doi: 10.1080/17437199.2015.1124240.
  8. 8.
    Pallant JF, Tennant A. An introduction to the Rasch measurement model: an example using the Hospital Anxiety and Depression Scale (HADS). Br J Clin Psychol. 2007;46(1):1–18.CrossRefPubMedGoogle Scholar
  9. 9.
    van der Eijk C, Rose J. Risky business: factor analysis of survey data—assessing the probability of incorrect dimensionalisation. PLoS One. 2015;10(3):e0118900.CrossRefPubMedPubMedCentralGoogle Scholar
  10. 10.
    The Canadian Council for Accreditation of Pharmacy Programs. Standards for the first professional degrees in pharmacy programs. 2013. http://www.ccapp-accredit.ca/site/pdfs/university/CCAPP_accred_standards_degree_2014.pdf. Accessed 23 Apr 2015.
  11. 11.
    Bollen K, Lennox R. Conventional wisdom on measurement: a structural equation perspective. Psychol Bull. 1991;110(2):305–14.CrossRefGoogle Scholar
  12. 12.
    Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Market Res JMR. 1981;18(1):39–50.CrossRefGoogle Scholar
  13. 13.
    Schreiber JB. Core reporting practices in structural equation modeling. Res Soc Adm Pharm. 2008;4(2):83–97.CrossRefGoogle Scholar
  14. 14.
    Fike DS, Zorek JA, MacLaughlin AA, Samiuddin M, Young RB, MacLaughlin EJ. Development and validation of the student perceptions of physician-pharmacist interprofessional clinical education (SPICE) instrument. Am J Pharm Educ. 2013;77(9):190.CrossRefPubMedPubMedCentralGoogle Scholar
  15. 15.
    Lee C, Segal R, Kimberlin C, Smith WT, Weiler RM. Reliability and validity for the measurement of moral disengagement in pharmacists. Res Soc Adm Pharm. 2013;10(2):297–312.Google Scholar
  16. 16.
    Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait–multimethod matrix. Psychol Bull. 1959;56(2):81–105.CrossRefPubMedGoogle Scholar
  17. 17.
    Heritage B, Pollock C, Roberts LD. Confirmatory factor analysis of Warr, Cook, and Wall’s (1979) Job Satisfaction Scale. Aust Psychol. 2015;50(2):122–9.CrossRefGoogle Scholar
  18. 18.
    Warr P, Cook J, Wall T. Scales for the measurement of some work attitudes and aspects of psychological well-being. J Occup Psychol. 1979;52(2):129–48.CrossRefGoogle Scholar
  19. 19.
    Sijtsma K. On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika. 2009;74(1):107–20.CrossRefPubMedGoogle Scholar
  20. 20.
    Dagger TS, Sweeney JC, Johnson LW. A hierarchical model of health service quality: scale development and investigation of an integrated model. J Serv Res. 2007;10(2):123.CrossRefGoogle Scholar
  21. 21.
    Hair J, Black W, Babin B, Anderson R, Tatham R. Multivariate data analysis. Upper Saddle River: Wiley; 2006. ISBN:0130329290.Google Scholar
  22. 22.
    Raykov T. Scale reliability evaluation with LISREL 8.50. 2003. www.ssicentral.com/lisrel/techdocs/reliabil.pdf. Accessed 16 Oct 2015.
  23. 23.
    Anderson JC, Gerbing DW. Structural equation modeling in practice: a review and recommended two-step approach. Psychol Bull. 1988;103(3):411–23.CrossRefGoogle Scholar
  24. 24.
    Cizek GJ. Defining and distinguishing validity: interpretations of score meaning and justifications of test use. Psychol Methods. 2012;17(1):31–43.CrossRefPubMedGoogle Scholar
  25. 25.
    Burnham KP, Anderson DR. Model selection and multimodel inference: a practical information-theoretic approach. New York: Springer; 2002.Google Scholar

Copyright information

© Springer International Publishing 2016

Authors and Affiliations

  1. 1.Faculty of PharmacyUniversity of SydneySydneyAustralia

Personalised recommendations