Abstract
While there is growing awareness for the need to examine the etiology of problem behaviors across cultural, racial, socioeconomic, and gender groups, much research tends to assume that constructs are equivalent and that the measures developed within one group equally assess constructs across groups. The meaning of constructs, however, may differ across groups or, if similar in meaning, measures developed for a given construct in one particular group may not be assessing the same construct or may not be assessing the construct in the same manner in other groups. The aims of this paper were to demonstrate a process of testing several forms of equivalence including conceptual, functional, item, and scalar using different methods. Data were from the Cross-Cultural Families Project, a study examining factors that promote the healthy development and adjustment of children among immigrant Cambodian and Vietnamese families. The process described in this paper can be implemented in other prevention studies interested in diverse groups. Demonstrating equivalence of constructs and measures prior to group comparisons is necessary in order to lend support of our interpretation of issues such as ethnic group differences and similarities.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bentler, P. M. (1990). Comparative fix indexes in structural models. Psychological Bulletin, 107, 238–246.
Bentler, P. M. (1993). EQS: Structural equations program manual. Los Angeles, CA: BMDP Statistical Software.
Byrne, B. M. (1994). Structural equation modeling with EQS and EQS-Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage Publications.
Byrne, B. M., Shavelson, R. J., & Muthen, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466.
Cahn, D., & Stansell, J. (Eds.). (2005). From Refugee to Deportee: How U.S. Immigration Law Failed the Cambodian Community: K. H. Barrett, & W. H. George (Eds.). (2005). Race, culture, psychology, and law. (pp. 237–254). xvii, 478 pp. Thousand Oaks, CA, US: Sage Publications, Inc.
Catalano, R. F., Hawkins, J. D., Krenz, C., Gillmore, M., Morrison, D., Wells, E., et al. (1993). Using research to guide culturally appropriate drug abuse prevention. Journal of Consulting and Clinical Psychology, 61, 804–811.
Cauce, A. M., Coronado, N., & Watson, J. (1998). Conceptual, methodological, and statistical issues in culturally competent research. In M. Hernandez & R. Isaacs (Eds.), Promoting cultural competence in children's mental health services. (pp. 305–329). Baltimore, MD: Paul H. Brookes.
Forsyth, B. H., Lessler, J. T., & Hubbard, M. L. (1992). Cognitive evaluation of the questionnaire. In C. F. Turner, J. T. Lessler, & J. C. Gfroerer (Eds.), Survey measurement of drug use: Methodological studies (DHHS Publication No. ADM 92–1929, pp. 13–52). Rockville, MD: National Institute on Drug Abuse.
Fuller, T. D., Edwards, J. N., Vorakitphokatorn, S., & Sermsri, S. (1993). Using focus groups to adapt survey instruments to new populations: Experience from a developing country. In D. L. Morgan (Ed.) Successful focus groups: Advancing the state of the art (Vol. 156, pp. 89–104). Thousand Oaks, CA: Sage Publications.
Gottfredson, D. C., & Koper, C. S. (1997). Race and sex differences in the measurement of risk for drug use. Journal of Quantitative Criminology, 13, 325–347.
Griffin, K. W., Scheier, L. M., Botvin, G. J., Diaz, T., & Miller, N. (1999). Interpersonal aggression in urban minority youth: Mediators of perceived neighbhorhood, peer, and parental influcences. Journal of Community Psychology, 27, 281– 298.
Harkness, J. A., Mohler, P. Ph., & Van de Vijver, F. J. R. (2003). Comparative research. In J. A. Harkness, F. J. R. Van de Vijver, & P. Ph. Mohler (Eds.). Cross-cultural survey methods (pp. 3–16). Hoboken, NJ: John Wiley & Sons.
Harkness, J. A., Van De Vijver, F. J. R., & Mohler, P. P. H. (2003). Cross-cultural survey methods. Hoboken, NJ: John Wiley & Sons.
Hobbs, F., & Stoops, N. (2002). Demographic trends in the 20th century: Census 2000 special reports (Series CENSR-4). Washington, DC: U.S. Government Printing Office.
Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117–144.
Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453.
Huebner, A., & Howell, L. W. (2003). Examining the relationship between adolescent sexual risk-taking and perceptions of monitoring, communication, and parenting styles. Journal of Adolescent Health, 33, 71–78.
Hui, C. H., & Triandis, H. C. (1985). Measurement in cross-cultural psychology—a review and comparison of strategies. Journal of Cross-Cultural Psychology, 16, 131–152.
Jobe, J. B., & Mingay, D. J. (1990). Cognitive laboratory approach to designing questionnaires for surveys of the elderly. Public Health Reports, 105, 518–524.
Kline, R. B. (1998). Principles and practice of structural equation modeling. NY: Guilford Press.
Knight, G. P., & Hill, N. E. (1998). Measurement equivalence in research involving minority adolescents. In V. C. McLoyd & L. Steinberg (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 183–210). Mahwah, NJ: Erlbaum.
Knight, G. P., Tein, J. Y., Shell, R., & Roosa, M. (1992). The cross-ethnic equivalence of parenting and family interaction measures among Hispanic and Anglo-American families. Child Development, 63, 1392–1403.
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.
Marshall, G. N., Schell, T. L., Elliott, M. N., Berthold, S. M., & Chun, C.-A. (2005). Mental health of Cambodian refugees 2 decades after resettlement in the United States. JAMA: Journal of the American Medical Association, 294, 571–579.
McLoyd, V. C., & Steinberg, L. (Eds.) (1998). Studying minority adolescents. Mahwah, NJ: Lawrence Erlbaum Associates
McLoyd, V. C. (1998). Changing demographics in the American population: Implications for research on minority children and adolescents. In V. C. McLoyd & L. Steinberg (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 3–28). Mahwah, NJ: Erlbaum.
Olson, D. H., Portner, J., & Bell, R. (1982). Family adaptability and cohesion evaluation scales. St. Paul: University of Minnesota Press.
O’Neil, R., Parke, R. D., & McDowell, D. J. (2001). Objective and subjective features of children's neighborhoods: Relations to parental regulatory strategies and children's social competence. Applied Developmental Psychology, 22, 135–155.
Pons, D. A., F.L., Balaguer, I., & Garcia Merita, M. L. (2000). Satisfaction with Life Scale: Analysis of factorial invariance for adolescents and elderly persons. Perceptual and Motor Skills, 91, 62– 68.
Robinson, C. C., Mandleco, B. F., Olsen, S., & Hart, C. H. (1995). Authoritative, authoritarian, and permissive parenting practices: Development of a new measure. Psychological Reports, 77, 819–830.
Rosay, A. B., Gottfredson, D. C., Armstrong, T. A., & Harmon, M. A. (2000). Invariance of measures of prevention program effectiveness: A replication. Journal of Quantitative Criminology, 16, 341–367.
Steenkamp, J.-B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90.
Steiger, J. H., & Lind, J. (1980). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
Triandis, H. C. (1993). Collectivism and individualism as cultural syndromes. Cross-Cultural Psychology, 27, 155–180.
U. S. Department of Education. (2002). Inside No Child Left Behind. Title IV–21st Century Schools, Part A–Safe and Drug-Free Schools and Communities. Retrieved the World Wide Web: http://www.ed.gov/legislation/ESEA02/pg51.html.
Van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Newbury Park, CA: Sage Publications.
Vandenberg, R. J. (2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5, 139– 158.
Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–69.
Wu, P., Robinson, C. C., Yang, C., Hart, C. H., Olsen, S. F., Porter, C. L., Jin, S., Wo, J., & Wu, X. (2002). Similarities and differences in mothers’ parenting of preschoolers in China and the United States. International Journal of Behavioral Development, 26, 481–491.
Yu, E. S. H. (1985). Studying Vietnamese refugees: Methodological lessons in transcultural research. In T. C. Owan (Ed.) Southeast Asian mental health: Treatment, prevention, services, training and research (DHHS Publication No. ADM 85–1399, pp. 517–541). Washington, DC: U.S. Government Printing Office.
Acknowledgement
This investigation was supported by a grant from the Prevention Research Center at the School of Social Work (MH56599) and by a grant from the National Institute on Drug Abuse (DA012038). An earlier version of this article was presented at the Annual Meeting of the Society for Prevention Research in Montreal, Quebec, June 2000.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Harachi, T.W., Choi, Y., Abbott, R.D. et al. Examining Equivalence of Concepts and Measures in Diverse Samples. Prev Sci 7, 359–368 (2006). https://doi.org/10.1007/s11121-006-0039-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-006-0039-0