Skip to main content

Internationalizing Courses in Testing and Assessment

  • Conference paper
  • First Online:
  • 852 Accesses

Part of the book series: International and Cultural Psychology ((ICUP))

Abstract

Focusing on the key psychometric topics of test construction, validity/reliability, standardization, and bias typically addressed in courses on Testing and Assessment, this chapter suggests ways by which these important concepts can be extended to international contexts. Primary concerns addressed within this international framework include: (a) adaptation and testing for equivalence of translated tests, (b) use and development of indigenous tests, and (c) establishment of related test score norms. Prefacing discussion of these core elements is a brief historical review of the development and growth of testing and assessment, together with clarification of the many misused and misunderstood terms associated with their use.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Aiken, L. S., West, S. G., Sechrest, L., & Reno, R. R. (1990). Graduate training in statistics, methodology, and measurement in psychology: a survey of PhD programs in North America. American Psychologist, 45, 721–734.

    Article  Google Scholar 

  • Aiken, L. S., West, S. G., & Millsap, R. E. (2008). Doctoral training in statistics, measurement, and methodology in psychology: replication and extension of Aiken, West, Sechrest, and Reno’s (1990) survey of PhD programs in North America. American Psychologist, 63, 32–50.

    Article  PubMed  Google Scholar 

  • American Educational Research Association, American Psychological Association, & National Council on Educational Measurement. (2004). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

    Google Scholar 

  • Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall.

    Google Scholar 

  • Bartram, D., & Hambleton, R. (Eds.). (2006). Computer-based testing and the internet. West Sussex: Wiley.

    Google Scholar 

  • Beck, A., Steer, R., & Brown, G. (1996). Beck depression inventory manual (2nd ed.). San Antonio, TX: The Psychological Association.

    Google Scholar 

  • Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1, 185–216.

    Article  Google Scholar 

  • Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A. M., & Kaemmer, B. (1989). MMPI-2: Manual for administration and scoring. Minneapolis, MN: University of Minnesota Press.

    Google Scholar 

  • Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Byrne, B. M. (2003). Confirmatory factor analysis. In R. Fernández-Ballesteros (Ed.), Encyclopedia of psychological assessment (Vol. 1, pp. 399–402). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Byrne, B. M. (2005a). Factor analysis: confirmatory. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioural science (pp. 599–606). London: Wiley.

    Google Scholar 

  • Byrne, B. M. (2005b). Factor analytic models: viewing the structure of an assessment instrument from three perspectives. Journal of Personality Assessment, 85, 17–30.

    Article  PubMed  Google Scholar 

  • Byrne, B. M. (2006). Structural equation modeling with EQS: basic concepts, applications, and programming (2nd ed.). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Byrne, B. M. (2009a). Testing for evidence of construct validity: two approaches to the multitrait-multimethod model. In T. Teo & M. S. Khine (Eds.), Structural equation modeling in educational research: concepts and applications (pp. 175–199). Rotterdam, NL: Sense.

    Google Scholar 

  • Byrne, B. M. (2009b). Structural equation modeling with AMOS: basic concepts, applications, and programming (2nd ed.). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Byrne, B. M., & Baron, P. (1993). The Beck Depression Inventory: testing and cross-validating an hierarchical structure for nonclinical adolescents. Measurement and Evaluation in Counseling and Development, 26, 164–178.

    Google Scholar 

  • Byrne, B. M., Stewart, S. M., & Lee, P. W. H. (2004). Validating the Beck Depression Inventory-II for Hong Kong community adolescents. International Journal of Testing, 4, 199–216.

    Article  Google Scholar 

  • Byrne, B. M., Stewart, S. M., Kennard, B. D., & Lee, P. (2007). The Beck Depression Inventory II: testing for measurement equivalence and factor mean differences across Hong Kong and American adolescents. International Journal of Testing, 7, 1–17.

    Article  Google Scholar 

  • Byrne, B. M., Oakland, T., Leong, F. T. L., van de Vijver, F. J. R., Hambleton, R. K., Cheung, F. M., & Bartram, D. (2009). A critical analysis of cross-cultural research and testing practices: implications for improved education and training in psychology. Training and Education in Professional Psychology, 3, 94–105.

    Article  Google Scholar 

  • Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.

    Article  PubMed  Google Scholar 

  • Cheung, F. M., & Leung, K. (1998). Indigenous personality measures. Journal of Cross-Cultural Research, 29, 233–248.

    Article  Google Scholar 

  • Cheung, G. W., & Rensvold, R. B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. Journal of Cross-Cultural Research, 31, 187–212.

    Article  Google Scholar 

  • Cheung, F. M., Leung, K., Fan, R., Song, W. Z., Zang, J. X., & Zhang, J. P. (1996). Development of the Chinese Personality Assessment Inventory (CPAI). Journal of Cross-Cultural Psychology, 27, 181–199.

    Article  Google Scholar 

  • Cheung, F. M., Leung, K., Zhang, J. X., Sun, H. F., Gan, Y. Q., Song, W. Z., et al. (2001). Indigenous Chinese personality construct: is the Five Factor Model complete? Journal of Cross-Cultural Psychology, 32, 407–433.

    Article  Google Scholar 

  • Cheung, F. M., Cheung, S. F., Wada, S., & Zhang, J. (2003). Indigenous measures of personality assessment in Asian countries: a review. Psychological Assessment, 15, 280–289.

    Article  PubMed  Google Scholar 

  • Cheung, F. M., Cheung, S. F., Zhang, J., Leung, K., Leong, F., & Yeh, K. H. (2008). Relevance of openness as a personality dimension in Chinese culture: aspects of its cultural relevance. Journal of Cross-Cultural Research, 39, 81–108.

    Article  Google Scholar 

  • Cooke, D. J., Kosson, D. S., & Michie, C. (2001). Psychopathy and ethnicity: structural, item, and test generalizability of the Psychopathy Checklist – Revised (PCL-R) in Caucasian and African American participants. Psychological Assessment, 13, 531–542.

    Article  PubMed  Google Scholar 

  • Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.

    Article  PubMed  Google Scholar 

  • DuBois, P. H. (1970). A history of psychological testing. Boston, MA: Allyn & Bacon.

    Google Scholar 

  • Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Geisinger, K. F. (1994). Cross-cultural normative assessment: translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6, 304–312.

    Article  Google Scholar 

  • Geisinger, K. F. (2000). Psychological testing at the end of the millennium: a brief historical review. Professional Psychology: Research and Practice, 3, 117–118.

    Article  Google Scholar 

  • Graham, J. R., & Lilly, R. S. (1984). Psychological testing. Englewood Cliffs, NJ: Prentice Hall.

    Google Scholar 

  • Hambleton, R. K. (1994). Guidelines for adapting educational and psychological tests: a progress report. European Journal of Psychological Assessment, 10, 229–244.

    Google Scholar 

  • Hambleton, R. K. (2001). The next generation of the ITC test translation and adaptation guidelines. European Journal of Psychological Assessment, 17, 164–172.

    Article  Google Scholar 

  • Hambleton, R. K. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3–38). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Hambleton, R. K., & de Jong, J. (2003). Advances in translating and adapting educational and psychological tests. Language Testing, 20, 127–240.

    Article  Google Scholar 

  • Hambleton, R. K., & Kanjee, A. (1995). Increasing the validity of cross-cultural assessments: use of improved methods for test adaptations. European Journal of Psychological Assessment, 11, 147–157.

    Article  Google Scholar 

  • Hambleton, R. K., Sireci, S. G., & Robin, F. (1999). Adapting credentialing exams for use in multiple languages. CLEAR Exam Review, 10, 24–28.

    Google Scholar 

  • Ho, D. Y. F. (1998). Indigenous psychologies: Asian perspectives. Journal of Cross-Cultural Psychology, 29, 88–103.

    Article  Google Scholar 

  • Hui, C. H., & Triandis, H. C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20, 296–309.

    Article  Google Scholar 

  • International Test Commission. (2006). International guidelines on computer-based and internet-delivered testing. International Journal of Testing, 6, 143–171.

    Article  Google Scholar 

  • Kaplan, R. M., & Saccuzzo, D. P. (1993). Psychological testing: principles, applications, and issues (3rd ed.). Belmont, CA: Brooks/Cole.

    Google Scholar 

  • Marín, G., Gamba, R. J., & Marín, B. V. (1992). Extreme response style and acquiescence among Hispanics. Journal of Cross-Cultural Psychology, 23, 498–509.

    Article  Google Scholar 

  • Matsumoto, D. (2000). Culture and psychology: people around the world (2nd ed.). Belmont, CA: Wadsworth.

    Google Scholar 

  • McIntire, S. A., & Miller, L. A. (2006). Foundations of psychological testing: a practical approach. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Merenda, P. F. (2005). Cross-cultural adaptation of educational and psychological testing. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 321–341). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Oyserman, D., & Markus, H. R. (1993). The sociocultural self. In J. Suls (Ed.), Psychological perspectives on the self: the self in social perspective (pp. 187–220). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Poortinga, Y. (1995). Use of tests across culture. In T. Oakland & R. K. Hambleton (Eds.), International perspectives on academic assessment (pp. 187–206). Boston, MA: Kluwer.

    Chapter  Google Scholar 

  • Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: a comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517–529.

    Article  PubMed  Google Scholar 

  • Rossen, E., & Oakland, T. (2008). Graduate preparation in research methods: the current status of APA-accredited professional programs in psychology. Training and Education in Professional Psychology, 2, 42–49.

    Article  Google Scholar 

  • Sireci, S. G., Yang, Y., Harter, J., & Ehrlich, E. J. (2006). Evaluating guidelines for test adaptations: a methodological analysis of translation quality. Journal of Cross-Cultural Psychology, 37, 557–567.

    Article  Google Scholar 

  • Tanzer, N. K., & Sim, C. Q. E. (1999). Adapting instruments for use in multiple languages and cultures: a review of the ITC Guidelines for test Adaptations. European Journal of Psychological Assessment, 15, 258–269.

    Article  Google Scholar 

  • Thorndike, R. M., & Lohman, D. F. (1990). A century of ability testing. Chicago, IL: Riverside.

    Google Scholar 

  • Urbina, S. (2004). Essentials of psychological testing. New York: Wiley.

    Google Scholar 

  • van de Vijver, F., & Hambleton, R. K. (1996). Translating tests: some practical guidelines. European Psychologist, 1, 89–99.

    Article  Google Scholar 

  • van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage.

    Google Scholar 

  • van de Vijver, F. J. R., & Tanzer, N. K. (1997). Bias and equivalence in cross-cultural assessment: an overview. European Review of Applied Psychology, 47, 263–279.

    Google Scholar 

  • Walsh, W. B., & Betz, N. E. (1990). Tests and assessment (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.

    Google Scholar 

  • Wechsler, D. (1939). The measurement of adult intelligence. Baltimore, MD: Williams & Wilkins.

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Barbara M. Byrne .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Scienc+Business Media, LLC

About this paper

Cite this paper

Byrne, B.M. (2011). Internationalizing Courses in Testing and Assessment. In: Leong, F., Pickren, W., Leach, M., Marsella, A. (eds) Internationalizing the Psychology Curriculum in the United States. International and Cultural Psychology. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0073-8_7

Download citation

Publish with us

Policies and ethics