Abstract
Focusing on the key psychometric topics of test construction, validity/reliability, standardization, and bias typically addressed in courses on Testing and Assessment, this chapter suggests ways by which these important concepts can be extended to international contexts. Primary concerns addressed within this international framework include: (a) adaptation and testing for equivalence of translated tests, (b) use and development of indigenous tests, and (c) establishment of related test score norms. Prefacing discussion of these core elements is a brief historical review of the development and growth of testing and assessment, together with clarification of the many misused and misunderstood terms associated with their use.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aiken, L. S., West, S. G., Sechrest, L., & Reno, R. R. (1990). Graduate training in statistics, methodology, and measurement in psychology: a survey of PhD programs in North America. American Psychologist, 45, 721–734.
Aiken, L. S., West, S. G., & Millsap, R. E. (2008). Doctoral training in statistics, measurement, and methodology in psychology: replication and extension of Aiken, West, Sechrest, and Reno’s (1990) survey of PhD programs in North America. American Psychologist, 63, 32–50.
American Educational Research Association, American Psychological Association, & National Council on Educational Measurement. (2004). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall.
Bartram, D., & Hambleton, R. (Eds.). (2006). Computer-based testing and the internet. West Sussex: Wiley.
Beck, A., Steer, R., & Brown, G. (1996). Beck depression inventory manual (2nd ed.). San Antonio, TX: The Psychological Association.
Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1, 185–216.
Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A. M., & Kaemmer, B. (1989). MMPI-2: Manual for administration and scoring. Minneapolis, MN: University of Minnesota Press.
Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
Byrne, B. M. (2003). Confirmatory factor analysis. In R. Fernández-Ballesteros (Ed.), Encyclopedia of psychological assessment (Vol. 1, pp. 399–402). Thousand Oaks, CA: Sage.
Byrne, B. M. (2005a). Factor analysis: confirmatory. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioural science (pp. 599–606). London: Wiley.
Byrne, B. M. (2005b). Factor analytic models: viewing the structure of an assessment instrument from three perspectives. Journal of Personality Assessment, 85, 17–30.
Byrne, B. M. (2006). Structural equation modeling with EQS: basic concepts, applications, and programming (2nd ed.). Mahwah, NJ: Erlbaum.
Byrne, B. M. (2009a). Testing for evidence of construct validity: two approaches to the multitrait-multimethod model. In T. Teo & M. S. Khine (Eds.), Structural equation modeling in educational research: concepts and applications (pp. 175–199). Rotterdam, NL: Sense.
Byrne, B. M. (2009b). Structural equation modeling with AMOS: basic concepts, applications, and programming (2nd ed.). Mahwah, NJ: Erlbaum.
Byrne, B. M., & Baron, P. (1993). The Beck Depression Inventory: testing and cross-validating an hierarchical structure for nonclinical adolescents. Measurement and Evaluation in Counseling and Development, 26, 164–178.
Byrne, B. M., Stewart, S. M., & Lee, P. W. H. (2004). Validating the Beck Depression Inventory-II for Hong Kong community adolescents. International Journal of Testing, 4, 199–216.
Byrne, B. M., Stewart, S. M., Kennard, B. D., & Lee, P. (2007). The Beck Depression Inventory II: testing for measurement equivalence and factor mean differences across Hong Kong and American adolescents. International Journal of Testing, 7, 1–17.
Byrne, B. M., Oakland, T., Leong, F. T. L., van de Vijver, F. J. R., Hambleton, R. K., Cheung, F. M., & Bartram, D. (2009). A critical analysis of cross-cultural research and testing practices: implications for improved education and training in psychology. Training and Education in Professional Psychology, 3, 94–105.
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.
Cheung, F. M., & Leung, K. (1998). Indigenous personality measures. Journal of Cross-Cultural Research, 29, 233–248.
Cheung, G. W., & Rensvold, R. B. (2000). Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling. Journal of Cross-Cultural Research, 31, 187–212.
Cheung, F. M., Leung, K., Fan, R., Song, W. Z., Zang, J. X., & Zhang, J. P. (1996). Development of the Chinese Personality Assessment Inventory (CPAI). Journal of Cross-Cultural Psychology, 27, 181–199.
Cheung, F. M., Leung, K., Zhang, J. X., Sun, H. F., Gan, Y. Q., Song, W. Z., et al. (2001). Indigenous Chinese personality construct: is the Five Factor Model complete? Journal of Cross-Cultural Psychology, 32, 407–433.
Cheung, F. M., Cheung, S. F., Wada, S., & Zhang, J. (2003). Indigenous measures of personality assessment in Asian countries: a review. Psychological Assessment, 15, 280–289.
Cheung, F. M., Cheung, S. F., Zhang, J., Leung, K., Leong, F., & Yeh, K. H. (2008). Relevance of openness as a personality dimension in Chinese culture: aspects of its cultural relevance. Journal of Cross-Cultural Research, 39, 81–108.
Cooke, D. J., Kosson, D. S., & Michie, C. (2001). Psychopathy and ethnicity: structural, item, and test generalizability of the Psychopathy Checklist – Revised (PCL-R) in Caucasian and African American participants. Psychological Assessment, 13, 531–542.
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
DuBois, P. H. (1970). A history of psychological testing. Boston, MA: Allyn & Bacon.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.
Geisinger, K. F. (1994). Cross-cultural normative assessment: translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6, 304–312.
Geisinger, K. F. (2000). Psychological testing at the end of the millennium: a brief historical review. Professional Psychology: Research and Practice, 3, 117–118.
Graham, J. R., & Lilly, R. S. (1984). Psychological testing. Englewood Cliffs, NJ: Prentice Hall.
Hambleton, R. K. (1994). Guidelines for adapting educational and psychological tests: a progress report. European Journal of Psychological Assessment, 10, 229–244.
Hambleton, R. K. (2001). The next generation of the ITC test translation and adaptation guidelines. European Journal of Psychological Assessment, 17, 164–172.
Hambleton, R. K. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3–38). Mahwah, NJ: Erlbaum.
Hambleton, R. K., & de Jong, J. (2003). Advances in translating and adapting educational and psychological tests. Language Testing, 20, 127–240.
Hambleton, R. K., & Kanjee, A. (1995). Increasing the validity of cross-cultural assessments: use of improved methods for test adaptations. European Journal of Psychological Assessment, 11, 147–157.
Hambleton, R. K., Sireci, S. G., & Robin, F. (1999). Adapting credentialing exams for use in multiple languages. CLEAR Exam Review, 10, 24–28.
Ho, D. Y. F. (1998). Indigenous psychologies: Asian perspectives. Journal of Cross-Cultural Psychology, 29, 88–103.
Hui, C. H., & Triandis, H. C. (1989). Effects of culture and response format on extreme response style. Journal of Cross-Cultural Psychology, 20, 296–309.
International Test Commission. (2006). International guidelines on computer-based and internet-delivered testing. International Journal of Testing, 6, 143–171.
Kaplan, R. M., & Saccuzzo, D. P. (1993). Psychological testing: principles, applications, and issues (3rd ed.). Belmont, CA: Brooks/Cole.
MarÃn, G., Gamba, R. J., & MarÃn, B. V. (1992). Extreme response style and acquiescence among Hispanics. Journal of Cross-Cultural Psychology, 23, 498–509.
Matsumoto, D. (2000). Culture and psychology: people around the world (2nd ed.). Belmont, CA: Wadsworth.
McIntire, S. A., & Miller, L. A. (2006). Foundations of psychological testing: a practical approach. Thousand Oaks, CA: Sage.
Merenda, P. F. (2005). Cross-cultural adaptation of educational and psychological testing. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 321–341). Mahwah, NJ: Erlbaum.
Oyserman, D., & Markus, H. R. (1993). The sociocultural self. In J. Suls (Ed.), Psychological perspectives on the self: the self in social perspective (pp. 187–220). Hillsdale, NJ: Erlbaum.
Poortinga, Y. (1995). Use of tests across culture. In T. Oakland & R. K. Hambleton (Eds.), International perspectives on academic assessment (pp. 187–206). Boston, MA: Kluwer.
Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: a comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517–529.
Rossen, E., & Oakland, T. (2008). Graduate preparation in research methods: the current status of APA-accredited professional programs in psychology. Training and Education in Professional Psychology, 2, 42–49.
Sireci, S. G., Yang, Y., Harter, J., & Ehrlich, E. J. (2006). Evaluating guidelines for test adaptations: a methodological analysis of translation quality. Journal of Cross-Cultural Psychology, 37, 557–567.
Tanzer, N. K., & Sim, C. Q. E. (1999). Adapting instruments for use in multiple languages and cultures: a review of the ITC Guidelines for test Adaptations. European Journal of Psychological Assessment, 15, 258–269.
Thorndike, R. M., & Lohman, D. F. (1990). A century of ability testing. Chicago, IL: Riverside.
Urbina, S. (2004). Essentials of psychological testing. New York: Wiley.
van de Vijver, F., & Hambleton, R. K. (1996). Translating tests: some practical guidelines. European Psychologist, 1, 89–99.
van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Thousand Oaks, CA: Sage.
van de Vijver, F. J. R., & Tanzer, N. K. (1997). Bias and equivalence in cross-cultural assessment: an overview. European Review of Applied Psychology, 47, 263–279.
Walsh, W. B., & Betz, N. E. (1990). Tests and assessment (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
Wechsler, D. (1939). The measurement of adult intelligence. Baltimore, MD: Williams & Wilkins.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Scienc+Business Media, LLC
About this paper
Cite this paper
Byrne, B.M. (2011). Internationalizing Courses in Testing and Assessment. In: Leong, F., Pickren, W., Leach, M., Marsella, A. (eds) Internationalizing the Psychology Curriculum in the United States. International and Cultural Psychology. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-0073-8_7
Download citation
DOI: https://doi.org/10.1007/978-1-4614-0073-8_7
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-0072-1
Online ISBN: 978-1-4614-0073-8
eBook Packages: Behavioral ScienceBehavioral Science and Psychology (R0)