Abstract
Instruments in the affective domain may not be equivalent when the tests are administered to different populations with different cultural backgrounds. To illustrate a general approach, this study was intended to gather psychometric evidence for an instrument of attitude toward chemistry to support cross-cultural attitudinal studies for college chemistry students. The shortened version of Attitude toward the Subject of Chemistry Inventory, ASCIv2, was used at three universities, one in Saudi Arabia, one in Australia, and one in the USA. Based on the results of psychometric analysis of internal consistency reliability and internal structure validity, we found that students from the Saudi Arabian institution responded to item 6, chemistry is challenging or not, differently from those in Australia and the USA. This study signifies the importance of examining utility and student response in context when instrument data is gathered in cross-cultural scenarios, to ensure that responses in the new context still match the trait underlying the instruments. In addition, this study contributes to the use of ASCIv2 regarding the possible variance and profile for attitude scores from multiple countries.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abell, N., Springer, D. W., & Kamata, A. (2009). Developing and validating rapid assessment instruments. New York: Oxford University Press.
AERA, APA, & NCME. (1999). Standards for educational and psychological testing. Washington, DC.
Albaz, K. S. (2007). Using modeling approach on the 11th grade students on their performance, scientific reasoning and attitude toward chemistry. Journal of Science Education and Technology, 2(10), 91–120.
Albusylee, A., Sadieg, S., & Abdukader, F. (1990). Attitude of teachers community college student in Saudi Arabia toward chemistry and learning chemistry. Journal of Arabian Gulf, 35(11), 19–52.
Al-Khaldi, M. A., & AlJabri, I. M. (1998). The relationship of attitudes to computer utilization: New evidence from a developing nation. Computers in Human Behavior, 14(1), 23–42. doi:10.1016/s0747-5632(97)00030-7.
Allalouf, A. (2003). Revising translated differential item functioning items as a tool for improving cross-lingual assessment. Applied Measurement in Education, 16(1), 55–73. doi:10.1207/s15324818ame1601_3.
American Association for the Advancement of Science. (1989). Science for all Americans. Project 2061-The American Association for the Advancement of Science. Oxford University Press.
Arjoon, J. A., Xu, X., & Lewis, J. E. (2013). Understanding the state of the art for measurement in Chemical Education Research: Examining the psychometric evidence. Journal of Chemical Education, 90(5), 536–545. doi:10.1021/ed3002013.
Australian Education Network. (2013). Australian University Rankings. Retrieved 3/1/2013, from http://www.australianuniversities.com.au/rankings/
Balfagheh, N. M. (2001). The impact of concept map teaching strategy on the UAE 11th grade students on their performance and Attitude toward chemistry. Journal of Science Education and Technology, 3(1), 157–182.
Barbera, J., Adams, W. K., Wieman, C. E., & Perkins, K. K. (2008). Modifying and validating the Colorado Learning Attitudes about Science Survey for use in chemistry. Journal of Chemical Education, 85(10), 1435–1439.
Bauer, C. (2005). Beyond “student attitudes”: Chemistry self-concept inventory for assessment of the affective component of student learning. Journal of Chemical Education, 82(12), 1864–1870.
Bauer, C. (2008). Attitude towards chemistry: A semantic differential instrument for assessing curriculum impacts. Journal of Chemical Education, 85(10), 1440–1445.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246.
Brandriet, A. R., Xu, X., Bretz, S. L., & Lewis, J. E. (2012). Diagnosing changes in attitude in first-year college chemistry students with a shortened version of Bauer’s semantic differential. Chemistry Education Research and Practice, 12(2), 271–278.
Carnegie Foundation for the Advancement of Teaching. (2010). The Carnegie Classification of Institutions of Higher Education™. Retrieved 3/1/2013, from http://classifications.carnegiefoundation.org/
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. doi:10.1177/001316446002000104.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum, 25–27.
Fatallah, M. A. (2009). The impact of concept map teaching strategy on students’ performance, critical thinking and attitude toward collaborative leaning for middle school in Saudi Arabia. Journal of Science Education, 11(3).
Grove, N., & Bretz, S. L. (2007). CHEMX: An instrument to assess students’ cognitive expectations for learning chemistry. Journal of Chemical Education, 84(9), 1524–1929.
Harty, H., & Alfaleh, N. (1983). Saudi Arabian students chemistry achievement and science attitudes stemming from lecture-demonstration and small-group teaching-methods. Journal of Research in Science Teaching, 20(9), 861–866. doi:10.1002/tea.3660200908.
Hijazi, T. (2008). Constructing an attitudinal scale toward chemistry for eleventh and twelfth grades students. Journal of Educational and Psychological Sciences, 9(1), 73–90.
Hu, L., & Bentler, P. M. (1995). Evaluating model fit. In R. H. Hoyle (Ed.), Struct equation model: Concepts, issues and applications (pp. 76–99). Thousand Oaks: Sage.
Jiang, B., Xu, X., Garcia, A., & Lewis, J. E. (2010). Comparing two tests of formal reasoning in a college chemistry context. Journal of Chemical Education, 87(12), 1430–1437. doi:10.1021/ed100222v.
Landis, J.R., & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. doi:10.2307/2529310.
Martin, M. O., & Mullis, I. V. S., & Foy, P. (with Olson, J. F., Erberber, E., Preuschoff, C., & Galia, J.). (2008). TIMSS 2007 International Science Report: Findings from IEA’s Trends in International Mathematics and Science Study at the Fourth and Eighth Grades. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.
Miles, M.B., & Huberman, A.M. (1994). Qualitative data analysis: An expanded sourcebook. Thousand Oaks: Sage.
Modood, T. (1993). The number of ethnic minority students in British higher education: some grounds for optimism. Oxford Review of Education, 19(2), 167–182.
Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing: Principles and testing (6th ed.). Upper Saddle River, NJ: Prentice-Hall.
Muthén, L. K., & Muthén, B. O. (2007). Mplus user’s guide (5th ed.). Los Angeles: Muthén & Muthén.
Osborne, J., Simon, S., & Collins, S. (2003). Attitudes towards science: A review of the literature and its implications. International Journal of Science Education, 25(9), 1049–1079.
Papanastasiou, C. (2002). School, teaching and family influence on student attitudes toward science, based on TIMSS data for Cyprus. Studies in Educational Evaluation, 28(1), 71–86.
Papanastasiou, C., & Papanastasiou, E. C. (2004). Major influences on attitudes toward science. Educational Research and Evaluation, 10(3), 239–257. doi:10.1076/edre.10.3.239.30267.
Rosenberg, M. J., & Hovland, C. I. (1960). Cognitive, affective and behavioral components of attitudes. In C. I. Hovland & M. J. Rosenberg (Eds.), Attitude organization and change: An analysis of consistency among attitude components (p. 3). New Haven, CT: Yale University Press.
Roth, W.-M., Oliveri, M. E., Sandilands, D. D., Lyons-Thomas, J., & Ercikan, K. (2012). Investigating linguistic sources of differential item functioning using expert think-aloud protocols in science achievement tests. International Journal of Science Education, 35(4), 546–576. doi:10.1080/09500693.2012.721572.
Schroeder, J., Murphy, K. L., & Holme, T. A. (2012). Investigating factors that influence item performance on ACS exams. Journal of Chemical Education, 89(3), 346–350. doi:10.1021/ed101175f.
Schwarz, N. (1999). Cognitive research into survey measurement: Its influence on survey methodology and cognitive theory. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. M. Tanur, & R. Tourangeau (Eds.), Cognition and survey research. New York: Wiley.
Shanghai Jiao Tong University. (2012). The Academic Ranking of World Universities. Retrieved 3/1/2013, from http://www.shanghairanking.com/
Taylor, P. (1993). Minority ethnic groups and gender in access to higher education. Journal of Ethnic and Migration Studies, 19(3), 425–440.
The General Assembly of the State of South Carolina. (1998, Approved the 10th day of June, 1998.). South Carolina Education Accountability Act of 1998. Retrieved 3/13/2013, from http://www.scstatehouse.gov/sess112_1997-1998/bills/850.htm
van de Vijver, F., & Tanzer, N. K. (2004). Bias and equivalence in cross-cultural assessment: an overview. European Review of Applied Psychology, 54(2), 119–135. doi:10.1016/j.erap.2003.12.004.
Xu, X., & Lewis, J. E. (2011). Refinement of a chemistry attitude measure for college students. Journal of Chemical Education, 88(5), 561–568. doi:10.1021/ed900071q.
Xu, X., Southam, D., & Lewis, J. E. (2012). Attitude toward the Subject of Chemistry in Australia: An ALIUS and POGIL collaboration to promote cross-national comparisons. Australian Journal of Education in Chemistry, 72, 32.
Xu, X., Villafane, S. M., & Lewis, J. E. (2013). College students’ attitudes toward chemistry, conceptual knowledge and achievement: Structural equation model analysis. Chemistry Education Research and Practice, 14(2), 188–200. doi:10.1039/C3RP20170H.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Xu, X., Alhooshani, K., Southam, D., Lewis, J.E. (2015). Gathering Psychometric Evidence for ASCIv2 to Support Cross-Cultural Attitudinal Studies for College Chemistry Programs. In: Kahveci, M., Orgill, M. (eds) Affective Dimensions in Chemistry Education. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45085-7_9
Download citation
DOI: https://doi.org/10.1007/978-3-662-45085-7_9
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-45084-0
Online ISBN: 978-3-662-45085-7
eBook Packages: Chemistry and Materials ScienceChemistry and Material Science (R0)