Abstract
In this paper, we discuss the applicability of usability engineering methods to software engineering projects in intercultural contexts. We have conducted a review of 55 empirical studies from the field of intercultural usability engineering. Categories from ISO TR 16982 were used as a classification framework.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
International Standards Organization: ISO TR 16982 - Ergonomics of human-system interaction – Usability methods supporting human-centered design. In: DIN Deutsches Institut für Normung (ed.) Software Ergonomie- Empfehlungen für die Programmierung und Auswahl von Software. Beuth, Berlin (2004)
Sakala, L.: Participatory Design in a Cross-Cultural Design Context (2009)
Lee, J.-J., Lee, K.-P.: Cultural Differences and Design Methods for User Experience Research: Dutch and Korean Participants Compared. In: Proceedings of the 2007 Conference on Designing Pleasurable Products and Interfaces, pp. 21–34. ACM, New York (2007)
Jagne, J., Smith, S.G., Duncker, E., Curzon, P., Campus, T.P.: Cross-cultural interface design strategy. Univers. Access Inf. Soc., 1–8 (2006)
Herman, L.: Towards effective usability evaluation in Asia: cross-cultural differences. In: Sixth Australian Conference on Computer-Human Interaction, pp. 135–136 (1996)
Evers, V.: Cross-cultural Applicability of User Evaluation Methods: A Case Study Amongst Japanese, North-American, English and Dutch Users. In: CHI 2002 Extended Abstracts on Human Factors in Computing Systems, pp. 740–741. ACM, New York (2002)
Rau, P.-L.P., Plocher, T., Choong, Y.: Cross Cultural Design for IT Products and Services. CRC Press, Boca Raton (2013)
Survey Research Center: Guidelines for Best Practice in Cross-Cultural Surveys (2011)
Hoffmeyer-Zlotnik, J.H., Harkness, J.A.: Methodological Aspects in Cross-National Research. Gesis Verlag, Mannheim (2005)
Harkness, J.A., Braun, M., Edwards, B., Johnson, T.P., Lyberg, L.E., Mohler, P.P., Pennell, B.-E., Smith, T.W. (eds.): Survey methods in multinational, multiregional, and multicultural contexts. Wiley, Hoboken (2010)
Orlando, B., Kenneth, L.: Translating Questionnaires and Other Research Instruments: Problems and Solutions. Sage, London (2000)
Clemmensen, T.: Templates for Cross-Cultural and Culturally Specific Usability Testing: Results From Field Studies and Ethnographic Interviewing in Three Countries. Int. J. Hum. Comput. Interact. 27, 634–669 (2011)
Shi, Q.: A Field Study of the Relationship and Communication Between Chinese Evaluators and Users in Thinking Aloud Usability Tests. In: Proceedings of the 5th Nordic Conference on Human-computer Interaction: Building Bridges, pp. 344–352. ACM, New York (2008)
Vatrapu, R., Perez-Quinones, M.: Culture and Usability Evaluation: The Effects of Culture in Structured Interviews. J. Usability Stud. 1, 156–170 (2006)
Oyugi, C., Dunckley, L., Smith, A.: Evaluation methods and cultural differences: studies across three continents. In: NordiCHI 2008: Using Bridges, pp. 318–325. ACM (2008)
Yeo, A., Barbour, R.H., Apperley, M.: Usability Testing: A Malaysian Study. Department of Computer Science. University of Waikato (1997)
Day, D., Evers, V.: Questionnaire Development for Multicultural Data Collection (1999)
Vermeeren, A., Attema, J., Akar, E., de Ridder, H., von Doorn, A., Erbuğ, C., Berkman, A., Maguire, M.: Usability Problem Reports for Comparative Studies: Consistency and Inspectability. Human-Computer Interact 23, 329–380 (2008)
Schaffer, B.S., Riordan, C.M.: A Review of Cross-Cultural Methodologies for Organizational Research: A Best- Practices Approach. Organ. Res. Methods 6, 169–215 (2003)
Nielsen, L.: Personas - User Focused Design. Springer, London (2012)
Biesterfeldt, J., Capra, M.: Leading International UX Research Projects. In: Marcus, A. (ed.) HCII 2011 and DUXU 2011, Part I. LNCS, vol. 6769, pp. 368–377. Springer, Heidelberg (2011)
Gorlenko, L., Krause, S.: Managing International Usability Projects: Cooperative Strategy. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 159–164. ACM, New York (2006)
Sun, X., Shi, Q.: Language Issues in Cross Cultural Usability Testing: A Pilot Study in China. In: Aykin, N. (ed.) Usability and Internationalization, Part II, HCII 2007. LNCS, vol. 4560, pp. 274–284. Springer, Heidelberg (2007)
Puri, S.K., Byrne, E., Nhampossa, J.L., Quraishi, Z.B.: Contextuality of Participation in IS Design: A Developing Country Perspective. In: Proceedings of the Eighth Conference on Participatory Design: Artful Integration: Interweaving Media, Materials and Practices, vol. 1, pp. 42–52. ACM, New York (2004)
Oreglia, E., Liu, Y., Zhao, W.: Designing for Emerging Rural Users: Experiences from China. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1433–1436. ACM, New York (2011)
Honold, P.: Culture and Context: An Empirical Study for the Development of a Framework for the Elicitation of Cultural Influence in Product Usage. Int. J. Hum. Comput. Interact. 12, 327–345 (2000)
Bourges-Waldegg, P., Scrivener, S.A.R.: Meaning, the central issue in cross-cultural HCI design. Interact. Comput. 9, 287–309 (1998)
Asano, K., Yamazaki, K.: Observation Analysis Method for Culture Centered Design – Proposal of KH Method –. In: Marcus, A. (ed.) DUXU/HCII 2013, Part II. LNCS, vol. 8013, pp. 11–19. Springer, Heidelberg (2013)
You, M., Xu, Y.-J.: A Usability Testing of Chinese Character Writing System for Foreign Learners. In: Marcus, A. (ed.) DUXU/HCII 2013, Part II. LNCS, vol. 8013, pp. 149–157. Springer, Heidelberg (2013)
Vatrapu, R., Suthers, D.: Intra- and Inter-Cultural Usability in Computer-Supported Collaboration. J. Usability Stud. 5, 172–197 (2010)
Ford, G.: The Effects of Culture on Performance Achieved through the use of Human Computer Interaction. Human-Computer Interact., 218–230 (2003)
Bilal, D.: Measuring the usability of an international user interface: Culture and design representations. In: Human-Computer Interaction Symposium, Austin, TX (2006)
Yan, Q., Gu, G.: A remote study on east-west cultural differences in mobile user experience. In: Aykin, N. (ed.) Usability and Internationalization, Part II, HCII 2007. LNCS, vol. 4560, pp. 537–545. Springer, Heidelberg (2007)
Lee, Y.S., Ryu, Y.S., Smith-Jackson, T.L., Shin, D.J., Nussbaum, M.A., Tomioka, K.: Usability testing with cultural groups in developing a cell phone navigation system. In: Proceedings of HCI International (2005)
Sturm, C., Strube, G., Gouda, S.: Localization beyond National Characteristics: The Impact of Language on Users’ Performance with Different Menu Structures. In: Marcus, A. (ed.) DUXU/HCII 2013, Part II. LNCS, vol. 8013, pp. 105–114. Springer, Heidelberg (2013)
Rau, P.-L.P., Liang, S.-F.: Internationalization and localization: evaluating and testing a Website for Asian users. Ergonomics 46, 255–270 (2003)
Hartson, H.R., Castillo, J.C., Kelso, J., Neale, W.C.: Remote Evaluation: The Network As an Extension of the Usability Laboratory. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 228–235. ACM, New York (1996)
Liu, J., Liu, Y., Rau, P.-L.P., Li, H., Wang, X., Li, D.: How Socio-economic Structure Influences Rural Users’ Acceptance of Mobile Entertainment. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2203–2212. ACM, New York (2010)
Wang, L., Rau, P.P., Salvendy, G.: A Cross-Culture Study on Older Adults Information Technology Acceptance. Int. J. Mob. Commun. 9, 421–440 (2011)
Tractinsky, N.: Aesthetics and Apparent Usability: Empirically Assessing Cultural and Methodological Issues. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 115–122. ACM, New York (1997)
Clemmensen, T., Goyal, S.: Cross cultural usability testing. The relationship between evaluator and test user (2005)
Ménard, E., Khashman, N., Dorey, J.: Two Solitudes Revisited: A Cross-Cultural Exploration of Online Image Searcher’s Behaviors. In: Marcus, A. (ed.) DUXU/HCII 2013, Part II. LNCS, vol. 8013, pp. 79–88. Springer, Heidelberg (2013)
Wang, M.-Y., Tang, D.-L., Kao, C.-T., Sun, V.C.: Banner Evaluation Predicted by Eye Tracking Performance and the Median Thinking Style. In: Marcus, A. (ed.) DUXU/HCII 2013, Part II. LNCS, vol. 8013, pp. 129–138. Springer, Heidelberg (2013)
Walsh, T., Nurkka, P., Koponen, T., Varsaluoma, J., Kujala, S., Belt, S.: Collecting Cross-cultural User Data with Internationalized Storyboard Survey. In: Proceedings of the 23rd Australian Computer-Human Interaction Conference, pp. 301–310. ACM, New York (2011)
Graffigna, G., Bosio, A.C., Olson, K.: Face-to-Face versus Online Focus Groups in Two Different Countries: Do Qualitative Data Collection Strategies Work the Same Way in Different Cultural Contexts? Doing Cross-Cultural Research. In: Ethical and Methodological Perspectives, pp. 265–286 (2008)
Diehl, J.C., Christiaans, H.H.C.: Globalization and cross- cultural product design. In: Marjanovic, D. (ed.) Proceedings of the 9th International Design Conference, pp. 503–510
Hunter, M.G., Beck, J.E.: Using Repertory Grids to Conduct Cross-Cultural Information Systems Research. Info. Sys. Res. 11, 93–101 (2000)
Vatrapu, R., Perez-Quinones, M.A.: Culture and International Usability Testing: The Effects of Culture in Structured Interviews. J. Usability Stud. 1, 156–170 (2004)
Tomico, O., Karapanos, E., Levy, P., Mizutani, N., Yamanaka, T.: The Repertory Grid Technique as a Method for the Study of Cultural Differences. Int. J. Des. Vol 3(3) (2009)
Sun, H.: Building a Culturally-competent Corporate Web Site: An Exploratory Study of Cultural Markers in Multilingual Web Design. In: Proceedings of the 19th Annual International Conference on Computer Documentation, pp. 95–102. ACM, New York (2001)
Yammiyavar, P.G., Torkil Clemmensen, J.K.: Influence of Cultural Background on Non-verbal Communication in a Usability Testing Situation. Int. J. Des. 2(3)
Plocher, T., Zhao, C.: Photo interview approach to understanding independent living needs of elderly Chinese: A case study. In: Dai, G. (ed.) Proceedings of 5th Asia-Pacific Conference on Computer-Human Interaction. Science Press (2002)
Law, E.L.-C., Hvannberg, E.T.: Analysis of Combinatorial User Effect in International Usability Tests. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 9–16. ACM, New York (2004)
Brush, A.J.B., Ames, M., Davis, J.: A Comparison of Synchronous Remote and Local Usability Studies for an Expert Interface. In: CHI 2004 Extended Abstracts on Human Factors in Computing Systems, pp. 1179–1182. ACM, New York (2004)
Yasuoka, M., Sakurai, R.: Out of Scandinavia to Asia: Adaptability of Participatory Design in Culturally Distant Society. In: Proceedings of the 12th Participatory Design Conference: Exploratory Papers, Workshop Descriptions, Industry Cases, vol. 2, pp. 21–24. ACM, New York (2012)
Clarke, R., Wright, P.: Evocative of Experience: Crafting Cross-cultural Digital Narratives Through Stories and Portraits. In: Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design, pp. 318–321. ACM, New York (2012)
Lee, J.-J., Lee, K.-P.: Cultural Differences and Design Methods for User Experience Research: Dutch and Korean Participants Compared. In: Proceedings of the 2007 Conference on Designing Pleasurable Products and Interfaces, pp. 21–34. ACM, New York (2007)
Chavan, A.L.: Another culture another method. In: HCII 2005 Conference Proceedings, pp. 344–352 (2005)
Bidwell, N.J., Reitmaier, T., Marsden, G., Hansen, S.: Designing with Mobile Digital Storytelling in Rural Africa. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1593–1602. ACM, New York (2010)
Abdelnour-Nocera, J., Austin, A., Michaelides, M., Modi, S.: A Cross-Cultural Evaluation of HCI Student Performance – Reflections for the Curriculum. In: Marcus, A. (ed.) DUXU/HCII 2013, Part II. LNCS, vol. 8013, pp. 161–170. Springer, Heidelberg (2013)
Díaz, J., Rusu, C., Pow-Sang, J.A., Roncagliolo, S.: A Cultural-oriented Usability Heuristics Proposal. In: Proceedings of the 2013 Chilean Conference on Human - Computer Interaction, pp. 82–87. ACM, New York (2013)
Katre, D.S.: Position Paper On Cross-cultural Usability Issues of Bilingual (Hindi & English) Mobile Phones. In: Clemmensen, T., Yammiyavar, P. (eds.) Proceedings of Indo-Danish HCI Research Symposium. Indian Institute of Technology, Guwahati (2006)
Smith, A., Dunckley, L., French, T., Minocha, S., Chang, Y.: Reprint of a Process Model for Developing Usable Cross-cultural Websites. Interact. Comput. 24, 174–187 (2012)
Elbaz, P., Galal, P., Galal-Edeen, H., Gheith, M.: The Influence of Culture on Systems Usability. Int. J. Softw. Eng. 4, 93–114 (2011)
Röse, K.: Usability-Engineering in the Context of Product Development. In: Proceedings of the 17th World Congress The International Federation of Automatic Control, pp. 8124–8128
ISO 9241-210:2010(en) (Ergonomics of human-system interaction — Part 210: Human-centred design for interactive systems), https://www.iso.org/obp/ui/#iso:std:iso:9241:-210:ed-1:v1:en
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Böhm, V., Wolff, C. (2014). A Review of Empirical Intercultural Usability Studies. In: Marcus, A. (eds) Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience. DUXU 2014. Lecture Notes in Computer Science, vol 8517. Springer, Cham. https://doi.org/10.1007/978-3-319-07668-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-07668-3_2
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07667-6
Online ISBN: 978-3-319-07668-3
eBook Packages: Computer ScienceComputer Science (R0)