Issues in Adapting Usability Testing for Global Usability

  • Andy Smith
Part of the Human-Computer Interaction Series book series (HCIS)


The localisation of usability tools and techniques, and the recognition and promotion of these within national institutions responsible for professional practice, is critical to the development of usable products within a global development community. This chapter focuses on the localisation of usability testing methods and specifically on the extent to which cultural differences between users and developers impinge on the effectiveness of such methods. In order to explore the relationship between culture and user based evaluation it presents a review of different methods for user based testing/evaluation. It also provides a summary of key aspects within relevant literature on the ways in which cultural issues may influence evaluation effectiveness. It also reports on studies to date that document the effects of culture and usability evaluation. The chapter concludes by presenting potential guidance on the selection and implementation of usability evaluation methods within local and global contexts.


Usability Evaluation Local Moderator Power Distance Uncertainty Avoidance Usability Problem 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Beyer, H., Holtzblatt, K.: Contextual Design: Defining Customer-Centred Systems. Morgan Kaufmann, Los Altos (1998)Google Scholar
  2. Camara, S., Oyugi, C., Abdelnour-Nocera, J., Smith, A.: Augmenting Usability: Cultural elicitation in HCI, in Katre, D., Orngreen, R., Yammiyavar, P., Clemmensen, T. (eds.) Human Work Interaction Design: Usability in Social, Cultural and Organizational Contexts, Second IFIP WG 13.6 Conference HWID 2009, Springer pp. 46–56 (2010)Google Scholar
  3. Carroll, J.M., Mack, R.L.: Learning to use a word processor: by doing, by thinking, and by knowing. In: Tomas, J.C., Schneider, M.L. (eds.) Human Factors in Computer Systems, pp. 13–51. Ablex, Norwood (1984)Google Scholar
  4. Carroll, J.M., Rosson, M.B.: Designing by scenario. Hum. Comput. Interact. 6(3,4), 281–318 (1991)CrossRefGoogle Scholar
  5. Chavan, A.L.: Another culture, another method. In: Proceedings of the 11th International Conference on Human-Computer Interaction. Lawrence Erlbaum, Hillsdale (2005)Google Scholar
  6. Chetty, M.: Developing locally relevant applications for rural South Africa; a telemedicine example. University of Cape Town. Unpublished thesis (2005)Google Scholar
  7. Clemmensen, T., Plocher, T.: The cultural usability (CULTUSAB) project: studies of cultural models in psychological usability evaluation methods. In: Aykin, N. (ed.) Usability and Internationalization – Second International Conference on Usability and Internationalization, HCI International 2007, Beijing, China, Proceedings, Part I, pp. 274–280. Springer, Heidelberg (2007)Google Scholar
  8. Dray, S.: Usable for the world: a practical guide to international user studies, In: Day D., Dunckley L. (eds.) Designing for Global Markets 3, Proceedings of IWIPS 2001, pp. 154–155. IWIPS (2001)Google Scholar
  9. Evers, V.: Cultural aspects of user interface understanding: an empirical evaluation of an e-learning website by international user groups. PhD thesis, Open University (2001)Google Scholar
  10. Goguen, J.A.: Formality and Informality in Requirements Engineering, Proceedings of the Second International Conference on Requirements Engineering (ICRE’96), pp. 102–108. IEEE Computer Society Press, Silver Spring (1996)Google Scholar
  11. Gray, W.D., Saltzman, M.C.: Damaged merchandise? A review of experiments that compare usability evaluation methods. Hum. Comput. Interact. 13, 203–261 (1998)CrossRefGoogle Scholar
  12. Hall, E.T.: Beyond Culture. Doubleday, Garden City (1976)Google Scholar
  13. Hall, E.T., Hall, M.: Hidden Differences: Doing Business with the Japanese. Anchor Press/Doubleday, Garden City (1987)Google Scholar
  14. Herman, L.: Towards effective usability evaluation in Asia: cross-cultural differences. In: Proceedings of the 6th Australian Conference on Computer-Human Interaction (OZCHI ‘96), p. 135 (1996)Google Scholar
  15. Hofstede, G.: Cultures and Organizations. McGraw-Hill Book Company Europe, Berkshire (1991)Google Scholar
  16. Katre, D.S.: One-handed thumb use on smart phones by semi-literate and illiterate users in India: a usability report with design improvements for precision and ease. In: Proceedings of Workshop on Cultural Usability and Human Work Interaction Design, NordiCHI Conference, Lund, Sweden (2008)Google Scholar
  17. Landauer, T.K.: The Trouble with Computers. MIT Press, Cambridge (1995)Google Scholar
  18. Lim, K., Usma, M.: Usability evaluation in the field: lessons from a case-study involving public information kiosks. APCHI (Asia Pacific Conference on Computer Human Interaction) Journal, Los Alamitos, 70. IEEE Computer Society (1998)Google Scholar
  19. Lin, H.X., Choong, Y., Salvendy, G.: A proposed index of usability: a method for comparing the relative usability of different software systems. Behav. Inform. Technol. 16(4, 5), 267–278 (1997)Google Scholar
  20. Maiden, N., Rugg, G.: ACRE: selecting methods for requirements acquisition. Software. Eng. J. 11(3), 183–192 (1996)CrossRefGoogle Scholar
  21. Marcus, A., Gould, E. W.: Cultural dimensions and global web user-interface design: What? So What? Now What? In: Proceedings of the 6th Conference on Human Factors and the Web. Austin, Texas. (2000). Retrieved 25 Apr 2010
  22. Nakakoji, K.: Crossing the cultural boundary. Byte 19(6), 107–109 (1994)Google Scholar
  23. Norman, D.: Cognitive engineering. In: Norman, D.A., Draper, S.W. (eds.) User Centered Systems Design: New Perspectives on Human–Computer Interaction. Lawrence Erlbaum, Hillsdale (1986)Google Scholar
  24. Oyugi, C., Dunckley, L., Smith, A.: Evaluation methods and cultural differences: studies across three continents. In: ACM International Conference Proceeding Series, vol. 358, Proceedings of the 5th Nordic conference on Human-Computer Interaction: Building Bridges, Lund, Sweden, pp. 318–325 (2008)Google Scholar
  25. Sacher, H.: Interactions in Chinese: designing interfaces for Asian languages, Interactions, 5(5), pp. 28–38ACMGoogle Scholar
  26. Smith, A., Chang, Y., French, T.: Quantifying cultural characteristics of Chinese users. J. Asian Inform. Sci. Life 2(2) (2003)Google Scholar
  27. Smith, A., Dunckley, L.: Prototype evaluation and redesign: structuring the design space through contextual techniques, Interacting with Computers, 14(6), pp 821–843 (2002)Google Scholar
  28. Smith, A., Dunckley, L., French, T., Minocha, S., Chang, Y.: A process model for developing usable cross-cultural websites. Interact. Comput. 16(1), 63–91 (2004)CrossRefGoogle Scholar
  29. Smith, A., Joshi, A., Liu, Z., Bannon, L., Gulliksen, J., Li, C.: Institutionalizing HCI in Asia, Interact 2007. In: Proceedings of the 11th IFIP TC13 International Conference on Human Computer Interaction, pp. 85–99 (2007)Google Scholar
  30. Spolsky, B.: Conditions for Second Language Learning. Oxford University Press, Oxford (1989)Google Scholar
  31. Suchman, L.: Plans and Situated Action. Cambridge University Press, Cambridge (1987)Google Scholar
  32. Suinn, R.M., Ahuna, C., Khoo, G.: The Suinn-Lew Asian self-identity acculturation scale: ­concurrent and factorial validation. Educ. Psychol. Meas. 52(4), 1041–1046 (1992)CrossRefGoogle Scholar
  33. Trompenaars, F., Hampden-Turner, C.: Riding the Waves of Culture: Understanding Cultural Diversity in Business. Nicholas Brealey, London (1997)Google Scholar
  34. Vatrapu, R., Pérez-Quiñones, M.A.: Culture and usability evaluation: the effects of culture in structured interviews. J. Usability Stud. 1(4), 156–170 (2006)Google Scholar
  35. Wharton, C., Rieman, J., Lewis, C., Polson, P.: The cognitive walkthrough method: a practitioner’s guide. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods, John Wiley & Sons, New York, pp. 105–140 (1994)Google Scholar
  36. Winschiers, H.: Dialogical system design across cultural boundaries. Doctoral dissertation. University of Hamburg. Retrieved 15 Nov 2009
  37. Winschiers, H., Fendler, J.: Assumptions considered harmful – the need to redefine usability. In: Aykin, N. (ed.) Usability and Internationalization, Part I, HCII 2007, LNCS 4559, pp. 452–461. Springer, Berlin (2007)CrossRefGoogle Scholar
  38. Wright, P.C., Monk, A.F.: A cost-effective evaluation method for use by designers. Int. J. Man Mach. Stud. 35, 891–912 (1991)CrossRefGoogle Scholar
  39. Yammiyavar, P., Kate, P.: Developing mobile phone based GUIs: a methodology case study on conceptualising a GUI for users in the construction industry. In: Proceedings of IFIP HWID2009 Working Conference on Usability in Social, Cultural and Organisational Contexts Pune, India, 7–8 Oct 2009Google Scholar
  40. Yeo, A.: Global software development lifecycle: an exploratory study. In: Jacko, J., Sears, A., Beaudouin-Lafon, M., Jacob, R. (eds.) CHI 2001: Conference on Human Factors in Computing Systems, pp. 104–111. ACM Press, New York (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.Faculty of Professional Studies, School of Computing and TechnologyUniversity of West LondonLondonUK

Personalised recommendations