Abstract
This chapter describes an approach to evaluating user experience in video games and advanced interaction games (tabletop games) by using heuristics. We provide a short overview of computer games with a focus on advanced interaction games and explain the concept of user-centred design for games. Furthermore, we describe the history of heuristics for video games and the role of user experience of games in general. We propose a framework consisting of three sets of heuristics (game play/game story, virtual interface and tabletop specific) to detect the most critical issues in video games as well as advanced interaction games. To assess its applicability, we compare the results of expert evaluations of five current games with the user experience-based ratings of various game review sites. In the conclusion, we provide an outlook on possible extensions of our approach.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
References
Amaya G, Davis JP (2008) Games user research (GUR): Our experience with and evolution of four methods. In: Isbister K, Schaffer N (eds) Game Usability. Morgan Kaufmann, San Francisco, CA.
Barakonyi I, Weilguny M, Psik T, Schmalstieg D (2005) MonkeyBridge: Autonomous agents in augmented reality games. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (Valencia, Spain, 15–17 June 2005). ACE ’05, Vol. 265, ACM, New York, pp. 172–175.
Bernhaupt R, Eckschlager M, Tscheligi M (2007) Methods for evaluating games – How to measure usability and user experience in games? In: Proceedings of the International Conference on Advances in Computer Entertainment Technology (Salzburg, Austria, 13–15 June 2007). ACE ’07, Vol. 203, ACM, New York, pp. 309–310.
Bernhaupt R, Ijsselsteijn W, Mueller F, Tscheligi M, Wixon D (2008) Evaluating user experiences in games. In: CHI ’08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy, 5–10 April 2008). CHI ’08, ACM, New York, pp. 3905–3908.
Brown E, Cairns P (2004) A grounded investigation of game immersion. In: CHI ’04 Extended Abstracts on Human Factors in Computing Systems (Vienna, Austria, 24–29 April 2004). CHI ’04, ACM, New York, pp. 1297–1300.
Buisine S, Besacier G, Najm N, Aoussat A, Vernier F (2007) Computer-supported creativity: Evaluation of a tabletop mind-map application. Harris D (ed) Engineering Psychology and Cognitive Ergonomics, HCII 2007, LNAI 4562, Lecture Notes in Computer Science. In. Springer-Verlag, Berlin Heidelberg.
Callois R (1961) Man, play and games, Free Press of Glencoe, Illinois.
Cheng K, Cairns PA (2005) Behaviour, realism and immersion in games. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, 2–7 April 2005). CHI ’05, ACM, New York, pp. 1272–1275.
Clarke D, Duimering PR (2006) How computer gamers experience the game situation: A behavioral study. ACM Computers in Entertainment (CIE) 4(3), July 2006.
Cowley B, Charles D, Black M, Hickey R (2008) Toward an understanding of flow in videogames. ACM Computers in Entertainment (CIE) 6(2): 1–27, July 2008.
Csikszentmihalyi M (1975) Beyond Boredom and Anxiety. Jossey-Bass, San Francisco, CA.
Desurvire H, Caplan M, Toth JA (2004) Using heuristics to evaluate the playability of games. In: CHI ’04 Extended Abstracts on Human Factors in Computing Systems (Vienna, Austria, 24–29 April 2004). CHI ’04, ACM, New York, pp. 1509–1512.
Dewey J (1934) Art as Experience. Minton, Balch, New York.
Dietz P, Leigh D (2001) DiamondTouch: A multi-user touch technology. In: Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (Orlando, Florida, 11–14 November 2001). UIST ’01, ACM, New York, pp. 219–226.
Dumas J, Redish J (1999) A Practical Guide To Usability Testing. Intellect Books, Exeter.
ESA (2008) Essential facts about the computer and videogame industry, 2008 sales, demographic and usage data. Entertainment Software Association, http://www.theesa.com/facts/pdfs/ESA_EF_2008.pdf. Accessed 07 December 2008.
Esposito N (2005) A short and simple definition of what a videogame is. In: Proceedings of DiGRA 2005 Conference: Changing: Views – Worlds in Play (Vancouver, British Columbia, Canada, 16–20 June 2005) DiGRA’05, University of Vancouver, BC.
Federoff MA (2002) Heuristics and usability guidelines for the creation and evaluation of fun in videogames. Master’s Thesis, Department of Telecommunications, Indiana University.
Forlizzi J, Battarbee K (2004) Understanding experience in interactive systems. In: Proceedings of the 5th Conference on Designing interactive Systems: Processes, Practices, Methods, and Techniques (Cambridge, MA, 1–4 August 2004). DIS ’04, ACM, New York, pp. 261–268.
Fullerton T, Swain C, Hoffman S (2004) Game Design Workshop: Designing, Prototyping, and Playtesting Games. CMP Books, San Francisco, CA.
Hassenzahl M (2008) User experience (UX): Towards an experiential perspective on product quality. Keynote IHM, http://www.uni-landau.de/hassenzahl/pdfs/hassenzahl-ihm08.pdf. Accessed 7 December 2008.
Hassenzahl M, Tractinsky N (2006) User experience – A research agenda. Behavior & Information Technology 25(2): 91–97, March–April 2006.
Hazlett RL (2006) Measuring emotional valence during interactive experiences: Boys at videogame play. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada, 22–27 April 2006). CHI ’06, ACM, New York, pp. 1023–1026.
Huizinga J (1950) Homo Ludens: A Study of the Play-Element in Culture. Beacon Press, Boston, MA.
IJsselsteijn WA, Kort YAW de, Poels K, Jurgelionis A, Belotti F (2007) Characterising and measuring user experiences. In: Proceedings of the international Conference on Advances in Computer Entertainment Technology (Salzburg, Austria, 13–15 June 2007). ACE ’07, Vol. 203, ACM, New York.
ISO 13407:1999 (1999) Human-centred design processes for interactive systems. International Organization for Standardization, Geneva, Switzerland. http://www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=21197. Accessed on 7 December 2008.
Jegers K (2007) Pervasive game flow: Understanding player enjoyment in pervasive gaming. ACM Computers in Entertainment (CIE) 5(1): 9, January 2007.
Jegers K (2008) Investigating the applicability of usability and playability heuristics for evaluation of pervasive games. In: Proceedings of the 2008 Third International Conference on Internet and Web Applications and Services (Athens, Greece, 8–13 June 2008). ICIW, IEEE Computer Society, Washington, DC, pp. 656–661.
Koeffel CA (2007) Heuristics for tabletop games. Master’s Thesis, Department of Digital Media, Upper Austria University of Applied Sciences Hagenberg.
Koeffel C, Haller M (2008) Heuristics for the evaluation of tabletop games. In: Evaluating User Experiences in Games, Workshop at the 2008 Conference on Human Factors in Computing Systems (Florence, Italy, 5–10 April 2008). CHI ’08.
Koivisto EMI, Korhonen H (2006) Mobile game playability heuristics. Forum Nokia. http://www.forum.nokia.com/. Accessed 07 December 2008.
Kojima M, Sugimoto M, Nakamura A, Tomita M, Inami M, Nii H (2006) Augmented coliseum: An augmented game environment with small vehicles. In: Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (Adelaide, Australia, 5–7 January 2006). TABLETOP, IEEE Computer Society, Washington, DC, pp. 3–8.
Larsen JM (2008) Evaluating user experience – How game reviewers do it. In: Evaluating User Experiences in Games, Workshop at the 2008 Conference on Human Factors in Computing Systems (Florence, Italy, 5–10 April 2008). CHI ’08.
Law E, Roto V, Vermeeren AP, Kort J, Hassenzahl M (2008) Towards a shared definition of user experience. In: CHI ’08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy, 5–10 April 2008). CHI ’08, ACM, New York, pp. 2395–2398.
Lee W, Woo W, Lee J (2005) TARBoard: Tangible augmented reality system for table-top game environment. In: PerGames2005 (Munich, Germany, 11 May 2005). PerGames ’05, ACM, New York.
Loenen E van, Bergman T, Buil V, Gelder K van, Groten M, Hollemans G, Hoonhout J, Lashina T, Wijdeven S van de (2007) Entertaible: A solution for social gaming experiences. In: Tangible Play: Research and Design for Tangible and Tabletop Games, Workshop at the 2007 Intelligent User Interfaces Conference (Honolulu, HI, 28–31 January 2007) ACM, New York, pp. 16–19.
Magerkurth C, Memisoglu M, Engelke T, Streitz N (2004) Towards the next generation of tabletop gaming experiences. In: Proceedings of Graphics interface 2004 (London, Ontario, Canada, 17–19 May 2004). ACM International Conference Proceeding Series, Vol. 62, Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, ON, pp. 73–80.
Malone TW (1980) What makes things fun to learn? Heuristics for designing instructional computer games. In: SIGSMALL ’80: Proceedings of the 3rd ACM SIGSMALL Symposium and the First SIGPC Symposium on Small systems (Palo Alto, CA, 18–19 September 1980) ACM, New York, pp. 162–169.
Malone TW (1982) Heuristics for designing enjoyable user interfaces: Lessons from computer games. In: Proceedings of the 1982 Conference on Human Factors in Computing Systems (Gaithersburg, MD, 15–17 March 1982). ACM, New York, pp. 63–68.
Mandryk RL, Atkins MS (2007) A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. International Journal of Human-Computer Studies 65(4): 329–347, April 2007.
Marsh T, Yang K, Shahabi C, Wong WL, Nocera L, Carriazo E, Varma A, Yoon H, Kyriakakis C (2005) Automating the detection of breaks in continuous user experience with computer games. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, 2–7 April 2005). CHI ’05, ACM, New York, pp. 1629–1632.
Medlock MC, Wixon D, Terrano M, Romero R, Fulton B (2002) Using the RITE Method to improve products: A definition and a case study. Usability Professionals Association, Orlando, FL.
Morris MR, Piper AM, Cassanego A, Huang A, Paepcke A, Winograd T (2006) Mediating group dynamics through tabletop interface design. IEEE Computer Graphics & Applications 26 (5): 65–73.
Nielsen J (1994) Usability Engineering. Morgan Kaufmann, San Francisco, CA.
Nielsen J, Mack RL (1994) Usability Inspection Methods. John Wiley & Sons, New York.
Nielsen J, Molich R (1990) Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Empowering People (Seattle, Washington, United States, 1–5 April 1990). CHI ’90, ACM, New York, pp. 249–256.
Pagulayan RJ, Keeker K, Wixon D, Romero R, Fuller T (2003) User-centered design in games. In: Jacko J, Sears A (eds) Handbook for Human-Computer Interaction in Interactive Systems. Lawrence Erlbaum Associates, Inc., Mahwah, NJ.
Phillips B (2006) Talking about games experiences: A view from the trenches. Interactions 13(5): 22–23, September 2006.
Pinelle D, Gutwin C (2007) Evaluating teamwork support in tabletop groupware applications using collaboration usability analysis. Personal and Ubiquitous Computing 12(3): 237–254, January 2008.
Pinelle D, Wong N, Stach T (2008) Heuristic evaluation for games: Usability principles for videogame design. In: Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, 5–10 April 2008). CHI ’08, ACM, New York, pp. 1453–1462.
Röcker C, Haar M (2006) Exploring the usability of videogame heuristics for pervasive game development in smart home environments. In: Proceedings of the Third International Workshop on Pervasive Gaming Applications – PerGames 2006 (Dublin, Ireland, 7–10 May 2006), Springer-Verlag, Heidelberg, pp. 199–206.
Roto V, Kaasinen E (2008) The second international workshop on mobile internet user experience. In: Proceedings of the 10th international Conference on Human Computer interaction with Mobile Devices and Services (Amsterdam, The Netherlands, 2–5 September 2008). MobileHCI ’08, ACM, New York, pp. 571–573.
Sarodnick F, Brau H (2006) Methoden der Usability Evaluation, Wissenschaftliche Grundlagen und praktische Anwendung. Hans Huber Verlag, Bern, Switzerland.
Schaffer N (2007) Heuristics for usability in games. Technical report, Rensselaer Polytechnic Institute. http://friendlymedia.sbrl.rpi.edu/heuristics.pdf. Accessed 7 December 2008.
Scott SD, Carpendale S (2006) Guest editors’ introduction: Interacting with digital tabletops. IEEE Computer Graphics & Applications: Special Issue on Interacting with Digital Tabletops 26 (5): 24–27.
Sugimoto M, Kagotani G, Kojima M, Nii H, Nakamura A, Inami M (2005) Augmented coliseum: Display-based computing for augmented reality inspiration computing robot. In: ACM SIGGRAPH 2005 Emerging Technologies (Los Angeles, California, 31 July–4 August 2005). SIGGRAPH ’05, ACM, New York, p. 1.
Sweetser P, Wyeth P (2005) GameFlow: A model for evaluating player enjoyment in games. ACM Computers in Entertainment (CIE) 3(3): 1–24, July 2005.
Tse E, Greenberg S, Shen C, Forlines C (2007) Multimodal multiplayer tabletop gaming. ACM Computers in Entertainment (CIE) 5(2): 12, April 2007.
Wilson AD (2005) PlayAnywhere: A compact interactive tabletop projection-vision system. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (Seattle, WA, 23–26 October 2005). UIST ’05, ACM, New York, pp. 83–92.
Wilson A, Robbins DC (2006) PlayTogether: Playing games across multiple interactive tabletops. In: IUI Workshop on Tangible Play: Research and Design for Tangible and Tabletop Games (Honolulu, HI, 28–31 January 2007). IUI ’07, ACM, New York.
Wolf MJP (2001) The Medium of the Videogame. University of Texas Press, Austin, TX.
Ye Z (2004) Genres as a tool for understanding and analyzing user experience in games. In: CHI ’04 Extended Abstracts on Human Factors in Computing Systems (Vienna, Austria, 24–29 April 2004). CHI ’04, ACM, New York, pp. 773–774.
Zimmerman E (2004) Narrative, interactivity, play, and games. In: Wardrip-Fruin N, Harrigan P (eds) First Person. MIT Press, Cambridge, UK.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag London
About this chapter
Cite this chapter
Koeffel, C., Hochleitner, W., Leitner, J., Haller, M., Geven, A., Tscheligi, M. (2010). Using Heuristics to Evaluate the Overall User Experience of Video Games and Advanced Interaction Games. In: Bernhaupt, R. (eds) Evaluating User Experience in Games. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-963-3_13
Download citation
DOI: https://doi.org/10.1007/978-1-84882-963-3_13
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84882-962-6
Online ISBN: 978-1-84882-963-3
eBook Packages: Computer ScienceComputer Science (R0)