Skip to main content
SpringerLink
Log in

An AHP-Based Approach in the Early Design Evaluation via Usability Goals

  • Conference paper
Advances in Visual Informatics (IVIC 2013)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8237))

Included in the following conference series:

  • 4321 Accesses

Abstract

The usability engineering process has indicated the importance of setting usability criteria and a measureable level for important goals. Without goal-oriented practice, novice or inexperienced designers do not know how to deliver usable and quality system and would unreasonably follow what they have seen or used before. This paper presents a quantitative basis for selecting and prioritizing design goals or usability goals, thereafter selecting the best prototype relative to the usability goals. The proposed method consists of two main phase, namely: the prioritizing goals phase and the user evaluation phase. The objective of the prioritizing goal phase is to set priorities of the usability goals using analytic hierarchy process (AHP). The second phase involves users in the quantitative and qualitative evaluation methods to evaluate the prototypes using quantitative criteria and thereafter select the best prototype. The level of importance of usability goals assists designers to decide which alternative designs meet the most important usability goals. A case study of prototype selection in students’ design assignment is presented, and the proposed approach is applied to facilitate their design decision during prototype development and evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Leventhal, L., Barnes, J.: Usability Engineering: process, products and examples. Pearson Prentice Hall, New Jersey (2008)

    Google Scholar 

  2. Barney, S., Petersen, K., Svahnberg, M., et al.: Software quality trade-offs: A systematic map. Information and Software Technology 54(7), 651–662 (2012)

    Article  Google Scholar 

  3. Fukuzumi, S., Ikegami, T., Okada, H.: Development of Quantitative Usability Evaluation Method. In: Jacko, J.A. (ed.) HCI International 2009, Part I. LNCS, vol. 5610, pp. 252–258. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  4. Park, K.S., Lim, C.H.: A structured methodology for comparative evaluation of user interface designs using usability criteria and measures. International Journal of Industrial Ergonomics 23(5), 379–389 (1999)

    Article  Google Scholar 

  5. Saaty, T.L.: AHP: The Analytic Hierarchy Process. McGraw-Hill (1980)

    Google Scholar 

  6. Saaty, T.L.: Decision making with the analytic hierarchy process. International Journal of Services Sciences 1(1), 83–98 (2008)

    Article  MathSciNet  Google Scholar 

  7. Seffah, A., Metzker, E.: On Usability and Usability Engineering. In: Adoption-centric Usability Engineering, Part I, pp. 3–13 (2009)

    Google Scholar 

  8. Bevan, N.: International standards for HCI and usability. International Journal of Human-Computer Studies 55, 533–552 (2001)

    Article  MATH  Google Scholar 

  9. ISO DIS 9241-10: Dialogue Principles (1994a)

    Google Scholar 

  10. ISO DIS 9241-14: Menu Guidelines (1994b)

    Google Scholar 

  11. ISO/IEC FDIS 9126-1: Software Engineering – Product Quality- Part 1: Quality Model (2000)

    Google Scholar 

  12. ISO/IEC DTR 9126-4: Software Engineering – Product Quality- Part 4: Quality in Use Metrics (2001)

    Google Scholar 

  13. ISO 9241-11: Guidance on Usability (1998)

    Google Scholar 

  14. ISO/IEC 9126: Information Technology - Software quality characteristics and metrics (1991)

    Google Scholar 

  15. ISO14915: Software Ergonomics for multimedia user interfaces (2000)

    Google Scholar 

  16. IEC TR 61997: Guidelines for the user interfaces in multimedia equipment for general purpose use (2000)

    Google Scholar 

  17. ISO Std 13407: Human-Centred Design Processes for Interactive Systems (1999)

    Google Scholar 

  18. ISO DTR 16982: Usability methods supporting human centred design (2001)

    Google Scholar 

  19. ISO TR 18529: Ergonomics of human-system interaction – human-centred lifecycle process descriptions (2000)

    Google Scholar 

  20. van Welie, M., van der Veer, G.C., Eliens, A.: Breaking down Usability. In: Proceedings of Interact 1999, Edinburgh, Scotland (1999)

    Google Scholar 

  21. Folmer, E., van Gurp, J., Bosch, J.: A framework for capturing the relationship between usability and software architecture. Software Process: Improvement and Practice 8(2), 67–87 (2003)

    Article  Google Scholar 

  22. Michael Pearson, J., Pearson, A., Green, D.: Determining the importance of key criteria in web usability. Management Research News 30(11), 816–828

    Google Scholar 

  23. Gonzalez, R., Martin, M., Arteaga, J., et al.: Web Service-Security Specification based on Usability Criteria and Pattern Approach. Journal of Computers 4 (August 2009)

    Google Scholar 

  24. Ozok, A.A., Fan, Q., Norcio, A.F.: Design guidelines for effective recommender system interfaces based on a usability criteria conceptual model: results from a college student population. Behaviour & Information Technology 29, 57–83 (2009)

    Article  Google Scholar 

  25. Hoo, M.H., Jaafar, A.: Usability in practice: Perception and practicality of management and practitioners. In: International Conference on Pattern Analysis and Intelligent Robotics (ICPAIR), vol. 2, pp. 211–216 (2011)

    Google Scholar 

  26. Nielsen, J.: The usability engineering life cycle. Computer 25(3), 12–22 (1992)

    Article  Google Scholar 

  27. Bak, J.O., Nguyen, K., Risgaard, P., Stage, J.: Obstacles to usability evaluation in practice: a survey of software development organizations. In: Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges (NordiCHI 2008), pp. 23–32. ACM, New York (2008)

    Chapter  Google Scholar 

  28. Keinonen, T.: One dimensional usability – influence of usability on consumers product preference. University of Art and Design (1998)

    Google Scholar 

  29. Gould, J.D., Lewis, C.: Designing for usability: key principles and what designers think. Communications of the ACM 28(3), 300–311 (1985)

    Article  Google Scholar 

  30. Ardito, C., Buono, P., Caivano, D., Costabile, M.F., Lanzilotti, R., Bruun, A., Stage, J.: Usability Evaluation: A Survey of Software Development Organizations. In: Proc. SEKE, Knowledge Systems, Institute Graduate School, Skokie, IL, USA (2011)

    Google Scholar 

  31. Saaty, T.L., Rogers, P.C.: Higher education in the United States (1985-2000): Scenario construction using a hierarchical framework with eigenvector weighting. Socio-Economic Planning Science 10, 251–263 (1976)

    Article  Google Scholar 

  32. Saaty, T.L., Ramanujam, V.: An objective approach to facility promotion and tenure by the analytic hierarchy process. Research in Higher Education 18, 311–331 (1983)

    Article  Google Scholar 

  33. Vellore, R.C., Olson, D.L.: An AHP Application to Computer System Selection. Mathematical and Computer Modelling 15(7), 83–93 (1991)

    Article  Google Scholar 

  34. Hokey, M.: Selection of software: The analytic Hierarchy Process. International Journal of Physical Distribution and Logistic Management 22, 42–52 (1992)

    Article  Google Scholar 

  35. Ramanujam, V., Saaty, T.L.: Technological Choice in Less Developing Countries. Technological Forecasting and Social Change 19(1), 81–98 (1981)

    Article  Google Scholar 

  36. Arbel, A.: Venturing into new technological markets. Mathematical Modeling 9, 293–298 (1987)

    Article  Google Scholar 

  37. Chang, P.L., Chen, Y.C.: A fuzzy multi-criteria decision making method for technology transfer strategy selection in Biotechnology. Fuzzy Sets and Systems 63, 31–139 (1984)

    Google Scholar 

  38. Mitta, D.A.: An application of the analytic hierarchy process: A rank-ordering of computer interfaces. Human Factors: The Journal of the Human Factors and Ergonomics Society 35(1) (1993)

    Google Scholar 

  39. Hasiah, O.M., Rohana, Y., Azizah, J.: Quantitative analysis in a heuristic evaluation for usability of Educational Computer Game (UsaECG). In: International Conference on Information Retrieval & Knowledge Management (CAMP), Kuala Lumpur, Malaysia, pp. 187–192 (2012)

    Google Scholar 

  40. Hasiah, O.M., Azizah, J.: AHP_HeGES: Tools to evaluate usability of educational computer game (UsaECG). In: International Conference on User Science and Engineering (i-USEr), Shah Alam, Selangor, pp. 73–76 (2011)

    Google Scholar 

  41. Delice, E.K., Gungor, Z.: The usability analysis with heuristic evaluation and analytic hierarchy process. International Journal of Industrial Ergonomics 39(6) (2009)

    Google Scholar 

  42. Saaty, T.L.: Priority setting in complex problems. IEEE Transactions on Engineering Management 30(3), 140–155 (1983)

    Article  Google Scholar 

  43. Saaty, T.L., Vargas, L.G.: The logic of priorities: applications in business, energy, health, and transportation. Kluwer-Nijhoff, Boston (1982)

    Book  Google Scholar 

  44. Saaty, T.L.: Group Decision Making and the AHP. In: Golden, B.L., Wasil, E.A., Harker, P.T. (eds.) The Analytic Hierarchy Process: Application and Studies, pp. 59–67. Springer (1989)

    Google Scholar 

  45. Saary, T.L.: The Analytic Hierarchy Process: Planning, Priority Setting, and Resource Allocation. RWS Publication, Pittsburgh (1990)

    Google Scholar 

  46. Virzi, R.A.: Refining the Test Phase of Usability Evaluation: How many subjects is enough? Human Factors: The Journal of the Human Factors and Ergonomics Society 34(4), 457–468 (1992)

    Google Scholar 

  47. Nielsen, J.: How many test users in a Usability study? Alertbox, http://www.useit.com/alertbox/number-of-test-users.html

  48. Dumas, J.S., Redish, J.C.: A practical guide to usability testing. Intellect Ltd. (1999)

    Google Scholar 

  49. Brooke, J.: SUS-A quick and dirty usability scale. Usability Evaluation in Industry 189 (1996)

    Google Scholar 

  50. Hoo, M.H., Jaafar, A.: Quantitative Approach in a Preliminary Study of Evaluating User Interface Designs Using Usability Goal. In: Proceedings of the Visual Informatics International Seminar 2012 (VIIS 2012), pp. 128–136. Institute of Visual Informatics. UKM and Working Group on Visual Informatics, MyRen, Malaysia (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Universiti Tunku Abdul Rahman, Kuala Lumpur, Malaysia

    Meei Hao Hoo

  2. Universiti Kebangsaan Malaysia, Bangi, Malaysia

    Azizah Jaafar

Authors
  1. Meei Hao Hoo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Azizah Jaafar
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Institute of Visual Informatics, Universiti Kebangsaan Malaysia, Bangi, Selangor, Malaysia

    Halimah Badioze Zaman

  2. Computer Laboratory, University of Cambridge, CB3 0FD, Cambridge, UK

    Peter Robinson

  3. School of Computing Science, Newcastle University, Culture Lab, King’s Walk, NE1 7RU, Newcastle Upon Tyne, UK

    Patrick Olivier

  4. Dept. of Computer Science and Information Engineering, National Central University, No 300, Jhongda Rd, Jhongli, Taiwan

    Timothy K. Shih

  5. Computing and Information Systems, Kingston University, Penrhyn Road, Kingston upon Thames, KT1 2EE, London, United Kingdom

    Sergio Velastin

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Hoo, M.H., Jaafar, A. (2013). An AHP-Based Approach in the Early Design Evaluation via Usability Goals. In: Zaman, H.B., Robinson, P., Olivier, P., Shih, T.K., Velastin, S. (eds) Advances in Visual Informatics. IVIC 2013. Lecture Notes in Computer Science, vol 8237. Springer, Cham. https://doi.org/10.1007/978-3-319-02958-0_63

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02958-0_63

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02957-3

  • Online ISBN: 978-3-319-02958-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation