Towards Indicators for HCI Quality Evaluation Support
The current variety of existing approaches for HCI quality evaluation is marked by a lack of the integration of subjective methods (such as the questionnaire method) and objective methods (such as the electronic informer method) for supporting in making an evaluation final decision. Over the past decades, different researches have been interested to define various quality criteria with their measures. However, the lack in determining how to integrate qualitative with quantitative data leads us to specify new indicators for HCI quality evaluation. This paper aims at defining and constructing quality indicators with their measures related relatively to existing quality criteria based on ISO/IEC 15939 standard. These indicators allow the integration of qualitative and quantitative data and provide a basis for decision making about the quality of the HCI relatively to the evaluation quality criteria. This paper presents a proposal for defining and constructing quality indicators and it highlights a proposed example. A feasibility study of using a quality indicator is presented by the evaluation of traffic supervision system in Valenciennes (France) as a part of CISIT-ISART project.
KeywordsHuman-Computer Interface (HCI) HCI evaluation integration measures indicator qualitative quantitative criteria
Unable to display preview. Download preview PDF.
- 1.Al-Wabil, A., Al-Khalifa, H.: A Framework for Integrating Usability Evaluations Methods: The Mawhiba Web Portal Case Study. In: The International Conference on the Current Trends in Information Technology (CTIT 2009), Dubai, UAE, pp. 1–6 (2009)Google Scholar
- 3.Bastien, J.M.C., Scapin, D.: Ergonomic Criteria for the Evaluation of Human Computer interfaces. Technical Report n° 156, Institut Nationale de Recherche en Informatique et en Automatique, France (1993)Google Scholar
- 4.Charfi, S., Ezzedine, H., Kolski, C.: RITA: A Framework based on multi-evaluation techniques for user interface evaluation, Application to a transport network supervision system. In: ICALT, May 29-31, pp. 263–268. IEEE, Tunisia (2013) ISBN 978-1-4799-0312-2Google Scholar
- 5.Hardin, M., Hom, D., Perez, R., Williams, L.: Quel diagramme ou graphique vous convient le mieux? Copyright Tableau Software, Inc. (2012)Google Scholar
- 8.ISO/IEC 15939 Systems and software engineering — Measurement process (2007)Google Scholar
- 9.ISO/IEC. ISO 9241-11 Ergonomic requirements for office work with visual display terminals (VDT) s- Part 11 Guidance on usability. ISO/IEC 9241-11: 1998(E)Google Scholar
- 10.Kerzazi, N., Lavallée, M.: Inquiry on usability of two software process modeling systems using ISO/IEC 9241. In: CCECE, pp. 773–776 (2011)Google Scholar
- 11.Lewis, J.R.: IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. IJHCI (7), 57–78 (1995)Google Scholar
- 13.Nielsen, N.: Engineering, Usability. Morgan Kaufmann Publishers Inc., San Francisco (1993)Google Scholar
- 16.Whiting, M.A., Haack, J., Varley, C.: Creating realistic, scenario-based synthetic data for test and evaluation of information analytics software. In: Proc. Conference on Beyond Time and Errors: Novel Evaluation Methods For information Visualization, A Workshop of the ACM CHI 2008 Conference, Florence, Italy, pp. 1–9 (2008)Google Scholar
- 17.Yang, T., Linder, J., Bolchini, D.: DEEP: Design-Oriented Evaluation of Perceived Usability. International Journal of Human Computer Interaction, 308–346 (2012)Google Scholar