Implementation Support of Guidelines through Directed Evaluation and Re-Engineering

  • Chris Stary


The contribution deals (i) with the gap between guidelines and their implementation support through design or evaluation methods/methodologies, and (ii) with the gap between activities of testing usability and those of user-centered design. The approach to bridge the addressed gaps taken in this paper is based on the concept to enrich evaluation techniques through specific guidelines for redesigning user interfaces according to the results of checking their usability. This way, evaluation and design become part of a consistent and case-sensitive feedback loop between developers and users. The methodology EU-CON II implements that feedback loop. It has been developed to implement the EC directive 90/270/EEC on human-computer interaction. In the paper the methodology is detailed, and empirical evidence for its successful application is given.


Usability Engineering Sample Answer Heuristic Evaluation Implementation Support Text Editing 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bastien, J.M.C., Scapin, D.: A Validation of Ergonomic Criteria for the Evaluation of Human-Computer Interfaces. International Journal of Human-Computer Interaction 4, 2 (1992) 183–196CrossRefGoogle Scholar
  2. 2.
    Cuomo, D.L., Bowen, C.D.: Understanding Usability Issues addressed by three User-System Interface Evaluation Techniques. Interacting with Computers 6, 1 (1994) 86–108CrossRefGoogle Scholar
  3. 3.
    DIN 66 234 Teil 8: Bildschirmarbeitsplätze, Grundsätze der Dialoggestaltung. Beuth, Berlin (1988)Google Scholar
  4. 4.
    DIN EN 29 241 Deutsches Institut für Normung, Teil 10: Ergonomische Anforderungen für Bürotätigkeiten mit Bildschirmgeräten, Teil 11: Grundsätze der Dialoggestaltung. Berlin (January 1994)Google Scholar
  5. 5.
    EC-Directive 90/270/EWG: Human-Computer Interfaces. In: Directive 29.5.1990 about Safety and Health of VDU-Work (5th Directive Art. 16 Par. 1 of Dir. 89/391/EWG). Official EC-Newsletter, Vol. 33, L 156, Minimal Standards, Par. 3 (21.6.1990) 18Google Scholar
  6. 6.
    Greutmann, T., Ackermann, D.: Zielkonflikte bei Software-Gestaltungskriterien. In: Proc. Software-Ergonomie ’89. Teubner, Stuttgart (1989) 144–152Google Scholar
  7. 7.
    Große, B.-M.: Probleme bei der Umsetzung von Normen und Richtlinien in firmeninterne Richtlinien. Ergonomie und Informatik 19 (1993) 22–29Google Scholar
  8. 8.
    Houwing, E.H., Wiethoff, M., Arnold, A.G.: Usability Evaluation from Users’ Point of View: Three Complementary Measures. In: Proc. of the 5th Conf. on Human-Computer Interaction HCI International’93 (Orlando, August 1993). Elsevier, Amsterdam (1993) 475–480Google Scholar
  9. 9.
    IBM, CUA (SAA): Systems Application Architecture Common User Access Panel Design and User Interaction, SC26–4351 (1987). Basic Interface Design Guide, SC26–4351 (1989). Advanced Interface Design Guide, SC26–4351 (1989). Guide to User Interface Design, (1991). Advanced Interface Design Reference, SC26–4351 (1991)Google Scholar
  10. 10.
    ISO 9241 Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs); Part 10–17: Dialogue Principles; Guidance Specifying and Measuring Usability; Framework for Describing Usability in Terms of User-Based Measures; Presentation of Information; User Guidance; Menu Dialogs; Command Dialogs; Direct Manipulation Dialogs; Form Filling Dialogs. ISO, Geneva (1993)Google Scholar
  11. 11.
    ISO, DIS 13407—Human Centred Design Process for Interactive Systems. ISO, Geneva (1997)Google Scholar
  12. 12.
    Jeffries, R., Miller, J.R., Wharton, C., Uyeda, K.M.: User Interface Evaluation in the Real World: A Comparison of Four Techniques. In: Proc. of ACM Conf. on Human Aspects in Computing Systems CHI’91 (New Orleans, April 28-May 2, 1991). Addison-Wesley, Reading (1991) 119–124Google Scholar
  13. 13.
    Karat, J.: User-Centred Software Evaluation Methodologies. In: Helander M. et al. (eds.): Handbook of Human-Computer Interaction. Elsevier Science (North Holland), Amsterdam (1997) 689–704Google Scholar
  14. 14.
    Mayhew, D.J.: The Usability Engineering Lifecycle. Tutorial Notes No. 25, CHI’99, 1999.Google Scholar
  15. 15.
    Microsoft: The Windows Interface. An Application Design Guide. Microsoft, Redmond (1991)Google Scholar
  16. 16.
    McGrath, J.E.: Methodology Matters: Doing Research in the Behavioral and Social Science. In: Baecker, R.M., Buxton, W.A.S. (eds.): Readings in Human-Computer Interaction: Towards the Year 2000. Morgan Kaufmann, San Francisco (1995) 152–169Google Scholar
  17. 17.
    Nielsen, J.: Finding Usability Problems Through Heuristic Evaluation. In: Proc. of ACM Conf. on Human Aspects in Computing Systems CHI’92 (Monterey, May 3–7, 1992). Addison-Wesley, Reading (1992) 3–7Google Scholar
  18. 18.
    Nielsen, J.: Heuristic Evaluation. In: Nielsen, J., Mack, R. (eds.): Usability Inspection Methods. John Wiley & Sons, New York (1994) 25–62Google Scholar
  19. 19.
    Rauterberg, M.: Läßt sich die Gebrauchstauglichkeit interaktiver Software messen? Und wenn ja, wie? Ergonomie und Informatik, GI (1992)Google Scholar
  20. 20.
    SAP: Leitfaden für eine benutzergerechte Dialoggestaltung. SAP, Walldorf (1990)Google Scholar
  21. 21.
    Sears, A.: Layout Appropriateness: A Metric for Evaluating User Interface Widget Layout. IEEE Transactions on Software Engineering 7 (1993) 707–719CrossRefGoogle Scholar
  22. 22.
    Smith, S.L.: Standards Versus Guidelines for Designing User Interface Software. In: Helander, M. (ed.): Handbook of Human-Computer Interaction. Elsevier (North Holland), Amsterdam (1988) 877–899Google Scholar
  23. 23.
    Snyder, K.M.: A Guide to Software Usability. IBM, White Plains, New York (1991)Google Scholar
  24. 24.
    Stary, Ch.: Usability Analysis of CUA, CD-S 96/2, CD-Lab of Expert Systems. Vienna University of Technology (1996). Available at Google Scholar
  25. 25.
    Stary, Ch., Riesenecker-Caba, T.; Flecker, J.: Implementing the Directive for VDU work - the EU-state of the art. Behaviour & Information Technology 17, 2 (1998) 65–81CrossRefGoogle Scholar
  26. 26.
    Stary, Ch., Riesenecker-Caba, Th.: EU-CON II — Software-ergonomische Gestaltung und Bewertung und Gestaltung von Bildschirmarbeit, Schriftenreihe der Bundesanstalt für Arbeitsschutz und Arbeitsmedizin, Fb 826 Arbeitsschutz. WirtschaftsverlagNerlag für neue Wissenschaft NW, Dortmund (1999)Google Scholar
  27. 27.
    Sweeney, M., Maguire, M., Shackel, B.: Evaluating User-Computer Interaction: A Framework. International Journal of Man-Machine Studies 39 (1993) 689–711CrossRefGoogle Scholar
  28. 28.
    Tetzlaff, L., Schwartz, D.: The Use of Guidelines in Interface Design. In: Proc. of ACM Conf. on Human Aspects in Computing Systems CHI’91 (New Orleans, April 28-May 2, 1991). Addison-Wesley, Reading (1991) 329–333Google Scholar
  29. 29.
    Totter, A., Stary, Ch.: Methodengesicherte Validierung eines prozeßgeleiteten, SW-ergonomischen, integrativen Bewertungs-und Gestaltungsinstruments: EU-CON II. In: Proc. Software Ergonomie’99. GI/ACM (March 1999)Google Scholar
  30. 30.
    Totter, A., Stary, Ch.: Tailorability and Usability Engineering: A Roadmap for Convergence. In: Kobsa, A, Stephanidis, C. (eds.): Proc. of the 5“ ERCIM Workshop on User Interfaces for All (Dagstuhl, 28 November-1 December 1999), GMD Report 74. GMD - Forschungszentrum Informationstechnik GmbH, Sankt Augustin (1999). Available at
  31. 31.
    Ulich, E., Rauterberg, M., Moll, T., Greutmann, T., Strohm, O.: Task Orientation and User-Oriented Dialog Design. International Journal of Human-Computer Interaction 3, 2 (1991) 117–144CrossRefGoogle Scholar
  32. 32.
    VDI - Verein Deutscher Ingenieure: VDI-Richtlinie 5005. Bürokommunikation - Software-Ergonomie in der Bürokommunikation. Beuth Verlag, Düsseldorf (1990)Google Scholar

Copyright information

© Springer-Verlag London 2001

Authors and Affiliations

  • Chris Stary
    • 1
  1. 1.Department of Business Information Systems Communications EngineeringUniversity of LinzLinzAustria

Personalised recommendations