Abstract
Questionnaires are nowadays widely used usability evaluation instruments, and several generic usability questionnaires are available. But these generic artefacts are not always appropriate to evaluate a given setting, and constructing a questionnaire from scratch is a complex task requiring both expertise and resources, so that discount-usability approaches to questionnaire-based evaluation can make a good option in many cases. In this work, a novel knowledge-based approach to design Web usability questionnaires is described. The questionnaire model comprises different ontologies including concepts regarding questions and questionnaires, the different measures that can be obtained and the tasks that have to be carried out by users in order to evaluate a specific kind of Web application. As a proof of concept for the model, a prototype questionnaire design application is also described. The application demonstrates how facts can be gathered through a guided dialogue with the user, and how the system can use this information to tailor the resulting questionnaire to the concrete situation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aroyo, L. and Dicheva, D., Authoring Framework for Concept-Based Web Information Systems, in Proceedings of the Workshop on Concepts and Ontologies in Web-based Educational System, during International Conference on Computers in Education ICCE’2002 (Auckland, 3–6 December 2002), CS-Report 02-15, Technical University of Eindhoven, Eindhoven, 2002, pp. 41–48.
Blandford, A. and Green, T.R.G., OSM: An Ontology-Based Approach to Usability Evaluation, in Proc. of Workshop on Representation in Interactive Software Development, Queen Mary & Westfield College, July 1997.
Borgida, A., On the Relative Expressiveness of Description Logics and Predicate Logics, Artificial Intelligence, Vol. 82, No. 1–2, 1996, pp. 353–367.
Brooke, J., SUS: A’ Quick and Dirty’ Usability Scale, in P.W. Jordan, I.L. McClelland, B. Thomas, and B.A. Weerdmeester (eds.), Usability Evaluation in Industry, Taylor and Francis, London, 1996.
Ceri, S., Fraternali, P., and Matera, M., Conceptual Modelling of Data-Intensive Web Applications, IEEE Internet Computing, Vol. 6, No. 4, 2002, pp. 20–30.
Díaz, P., Sicilia M.A. and Aedo, I., Evaluation of Hypermedia Educational Systems: Criteria ad Imperfect Measures, Proc. of International Conference on Computers in Education ICCE’2002 (Auckland, 3–6 December 2002), IEEE Computer Society, Los Alamitos, 2002, pp. 621–626.
Dix, A., Abowd, G., Beale, R., and Finlay, J., Human-Computer Interaction, Prentice Hall, New York, 1998.
Dumas, J.S. and Redish, J.C., A Practical Guide to Usability Testing, Intellec, Bristol, 1999.
Fernández, M., Gómez-Pérez, A., Pazos, J., and Pazos, A., Building a Chemical Ontology Using METHONTOLOGY and the Ontology Design Environment, IEEE Intelligent Systems, Vol. 14, No. 1, 1999, pp. 37–46.
Gamma, E., Helm, R., Johnson, R., and Vlissides, J., Structural patterns, in Design Patterns, Addison Wesley, Boston, 1995, pp. 163–175.
García, E., Sicilia, M.A., Hilera, J.R., and Gutiérrez, J.A., Extracting Knowledge from Usability Evaluation Databases, in Proceedings of the 8th IFIP TC. 13 International Conf. on Human Computer Interaction INTERACT’01 (Tokyo, 9–13 July 2001), IOS Press, Amsterdam, 2001, pp. 713–715.
García, E., Sicilia, M.A., Hilera, J.R., and Gutiérrez, J.A., Computer-Aided Usability Evaluation, A questionnaire case study, Advances in Human Computer Interaction, Typorama, 2001, pp. 85–91.
García, E., Sicilia, M.A., González, L., and Hilera, J.R., Machine Learning Techniques in Usability-Evaluation Questionnaire Systems, in Proceedings of 2nd International Conference Learning ICDL’02 (Cambridge, 12–15 June 2002), IEEE Computer Society Press, Los Alamitos, 2002.
Harper, B., Slaughter, L., and Norman, K., Questionnaire Administration via the WWW: A Validation and Reliability Study for a User Satisfaction Questionnaire, in Proc. of the WebNet World Conference (Toronto, 31–5 October 1997), accessible at http://www.lap.umd.edu/webnet/paper.html
ISO/IEC/JTC 1/SC 7. ISO/IEC FDIS 9126-1, Software Engineering — Product quality — Part 1: Quality model, Technical Committee of International Organization for Standardization, 2000.
Kirakowski, J., Claridge, N., and Whitehead, R., Human Centered Measures of Success in Web Site Design, in Proc. of the 4th Conference on Human Factors and the Web HFWeb’1998 (New Jersey, 5 June 1998), 1998.
Lei, Y., Motta, E., and Domingue, J., An Ontology-Driven Approach to Web Site Generation and Maintenance, in Proc. of 13th International Conference on Knowledge Engineering and Knowledge Management EKAW’02 (Sigüenza, 1–4 October 2002), 2002, pp. 219–234.
Mayhew, D., The Usability Engineering Lifecycle, Morgan Kaufmann, San Francisco, 1999.
Menzies, T., Cost Benefits of Ontologies, ACM SIGART Intelligence, 1999, accessible at http://menzies.us/pdf/99sigart.pdf
Nielsen, J., Usability Engineering, Morgan Kaufmann, San Francisco, 1994.
Nielsen, J. and Mack, R., Usability Inspection Methods, John Wiley and Sons, New York, 1994.
Nielsen, J., Guerrila HCI: Using Discount Usability Engineering to Penetrate the Intimidation Barrier, in R.G. Bias and D.J. Mayhew (eds.), Cost-Justifying Usability, Academic Press Professional, Boston, 1994, pp 245–272.
Oppenheim, A.N., Questionnaire Design, Interviewing and Attitude Measurement, Pinter Pub Ltd, 1992.
Rumbaugh, J., Jacobson, I., and Booch, G., The Unified Modelling Language Reference Manual, Addison Wesley, Boston, 1998.
Sicilia, M., García, E., Díaz, P., and Aedo, I., A Literature-Based Approach to Annotation and Browsing of Web Resources, Information Research, Vol. 8, No. 2, 2003, accessible at http://informationr.net/ir/8-2/paper149.html
Shneiderman, B., Designing the User Interface, Addison-Wesley, New York, 1998.
van Welie, M., van der Veer, G., and Eliëns, A., Breaking down usability, in A.M. Sasse, Ch. Johnson (eds.). Proceedings of 7th IFIP TC.13 International Conference on Human-Computer Interaction INTERACT’99 (Edinburgh, 30 August–3 September 1999), IOS Press, Amsterdam, 1999, pp. 613–620.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Kluwer Academic Publishers
About this paper
Cite this paper
Barriocanal, E.G., Sicilia Urbán, M.A., González, L., Hilera, J.R. (2005). Dialogue-Based Design of Web Usability Questionnaires Using Ontologies. In: Jacob, R.J., Limbourg, Q., Vanderdonckt, J. (eds) Computer-Aided Design of User Interfaces IV. Springer, Dordrecht. https://doi.org/10.1007/1-4020-3304-4_11
Download citation
DOI: https://doi.org/10.1007/1-4020-3304-4_11
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-3145-8
Online ISBN: 978-1-4020-3304-9
eBook Packages: Computer ScienceComputer Science (R0)