Remote Evaluation of Mobile Applications

  • Fabio Paternò
  • Andrea Russino
  • Carmen Santoro
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4849)


In this paper we present a method and a supporting environment that allows remote evaluation of mobile applications. Various modules have been developed in order to gather contextual data about the usage of such applications in different environments. In addition, issues related to how to visualise usability data have been addressed in order to support the designers’ work in analysing such data.


Remote usability evaluation Usability in Mobile Applications Representation of Usability Data 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hartson, R.H., Castillo, J.C., Kelso, J.T., Neale, W.C.: Remote Evaluation: The Network as an Extension of the Usability Laboratory. CHI 1996, 228–235 (1996)Google Scholar
  2. 2.
    Ivory, M.Y., Hearst, M.A.: The state of the art in automating usability evaluation of user interfaces. ACM Computing Surveys 33(4), 470–516 (2001)CrossRefGoogle Scholar
  3. 3.
    Tullis, T., Fleischman, S., McNulty, M., Cianchette, C., Bergel, M.: An Empirical Comparison of Lab and Remote Usability Testing of Web Sites. Usability Professionals Conference, Pennsylvania  (2002)Google Scholar
  4. 4.
    Lister, M.: Streaming Format Software for Usability Testing. In: Proceedings ACM CHI 2003, Extended Abstracts, pp. 632–633 (2003)Google Scholar
  5. 5.
    Tennent, P., Chalmers, M.: Recording and Understanding Mobile People and Mobile Technology, E-social science (2005)Google Scholar
  6. 6.
    Andreasen, M., Nielsen, H., Schrøder, S., Stage, J.: What happened to remote usability testing?: An empirical study of three methods. In: CHI 2007, pp. 1405–1414 (2007)Google Scholar
  7. 7.
    Waterson, S., Landay, J.A., Matthews, T.: In the lab and Out in the wild: remote web usability usability Testing for Mobile Devices. In: CHI 2002, Minneapolis, Minnesota, USA, pp. 796–797 (April 2002)Google Scholar
  8. 8.
    Stoica, A., Fiotakis, G., Simarro Cabrera, J., Frutos, H.M., Avouris, N., Dimitriadis, Y.: Usability evaluation of handheld devices: A case study for a museum application. In: Bozanis, P., Houstis, E.N. (eds.) PCI 2005. LNCS, vol. 3746, Springer, Heidelberg (2005)Google Scholar
  9. 9.
    Avouris, N., Komis, V., Margaritis, M., Fiotakis, G.: An environment for studying collaborative learning activities. Journal  (2004)Google Scholar
  10. 10.
    Serrano, M., Nigay, L., Demumieux, R., Descos, J., Losquin, P.: Multimodal interaction on mobile phones: Development and evaluation using ACICARE. In: Proceedings of the 8th Conference on Human-Computer Interaction with Mobile Devices and Services, Mobile HCI 2006, Helsinki, Finland, pp. 129–136 (September 12-15, 2006)Google Scholar
  11. 11.
    Waterson, S., Hong, J., Sohn, T., Heer, J., Matthews, T., Landay, J.: What Did They Do? Understanding Clickstreams with the WebQuilt Visualization System. In: Proceedings of the ACM International Working Conference on Advanced Visual Interfaces, Trento, Italy (September 12-15, 2002)Google Scholar
  12. 12.
    Maly, I., Slavik, P.: Towards Visual Analysis of Usability Test Logs Using Task Models (Paper in Conference Proceedings). In: Coninx, K., Luyten, K., Schneider, K.A. (eds.) TAMODIA 2006. LNCS, vol. 4385, pp. 24–38. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  13. 13.
    Paganelli, L., Paternò, F.: Tools for Remote Usability Evaluation of Web Applications through Browser Logs and Task Models, Behavior Research Methods, Instruments, and Computers. The Psychonomic Society Publications 35(3), 369–378 (2003)Google Scholar
  14. 14.
    Paternò, F.: Model-based design and evaluation of interactive applications. Springer, Heidelberg (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Fabio Paternò
    • 1
  • Andrea Russino
    • 1
  • Carmen Santoro
    • 1
  1. 1.ISTI-CNR, Via G. Moruzzi, 1, 56124 PisaItaly

Personalised recommendations