Evaluating the Calmness of Ubiquitous Applications

  • Jukka Riekki
  • Pekka Isomursu
  • Minna Isomursu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3009)


Evaluating the characteristics of ubiquitous applications is still in its infancy although this area is rapidly gaining importance as such applications are becoming common. We present a framework for evaluating the degree of calmness in ubiquitous applications. Calmness is a characteristic of the system that is experienced by the user in the usage situation, hence our evaluation framework is targeted at evaluating the technology in real usage context. We first identify the characteristics of calmness from the user’s perspective and then use them to define the dimensions for our evaluation framework. As the framework is subjective in nature, calmness is not presented as numerical values but as graphics. The suggested presentation gives an overall understanding of the application characteristics at a glance. Further, it facilitates understanding the effects of different design and implementation choices and comparing different applications. We illustrate the framework by evaluating an application being currently constructed. This application will be evaluated in real usage context at the beginning of year 2004. We also compare related work with ours.


Ubiquitous Computing Evaluation Framework Real Usage Personal Assistant Uneven Condition 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Merriam-Webster’s Collegiate Dictionary (2002), WWW:
  2. 2.
    Weiser, M., Brown, J.S.: The Coming Age of Calm Technology. In: Denning, P.J., Metcalfe, R.M. (eds.) Beyond Calculation: The Next Fifty Years of Computing, p. 313. Springer, New York (1997)Google Scholar
  3. 3.
    Weiser, M.: The Computer for the 21st Century. Scientific American, 66–75 (September 1991)Google Scholar
  4. 4.
    Satyanarayanan, M.: Pervasive Computing: Visions and Challenges. IEEE Personal Communications Journal 8, 10–17 (2001)CrossRefGoogle Scholar
  5. 5.
    Schilit, B., Adams, N., Want, R.: Context-Aware Computing Applications. In: Proc. of IEEE workshop on mobile computing systems and applications (1994)Google Scholar
  6. 6.
    Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proc. of the SIGCHI conference on human factors in computing systems, March 1997, pp. 234–241 (1997)Google Scholar
  7. 7.
    Mankoff, J., Dey, A.K., Hsieh, G., Kientz, J., Ames, M., Lederer, S.: Heuristic evaluation of ambient displays. In: CHI 2003, ACM Conference on Human Factors in Computing Systems, CHI Letters, vol. 5(1), pp. 169–176 (2003)Google Scholar
  8. 8.
    Antifakos, S., Michahelles, F., Schiele, B.: Proactive Instructions for Furniture Assembly. In: Borriello, G., Holmquist, L.E. (eds.) UbiComp 2002. LNCS, vol. 2498, p. 351. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  9. 9.
    Abowd, G., Mynatt, E.: Charting Past, Present and Future Research in Ubiquitous Computing. ACM Transactions on Human-Computer Interaction 7, 29–58 (2000)CrossRefGoogle Scholar
  10. 10.
    LaMarca, A., Brunette, W., Koizumi, D., Lease, M., Sigurdsson, S., Sikorski, K., Fox, D., Borriello, G.: PlantCare: An Investigation in Practical Ubiquitous Systems. In: Borriello, G., Holmquist, L.E. (eds.) UbiComp 2002. LNCS, vol. 2498, p. 316. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  11. 11.
    Scholtz, J., Richter, H., Abowd, G. (ed.): Report from Ubicomp 2001 Workshop: Evaluation Methodologies for Ubiquitous Computing. SIGCHI Bulletin (2001), WWW:

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Jukka Riekki
    • 1
  • Pekka Isomursu
    • 2
  • Minna Isomursu
    • 3
  1. 1.Department of Electrical EngineeringUniversity of OuluFinland
  2. 2.Nokia CorporationOuluFinland
  3. 3.Department of Information Processing ScienceUniversity of OuluFinland

Personalised recommendations