Evaluating the Calmness of Ubiquitous Applications
Evaluating the characteristics of ubiquitous applications is still in its infancy although this area is rapidly gaining importance as such applications are becoming common. We present a framework for evaluating the degree of calmness in ubiquitous applications. Calmness is a characteristic of the system that is experienced by the user in the usage situation, hence our evaluation framework is targeted at evaluating the technology in real usage context. We first identify the characteristics of calmness from the user’s perspective and then use them to define the dimensions for our evaluation framework. As the framework is subjective in nature, calmness is not presented as numerical values but as graphics. The suggested presentation gives an overall understanding of the application characteristics at a glance. Further, it facilitates understanding the effects of different design and implementation choices and comparing different applications. We illustrate the framework by evaluating an application being currently constructed. This application will be evaluated in real usage context at the beginning of year 2004. We also compare related work with ours.
KeywordsUbiquitous Computing Evaluation Framework Real Usage Personal Assistant Uneven Condition
Unable to display preview. Download preview PDF.
- 1.Merriam-Webster’s Collegiate Dictionary (2002), WWW: http://www.webster.com/cgibin/dictionary
- 2.Weiser, M., Brown, J.S.: The Coming Age of Calm Technology. In: Denning, P.J., Metcalfe, R.M. (eds.) Beyond Calculation: The Next Fifty Years of Computing, p. 313. Springer, New York (1997)Google Scholar
- 3.Weiser, M.: The Computer for the 21st Century. Scientific American, 66–75 (September 1991)Google Scholar
- 5.Schilit, B., Adams, N., Want, R.: Context-Aware Computing Applications. In: Proc. of IEEE workshop on mobile computing systems and applications (1994)Google Scholar
- 6.Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proc. of the SIGCHI conference on human factors in computing systems, March 1997, pp. 234–241 (1997)Google Scholar
- 7.Mankoff, J., Dey, A.K., Hsieh, G., Kientz, J., Ames, M., Lederer, S.: Heuristic evaluation of ambient displays. In: CHI 2003, ACM Conference on Human Factors in Computing Systems, CHI Letters, vol. 5(1), pp. 169–176 (2003)Google Scholar
- 11.Scholtz, J., Richter, H., Abowd, G. (ed.): Report from Ubicomp 2001 Workshop: Evaluation Methodologies for Ubiquitous Computing. SIGCHI Bulletin (2001), WWW: sigchi.org/bulletin/2002.1/janfeb02.pdf