Mobile Interaction with the Real World: An Evaluation and Comparison of Physical Mobile Interaction Techniques

  • Enrico Rukzio
  • Gregor Broll
  • Karin Leichtenstern
  • Albrecht Schmidt
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4794)


Mobile devices are more and more used for mobile interactions with things, places and people in the real world. However, so far no studies have discussed which interaction techniques are preferred by users in different contexts. This paper presents an experimental comparison of four different physical mobile interaction techniques: touching, pointing, scanning and user-mediated object interaction. To evaluate these techniques across different scenarios and to collect real usage data, four prototypes were implemented: a system for mobile interaction in smart environments, a mobile tourist guide, a mobile museum guide and a prototype for mobile interaction with advertisement posters. In each setting an experimental comparison was performed. Based on the results of these studies, which involved over 60 participants in total, advantages and disadvantages of these interaction techniques are described. Context-specific user preferences are presented for the interaction techniques, to help application designers and developers decide which interaction technique(s) to integrate into their application and which consequences this decision has.


Physical mobile interaction touching pointing scanning user-mediated object interaction evaluation comparison 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kindberg, T., Barton, J., Morgan, J., Becker, G., Caswell, D., Debaty, P., Gopal, G., Frid, M., Krishnan, V., Morris, H., Schettino, J., Serra, B., Spasojevic, M.: People, places, things: web presence for the real world. Mobile Networks and Applications 7(5), 365–376 (2002)zbMATHCrossRefGoogle Scholar
  2. 2.
    Boyd, J.: Here Comes The Wallet Phone. IEEE Spektrum 42(11), 12–13 (2005)Google Scholar
  3. 3.
    Fowler, G.A.: QR codes: In Japan, Billboards Take Code-Crazy Ads to New Heights. Wall Street Journal (October 2005)Google Scholar
  4. 4.
    Rukzio, E.: Physical Mobile Interactions: Mobile Devices as Pervasive Mediators for Interactions with the Real World. PhD Dissertation. Faculty for Mathematics, Computer Sience and Statistics. University of Munich (2006)Google Scholar
  5. 5.
    Ballagas, R., Rohs, M., Sheridan, J., Borchers, J.: The Smart Phone: A Ubiquitous Input Device. IEEE Pervasive Computing 5(1), 70–77 (2006)CrossRefGoogle Scholar
  6. 6.
    Want, R., Fishkin, K.P., Gujar, A., Harrison, B.L.: Bridging physical and virtual worlds with electronic tags. In: Proceedings of the SIGCHI conference on Human factors in computing systems: the CHI is the limit, ACM Press, Pittsburgh (1999)Google Scholar
  7. 7.
    Välkkynen, P., Korhonen, I., Plomp, J., Tuomisto, T., Cluitmans, L., Ailisto, H., Seppä, H.: A user interaction paradigm for physical browsing and near-object control based on tags. In: PI 2003. Workshop on Real World User Interfaces in conjunction with Mobile HCI 2003, Udine, Italy (2003)Google Scholar
  8. 8.
    Fitzmaurice, G.W.: Situated information spaces and spatially aware palmtop computers. Communications of the ACM 36(7), 39–49 (1993)CrossRefGoogle Scholar
  9. 9.
    Rekimoto, J., Nagao, K.: The World Through the Computer: Computer Augmented Interaction with Real World Environments. In: UIST 1995. Proceedings of the 8th ACM Symposium on User Interface Software and Technology, Pittsburgh, PA, USA, pp. 29–36 (1995)Google Scholar
  10. 10.
    NTT DoCoMo i-area: Location Based Services,
  11. 11.
    Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a context-aware electronic tourist guide: some issues and experiences. In: Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Press, The Hague, The Netherlands (2000)Google Scholar
  12. 12.
    Dix, A., Finlay, J., Abowd, G.D., Beale, R.: Human Computer Interaction, 3rd edn. Prentice Hall, Englewood Cliffs (2003)Google Scholar
  13. 13.
    Rukzio, E., Leichtenstern, K., Callaghan, V., Holleis, P., Schmidt, A., Chin, J.: An Experimental Comparison of Physical Mobile Interaction Techniques: Touching, Pointing and Scanning. In: Dourish, P., Friday, A. (eds.) UbiComp 2006. LNCS, vol. 4206, Springer, Heidelberg (2006)CrossRefGoogle Scholar
  14. 14.
    Broll, G., Siorpaes, S., Rukzio, E., Paolucci, M., Hamard, J., Wagner, M., Schmidt, A.: Supporting Mobile Service Usage through Physical Mobile Interaction. In: PerCom 2007. Fifth Annual IEEE International Conference on Pervasive Computing and Communication, White Plains, NY, USA (2007)Google Scholar
  15. 15.
    Rohs, M., Gfeller, B.: Using Camera-Equipped Mobile Phones for Interacting with Real-World Objects. In: Advances in Pervasive Computing, pp. 265–271, Austrian Computer Society (OCG) (2004) ISSN 3-85403-176-9Google Scholar
  16. 16.
    Lewis, C., Rieman, J.: Task-Centered User Interface Design: A Practical Introduction (1994),
  17. 17.

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Enrico Rukzio
    • 1
  • Gregor Broll
    • 2
  • Karin Leichtenstern
    • 3
  • Albrecht Schmidt
    • 4
  1. 1.Computing Department, Lancaster UniversityUK
  2. 2.Media Informatics Group, University of MunichGermany
  3. 3.Multimedia Concepts and Applications Group, University of AusgburgGermany
  4. 4.Fraunhofer IAIS, Sankt Augustin and B-IT, University of BonnGermany

Personalised recommendations