Advertisement

Where Is Mobile Projection Interaction Going? The Past, Present and Future of the Mobile Projected Interface

  • Yun Zhou
  • Tao Xu
  • Bertrand David
  • René Chalon
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8512)

Abstract

With the rapid development of portable projection technologies and the miniaturization of sensors, the magnitude mobile projector system provides an alternative access to mobile interaction and communication. In this review, we survey and discuss the mobile projected interactions that enable seamless integration of techniques into real world tasks. We first briefly describe the background of emerging projection interaction from past to present. Then we conduct a statistic literature review by collecting data from top tier conferences in the field of Human-Computer Interaction. We next present our two applications corresponding to the new affordances of mobile projectors. We finally conclude with a discussion of the challenges, ranging from hardware issues, social issues, device and sensor fusion in the context, input gesture design and usability, as well as the opportunities provided by mobile projected interfaces.

Keywords

Mobile projectors Ubiquitous computing Mobility Affordance Projection interaction Context Literature review Pico-projector 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Akaoka, E., Ginn, T., Vertegaal, R.: DisplayObjects: prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models. In: TEI 2010: Proceedings of the 4th International Conference on Tangible and Embedded Interaction, pp. 49–56 (2010)Google Scholar
  2. 2.
    Åkerman, P., Puikkonen, A.: Prochinima: using pico projector to tell situated stories. In: MobileHCI 2011: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 337–346. ACM (2011)Google Scholar
  3. 3.
    Baber, C.: Ubiquitous Computing Fundamentals (2010)Google Scholar
  4. 4.
    Baur, D., Boring, S., Feiner, S.: Virtual projection: exploring optical projection as a metaphor for multi-device interaction. In: CHI 2012: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems, pp. 1693–1702. ACM (2012)Google Scholar
  5. 5.
    Chan, L.W., Wu, H.T., Kao, H.S., Ko, J.C., Lin, H.R., Chen, M.Y., Hsu, J., Hung, Y.P.: Enabling beyond-surface interactions for interactive surface with an invisible projection. In: UIST 2010: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 263–272. ACM (2010)Google Scholar
  6. 6.
    Cowan, L.G., Li, K.A.: ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows. In: CHI 2011: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2707–2716. ACM (2011)Google Scholar
  7. 7.
    Dachselt, R., Jones, M., Häkkilä, J., Löchtefeld, M., Rohs, M., Rukzio, E.: Mobile and personal projection (MP 2). In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 21–23. ACM (2011)Google Scholar
  8. 8.
    Greaves, A., Akerman, P., Rukzio, E., Cheverst, K., Hakkila, J.: Exploring user reaction to personal projection when used in shared public places: A formative study. In: MobileHCI 2009 Workshop: CAM3SN (2009)Google Scholar
  9. 9.
    Harrison, C., Benko, H., Wilson, A.D.: OmniTouch: wearable multitouch interaction everywhere. In: UIST 2011: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 441–450 (2011)Google Scholar
  10. 10.
    Harrison, C., Tan, D., Morris, D.: Skinput: appropriating the body as an input surface. In: CHI 2010: Proceedings of the 28th SIGCHI Conference on Human Factors in Computing Systems, pp. 453–462 (2010)Google Scholar
  11. 11.
    Holman, D., Vertegaal, R., Altosaar, M., Troje, N., Johns, D.: Paper windows: interaction techniques for digital paper. In: CHI 2005: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 591–599 (2005)Google Scholar
  12. 12.
    Jones, B.R., Benko, H., Ofek, E., Wilson, A.D.: IllumiRoom: peripheral projected illusions for interactive experiences. In: CHI 2013: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 869–878. ACM (2013)Google Scholar
  13. 13.
    Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A.D., Philipose, M., LaMarca, A.: Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In: UIST 2009: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 129–138. ACM (2009)Google Scholar
  14. 14.
    Kaufmann, B., Ahlström, D.: Studying spatial memory and map navigation performance on projector phones with peephole interaction. In: CHI 2013: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3173–3176. ACM (2013)Google Scholar
  15. 15.
    Kim, S., Chung, J., Oh, A., Schmandt, C., Kim, I.-J.: iLight: information flashlight on objects using handheld projector. In: CHI 2010 Extended Abstracts on Human Factors in Computing Systems, pp. 3631–3636. ACM Press, New York (2010)Google Scholar
  16. 16.
    Ko, J.C., Chan, L.W., Hung, Y.P.: Public issues on projected user interface. In: CHI EA 2010: Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2873–2882 (2010)Google Scholar
  17. 17.
    Leung, M., Tomitsch, M., Vande Moere, A.: Designing a personal visualization projection of online social identity. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 1843–1848. ACM (2011)Google Scholar
  18. 18.
    Löchtefeld, M., Gehring, S., Jung, R., Krüger, A.: guitAR: supporting guitar learning through mobile projection. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 1447–1452. ACM (2011)Google Scholar
  19. 19.
    Mistry, P., Maes, P., Chang, L.: WUW-wear Ur world: a wearable gestural interface. In: CHI EA 2009: Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems, pp. 4111–4116 (2009)Google Scholar
  20. 20.
    Mistry, P., Maes, P.: Quickies: Intelligent sticky notes. In: IET 2008: 4th International Conference on Intelligent Environments, pp. 1–4 (2008)Google Scholar
  21. 21.
    Robinson, S., Jones, M., Vartiainen, E., Marsden, G.: PicoTales: collaborative authoring of animated stories using handheld projectors. In: CSCW 2012: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, pp. 671–680. ACM (2012)Google Scholar
  22. 22.
    Song, H., Guimbretiere, F., Grossman, T., Fitzmaurice, G.: MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In: CHI 2010: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2451–2460. ACM (2010)Google Scholar
  23. 23.
    Song, H., Grossman, T., Fitzmaurice, G., Guimbretiere, F., Khan, A., Attar, R., Kurtenbach, G.: PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. In: CHI 2009: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 143–152. ACM (2009)Google Scholar
  24. 24.
    Willis, K.D.D., Poupyrev, I., Shiratori, T.: Motionbeam: a metaphor for character interaction with handheld projectors. In: CHI 2011: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1031–1040 (2011)Google Scholar
  25. 25.
    Wilson, A.D., Benko, H.: Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: UIST 2010: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 273–282. ACM (2010)Google Scholar
  26. 26.
    Wilson, M.L., Robinson, S., Craggs, D., Brimble, K., Jones, M.: Pico-ing into the future of mobile projector phones. In: CHI EA 2010: Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing Systems, pp. 3997–4002 (2010)Google Scholar
  27. 27.
    Xiao, R., Harrison, C., Willis, K.D., Poupyrev, I., Hudson, S.E.: Lumitrack: low cost, high precision, high speed tracking with projected m-sequences. In: UIST 2013: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, pp. 3–12. ACM (2013)Google Scholar
  28. 28.
    Zhou, Y.: Context-based Innovative Mobile User Interfaces. Ecole Centrale de Lyon. pp. 105–129 (2012)Google Scholar
  29. 29.
    Zhou, Y., David, B.T., Chalon, R.: PlayAllAround: Wearable One-hand Gesture Input and Scalable Projected Interfaces. In: ERGO-IHM 2012: Ergonomie et Interaction Homme-Machine, ACM Digital Library (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Yun Zhou
    • 1
  • Tao Xu
    • 1
  • Bertrand David
    • 1
  • René Chalon
    • 1
  1. 1.Ecole Centrale de Lyon, LIRIS, UMR5205Université de Lyon, CNRSFrance

Personalised recommendations