Abstract
With the rapid development of portable projection technologies and the miniaturization of sensors, the magnitude mobile projector system provides an alternative access to mobile interaction and communication. In this review, we survey and discuss the mobile projected interactions that enable seamless integration of techniques into real world tasks. We first briefly describe the background of emerging projection interaction from past to present. Then we conduct a statistic literature review by collecting data from top tier conferences in the field of Human-Computer Interaction. We next present our two applications corresponding to the new affordances of mobile projectors. We finally conclude with a discussion of the challenges, ranging from hardware issues, social issues, device and sensor fusion in the context, input gesture design and usability, as well as the opportunities provided by mobile projected interfaces.
Keywords
Download to read the full chapter text
Chapter PDF
References
Akaoka, E., Ginn, T., Vertegaal, R.: DisplayObjects: prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models. In: TEI 2010: Proceedings of the 4th International Conference on Tangible and Embedded Interaction, pp. 49–56 (2010)
Åkerman, P., Puikkonen, A.: Prochinima: using pico projector to tell situated stories. In: MobileHCI 2011: Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 337–346. ACM (2011)
Baber, C.: Ubiquitous Computing Fundamentals (2010)
Baur, D., Boring, S., Feiner, S.: Virtual projection: exploring optical projection as a metaphor for multi-device interaction. In: CHI 2012: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems, pp. 1693–1702. ACM (2012)
Chan, L.W., Wu, H.T., Kao, H.S., Ko, J.C., Lin, H.R., Chen, M.Y., Hsu, J., Hung, Y.P.: Enabling beyond-surface interactions for interactive surface with an invisible projection. In: UIST 2010: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 263–272. ACM (2010)
Cowan, L.G., Li, K.A.: ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows. In: CHI 2011: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2707–2716. ACM (2011)
Dachselt, R., Jones, M., Häkkilä, J., Löchtefeld, M., Rohs, M., Rukzio, E.: Mobile and personal projection (MP 2). In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 21–23. ACM (2011)
Greaves, A., Akerman, P., Rukzio, E., Cheverst, K., Hakkila, J.: Exploring user reaction to personal projection when used in shared public places: A formative study. In: MobileHCI 2009 Workshop: CAM3SN (2009)
Harrison, C., Benko, H., Wilson, A.D.: OmniTouch: wearable multitouch interaction everywhere. In: UIST 2011: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 441–450 (2011)
Harrison, C., Tan, D., Morris, D.: Skinput: appropriating the body as an input surface. In: CHI 2010: Proceedings of the 28th SIGCHI Conference on Human Factors in Computing Systems, pp. 453–462 (2010)
Holman, D., Vertegaal, R., Altosaar, M., Troje, N., Johns, D.: Paper windows: interaction techniques for digital paper. In: CHI 2005: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 591–599 (2005)
Jones, B.R., Benko, H., Ofek, E., Wilson, A.D.: IllumiRoom: peripheral projected illusions for interactive experiences. In: CHI 2013: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 869–878. ACM (2013)
Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A.D., Philipose, M., LaMarca, A.: Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In: UIST 2009: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 129–138. ACM (2009)
Kaufmann, B., Ahlström, D.: Studying spatial memory and map navigation performance on projector phones with peephole interaction. In: CHI 2013: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3173–3176. ACM (2013)
Kim, S., Chung, J., Oh, A., Schmandt, C., Kim, I.-J.: iLight: information flashlight on objects using handheld projector. In: CHI 2010 Extended Abstracts on Human Factors in Computing Systems, pp. 3631–3636. ACM Press, New York (2010)
Ko, J.C., Chan, L.W., Hung, Y.P.: Public issues on projected user interface. In: CHI EA 2010: Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2873–2882 (2010)
Leung, M., Tomitsch, M., Vande Moere, A.: Designing a personal visualization projection of online social identity. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 1843–1848. ACM (2011)
Löchtefeld, M., Gehring, S., Jung, R., Krüger, A.: guitAR: supporting guitar learning through mobile projection. In: CHI 2011 Extended Abstracts on Human Factors in Computing Systems, pp. 1447–1452. ACM (2011)
Mistry, P., Maes, P., Chang, L.: WUW-wear Ur world: a wearable gestural interface. In: CHI EA 2009: Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems, pp. 4111–4116 (2009)
Mistry, P., Maes, P.: Quickies: Intelligent sticky notes. In: IET 2008: 4th International Conference on Intelligent Environments, pp. 1–4 (2008)
Robinson, S., Jones, M., Vartiainen, E., Marsden, G.: PicoTales: collaborative authoring of animated stories using handheld projectors. In: CSCW 2012: Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, pp. 671–680. ACM (2012)
Song, H., Guimbretiere, F., Grossman, T., Fitzmaurice, G.: MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In: CHI 2010: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2451–2460. ACM (2010)
Song, H., Grossman, T., Fitzmaurice, G., Guimbretiere, F., Khan, A., Attar, R., Kurtenbach, G.: PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. In: CHI 2009: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 143–152. ACM (2009)
Willis, K.D.D., Poupyrev, I., Shiratori, T.: Motionbeam: a metaphor for character interaction with handheld projectors. In: CHI 2011: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1031–1040 (2011)
Wilson, A.D., Benko, H.: Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: UIST 2010: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 273–282. ACM (2010)
Wilson, M.L., Robinson, S., Craggs, D., Brimble, K., Jones, M.: Pico-ing into the future of mobile projector phones. In: CHI EA 2010: Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing Systems, pp. 3997–4002 (2010)
Xiao, R., Harrison, C., Willis, K.D., Poupyrev, I., Hudson, S.E.: Lumitrack: low cost, high precision, high speed tracking with projected m-sequences. In: UIST 2013: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, pp. 3–12. ACM (2013)
Zhou, Y.: Context-based Innovative Mobile User Interfaces. Ecole Centrale de Lyon. pp. 105–129 (2012)
Zhou, Y., David, B.T., Chalon, R.: PlayAllAround: Wearable One-hand Gesture Input and Scalable Projected Interfaces. In: ERGO-IHM 2012: Ergonomie et Interaction Homme-Machine, ACM Digital Library (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Zhou, Y., Xu, T., David, B., Chalon, R. (2014). Where Is Mobile Projection Interaction Going? The Past, Present and Future of the Mobile Projected Interface. In: Kurosu, M. (eds) Human-Computer Interaction. Applications and Services. HCI 2014. Lecture Notes in Computer Science, vol 8512. Springer, Cham. https://doi.org/10.1007/978-3-319-07227-2_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-07227-2_19
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07226-5
Online ISBN: 978-3-319-07227-2
eBook Packages: Computer ScienceComputer Science (R0)