Abstract
With the proliferation of Intelligent Environments, the need for configuring their behaviors to address their users’ needs emerges. In combination with the current advances in Augmented and Virtual Reality and Conversational Agents, new opportunities arise for systems which allow people to program their environment. Whereas today this requires programming skills, soon, when most spaces will include smart objects, tools which allow their collaborative management by non-technical users will become a necessity. To that end, we present BricklAyeR, a novel collaborative platform for non-programmers, that allows to define the behavior of Intelligent Environments, through an intuitive, 3D building-block User Interface, following the Trigger-Action programming principle, in Augmented Reality, with the help of a Conversational Agent.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
- 5.
References
Dahl, Y., Svendsen, R.-M.: End-user composition interfaces for smart environments: a preliminary study of usability factors. In: Marcus, A. (ed.) DUXU 2011. LNCS, vol. 6770, pp. 118–127. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21708-1_14
Dey, A.K., Sohn, T., Streng, S., Kodama, J.: iCAP: interactive prototyping of context-aware applications. In: Fishkin, K.P., Schiele, B., Nixon, P., Quigley, A. (eds.) Pervasive 2006. LNCS, vol. 3968, pp. 254–271. Springer, Heidelberg (2006). https://doi.org/10.1007/11748625_16
Truong, K.N., Huang, E.M., Abowd, G.D.: CAMP: a magnetic poetry interface for end-user programming of capture applications for the home. In: Davies, N., Mynatt, E.D., Siio, I. (eds.) UbiComp 2004. LNCS, vol. 3205, pp. 143–160. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-30119-6_9
Ur, B., McManus, E., Pak Yong Ho, M., Littman, M.L.: Practical trigger-action programming in the smart home. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 803–812. ACM, New York (2014)
McNerney, T.S.: Tangible programming bricks: an approach to making programming accessible to everyone (1999)
Vygotsky, L.S.: Mind in Society. Harvard University Press, Cambridge (1978)
Zidianakis, E., Papagiannakis, G., Stephanidis, C.: A cross-platform, remotely-controlled mobile avatar simulation framework for AmI environments. In: SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications, p. 12. ACM (2014)
Nosek, J.T.: The case for collaborative programming. Commun. ACM 41, 105–108 (1998)
Oliveira, I., Tinoca, L., Pereira, A.: Online group work patterns: how to promote a successful collaboration. Comput. Educ. 57, 1348–1357 (2011)
Vacchetti, L., et al.: A stable real-time AR framework for training and planning in industrial environments. In: Ong, S.K., Nee, A.Y.C. (eds.) Virtual and Augmented Reality Applications in Manufacturing, pp. 129–145. Springer, London (2004). https://doi.org/10.1007/978-1-4471-3873-0_8
Kateros, S., et al.: A comparison of gamified, immersive VR curation methods for enhanced presence and human-computer interaction in digital humanities. Int. J. Heritage Digit. Era. 4, 221–233 (2015)
Söderberg, R., Wärmefjord, K., Carlson, J.S., Lindkvist, L.: Toward a Digital Twin for real-time geometry assurance in individualized production. CIRP Ann. 66, 137–140 (2017)
Stojkoska, B.L.R., Trivodaliev, K.V.: A review of Internet of Things for smart home: challenges and solutions. J. Clean. Prod. 140, 1454–1464 (2017)
Walch, M., Rietzler, M., Greim, J., Schaub, F., Wiedersheim, B., Weber, M.: homeBLOX: making home automation usable. In: Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, pp. 295–298. ACM (2013)
Stefanidi, E., et al.: ParlAmI: a multimodal approach for programming intelligent environments. Technologies 7, 11 (2019)
Korozi, M., Leonidis, A., Antona, M., Stephanidis, C.: LECTOR: towards reengaging students in the educational process inside smart classrooms. In: Horain, P., Achard, C., Mallem, M. (eds.) IHCI 2017. LNCS, vol. 10688, pp. 137–149. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-72038-8_11
Neumann, U., Majoros, A.: Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. In: 1998 Proceedings of IEEE Virtual Reality Annual International Symposium, pp. 4–11. IEEE (1998)
Kasahara, S., Niiyama, R., Heun, V., Ishii, H.: exTouch: spatially-aware embodied manipulation of actuated objects mediated by augmented reality. In: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction, pp. 223–228. ACM (2013)
Zaeh, M.F., Vogl, W.: Interactive laser-projection for programming industrial robots. In: 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality. ISMAR 2006, pp. 125–128. IEEE (2006)
Heun, V., Hobin, J., Maes, P.: Reality editor: programming smarter objects. In: Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, pp. 307–310. ACM, New York (2013)
Heun, V., Kasahara, S., Maes, P.: Smarter objects: using AR technology to program physical objects and their interactions. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, pp. 961–966. ACM (2013)
Mateo, C., Brunete, A., Gambao, E., Hernando, M.: Hammer: an android based application for end-user industrial robot programming. In: 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications (MESA), pp. 1–6. IEEE (2014)
Chong, J.W.S., Ong, S.K., Nee, A.Y.C., Youcef-Youmi, K.: Robot programming using augmented reality: an interactive method for planning collision-free paths. Robot. Comput.-Integr. Manuf. 25, 689–701 (2009)
Greenlee, B.J., Karanxha, Z.: A study of group dynamics in educational leadership cohort and non-cohort groups. J. Res. Leadersh. Educ. 5, 357–382 (2010)
Brown, B., et al.: Lessons from the lighthouse: collaboration in a shared mixed reality system. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 577–584. ACM, New York (2003)
Leonidis, A., Arampatzis, D., Louloudakis, N., Stephanidis, C.: The AmI-Solertis system: creating user experiences in smart environments. In: Proceedings of the 13th IEEE International Conference on Wireless and Mobile Computing, Networking and Communications (2017)
Korozi, M.: Empowering intelligent classrooms with attention monitoring and intervention cycles (2017)
Weintrop, D., Wilensky, U.: To block or not to block, that is the question: students’ perceptions of blocks-based programming. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 199–208. ACM (2015)
Blackmon, M.H., Polson, P.G., Kitajima, M., Lewis, C.: Cognitive walkthrough for the web. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 463–470. ACM (2002)
Nielsen, J.: Enhancing the explanatory power of usability heuristics. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 152–158. ACM (1994)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Stefanidi, E., Arampatzis, D., Leonidis, A., Papagiannakis, G. (2019). BricklAyeR: A Platform for Building Rules for AmI Environments in AR. In: Gavrilova, M., Chang, J., Thalmann, N., Hitzer, E., Ishikawa, H. (eds) Advances in Computer Graphics. CGI 2019. Lecture Notes in Computer Science(), vol 11542. Springer, Cham. https://doi.org/10.1007/978-3-030-22514-8_39
Download citation
DOI: https://doi.org/10.1007/978-3-030-22514-8_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-22513-1
Online ISBN: 978-3-030-22514-8
eBook Packages: Computer ScienceComputer Science (R0)