Advertisement

Universal Access in the Information Society

, Volume 18, Issue 4, pp 821–835 | Cite as

Foundations for distributing the interaction: facilitating universal access through Responsive Cross-Device Applications

  • Felix Albertos-MarcoEmail author
  • Victor M. R. Penichet
  • Jose A. Gallud
Long Paper
  • 472 Downloads

Abstract

The emergence of the Internet of Things has created the prospect of a future in which devices can always be connected. There is a trend for information to be available to anyone, anywhere and anytime. Moreover, current scenarios are full of interconnected devices with their own interactive capabilities. The problem of orchestrating these capabilities in multi-device environments is complex and remains unsolved. However, providing universal access is not only a question of devices being connected or sharing information. To get a better understanding of how to distribute interaction in Web applications, we developed new theoretical and practical proposals. Also, we perform case studies through the supporting tools developed as prototypes. On this article, we present two major contributions. First, we present the foundations of Responsive Cross-Device Applications. This approach is aimed at supporting user tasks in cross-device environments, adapting interaction to facilitate user task completion. Secondly, we provide the answer for the following research questions: (1) What do we mean by Distributed Interaction? (2) How do current approaches deal with the distribution of the interaction? (3) What is the best platform for distributing the interaction? and (4) Does the distribution of the interaction facilitate universal access? Finally, we discuss the outcomes of this article in view of these research questions.

Keywords

Distributed Interaction Web applications Responsive Cross-Device Applications Universal access 

Notes

Acknowledgements

This work has been partially supported by Grant 2014/10340 from the University of Castilla-La Mancha, Spain.

References

  1. 1.
    Abowd, G.D.: Formal aspects of human-computer interaction. Ph.D. thesis (1991)Google Scholar
  2. 2.
    Albertos Marco, F., Gallud, J., Penichet, V.M., Winckler, M.: A model-based approach for describing offline navigation of web applications. J. Web Eng. 16(1&2), 1–38 (2017)Google Scholar
  3. 3.
    Albertos Marco, F., Penichet, V.M., Gallud, J.A.: Drag&share: a shared workspace for distributed synchronous collaboration. In: Gallud, J.A., Tesoriero, R., Penichet, V.M. (eds.) Distributed User Interfaces, Human-Computer Interaction Series, pp. 125–132. Springer London, London (2011).  https://doi.org/10.1007/978-1-4471-2271-5_14 CrossRefGoogle Scholar
  4. 4.
    Albertos Marco, F., Penichet, V.M.R., Gallud, J.A.: Collaborative e-learning through Drag&Share in synchronous shared workspaces. J. UCS 19(7), 894–911 (2013).  https://doi.org/10.3217/jucs-019-07-0894 CrossRefGoogle Scholar
  5. 5.
    Albertos Marco, F., Penichet, V.M.R., Gallud, J.A.: Making distributed user interfaces interruption-resistant: a model-based approach. In: Lozano, M.D., Mashat, A.S., Fardoun, H.M., Gallud, J.A., Penichet, V.M.R., Tesoriero, R., Vanderdonckt, J. (eds.) DUI@EICS, pp. 18–22 (2013)Google Scholar
  6. 6.
    Albertos Marco, F., Penichet, V.M.R., Gallud, J.A, Winckler, M.A.: User interaction with offline web applications: a case study. In: Interacción’15 (2015).  https://doi.org/10.1145/2829875.2829890
  7. 7.
    Albertos Marco, F., Penichet, V.M.R., Gallud, J.A, Winckler, M.A.: What happens when students go offline in mobile devices? In: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct, MobileHCI ’15, pp. 1199–1206. ACM, New York, NY, USA (2015).  https://doi.org/10.1145/2786567.2801609
  8. 8.
    Almeida, N., Silva, S., Teixeira, A.: Multimodal multi-device application supported by an SCXML state chart machine. In: Proceedings of EICS Workshop on Engineering Interactive Systems with SCXML (2014)Google Scholar
  9. 9.
    Bunde-Pedersen, J.: Distributed interaction for activity-based computing. Ph.D. thesis, Department of Computer Science, University of Aarhus (2009)Google Scholar
  10. 10.
    Chi, P.Y.P., Li, Y.: Weave: scripting cross-device wearable interaction. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, pp. 3923–3932. ACM, New York, NY, USA (2015).  https://doi.org/10.1145/2702123.2702451
  11. 11.
    Dearman, D., Pierce, J.S.: It’s on my other computer!: Computing with multiple devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’08, pp. 767–776. ACM, New York, NY, USA (2008).  https://doi.org/10.1145/1357054.1357177
  12. 12.
    de la Guía, E., Camacho, V., Orozco-Barbosa, L., Lujan, V.B., Penichet, V.M.R., Lozano, M.: Introducing IoT and wearable technologies into task-based language learning for young children. IEEE Trans. Learn. Technol. PP(99), 1–1 (2016).  https://doi.org/10.1109/TLT.2016.2557333 CrossRefGoogle Scholar
  13. 13.
    Elmqvist, N.: Distributed User Interfaces: State of the Art, pp. 1–12. Springer London, London (2011).  https://doi.org/10.1007/978-1-4471-2271-5_1 CrossRefGoogle Scholar
  14. 14.
    Fitzmaurice, G.W., Khan, A., Buxton, W., Kurtenbach, G., Balakrishnan, R.: Sentient data access via a diverse society of devices. Queue 1(8), 52–62 (2003).  https://doi.org/10.1145/966712.966721 CrossRefGoogle Scholar
  15. 15.
    Ghiani, G., Manca, M., Paternò, F.: Authoring context-dependent cross-device user interfaces based on trigger/action rules. In: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia, MUM ’15, pp. 313–322. ACM, New York, NY, USA (2015).  https://doi.org/10.1145/2836041.2836073
  16. 16.
    Ghiani, G., Paternò, F., Santoro, C.: Push and pull of web user interfaces in multi-device environments. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, AVI ’12, pp. 10–17. ACM, New York, NY, USA (2012).  https://doi.org/10.1145/2254556.2254563
  17. 17.
    Hamilton, P., Wigdor, D.J.: Conductor: enabling and understanding cross-device interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, pp. 2773–2782. ACM, New York, NY, USA (2014).  https://doi.org/10.1145/2556288.2557170
  18. 18.
    Houben, S.: An activity-centric approach to configuration work in distributed interaction. Ph.D. thesis, Pervasive Interaction Technology Laboratory, IT University of Copenhagen (2015)Google Scholar
  19. 19.
    Houben, S., Nielsen, S., Esbensen, M., Bardram, J.E.: Noosphere: an activity-centric infrastructure for distributed interaction. In: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia, MUM ’13, pp. 13:1–13:10. ACM, New York, NY, USA (2013).  https://doi.org/10.1145/2541831.2541856
  20. 20.
    Husmann, M., Nebeling, M., Norrie, M.: Multimasher: a visual tool for multi-device mashups. In: Sheng, Q., Kjeldskov, J. (eds.) Current Trends in Web Engineering, Lecture Notes in Computer Science, pp. 27–38. Springer, Cham (2013).  https://doi.org/10.1007/978-3-319-04244-2_4 CrossRefGoogle Scholar
  21. 21.
    Jetter, H.C., Zllner, M., Gerken, J., Reiterer, H.: Design and implementation of post-wimp distributed user interfaces with zoil. Int. J. Hum. Comput. Interact. 28(11), 737–747 (2012).  https://doi.org/10.1080/10447318.2012.715539 CrossRefGoogle Scholar
  22. 22.
    Jokela, T., Ojala, J., Olsson, T.: A diary study on combining multiple information devices in everyday activities and tasks. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI ’15, pp. 3903–3912. ACM, New York, NY, USA (2015).  https://doi.org/10.1145/2702123.2702211
  23. 23.
    Kane, S.K., Karlson, A.K., Meyers, B.R., Johns, P., Jacobs, A., Smith, G.: Exploring cross-device web use on pcs and mobile devices. In: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I, INTERACT ’09, pp. 722–735. Springer, Berlin (2009).  https://doi.org/10.1007/978-3-642-03655-2_79 CrossRefGoogle Scholar
  24. 24.
    Manca, M., Paternò, F.: Customizable dynamic user interface distribution. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, EICS ’16, pp. 27–37. ACM, New York, NY, USA (2016).  https://doi.org/10.1145/2933242.2933259
  25. 25.
    Manca, M., Paternó, F., Santoro, C., Spano, L.: Generation of multi-device adaptive multimodal web applications. In: Daniel, F., Papadopoulos, G., Thiran, P. (eds.) Mobile Web Information Systems, Lecture Notes in Computer Science, pp. 218–232. Springer, Berlin (2013).  https://doi.org/10.1007/978-3-642-40276-0_17 CrossRefGoogle Scholar
  26. 26.
    Nebeling, M., Mintsi, T., Husmann, M., Norrie, M.: Interactive development of cross-device user interfaces. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, CHI ’14, pp. 2793–2802. ACM, New York, NY, USA (2014).  https://doi.org/10.1145/2556288.2556980
  27. 27.
    Oulasvirta, A., Sumari, L.: Mobile kits and laptop trays: managing multiple devices in mobile information work. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’07, pp. 1127–1136. ACM, New York, NY, USA (2007).  https://doi.org/10.1145/1240624.1240795
  28. 28.
    Rekimoto, J.: Pick-and-drop: a direct manipulation technique for multiple computer environments. In: UIST ’97—Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology, pp. 31–39. ACM Press, New York, NY, USA (1997).  https://doi.org/10.1145/263407.263505
  29. 29.
    Santosa, S., Wigdor, D.: A field study of multi-device workflows in distributed workspaces. In: Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp ’13, pp. 63–72. ACM, New York, NY, USA (2013).  https://doi.org/10.1145/2493432.2493476
  30. 30.
    Schreiner, M., Rädle, R., Jetter, H.C., Reiterer, H.: Connichiwa: a framework for cross-device web applications. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA ’15, pp. 2163–2168. ACM, New York, NY, USA (2015).  https://doi.org/10.1145/2702613.2732909
  31. 31.
    Silva, S., Almeida, N., Pereira, C., Martins, A.I., Rosa, A.F., Oliveira e Silva, M., Teixeira, A.: Design and Development of Multimodal Applications: A Vision on Key Issues and Methods, pp. 109–120. Springer, Cham (2015).  https://doi.org/10.1007/978-3-319-20678-3_11 CrossRefGoogle Scholar
  32. 32.
    Stephanidis, C.: Universal access in the information society—a retrospective of recent activities. In: Universal Design: Towards Universal Access in the Information Society, CHI ’01. ACM, New York, NY, USA (2001)Google Scholar
  33. 33.
    Villanueva, P.G., Tesoriero, R., Gallud, J.A.: Copyflypaste: distributing information on distributed user interfaces. In: Distributed User Interfaces: Models, Methods and Tools, DUI 2013 In Conjunction with ACM EICS 2013 Conference, London, UK, June 24th 2013, pp. 62–66 (2013)Google Scholar
  34. 34.
    Villanueva, P.G., Tesoriero, R., Gallud, J.A.: Proxywork: distributing user interface components of web applications. In: Distributed User Interfaces: Models, Methods and Tools, DUI 2013 In Conjunction with ACM EICS 2013 Conference, London, UK, June 24th 2013, pp. 58–61 (2013)Google Scholar
  35. 35.
    Wäljas, M., Segerståhl, K., Väänänen-Vainio-Mattila, K., Oinas-Kukkonen, H.: Cross-platform service user experience: a field study and an initial framework. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, MobileHCI ’10, pp. 219–228. ACM, New York, NY, USA (2010).  https://doi.org/10.1145/1851600.1851637
  36. 36.
    Yang, J., Wigdor, D.: Panelrama: enabling easy specification of cross-device web applications. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’14, pp. 2783–2792. ACM, New York, NY, USA (2014).  https://doi.org/10.1145/2556288.2557199

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2017

Authors and Affiliations

  1. 1.Computer System DepartmentUniversity of Castilla-La ManchaAlbaceteSpain

Personalised recommendations