Skip to main content

A Model and Platform for Building Agent-Based Pervasive Mixed Reality Systems

Part of the Lecture Notes in Computer Science book series (LNAI,volume 10978)

Abstract

In agent literature, a partially unexplored area is related to the integration of ever-wider opportunities offered by technologies such as Mixed Reality (MR) and Augmented Reality (AR). In this paper we present a framework called Augmented Worlds (AW), which provides a model and a technological support to develop a broad spectrum of agent-based AR/MR systems. Distinguishing key features of the approach include: bi-directional augmentation, support for existing cognitive agent technologies, support for developing open multi-user environments. In the paper, we describe first the conceptual model on which the framework is based, and then a concrete architecture and prototype implementation. Two case studies about real-world applications – an augmented museum and an augmented harbour – engineered with the framework are finally discussed.

Keywords

  • Mixed Reality
  • Augmented Reality
  • Augmented Worlds
  • Agent programming technologies
  • BDI

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-94580-4_10
  • Chapter length: 13 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   59.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-94580-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   79.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.

Notes

  1. 1.

    https://bitbucket.org/account/user/awuniboteam/projects/AW.

  2. 2.

    http://vertx.io.

  3. 3.

    Museo della Regina, Cattolica (RN), Italy.

  4. 4.

    https://goo.gl/avBSgH.

References

  1. Azuma, R.T.: A survey of augmented reality. Presence: Teleoper. Virtual Environ. 6(4), 355–385 (1997)

    CrossRef  Google Scholar 

  2. Behrens, T.M., Hindriks, K.V., Dix, J.: Towards an environment interface standard for agent platforms. Ann. Math. Artif. Intell. 61(4), 261–295 (2011)

    CrossRef  Google Scholar 

  3. Billinghurst, M., Clark, A., Lee, G.: A survey of augmented reality. Found. Trends Hum.-Comput. Interact. 8(2–3), 73–272 (2015)

    CrossRef  Google Scholar 

  4. Billinghurst, M., Kato, H.: Collaborative augmented reality. Commun. ACM 45(7), 64–70 (2002)

    CrossRef  Google Scholar 

  5. Boissier, O., Bordini, R.H., Hübner, J.F., Ricci, A., Santi, A.: Multi-agent oriented programming with JaCaMo. Sci. Comput. Program. 78(6), 747–761 (2013)

    CrossRef  Google Scholar 

  6. Bordini, R.H., Hübner, J.F., Wooldrige, M.: Programming Multi-agent Systems in AgentSpeak using Jason. Wiley Series in Agent Technology. Wiley, Hoboken (2007)

    MATH  Google Scholar 

  7. Campbell, A.G., Stafford, J.W., Holz, T., O’hare, G.M.: Why, when and how to use augmented reality agents (AuRAs). Virtual Real. 18(2), 139–159 (2014)

    CrossRef  Google Scholar 

  8. Collier, R.W., Russell, S., Lillis, D.: Reflecting on agent programming with AgentSpeak(L). In: Chen, Q., Torroni, P., Villata, S., Hsu, J., Omicini, A. (eds.) PRIMA 2015. LNCS (LNAI), vol. 9387, pp. 351–366. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25524-8_22

    CrossRef  Google Scholar 

  9. Croatti, A., Ricci, A.: Towards the web of augmented things. In: 2017 IEEE International Conference on Software Architecture Workshops (ICSAW), pp. 80–87, April 2017

    Google Scholar 

  10. Guinard, D.D., Trifa, V.: Building the Web of Things. Manning, New York (2016)

    Google Scholar 

  11. Holz, T., Campbell, A.G., O’Hare, G.M.P., Stafford, J.W., Martin, A., Dragone, M.: Mira-mixed reality agents. Int. J. Hum.-Comput. Stud. 69(4), 251–268 (2011)

    CrossRef  Google Scholar 

  12. Lasi, H., Fettke, P., Kemper, H.G., Feld, T., Hoffmann, M.: Industry 4.0. business & information. Syst. Eng. 6(4), 239–242 (2014)

    Google Scholar 

  13. Luck, M., Aylett, R.: Applying artificial intelligence to virtualreality: intelligent virtual environments. Appl. Artif. Intell. 14(1), 3–32 (2000)

    CrossRef  Google Scholar 

  14. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. E77-D(12), 1321–1329 (1994)

    Google Scholar 

  15. Omicini, A., Ricci, A., Viroli, M.: Artifacts in the A&A meta-model for multi-agent systems. Auton. Agents Multi-agent Syst. 17(3), 432–456 (2008)

    CrossRef  Google Scholar 

  16. Panetta, K.: Exploring augmented reality for business and consumers. Gartner report (2017)

    Google Scholar 

  17. Ricci, A., Piunti, M., Tummolini, L., Castelfranchi, C.: The mirror world: preparing for mixed-reality living. IEEE Pervasive Comput. 14(2), 60–63 (2015)

    CrossRef  Google Scholar 

  18. Ricci, A., Piunti, M., Viroli, M.: Environment programming in multi-agent systems: an artifact-based perspective. Auton. Agent. Multi-agent Syst. 23(2), 158–192 (2011)

    CrossRef  Google Scholar 

  19. Ricci, A., Tummolini, L., Piunti, M., Boissier, O., Castelfranchi, C.: Mirror worlds as agent societies situated in mixed reality environments. In: Ghose, A., Oren, N., Telang, P., Thangarajah, J. (eds.) COIN 2014. LNCS (LNAI), vol. 9372, pp. 197–212. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25420-3_13

    CrossRef  Google Scholar 

  20. Rincon, J.A., Poza-Lujan, J.L., Julian, V., Posadas-Yague, J.L., Carrascosa, C.: Extending MAM5 meta-model and JaCalIVE framework to integrate smart devices from real environments. PLoS ONE 11(2), 1–27 (2016)

    CrossRef  Google Scholar 

  21. Satyanarayanan, M.: Pervasive computing: vision and challenges. IEEE Pers. Commun. 8, 10–17 (2001)

    CrossRef  Google Scholar 

  22. Schmalstieg, D., Höllerer, T.: Augmented Reality: Principles and Practice. Addison-Wesley, Boston (2015)

    Google Scholar 

  23. Starner, T.: Project glass: an extension of the self. IEEE Pervasive Comput. 12(2), 14–16 (2013)

    CrossRef  Google Scholar 

  24. Weiser, M.: The computer for the 21st century. SIGMOBILE Mob. Comput. Commun. Rev. 3, 3–11 (1999)

    CrossRef  Google Scholar 

  25. Weyns, D., Omicini, A., Odell, J.: Environment as a first class abstraction in multiagent systems. Auton. Agent. Multi-agent Syst. 14(1), 5–30 (2007)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Angelo Croatti .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Croatti, A., Ricci, A. (2018). A Model and Platform for Building Agent-Based Pervasive Mixed Reality Systems. In: Demazeau, Y., An, B., Bajo, J., Fernández-Caballero, A. (eds) Advances in Practical Applications of Agents, Multi-Agent Systems, and Complexity: The PAAMS Collection. PAAMS 2018. Lecture Notes in Computer Science(), vol 10978. Springer, Cham. https://doi.org/10.1007/978-3-319-94580-4_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-94580-4_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-94579-8

  • Online ISBN: 978-3-319-94580-4

  • eBook Packages: Computer ScienceComputer Science (R0)