Skip to main content
SpringerLink
Log in

Explorable Representation of Interaction in VR/AR Environments

  • Conference paper
  • First Online:
Augmented Reality, Virtual Reality, and Computer Graphics (AVR 2018)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10851))

Abstract

Synthetic 3D content, which is the main element of virtual and augmented reality applications, typically includes objects, which react to interaction with users and other objects. Interaction may result in changes of the objects’ geometry, structure and appearance. Representation of 3D content covering temporal properties can be useful in application domains that benefit from analysis of users’ and objects’ behavior, such as education, training, e-commerce, marketing and merchandising. However, the available approaches do not enable exploration of 3D content with regards to its time-dependent properties. The main contribution of this paper is temporal representation of interaction. The representation is based on semantic web standards and ontologies, which enable use of general as well as domain knowledge for exploration of content. The representation is discussed in the context of an immersive virtual car showroom implemented using headsets and motion tracking devices.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The following 3D models have been used in the environment:

    https://www.cgtrader.com/dennisp

    https://free3d.com/3d-model/single-road-20861.html

    https://www.3dcadbrowser.com/download.aspx?3dmodel=102858

    https://free3d.com/3d-model/concrete-barrier-301778.html

References

  1. 3D Modeling Ontology (2018). http://3dontology.org/

  2. Leap Motion (2018). https://developer.leapmotion.com/documentation

  3. Oculus Rift (2018). https://support.oculus.com

  4. OWL 2 web ontology language profiles (second edition). http://www.w3.org/TR/owl2-profiles/#Computational_Properties. Accessed 07 Mar 2018

  5. OpenGL. https://www.opengl.org/. Accessed 20 Mar 2015

  6. Albertoni, R., et al.: Ontology-based searching framework for digital shapes. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM 2005. LNCS, vol. 3762, pp. 896–905. Springer, Heidelberg (2005). https://doi.org/10.1007/11575863_111

    Chapter  Google Scholar 

  7. Albrecht, S., Wiemann, T., Günther, M., Hertzberg, J.: Matching CAD object models in semantic mapping. In: Proceedings ICRA 2011 Workshop: Semantic Perception, Mapping and Exploration, SPME (2011)

    Google Scholar 

  8. Artale, A., Franconi, E.: A survey of temporal extensions of description logics. Ann. Math. Artif. Intell. 30(1–4), 171–210 (2001). https://doi.org/10.1023/A:1016636131405

    Article  MathSciNet  MATH  Google Scholar 

  9. Autodesk: 3ds Max (2017). http://www.autodesk.pl

  10. Away3D: Away3D (2017). http://away3d.com

  11. Batsakis, S., Petrakis, E., Tachmazidis, I., Antoniou, G.: Temporal representation and reasoning in OWL 2. Semant. Web 8, 1–20 (2009). http://www.semantic-web-journal.net/system/files/swj855.pdf

    Google Scholar 

  12. Berners-Lee, T., Hendler, J., Lassila, O., et al.: The semantic web. Sci. Am. 284(5), 28–37 (2001)

    Article  Google Scholar 

  13. Catalano, C.E., Mortara, M., Spagnuolo, M., Falcidieno, B.: Semantics and 3D media: current issues and perspectives. Comput. Graph. 35(4), 869–877 (2011)

    Article  Google Scholar 

  14. Chaudhuri, S., Kalogerakis, E., Giguere, S., Funkhouser, T.: Attribit: content creation with semantic attributes. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, UIST 2013, pp. 193–202. ACM, New York (2013)

    Google Scholar 

  15. Ciptawilangga, Y.: Online merchandising and ecommerce with virtual reality simulation of an actual retail location, US Patent App. 12/474, 202, 2 December 2010

    Google Scholar 

  16. De Floriani, L., Hui, A., Papaleo, L., Huang, M., Hendler, J.: A semantic web environment for digital shapes understanding. In: Falcidieno, B., Spagnuolo, M., Avrithis, Y., Kompatsiaris, I., Buitelaar, P. (eds.) SAMT 2007. LNCS, vol. 4816, pp. 226–239. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-77051-0_25

    Chapter  Google Scholar 

  17. De Troyer, O., Kleinermann, F., Pellens, B., Bille, W.: Conceptual modeling for virtual reality. In: Grundy, J., Hartmann, S., Laender, A.H.F., Maciaszek, L., Roddick, J.F. (eds.) Tutorials, Posters, Panels and Industrial Contributions at the 26th International Conference on Conceptual Modeling - ER 2007, CRPIT, Auckland, New Zealand, vol. 83, pp. 3–18. ACS (2007)

    Google Scholar 

  18. DFKI, Computer Graphics Lab of the Saarland University, I.V.C.I.: XML3D (2017). http://xml3d.org

  19. Falcidieno, B., Spagnuolo, M., Alliez, P., Quak, E., Vavalis, E., Houstis, C.: Towards the semantics of digital shapes: the AIM@SHAPE approach. In: EWIMT (2004)

    Google Scholar 

  20. Flotyński, J.: Semantic modelling of interactive 3D content with domain-specific ontologies. Procedia Comput. Sci. 35, 531–540 (2014). 18th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems

    Article  Google Scholar 

  21. Flotyński, J., Krzyszkowski, M., Walczak, K.: Semantic composition of 3D content behavior for explorable virtual reality applications. In: Barbic, J., D’Cruz, M., Latoschik, M.E., Slater, M., Bourdot, P. (eds.) EuroVR 2017. LNCS, vol. 10700, pp. 3–23. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-72323-5_1

    Chapter  Google Scholar 

  22. Flotyński, J., Walczak, K.: Semantic multi-layered design of interactive 3D presentations. In: Proceedings of the Federated Conference on Computer Science and Information Systems, Kraków, Poland, 8–11 September 2013, pp. 541–548. IEEE (2013)

    Google Scholar 

  23. Flotyński, J., Walczak, K.: Conceptual knowledge-based modeling of interactive 3D content. Vis. Comput. 31, 1–20 (2014)

    Google Scholar 

  24. Flotyński, J., Walczak, K.: Ontology-based creation of 3D content in a service-oriented environment. In: Abramowicz, W. (ed.) BIS 2015. LNBIP, vol. 208, pp. 77–89. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19027-3_7

    Chapter  Google Scholar 

  25. Flotyński, J., Walczak, K.: Customization of 3D content with semantic meta-scenes. Graph. Model. 88, 23–39 (2016)

    Article  MathSciNet  Google Scholar 

  26. Flotyński, J., Walczak, K.: Knowledge-based representation of 3D content behavior in a service-oriented virtual environment. In: Proceedings of the 22nd International Conference on Web3D Technology, Brisbane, Australia, 5–7 June 2017, Article no. 14. ACM, New York (2017)

    Google Scholar 

  27. Flotyński, J., Walczak, K.: Ontology-based representation and modelling of synthetic 3D content: a state-of-the-art review. In: Computer Graphics Forum, pp. 1–25 (2017)

    Article  Google Scholar 

  28. Foundation, B.: Blender (2017). http://www.blender.org

  29. Gutierrez, C., Hurtado, C., Vaisman, A.: Temporal RDF. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 93–107. Springer, Heidelberg (2005). https://doi.org/10.1007/11431053_7

    Chapter  Google Scholar 

  30. Gutiérrez, M., García-Rojas, A., Thalmann, D., Vexo, F., Moccozet, L., Magnenat-Thalmann, N., Mortara, M., Spagnuolo, M.: An ontology of virtual humans: Incorporating semantics into human shapes. Vis. Comput. 23(3), 207–218 (2007)

    Article  Google Scholar 

  31. Hu, X., Liu, X., He, Z., Zhang, J.: Batch modeling of 3D city based on Esri cityengine. In: Smart and Sustainable City 2013, ICSSC 2013, IET International Conference on IET (2013)

    Google Scholar 

  32. Jiang, H., Xu, W., Mao, T., Li, C., Xia, S., Wang, Z.: A semantic environment model for crowd simulation in multilayered complex environment. In: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, pp. 191–198. ACM (2009)

    Google Scholar 

  33. Kalogerakis, E., Christodoulakis, S., Moumoutzis, N.: Coupling ontologies with graphics content for knowledge driven visualization. In: VR 2006 Proceedings of the IEEE conference on Virtual Reality, Alexandria, Virginia, USA, 25–29 March 2006, pp. 43–50 (2006)

    Google Scholar 

  34. Klein, M., Fensel, D.: Ontology versioning on the semantic web. In: Proceedings of the First International Conference on Semantic Web Working, SWWS 2001, pp. 75–91. CEUR-WS.org, Aachen, Germany (2001). http://dl.acm.org/citation.cfm?id=2956602.2956610

  35. Kowalski, R., Sergot, M.: A Logic-based calculus of events. In: Schmidt, J.W., Thanos, C. (eds.) Foundations of Knowledge Base Management, Topics in Information Systems, pp. 23–55. Springer, Heidelberg (1989). https://doi.org/10.1007/978-3-642-83397-7_2

    Chapter  Google Scholar 

  36. Kowalski, R.A., Sadri, F.: The situation calculus and event calculus compared. In: ILPS, vol. 94, pp. 539–553 (1994)

    Google Scholar 

  37. Latoschik, M.E., Blach, R.: Semantic modelling for virtual worlds - a novel paradigm for realtime interactive systems? In: Proceedings of the ACM VRST 2008, pp. 17–20 (2008)

    Google Scholar 

  38. Lugrin, J.L., Cavazza, M.: Making sense of virtual environments: action representation, grounding and common sense. In: Proceedings of the 12th International Conference on Intelligent User Interfaces, IUI 2007, pp. 225–234. ACM, New York (2007)

    Google Scholar 

  39. Lui, T.W., Piccoli, G., Ives, B.: Marketing strategies in virtual worlds. SIGMIS Database 38(4), 77–80 (2007). https://doi.org/10.1145/1314234.1314248

    Article  Google Scholar 

  40. Microsoft: Direct3D 11.1 features (2017). https://msdn.microsoft.com

  41. Noy, N., Rector, A., Hayes, P., Welty, C.: Defining n-ary relations on the semantic web. https://www.w3.org/TR/swbp-n-aryRelations/. Accessed 06 Mar 2018

  42. Oracle: Java3D (2017). http://www.oracle.com

  43. Otto, K.: Semantic virtual environments. In: Special Interest Tracks and Posters of the 14th International Conference on World Wide Web, Chiba, Japan, 10–14 May 2005, pp. 1036–1037 (2005)

    Google Scholar 

  44. Pellens, B., De Troyer, O., Kleinermann, F.: CoDePA: a conceptual design pattern approach to model behavior for X3D worlds. In: Proceedings of the 13th International Symposium on 3D web technology, Los Angeles, 09–10 August 2008, pp. 91–99 (2008)

    Google Scholar 

  45. Pellens, B., Kleinermann, F., De Troyer, O.: A development environment using behavior patterns to facilitate building 3D/VR applications. In: Proceedings of the 6th Australasian Conference on Interactive Entertainment, IE 2009, pp. 8:1–8:8. ACM (2009)

    Google Scholar 

  46. Pittarello, F., De Faveri, A.: Semantic description of 3D environments: a proposal based on web standards. In: Proceedings of the Eleventh International Conference on 3D Web Technology, Web3D 2006, pp. 85–95. ACM, New York (2006)

    Google Scholar 

  47. Rabattu, P.Y., Massé, B., Ulliana, F., Rousset, M.C., Rohmer, D., Léon, J.C., Palombi, O.: My Corporis Fabrica Embryo: an ontology-based 3D spatio-temporal modeling of human embryo development. J. Biomed. Semant. 6(1), 36 (2015). https://doi.org/10.1186/s13326-015-0034-0

    Article  Google Scholar 

  48. Rumiński, D.: An experimental study of spatial sound usefulness in searching and navigating through ar environments. Virtual Real. 19, 223–233 (2015). https://doi.org/10.1007/s10055-015-0274-4

    Article  Google Scholar 

  49. Rumiński, D., Walczak, K.: Semantic contextual augmented reality environments. In: The 13th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014), ISMAR 2014, pp. 401–404. IEEE (2014)

    Google Scholar 

  50. Shanahan, M.: The event calculus explained. In: Wooldridge, M.J., Veloso, M. (eds.) Artificial Intelligence Today. LNCS (LNAI), vol. 1600, pp. 409–430. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-48317-9_17

    Chapter  Google Scholar 

  51. Sikos, L.F.: 3D model indexing in videos for content-based retrieval via X3D-based semantic enrichment and automated reasoning. In: Proceedings of the 22nd International Conference on 3D Web Technology, Web3D 2017, pp. 19:1–19:7. ACM, New York (2017). https://doi.org/10.1145/3055624.3075943

  52. Spagnuolo, M., Falcidieno, B.: The role of ontologies for 3D media applications. In: Kompatsiaris, Y., Hobson, P. (eds.) Semantic Multimedia and Ontologies. Springer, London (2008). https://doi.org/10.1007/978-1-84800-076-6_7

    Chapter  Google Scholar 

  53. Spagnuolo, M., Falcidieno, B.: 3D media and the semantic web. IEEE Intell. Syst. 24(2), 90–96 (2009)

    Article  Google Scholar 

  54. Technologies, U.: Unity (2017). http://unity3d.com/5

  55. Trellet, M., Ferey, N., Baaden, M., Bourdot, P.: Interactive visual analytics of molecular data in immersive environments via a semantic definition of the content and the context. In: 2016 Workshop on Immersive Analytics (IA), pp. 48–53. IEEE (2016)

    Google Scholar 

  56. Tutenel, T., Bidarra, R., Smelik, R.M., De Kraker, K.J.: The role of semantics in games and simulations. Comput. Entertain. (CIE) 6(4), 57 (2008)

    Google Scholar 

  57. Van Gool, L., Leibe, B., Müller, P., Vergauwen, M., Weise, T.: 3D challenges and a non-in-depth overview of recent progress. In: 3DIM, pp. 118–132 (2007)

    Google Scholar 

  58. W3C: SWRL (2004). http://www.w3.org/Submission/SWRL/

  59. W3C: VRML (2017). https://www.w3.org/MarkUp/VRML/

  60. W3C: X3D (2017). http://www.web3d.org/getting-started-x3d

  61. W3C: OWL. http://www.w3.org/2001/sw/wiki/OWL. Accessed 24 Mar 2015

  62. W3C: RDF. http://www.w3.org/TR/2004/REC-rdf-concepts-20040210/. Accessed 24 Mar 2015

  63. W3C: RDFS. http://www.w3.org/TR/2000/CR-rdf-schema-20000327/. Accessed 24 Mar 2015

  64. Walczak, K., Rumiński, D., Flotyński, J.: Building contextual augmented reality environments with semantics. In: Proceedings of the 20th International Conference on Virtual Systems and Multimedia, Hong Kong, 9–12 September 2014 (2014)

    Google Scholar 

  65. Welty, C., Fikes, R.: A reusable ontology for fluents in OWL. In: Proceedings of the 2006 Conference on Formal Ontology in Information Systems: Proceedings of the Fourth International Conference (FOIS 2006), pp. 226–236. IOS Press, Amsterdam (2006). http://dl.acm.org/citation.cfm?id=1566079.1566106

  66. Wiebusch, D., Latoschik, M.E.: Enhanced decoupling of components in intelligent realtime interactive systems using ontologies. In: Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), Proceedings of the IEEE Virtual Reality 2012 Workshop (2012)

    Google Scholar 

  67. Zaid, L.A., Kleinermann, F., De Troyer, O.: Applying semantic web technology to feature modeling. In: Proceedings of the 2009 ACM Symposium on Applied Computing, SAC 2009, pp. 1252–1256. ACM (2009)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Poznań University of Economics and Business, Niepodległości 10, 61-875, Poznań, Poland

    Jakub Flotyński, Adrian Nowak & Krzysztof Walczak

Authors
  1. Jakub Flotyński
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Adrian Nowak
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Krzysztof Walczak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jakub Flotyński .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Paris-Sud, Orsay, France

    Patrick Bourdot

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Flotyński, J., Nowak, A., Walczak, K. (2018). Explorable Representation of Interaction in VR/AR Environments. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2018. Lecture Notes in Computer Science(), vol 10851. Springer, Cham. https://doi.org/10.1007/978-3-319-95282-6_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-95282-6_42

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-95281-9

  • Online ISBN: 978-3-319-95282-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation