Maritime Applications of Augmented Reality – Experiences and Challenges

  • Uwe von Lukas
  • Matthias Vahl
  • Benjamin Mesing
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8526)


The paper summarizes experiences from applied research in visual computing for the maritime sector. It starts with initial remarks on Augmented Reality in general and the specific boundary conditions of the maritime industry. The focus is on a presentation of various concrete AR applications that have been implemented for use cases in maritime engineering, production, operation and retrofitting. The paper closes with remarks on future research in this area.


Augmented Reality Mixed Reality Applied Research Maritime Industry Mobile Systems 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Computer Graphics and Applications 21(6), 34–47 (2001)CrossRefGoogle Scholar
  2. 2.
    Azuma, R.: A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6(4), 355–385 (1997)Google Scholar
  3. 3.
    Perunovic, Z., Vidic, J.: Innovation in the Maritime Industry. In: Correa, H., College, R. (eds.) Proceedings of the 22nd Anual POM Conference: Operations Management: The Enabling Link, Reno, Nevada, U.S.A, April 29-May 2 (2011)Google Scholar
  4. 4.
    Blue Growth - Opportunities for marine and maritime sustainable growth Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions COM(2012) 494 final. European Union (2012)Google Scholar
  5. 5.
    Dolereit, T., Kuijper, A.: Converting Underwater Imaging into Imaging in Air. In: VISAPP 2014 - Proceedings of the International Conference on Computer Vision Theory and Applications, vol. 1, pp. 96–103 (2014)Google Scholar
  6. 6.
    Abhari, K., Baxter, J.S.H., Chen, E.S., Khan, A.R., Wedlake, C., Peters, T., Eagleson, R., de Ribaupierre, S.: The role of augmented reality in training the planning of brain tumor resection. In: Liao, H., Linte, C.A., Masamune, K., Peters, T.M., Zheng, G. (eds.) MIAR/AE-CAI 2013. LNCS, vol. 8090, pp. 241–248. Springer, Heidelberg (2013)Google Scholar
  7. 7.
    Sonntag, D., Zillner, S., Schulz, C., Weber, M., Toyama, T.: Towards medical cyber-physical systems: Multimodal augmented reality for doctors and knowledge discovery about patients. In: Marcus, A. (ed.) DUXU/HCII 2013, Part III. LNCS, vol. 8014, pp. 401–410. Springer, Heidelberg (2013)Google Scholar
  8. 8.
    De Paolis, L., Pulimeno, M., Aloisio, G.: An Augmented Reality Application for Minimally Invasive Surgery. In: Katashev, A., Dekthyar, Y., Spigulis, J. (eds.) 14th Nordic-Baltic Conference on Biomedical Engineering and Medical Physics. Springer, Heidelberg (2008)Google Scholar
  9. 9.
    Regenbrecht, H., Baratoff, G., Wilke, W.: Augmented Reality Projects in the Automotive and Aerospace Industries. IEEE Computer Graphics and Applications 25(6), 48–56 (2005)CrossRefGoogle Scholar
  10. 10.
    Crescenzio, F.D., Fantini, M., Persiani, F., Stefano, L.D., Azzari, P., Salti, S.: Augmented Reality for Aircraft Maintenance Training and Operations Support. IEEE Computer Graphics and Applications 31(1), 96–101 (2011)CrossRefGoogle Scholar
  11. 11.
    Kaufmann, H.: From where we sit: Augmented reality for an active ageing European society. Journal of Cyber Therapy and Rehabilitation 5(1), 35–37Google Scholar
  12. 12.
    Chi, H.-L., Kang, S.-C., Wang, X.: Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Automation in Construction 33, 116–122 (2013)CrossRefGoogle Scholar
  13. 13.
    Ong, S.K., Yuan, M.L., Nee, A.Y.C.: Augmented reality applications in manufacturing: A survey. International Journal of Production Research 46(10) (2008)Google Scholar
  14. 14.
    Nee, A.Y.C., Ong, S.K.: Virtual and Augmented Reality Applications in Manufacturing. In: Manufacturing Modelling, Management, and Control, vol. 7, Part1. IFAC PapersOnline (2013)Google Scholar
  15. 15.
    Filipkowski, D.: See More – Analysis of Possibilities of Implementation AR Solutions During Bridge Watchkeeping. In: Weintrit, A. (ed.) Marine Navigation and Safety of Sea Transportation, pp. 255–260. CRC Press (2013)Google Scholar
  16. 16.
    Hugues, O., Cieutat, J.M., Guitton, P.: An experimental augmented reality platform for assisted maritime navigation. In: Proceedings of the 1st Augmented Human International Conference (AH 2010). ACM, New York (2010)Google Scholar
  17. 17.
    Zysk, T., Luce, J., Cunningham, J.: Augmented reality precision navigation. GPS World, North Coast Media LLC (June 2012)Google Scholar
  18. 18.
    Haase, K., Koch, R.: AR Binocular - Augmented Reality System for nautical navigation. In: Workshop on Mobile and Embedded Interactive Systems. LNI, pp. 295–300. Springer, Heidelberg (2008)Google Scholar
  19. 19.
    Moulis, G., Bouchet, A.: A collaborative approach of augmented reality for maritime domain. In: Proceedings of the 2012 Virtual Reality International Conference (VRIC 2012). ACM, New York (2012)Google Scholar
  20. 20.
    Lee, J., Lee, K., Kim, K., Kim, D., Kim, J.: AR-based ship design information supporting system for pipe maintenance. Paper presented at the 11th International Symposium on Practical Design of Ships and Other Floating Structures, PRADS 2010, 1, pp. 607–612 (2010)Google Scholar
  21. 21.
    Morales-Garcia, R., Keitler, P., Maier, P., Klinker, G.: An Underwater Augmented Reality System for Commercial Diving Operations. In: OCEANS 2009, MTS/IEEE Biloxi - Marine Technology for Our Future: Global and Local Challenges (2009)Google Scholar
  22. 22.
    Matsuo, K., Rothenburg, U., Stark, R.: Application of AR Technologies to Sheet Metal Forming in Shipbuilding. In: Abramovici, M., Stark, R. (eds.) Smart Product Engineering. Proceedings of the 23rd CIRP Design Conference, pp. 937–945. Springer, Heidelberg (2013)Google Scholar
  23. 23.
    Vasiljević, A., Borović, B., Vukić, Z.: Augmented Reality in Marine Applications. In: Brodogradnja, vol. 62(2). Brodarski Institute d.o.o (2011)Google Scholar
  24. 24.
    von Lukas, U.: Virtual and augmented reality for the maritime sector – applications and requirements. In: 8th IFAC Conference on Control Applications in Marine Systems CAMS 2010, Rostock-Warnemünde, Germany, IFAC-PapersOnline (2010)Google Scholar
  25. 25.
    Engelke, T., Keil, J., Rojtberg, P., Wientapper, F., Webel, S., Bockholt, U.: Content first - A concept for industrial augmented reality maintenance applications using mobile devices. In: 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), October 1-4, pp. 251–252 (2013)Google Scholar
  26. 26.
    Mesing, B., König, C.R., von Lukas, U., Tietjen, T., Vinke, A.: Virtual Prototyping of Davits with Parameterized Simulation Models and Virtual Reality. In: Bertram, V. (ed.) Proceedings of the 11th International Conference on Computer and IT Applications in the Maritime Industries (COMPIT 2012), pp. 336–343. Technische Universität Hamburg-Harburg, Hamburg (2012)Google Scholar
  27. 27.
    Fellner, D., Behr, J., Bockholt, U.: Instantreality - A Framework for Industrial Augmented and Virtual Reality Applications. In: Ma, D., Fan, X., et al. (eds.) The 2nd Sino-German Workshop Virtual Reality & Augmented Reality in Industry, pp. 91–99. Springer, Heidelberg (2009)Google Scholar
  28. 28.
    Olbrich, M., Wuest, H., Riess, P., Bockholt, U.: Augmented reality pipe layout planning in the shipbuilding industry. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), October 26-29, pp. 269–270 (2011)Google Scholar
  29. 29.
    Mesing, B., von Lukas, U.: Authoring of Automatic Data Preparation and Scene Enrichment for maritime Virtual Reality Applications. In: Shumaker, R. (ed.) Human-Computer Interaction, Part II, HCII 2014. LNCS, vol. 8526, pp. 426–434. Springer, Heidelberg (2014)Google Scholar
  30. 30.
    Bieber, G., Haescher, M., Vahl, M.: Sensor requirements for activity recognition on smart watches. In: ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA). ACM, New York (2013)Google Scholar
  31. 31.
    Kahn, S., Wuest, H., Stricker, D., Fellner, D.W.: 3D discrepancy check via Augmented Reality”, Mixed and Augmented Reality (ISMAR). In: 2010 9th IEEE International Symposium, October 13-16, pp. 241–242. IEEE (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Uwe von Lukas
    • 1
    • 2
  • Matthias Vahl
    • 1
  • Benjamin Mesing
    • 1
  1. 1.Fraunhofer Institute for Computer Graphics Research IGDRostockGermany
  2. 2.University of RostockRostockGermany

Personalised recommendations