Vision Ship Information Overlay and Navigation “VISION” System

  • Jessica ReichersEmail author
  • Nathan Brannon
  • Joshua Rubini
  • Naomi Hillis
  • Katia Estabridis
  • Gary Hewer
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 962)


Modern naval vessels, marvels of systems engineering, combine a myriad of complex solutions into a single, sophisticated machine. Personnel responsible for the safe operation of these ships are required to parse, filter, and process a large array of information in order to make key decisions. Safe navigation requires better processing and interpretation of significant quantities of data, and ensuring this information is made available in an easily consumable fashion.

Augmented reality provides a means to solve this problem, using customizable interfaces and overlays of information on the world to help make intelligent decisions in dangerous, congested situations. The team’s Optimal Trajectory and other path planning algorithms can refine these navigational aids, accounting for changes in weather, current, and tides.

Our team successfully demonstrated an augmented reality solution, giving additional situational awareness during transit to sea and into port.


Augmented reality Decision making Human factors 


  1. 1.
    Kim, M., Yi, S., Jung, D., Park, S., Seo, D.: Augmented-reality visualization of aerodynamics simulation in sustainable cloud computing. Sustain. 10, 1362 (2018)CrossRefGoogle Scholar
  2. 2.
    Wu, M., Chien, J., Wu, C., Lee, J.: An augmented reality system using improved-iterative closest point algorithm for on-patient medical image visualization. Sens., 1–13 (2018)Google Scholar
  3. 3.
    Aricò, P., et al.: Human-machine interaction assessment by neurophysiological measures: a study on professional air traffic controllers. In: EBMC 2018, 40th International Engineering in Medicine and Biology Conference, Honolulu (2018)Google Scholar
  4. 4.
    Baumeister, J., et al.: Cognitive cost of using augmented reality displays. IEEE Trans. on Vis. Comp. Graph. 23, 2378–2388 (2017)CrossRefGoogle Scholar
  5. 5.
    Robbins, et al.: Compact optical system with mems scanners for image generation and object tracking. US Patent 10,175,489 B1, 8 Jan 2019Google Scholar
  6. 6.
  7. 7.
    Grabowski, M.: Research on wearable, immersive augmented reality (WIAR) adoption in maritime navigation. J. Navig. 68, 453–464 (2015)CrossRefGoogle Scholar
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
    Garon, M., Boulet, P., Doiron, J., Beaulieu, L., Lalonde, J.: Real-time high resolution 3D data on the hololens. In: IEEE ISMAR, 1–3 (2016)Google Scholar
  13. 13.
    Qian, L., Plopski, A., Navab, N., Kazanzides, P.: Restoring the awareness in the occluded visual field for optical see-through head-mounted displays. IEEE Trans. Vis. Comp. Graph. 24, 2936–2946 (2018)CrossRefGoogle Scholar
  14. 14.
    Xiao, R., Schwarz, J., Throm, N., Wilson, A., Benko, H.: MRTouch: adding touch input to head-mounted mixed reality. IEEE Trans. Vis. Comp. Graph. 24, 1653–1660 (2018)CrossRefGoogle Scholar
  15. 15.
    Robinson, D.R., Mar, R.T., Estabridis, K., Hewer, G.: An efficient algorithm for optimal trajectory generations for heterogeneous multi-agent systems in non-convex environments. IEEE Robot Auto. 3, 1215–1222 (2018)CrossRefGoogle Scholar
  16. 16.
    Skjetne, R., Smogeli, O., Fossen, T.: A nonlinear ship manoeuvering model: identification and adaptive control with experiments for a ship model. Mod. Ident. Contro. 25, 3–27 (2004)CrossRefGoogle Scholar

Copyright information

© This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply 2020

Authors and Affiliations

  • Jessica Reichers
    • 1
    Email author
  • Nathan Brannon
    • 1
  • Joshua Rubini
    • 1
  • Naomi Hillis
    • 1
  • Katia Estabridis
    • 1
  • Gary Hewer
    • 1
  1. 1.Naval Air Warfare Center – Weapons DivisionChina LakeUSA

Personalised recommendations