Abstract
In this paper, we present a content-based image retrieval framework which augments the user’s reality and supports the decision making process as well as awareness and understanding of the local marine environment. It comprises a real-time intelligent user interface combined with the 360\(^\circ \) real-time environment display in the virtual reality headset. The image retrieval utilizes a unified hybrid adaptive image retrieval model. The presented system provides the user with a unique solution combining the virtual reality real-time headset, 360\(^\circ \) view, and augmented reality to remotely monitor the surface and underwater marine environment. The objective of the proposed framework is to enhance the user interaction with the remote sensing and control applications. To our knowledge, it is the first system that combines real-time VR, 360\(^\circ \) camera, and hybrid models in the context of image retrieval and augmented reality.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
In this paper, the textual and visual terms refer to image tags and instances of visual words, respectively.
References
Bhowmik, N., Gonzalez, V.R., Gouet-Brunet, V., Pedrini, H., Bloch, G.: Efficient fusion of multidimensional descriptors for image retrieval. In: IEEE International Conference on Image Processing, pp. 5766–5770 (2014)
Goecks, V.G., Chamitoff, G.E., Borissov, S., Probe, A., McHenry, N.G., Cluck, N., Paddock, E., Schweers, J.P., Bell, B.N., Hoblit, J.: Virtual reality for enhanced 3D astronaut situational awareness during robotic operations in space. In: AIAA Information Systems-AIAA Infotech@ Aerospace, p. 0883 (2017)
Goker, A., Myrhaug, H., Bierig, R.: Context and information retrieval. In: Information Retrieval: Searching in the 21st century. Wiley (2009)
Kaliciak, L., Myrhaug, H., Goker, A., Song, D.: On the duality of fusion strategies and query modification as a combination of scores. In: The 17th International Conference on Information Fusion (Fusion 2014), Salamanca, Spain (2014)
Kaliciak, L., Myrhaug, H., Goker, A., Song, D.: Adaptive relevance feedback for fusion of text and visual features. In: The 18th International Conference on Information Fusion (Fusion 2015), pp. 1322–1329, Washington DC, USA (2015)
Liu, H., Song, D., Rueger, S., Hu, R., Uren, V.: Comparing dissimilarity measures for content-based image retrieval. In: The 4th Asia Information Retrieval Symposium, pp. 44–50 (2008)
Risojevic, V., Babic, Z.: Fusion of global and local descriptors for remote sensing image classification. IEEE Geosci. Remote Sens. Lett. 10(4), 836–840 (2013)
Teevan, J., Dumais, S., Horvitz, E.: Personalizing search via automated analysis of interests and activities. In: 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 449–456 (2005)
Singh, M., Singh, M.P.: Augmented reality interfaces. IEEE Internet Comput. 17(6), 66–70 (2013)
Sorensen, S., Kolagunda, A., Mahoney, A.R., Zitterbart, D.P., Kambhamettu, C.A.: Virtual reality framework for multimodal imagery for vessels in polar regions. In: MultiMedia Modeling: 23rd International Conference, MMM 2017, pp. 63–75 (2017)
Acknowledgements
This work has been partially funded by the CERBERO project no. 732105—a HORIZON 2020 EU project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Kaliciak, L., Myrhaug, H., Goker, A. (2017). Content-Based Image Retrieval in Augmented Reality. In: De Paz, J., Julián, V., Villarrubia, G., Marreiros, G., Novais, P. (eds) Ambient Intelligence– Software and Applications – 8th International Symposium on Ambient Intelligence (ISAmI 2017). ISAmI 2017. Advances in Intelligent Systems and Computing, vol 615. Springer, Cham. https://doi.org/10.1007/978-3-319-61118-1_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-61118-1_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-61117-4
Online ISBN: 978-3-319-61118-1
eBook Packages: EngineeringEngineering (R0)