Abstract
In this paper, a personal assistant and navigator system for visually impaired people will be described. The showcase presented intends to demonstrate how partially sighted people could be aided by the technology in performing an ordinary activity, like going to a mall and moving inside it to find a specific product. We propose an Android application that integrates Pedestrian Dead Reckoning and Computer Vision algorithms, using an off-the-shelf Smartphone connected to a Smartwatch. The detection, recognition and pose estimation of specific objects or features in the scene derive an estimate of user location with sub-meter accuracy when combined with a hardware-sensor pedometer. The proposed prototype interfaces with a user by means of Augmented Reality, exploring a variety of sensorial modalities other than just visual overlay, namely audio and haptic modalities, to create a seamless immersive user experience. The interface and interaction of the preliminary platform have been studied through specific evaluation methods. The feedback gathered will be taken into consideration to further improve the proposed system.
Chapter PDF
Similar content being viewed by others
Keywords
References
WHO, Fact Sheet N\(^\circ \)282: http://www.who.int/mediacentre/factsheets/fs282/en/
OpenStreetMap official website: http://openstreetmap.org
Sony Xperia Z: http://www.sonymobile.com/global-en/products/phones/xperia-z/
Google Talkback: https://play.google.com/store/apps/details?id=com.google.android.marvin.talkback
WozARd: http://youtu.be/bpSL0tLMy3w
Simulation of VENTURI Y2D: http://youtu.be/NNabKQIXiTc
HaptiMap project, FP7-ICT-224675: http://www.haptimap.org/
Alce, G., Hermodsson, K., Wallergård, M.: WozARd. In: Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI, pp. 600–605 (2013)
Angermann, M., Frassl, M., Doniec, M., Julian, B.J., Robertson, P.: Characterization of the indoor magnetic field for applications in localization and mapping. In: 2012 International Conference on Indoor Positioning and Indoor Navigation, pp. 1–9 (2012)
Baniukevic, A., Jensen, C.S., Hua, L.: Hybrid indoor positioning with wi-fi and bluetooth: architecture and performance. In: 14th International Conference on Mobile Data Management, vol. 1, pp. 207–216 (2013)
Barba, E., MacIntyre, B., Mynatt, E.D.: Here we are! Where are we? Locating mixed reality in the age of the smartphone. Proceedings of the IEEE 100, 929–936 (2012)
Borenstein, J., Ojeda, L., Kwanmuang, S.: Heuristic Reduction of Gyro Drift in a Personal Dead-reckoning System. Journal of Navigation 62(1), 41–58 (2009)
Brox, T., Bregler, C., Matas, J.: Large displacement optical flow. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 41–48 (2009)
Chang, C.C., Lin, C.J.: LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2(3), 27:1–27:27 (2011)
Colbrant, A., Lasorsa, Y., Lemordant, J., Liodenot, D., Razafimahazo, M.: One Idea and Three Concepts for Indoor-Outdoor Navigation, INRIA Research Report n\(^\circ \) 7849 (2011)
Dow, S., Macintyre, B., Lee, J., Oezbek, C., Bolter, J.D., Gandy, M.: Wizard of Oz Support throughout an Iterative Design Process. IEEE Pervasive Computing 4(4), 18–26 (2005)
Dunser, A., Billinghurst, M.: Handbook of Augmented Reality, Furht, B. (ed.) chap. 13, pp. 289–307 (2011)
Farinella, G.M., Ravì, D., Tomaselli, V., Guarnera, M., Battiato, S.: Representing Scenes for Real-Time Context Classification on Mobile Devices (2014). http://dx.doi.org/10.1016/j.patcog.2014.05.014
Fischler, M.A., Bolles, R.C.: Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of the ACM 24, 381–395 (1981)
Jones, M.J., Rehg, J.M.: Statistical color models with application to skin detection. International Journal of Computer Vision 46(1), 81–96 (2002)
Kurata, T., Kourogi, M., Ishikawa, T., Kameda, Y., Aoki, K., Ishikawa, J.: Indoor-outdoor navigation system for visually-impaired pedestrians: preliminary evaluation of position measurement and obstacle display. In: ISWC 2011 Proceedings of the 2011 15th Annual International Symposium on Wearable Computer, pp. 123–124 (2011)
Ladetto, Q.: Capteurs et Algorithmes pour la Localisation Autonome en Mode Pédestre, Phd thesis, École Polytechnique Fédérale de Lausanne (2003)
Lam, E., Goodman, J.W.: A mathematical analysis of the DCT coefficient distributions for images. IEEE Transactions on Image Processing 9(10), 1661–1666 (2000)
Le, M.H.V., Saragas, D., Webb, N.: Indoor navigation system for handheld devices, master’s thesis, Worcester Polytechnic Institute, Massachusetts, USA (2009)
Messelodi, S., Modena, C.M.: Scene Text Recognition and Tracking to Identify Athletes in Sport Videos. Multimedia Tools and Applications 63(2), 521–545 (2013)
Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation of the spatial envelope. International Journal of Computer Vision 42(3), 145–175 (2001)
Porzi, L., Messelodi, S., Modena, C.M., Ricci, E.: A smart watch-based gesture recognition system for assisting people with visual impairments. In: ACM International Workshop on Interactive Multimedia on Mobile and Portable Devices, pp. 19–24 (2013)
Xiao, W., Ni, W., Toh, Y.K.: Integrated Wi-Fi fingerprinting and inertial sensing for indoor positioning. In: 2011 International Conference on Indoor Positioning and Indoor Navigation, pp. 1–6 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Chippendale, P. et al. (2015). Personal Shopping Assistance and Navigator System for Visually Impaired People. In: Agapito, L., Bronstein, M., Rother, C. (eds) Computer Vision - ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science(), vol 8927. Springer, Cham. https://doi.org/10.1007/978-3-319-16199-0_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-16199-0_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16198-3
Online ISBN: 978-3-319-16199-0
eBook Packages: Computer ScienceComputer Science (R0)