Perspective Reconstruction by Determining Vanishing Points for Autonomous Mobile Robot Visual Localization on Supermarkets

  • Oscar Alonso-RamirezEmail author
  • Maria Dolores Lopez-Correa
  • Antonio Marin-Hernandez
  • Homero V. Rios-Figueroa
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10267)


Mobile robots are more and more used on diverse environments to provide useful services. One of these environments are supermarkets, where a robot can help to find and carry products, maintain the account of them and to mark out from a list, the products already in the shopping car (maybe the same robot). However, a common problem on these environments is the autonomous localization, due to the fact that supermarkets are a set of aisles, and most of them look the same for laser range finders; sensors commonly used for localization. On this paper, we present an approach to localize autonomous mobile robots on supermarket by using a perspective reconstruction of the shelves and then an statistical comparison of the products present in them. In order to detect the shelves, the vanishing points are estimated to provide a fast and efficient way to segment products on them. To avoid multiple vanishing points on this kind of environments, result of the variety of products present, a variation of a RANSAC approach is proposed. Once a vanishing point has been determined, an homography process is applied to the shelves in order to rectify images. And finally, by horizontal histograms the robot is able to segment individual products to be compared to the data base. Then the robot will be able to detect by a probability function the correct aisle where it is.


Mobile service robots SLAM RANSAC methods 


  1. 1.
    Barnard, S.T.: Interpreting perspective images. Artif. Intell. 21(4), 435–462 (1983)CrossRefGoogle Scholar
  2. 2.
    Behan, J., OKeeffe, D.T.: The development of an autonomous service robot. Implementation: Lucas the library assistant robot. Intell. Serv. Robot. 1(1), 73–89 (2008)CrossRefGoogle Scholar
  3. 3.
    Gharpure, C.P., Kulyukin, V.A.: Robot-assisted shopping for the blind: issues in spatial cognition and product selection. Intell. Serv. Rob. 1(3), 237–251 (2008)CrossRefGoogle Scholar
  4. 4.
    Gross, H.M., Boehme, H., Schroeter, C., Müller, S., König, A., Einhorn, E., Martin, C., Merten, M., Bley, A.: Toomas: interactive shopping guide robots in everyday use-final implementation and experiences from long-term field trials. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009, pp. 2005–2012. IEEE (2009)Google Scholar
  5. 5.
    Li, X., Zhang, X., Zhu, B., Dai, X.: A visual navigation method of mobile robot using a sketched semantic map. Int. J. Adv. Rob. Syst. 9(4), 138 (2012)CrossRefGoogle Scholar
  6. 6.
    Magee, M.J., Aggarwal, J.K.: Determining vanishing points from perspective images. Comput. Vis. Graph. Image Process. 26(2), 256–267 (1984)CrossRefGoogle Scholar
  7. 7.
    Mariottini, G.L., Roumeliotis, S.I.: Active vision-based robot localization and navigation in a visual memory. In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 6192–6198. IEEE (2011)Google Scholar
  8. 8.
    Schröter, C., Böhme, H.J., Gross, H.M.: Memory-efficient gridmaps in Rao-Blackwellized particle filters for slam using sonar range sensors. In: EMCR (2007)Google Scholar
  9. 9.
    Srinivasa, S.S., Ferguson, D., Helfrich, C.J., Berenson, D., Collet, A., Diankov, R., Gallagher, G., Hollinger, G., Kuffner, J., Weghe, M.V.: Herb: a home exploring robotic butler. Auton. Rob. 28(1), 5–20 (2010)CrossRefGoogle Scholar
  10. 10.
    Stückler, J., Biresev, N., Behnke, S.: Semantic mapping using object-class segmentation of RGB-D images. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3005–3010. IEEE (2012)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Oscar Alonso-Ramirez
    • 1
    Email author
  • Maria Dolores Lopez-Correa
    • 1
  • Antonio Marin-Hernandez
    • 1
  • Homero V. Rios-Figueroa
    • 1
  1. 1.Artificial Intelligence Research CenterUniversidad VeracruzanaXalapaMexico

Personalised recommendations