Indoor Localization by Photo-Taking of the Environment

  • Ruipeng Gao
  • Fan Ye
  • Guojie Luo
  • Jason Cong
Part of the SpringerBriefs in Computer Science book series (BRIEFSCOMPUTER)


Mainstream indoor localization technologies rely on RF signatures that require extensive human efforts to measure and periodically recalibrate signatures. The progress to ubiquitous localization remains slow. In this chapter, we explore Sextant, an alternative approach that leverages environmental reference objects such as store logos. A user uses a smartphone to obtain relative position measurements to such static reference objects for the system to triangulate the user location. Sextant leverages image matching algorithms to automatically identify the chosen reference objects by photo-taking, and we propose two methods to systematically address image matching mistakes that cause large localization errors. We formulate the benchmark image selection problem, prove its NP-completeness, and propose a heuristic algorithm to solve it. We also propose a couple of geographical constraints to further infer unknown reference objects. To enable fast deployment, we propose a lightweight site survey method for service providers to quickly estimate the coordinates of reference objects. Extensive experiments have shown that Sextant prototype achieves 2–5 m accuracy at 80-percentile, comparable to the industry state of the art, while covering a \(150\times 75\) m mall and \(300\times 200\) m train station requires a one-time investment of only 2–3 man-hours from service providers.


  1. 1.
    P. Bahl, V.N. Padmanabhan, RADAR: an in-building RF-based user location and tracking system, in IEEE INFOCOM (2000)Google Scholar
  2. 2.
    M. Youssef, A. Agrawala, The horus wlan location determination system, in ACM MobiSys (2005)Google Scholar
  3. 3.
    H. Liu, Y. Gan, J. Yang, S. Sidhom, Y. Wang, Y. Chen, F. Ye, Push the limit of wifi based localization for smartphones, in ACM Mobicom (2012)Google Scholar
  4. 4.
  5. 5.
    V. Otsason, A. Varshavsky, A. LaMarca, E. de Lara, Accurate gsm indoor localization, in UbiComp (2005), pp. 141–158Google Scholar
  6. 6.
    Z. Yang, C. Wu, Y. Liu, Locating in fingerprint space: wireless indoor localization with little human intervention, in ACM MobiCom (2012), pp. 269–280Google Scholar
  7. 7.
    K. Chintalapudi, A. Padmanabha Iyer, V.N. Padmanabhan, Indoor localization without the pain, in ACM MobiCom (2010)Google Scholar
  8. 8.
    A. Rai, K.K. Chintalapudi, V.N. Padmanabhan, R. Sen, Zee: zero-effort crowdsourcing for indoor localization, in ACM MobiCom (2012), pp. 293–304Google Scholar
  9. 9.
    Y. Tian, R. Gao, K. Bian, F. Ye, T. Wang, Y. Wang, X. Li, Towards ubiquitous indoor localization service leveraging environmental physical features, in IEEE INFOCOM (2014), pp. 55–63Google Scholar
  10. 10.
    R. Gao, F. Ye, T. Wang, Smartphone indoor localization by photo-taking of the environment, in IEEE ICC (2014)Google Scholar
  11. 11.
    C. Peng, G. Shen, Y. Zhang, Y. Li, K. Tan, Beepbeep: a high accuracy acoustic ranging system using cots mobile devices, in ACM SenSys (2007)Google Scholar
  12. 12.
    N.L. Johnson, S. Kotz, N. Balakrishnan, Continuous Univariate Distributions., 2nd edn. (Wiley, 1994)Google Scholar
  13. 13.
  14. 14.
    D.G. Lowe, Object recognition from local scale-invariant features, in ICCV (1999)Google Scholar
  15. 15.
    H. Bay, A. Ess, T. Tuytelaars, L.V. Gool, Surf: speeded up robust features, in Computer Vision and Image Understanding (2008)Google Scholar
  16. 16.
    M.A. Fischler, R.C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, in CVIU (2008)Google Scholar
  17. 17.
    S. Sahni, T. Gonzalez, P-complete approximation problems. J. ACM 23(3), 555–565 (1976)MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    I. Constandache, X. Bao, M. Azizyan, R.R. Choudhury, Did you see bob?: human localization using mobile phones, in ACM MobiCom (2010)Google Scholar
  19. 19.
    M. Azizyan, I. Constandache, R.R. Choudhury, Surroundsense: mobile phone localization via ambience fingerprinting, in ACM MobiCom (2009)Google Scholar
  20. 20.
    H. Wang, S. Sen, A. Elgohary, M. Farid, M. Youssef, R.R. Choudhury, No need to war-drive: unsupervised indoor localization, in ACM MobiSys (2012), pp. 197–210Google Scholar
  21. 21.
    J. Manweiler, P. Jain, R.R. Choudhury, Satellites in our pockets: an object positioning system using smartphones, in MobiSys (2012), pp. 211–224Google Scholar
  22. 22.
    P. Robertson, M. Angermann, B. Krach, Simultaneous localization and mapping for pedestrians using only foot-mounted inertial sensors, in ACM Ubicomp (2009)Google Scholar
  23. 23.
    Z. Zhang, X. Zhou, W. Zhang, Y. Zhang, G. Wang, B.Y. Zhao, H. Zheng, I am the antenna: accurate outdoor ap location using smartphones, in ACM MobiCom (2011)Google Scholar
  24. 24.
    S. Sen, R.R. Choudhury, S. Nelakuditi, Spinloc: spin once to know your location, in HotMobile (2012)Google Scholar

Copyright information

© The Author(s) 2018

Authors and Affiliations

  1. 1.Beijing Jiaotong UniversityBeijingChina
  2. 2.Stony Brook UniversityStony BrookUSA
  3. 3.Peking UniversityBeijingChina
  4. 4.UCLALos AngelesUSA

Personalised recommendations