Abstract
In this paper we describe an image-based approach to finding location-based information from camera-equipped mobile devices. We introduce a point-by-photograph paradigm, where users can specify a location simply by taking pictures. Our technique uses content-based image retrieval methods to search the web or other databases for matching images and their source pages to find relevant location-based information. In contrast to conventional approaches to location detection, our method can refer to distant locations and does not require any physical infrastructure beyond mobile internet service. We have developed a prototype on a camera phone and conducted user studies to demonstrate the efficacy of our approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arasu, A.: Searching the Web. ACM Transactions on Internet Technology 1(1), 2–43 (2001)
Aslandogan, Y.A., Yu, C.: Multiple evidence combination in image retrieval: Diogenes searches for people on the web. In: Proc. of ACM SIGIR 2000, pp. 88–95 (2000)
Built-in camera mobile phones increasingly used for business purposes. Nikkei Net Business, December 9 (2002)
Cheverst, K., Davies, N., Mitchell, K., Efstratiou, C.: Developing a context-aware electronic tourist guide: some issues and experiences. In: Proc. of CHI 2000, pp. 17–24 (2000)
FaceIT, http://www.visionics.com
Gausemeier, I., Bruederlin, B.: Development of a real time image based object recognition method for mobile AR-devices. In: Proc. of the 2nd AFRIGRAPH, pp. 133–139 (2003)
Google, Google’s PigeonRank, http://www.google.com/
Jansen, B.J., Spink, A., Bateman, J., Saracevic, T.: Real life information retrieval: A study of user queries on the Web. ACM SIGIR Forum 32(1), 5–17 (1998)
Kaasinen, E.: User needs for location-aware mobile services. Personal and Ubiquitous Computing 7, 70–79 (2003)
Kosecka, J., Zhou, L., Barber, P., Duric, Z.: Qualitative Image-Based Localization in Indoors Environments. In: CVPR 2003 (2003) (to appear)
Marmasse, N., Schmandt, C.: Location-aware information delivery with commotion. In: Thomas, P., Gellersen, H.-W. (eds.) HUC 2000. LNCS, vol. 1927, pp. 157–171. Springer, Heidelberg (2000)
Montemerlo, M., Thrun, S., Koller, D., Wegbreit, B.: FastSLAM: A factored solution to the simultaneous localization and mapping problem. In: Proc. of the AAAI National Conference on Artificial Intelligence (2002)
Niblack, W., Barber, R., Equitz, W., Flickner, M., Glasman, E., Petkovic, D., Yanker, P., Faloutsos, C., Taubin, G.: The QBIC projec. In: SPIE Storage and Retrieval for Image and Video Databases, pp. 173–187 (1993)
Nokia, Next Generation Mobile Browsing, http://www.nokia.com/
Oliva, A., Torralba, A.: Modeling the shape of the scene: a holistic representation. Intern. Journal of Computer Vision 42(3), 147–175
Pilu, M., Pollard, S.: A light-weight text image processing method for handheld embedded cameras. Tech. Report, HP Laboratories (March 2002)
Schiele, B., Jebara, T., Oliver, N.: Sensory-augmented computing: wearing the museum’s guide. Micro. IEEE 21(3), 44–52 (2001)
Smith, J., Chang, S.: An Image and Video Search Engine for the World-Wide Web. In: Symposium on Electronic Imaging, IS&T/SPIE (February 1997)
Smith, J.R., Chang, S.F.: Searching for images and videos on the WWW. In: Multimedia Systems, pp. 3–14 (1995)
Swain, M., Ballard, D.: Indexing via color histograms. Intern. Journal of Computer Vision, 390–393 (1990)
Symbian OS – The Mobile Operating System, http://www.symbian.com/
Starner, T., Schiele, B., Pentland, A.: Visual Contextual Awareness in Wearable Computing. In: Proc. of ISWC, pp. 50–57 (1998)
Yeh, T., Tollmar, K., Darrell, T.: Searching the Web with Mobile Images for Location Recognition. In: proc of CVPR 2004 (2004) (accepted for publication)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tollmar, K., Yeh, T., Darrell, T. (2004). IDeixis – Searching the Web with Mobile Images for Location-Based Information. In: Brewster, S., Dunlop, M. (eds) Mobile Human-Computer Interaction - MobileHCI 2004. Mobile HCI 2004. Lecture Notes in Computer Science, vol 3160. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-28637-0_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-28637-0_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-23086-1
Online ISBN: 978-3-540-28637-0
eBook Packages: Springer Book Archive