Skip to main content

A Fast Nearest Neighbor Method Using Empirical Marginal Distribution

  • Conference paper
  • 884 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5712))

Abstract

Unfortunately there is no essentially faster algorithm than the brute-force algorithm for the nearest neighbor searching in high-dimensional space. The most promising way is to find an approximate nearest neighbor in high probability. This paper describes a novel algorithm that is practically faster than most of previous algorithms. Indeed, it runs in a sublinear order of the data size.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Nene, S.A., Nayar, S.K.: A Simple Algorithm for Nearest Neighbor Search in High Dimensions. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 989–1003 (1997)

    Article  Google Scholar 

  2. Arya, S., et al.: An optimal algorithm for approximate nearest neighbor searching fixed dimensions. Journal of the ACM 45-6, 891–923 (1998), http://www.cs.umd.edu/~mount/ANN/

    Article  MathSciNet  MATH  Google Scholar 

  3. Kleinberg, J.M.: Two algorithms for nearest-neighbor search in high dimension. In: Proc. 29th Annu. ACM sympos. Theory Comput., pp. 599–608 (1997)

    Google Scholar 

  4. Maneewongvatana, S., Mount, D.M.: An Empirical Study of a New Approach to Nearest Neighbor Searching. In: Deng, R.H., Qing, S., Bao, F., Zhou, J. (eds.) ICICS 2002. LNCS, vol. 2513, pp. 172–187. Springer, Heidelberg (2002)

    Google Scholar 

  5. Ciaccia, P., Patella, M.: PAC nearest neighbor queries: Approximate and controlled search in high-dimensional and metric spaces. In: Proceedings of the 16th International Conference on Data Engineering, pp. 244–255 (2000)

    Google Scholar 

  6. Indyk, P., Motwani, R.: Approximate nearest neighbors: towards removing the curse of dimensionality. In: Proceedings of the 30th Annual ACM Symposium on Theory of Computing, pp. 604–613 (1998)

    Google Scholar 

  7. Andoni, A., et al.: Locality-Sensitive Hashing Using Stable Distributions. In: Shakhnarovich, G., Darrell, T., Indyk, P. (eds.) Nearest-Neighbor Methods in Learning and Vision: Theory and Practice, vol. 3. MIT Press, Cambridge (2006)

    Google Scholar 

  8. Andoni, A., Indyk, P.: Near-Optimal Hashing Algorithms for Approximate Nearest Neighbor in High Dimensions. Communications of the ACM 51(1), 117–122 (2008)

    Article  Google Scholar 

  9. Le Cunn, Y.: The mnist dataset of handwritten digits, http://yann.lecun.com/exdb/mnist/

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kudo, M., Toyama, J., Imai, H. (2009). A Fast Nearest Neighbor Method Using Empirical Marginal Distribution. In: Velásquez, J.D., Ríos, S.A., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based and Intelligent Information and Engineering Systems. KES 2009. Lecture Notes in Computer Science(), vol 5712. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04592-9_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-04592-9_42

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-04591-2

  • Online ISBN: 978-3-642-04592-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics