Automatic Choice of the Number of Nearest Neighbors in Locally Linear Embedding

  • Juliana Valencia-Aguirre
  • Andrés Álvarez-Mesa
  • Genaro Daza-Santacoloma
  • Germán Castellanos-Domínguez
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5856)


Locally linear embedding (LLE) is a method for nonlinear dimensionality reduction, which calculates a low dimensional embedding with the property that nearby points in the high dimensional space remain nearby and similarly co-located with respect to one another in the low dimensional space [1]. LLE algorithm needs to set up a free parameter, the number of nearest neighbors k. This parameter has a strong influence in the transformation. In this paper is proposed a cost function that quantifies the quality of the embedding results and computes an appropriate k. Quality measure is tested on artificial and real-world data sets, which allow us to visually confirm whether the embedding was correctly calculated.


Locally Linear Embedding Linear Embedding Nonlinear Dimensionality Reduction Embed Space Automatic Choice 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Saul, L.K., Roweis, S.T.: Think globally, fit locally: Unsupervised learning of low dimensional manifolds. Machine Learning Research 4 (2003)Google Scholar
  2. 2.
    Carreira-Perpiñan, M.A.: A review of dimension reduction techniques (1997)Google Scholar
  3. 3.
    Webb, A.R.: Statistical Pattern Recognition, 2nd edn. Wiley, USA (2002)zbMATHGoogle Scholar
  4. 4.
    Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)CrossRefGoogle Scholar
  5. 5.
    Saul, L.K., Roweis, S.T.: An introduction to locally linear embedding. AT&T Labs and Gatsby Computational Neuroscience Unit, Tech. Rep. (2000)Google Scholar
  6. 6.
    de Ridder, D., Duin, R.P.W.: Locally linear embedding for classification. Delft University of Technology, The Netherlands, Tech. Rep. (2002)Google Scholar
  7. 7.
    Kouropteva, O., Okun, O., Pietikäinen, M.: Selection of the optimal parameter value for the locally linear embedding algorithm. In: The 1st International Conference on Fuzzy Systems and Knowledge Discovery (2002)Google Scholar
  8. 8.
    Goldberg, Y., Ritov, Y.: Local procrustes for manifold embedding: a measure of embedding quality and embedding algorithms. Machine learning (2009)Google Scholar
  9. 9.
    Polito, M., Perona, P.: Grouping and dimensionality reduction by locally linear embedding. In: NIPS (2001)Google Scholar
  10. 10.
    Nene, S.A., Nayar, S.K., Murase, H.: Columbia object image library: Coil-100. Columbia University, New York, Tech. Rep. (1996)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Juliana Valencia-Aguirre
    • 1
  • Andrés Álvarez-Mesa
    • 1
  • Genaro Daza-Santacoloma
    • 1
  • Germán Castellanos-Domínguez
    • 1
  1. 1.Control and Digital Signal Processing GroupUniversidad Nacional de ColombiaManizalesColombia

Personalised recommendations