Probability-Based Distance Function for Distance-Based Classifiers

  • Cezary Dendek
  • Jacek Mańdziuk
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5768)


In the paper a new measure of distance between events/observations in the pattern space is proposed and experimentally evaluated with the use of k-NN classifier in the context of binary classification problems. The application of the proposed approach visibly improves the results compared to the case of training without postulated enhancements in terms of speed and accuracy.

Numerical results are very promising and outperform the reference literature results of k-NN classifiers built with other distance measures.


Distance Measure Cumulative Density Function Pattern Space Outlier Removal Probabilistic Distance 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Dendek, C., Mańdziuk, J.: Improving performance of a binary classifier by training set selection. In: Kůrková, V., Neruda, R., Koutník, J. (eds.) ICANN 2008, Part I. LNCS, vol. 5163, pp. 128–135. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  2. 2.
    Dendek, C., Mańdziuk, J.: Including metric space topology in neural networks training by ordering patterns. In: Kollias, S.D., Stafylopatis, A., Duch, W., Oja, E. (eds.) ICANN 2006. LNCS, vol. 4132, pp. 644–653. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  3. 3.
    Mańdziuk, J., Shastri, L.: Incremental class learning approach and its application to handwritten digit recognition. Inf. Sci. Inf. Comput. Sci. 141(3-4), 193–217 (2002)zbMATHGoogle Scholar
  4. 4.
    Asuncion, A., Newman, D.: UCI machine learning repository (2007)Google Scholar
  5. 5.
    Wang, J., Neskovic, P., Cooper, L.N.: Improving nearest neighbor rule with a simple adaptive distance measure. Pattern Recogn. Lett. 28(2), 207–213 (2007)CrossRefGoogle Scholar
  6. 6.
    Zhou, C.Y., Chen, Y.Q.: Improving nearest neighbor classification with cam weighted distance. Pattern Recogn. 39(4), 635–645 (2006)CrossRefzbMATHGoogle Scholar
  7. 7.
    Pardes, R., Vidal, E.: Learning weighted metrics to minimize nearest-neighbor classification error. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(7), 1100–1110 (2006)CrossRefGoogle Scholar
  8. 8.
    Amores, J., Sebe, N., Radeva, P.: Boosting the distance estimation. Pattern Recogn. Lett. 27(3), 201–209 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Cezary Dendek
    • 1
  • Jacek Mańdziuk
    • 1
  1. 1.Faculty of Mathematics and Information ScienceWarsaw University of TechnologyWarsawPoland

Personalised recommendations