Skip to main content

An Optimally Weighted Fuzzy k-NN Algorithm

  • Conference paper
Pattern Recognition and Data Mining (ICAPR 2005)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 3686))

Included in the following conference series:

Abstract

The nearest neighbor rule is a non-parametric approach and has been widely used for pattern classification. The k-nearest neighbor (k-NN) rule assigns crisp memberships of samples to class labels; whereas the fuzzy k-NN neighbor rule replaces crisp memberships with fuzzy memberships. The membership assignment by the conventional fuzzy k-NN algorithm has a disadvantage in that it depends on the choice of some distance function, which is not based on any principle of optimality. To overcome this problem, we introduce in this paper a computational scheme for determining optimal weights to be combined with di.erent fuzzy membership grades for classification by the fuzzy k-NN approach. We show how this optimally weighted fuzzy k-NN algorithm can be effectively applied for the classification of microarray-based cancer data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ablavsky, V., Stevens, M.R.: Automatic feature selection with applications to script identification of degraded documents. In: Proc. 7th Int. Conf. Document Analysis and Recognition (ICDAR 2003), vol. 2, pp. 750–754 (2003)

    Google Scholar 

  2. Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)

    MATH  Google Scholar 

  3. Baoli, L., Qin, L., Shiwen, Y.: An adaptive k-nearest neighbor text categorization strategy. ACM Trans. Asian Language Information Processing 3, 215–226 (2004)

    Article  Google Scholar 

  4. Brazma, A., Vilo, J.: Gene expression data analysis. Federation of European Biochemical Societies Letters 480, 17–24 (2000)

    Google Scholar 

  5. Cover, T.M., Hart, P.E.: Nearest neighbor pattern classification. IEEE Trans. Information Theory 13, 21–27 (1967)

    Article  MATH  Google Scholar 

  6. Duda, R., Hart, P.: Pattern Classification and Scene Analysis. John Wiley & Sons, New York (1973)

    MATH  Google Scholar 

  7. Ginneken, B.V., Loog, M.: Pixel position regression - application to medical image segmentation. In: Proc. 17th International Conference on Pattern Recognition (ICPR 2004), vol. 3, pp. 718–721 (2004)

    Google Scholar 

  8. Guo, G., Wang, H., Bell, D., Bi, Y., Greer, K.: An kNN model-based approach and its application in text categorization. In: Gelbukh, A. (ed.) CICLing 2004. LNCS, vol. 2945, pp. 559–570. Springer, Heidelberg (2004)

    Google Scholar 

  9. Hedenfalk, I., Duggan, D., Chen, Y., Radmacher, M., Bittner, M., Simon, R., Meltzer, P., Gusterson, B., Esteller, M., Kallioniemi, O., Wilfond, B., Borg, A., Trent, J.: Gene-expression profiles in hereditary breast cancer. The New England Journal of Medicine 344, 539–548 (2001)

    Article  Google Scholar 

  10. Isaaks, E.H., Srivastava, R.M.: An Introduction to Applied Geostatistics. Oxford University Press, New York (1989)

    Google Scholar 

  11. Journel, A.G., Huibregts, C.J.: Mining Geostatistics. Academic Press, London (1978)

    Google Scholar 

  12. Journel, A.G., Rao, S.E.: Deriving conditional distribution from ordinary kriging. Stanford Center for Reservoir Forcasting, Stanford University Report No. 29, 25 p (1996)

    Google Scholar 

  13. Keller, J.M., Gray, M.R., Givens, J.A.: A fuzzy k-nearest neighbor algorithm. IEEE Trans. Systems. Man and Cybernetics 15, 580–585 (1985)

    Google Scholar 

  14. Nguyen, D.V., Rocke, D.M.: Tumor classification by partial least squares using microarray gene expression data. Bioinformatics 18, 39–50 (2002)

    Article  Google Scholar 

  15. Paliwal, K.K., Rao, P.V.S.: Application of k-nearest-neighbor decision rule in vowel recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 5, 229–231 (1983)

    Article  Google Scholar 

  16. Tokola, T., Pitkänen, J., Partinen, S., Muinonen, E.: Point accuracy of a non-parametric method in estimation of forest characteristics with different satellite materials. International Journal of Remote Sensing 17, 2333–2351 (1996)

    Article  Google Scholar 

  17. Troyanskaya, O., Cantor, M., Sherlock, G., Brown, P., Hastie, T., Tibshirani, R., Bostein, D., Altman, R.B.: Missing value estimation methods for DNA microarrays. Bioinformatics 17, 520–525 (2001)

    Article  Google Scholar 

  18. Zhou, X., Liu, K.Y., Wong, S.T.C.: Cancer classification and prediction using logistic regression with Bayesian gene selection. J. Biomedical Informatics 37, 249–259 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pham, T.D. (2005). An Optimally Weighted Fuzzy k-NN Algorithm. In: Singh, S., Singh, M., Apte, C., Perner, P. (eds) Pattern Recognition and Data Mining. ICAPR 2005. Lecture Notes in Computer Science, vol 3686. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11551188_26

Download citation

  • DOI: https://doi.org/10.1007/11551188_26

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-28757-5

  • Online ISBN: 978-3-540-28758-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics