Skip to main content

An Improved K-NN Algorithm Through Class Discernibility and Cohesiveness

  • Conference paper
  • First Online:
  • 1014 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 740))

Abstract

The K-Nearest Neighbor (K-NN) is a primarily chosen method when it comes to the object classification, disease interpretation, and various other fields. In numerous cases, K-NN classifier uses the only parameter as K value, which is the number of nearest neighbors to decide the class of the instance and this appears to be insufficient. Within this study, we have looked at the initial K-Nearest Neighbor algorithm and also proposed modified K-NN algorithm to identify various ailments. Enhancing precision of the initial K-Nearest Neighbor algorithm, this specific suggested method consists of instance weights as an added parameter to determine the class of the example. This study presented a novel technique to assign weights, which utilizes the information from the structure of the data set and assigns weights to every instance relying on the priority of the instance in class discernibility. In this approach, we have included an additional metric “average density” together with “discernibility” to calculate an index which is used as a measure also with the value of K. The practice results obtained from UCI repository reveals that this classifier carries out much better than the traditional K-NN and preserve steady accuracy.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Ahmed, S.S., Dey, N., Ashour, A.S., Sifaki-Pistolla, D., Bălas-Timar, D., Balas, V.E., Tavares, J.M.R.: Effect of fuzzy partitioning in Crohn’s disease classification: a neuro-fuzzy-based approach. Med. Biol. Eng. Comput. 55(1), 101–115 (2017)

    Article  Google Scholar 

  2. Kausar, N., Palaniappan, S., Samir, B.B., Abdullah, A., Dey. N.: Systematic analysis of applied data mining based optimization algorithms in clinical attribute extraction and classification for diagnosis of cardiac patients. In: Applications of intelligent optimization in biology and medicine, pp 217–231. Springer (2016)

    Google Scholar 

  3. Dey, N.: Classification and clustering in biomedical signal processing. IGI Global (2016)

    Google Scholar 

  4. Nath, S.S., Mishra, G., Kar, J., Chakraborty, S., Dey, N.: A survey of image classification methods and techniques. In: Control, Instrumentation, Communication and Computational Technologies (ICCICCT), 2014 International Conference on, 2014. IEEE, pp 554–557 (2014)

    Google Scholar 

  5. Wettschereck, D., Aha, D.W., Mohri, T.: A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artif. Intell. Rev. 11, 273–314 (1997)

    Article  Google Scholar 

  6. Zhang, M.-L., Zhou, Z.-H.: ML-KNN: A lazy learning approach to multi-label learning. Pattern Recogn. 40, 2038–2048 (2007)

    Article  Google Scholar 

  7. Asuncion, A., Newman, D.: UCI machine learning repository (2007)

    Google Scholar 

  8. Gerhana, Y.A., Atmadja, A.R., Zulfikar, W.B., Ashanti, N: The implementation of K-nearest neighbor algorithm in case-based reasoning model for forming automatic answer identity and searching answer similarity of algorithm case. In: Cyber and IT Service Management (CITSM), 2017 5th International Conference on, 2017. IEEE, pp 1–5 (2017)

    Google Scholar 

  9. Selvaluxmiy, S., Kumara, T., Keerthanan, P., Velmakivan, R., Ragel, R., Deegalla, S.: Accelerating k-NN classification algorithm using graphics processing units. In: Information and Automation for Sustainability (ICIAfS), 2016 IEEE International Conference on, 2016. IEEE, pp 1–6 (2016)

    Google Scholar 

  10. Jaiswal, S., Bhadouria, S., Sahoo, A.: KNN model selection using modified Cuckoo search algorithm. In: Cognitive Computing and Information Processing (CCIP), 2015 International Conference on, 2015. IEEE, pp 1–5 (2015)

    Google Scholar 

  11. Taneja, S., Gupta, C., Aggarwal, S., Jindal, V.: MFZ-KNN—a modified fuzzy based K nearest neighbor algorithm. In: Cognitive Computing and Information Processing (CCIP), 2015 International Conference on, 2015. IEEE, pp 1–5 (2015)

    Google Scholar 

  12. Hechenbichler, K., Schliep, K.: Weighted K-Nearest-Neighbor Techniques and Ordinal Classification (2004)

    Google Scholar 

  13. Voulgaris, Z.: Discernibility Concept in Classification Problems. Citeseer (2009)

    Google Scholar 

  14. Voulgaris, Z., Magoulas, G.D.: Extensions of the k nearest neighbour methods for classification problems. In: Proceedings of the 26th IASTED International Conference on Artificial Intelligence and Applications (AIA), Innsbruck, Austria, February 11, 2008. pp 23–28 (2008)

    Google Scholar 

  15. Getis, A., Ord, J.K.: The analysis of spatial association by use of distance statistics. Geogr. Anal. 24, 189–206 (1992)

    Article  Google Scholar 

  16. Hu, L.-Y., Huang, M.-W., Ke, S.-W., Tsai, C.-F.: The distance function effect on k-nearest neighbor classification for medical datasets. SpringerPlus 5, 1304 (2016)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rajesh Prasad Sarkar .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sarkar, R.P., Maiti, A. (2019). An Improved K-NN Algorithm Through Class Discernibility and Cohesiveness. In: Kalita, J., Balas, V., Borah, S., Pradhan, R. (eds) Recent Developments in Machine Learning and Data Analytics. Advances in Intelligent Systems and Computing, vol 740. Springer, Singapore. https://doi.org/10.1007/978-981-13-1280-9_41

Download citation

Publish with us

Policies and ethics