Skip to main content

Rough Nearest Neighbour Classifier

  • Chapter
  • First Online:
Rough Set–Based Classification Systems

Part of the book series: Studies in Computational Intelligence ((SCI,volume 802))

Abstract

The nearest neighbour algorithm is an efficient but relatively time–consuming method of non-parametric regression and classification [9]. The method can be easily adapted to work with missing data using simple marginalisation or other preprocessing [1, 8, 10, 12]. Moreover, the efficiency of this solution is really high. In this chapter, a rough version of the algorithm will be presented. At the beginning, the basic version of the k-nearest neighbour classifier will be recalled, and then a rough version prepared for missing data will be proposed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ashraf, M., Le, K., Huang, X.: Iterative weighted k-nn for constructing missing feature values in Wisconsin breast cancer dataset. In: 2011 3rd International Conference on Data Mining and Intelligent Information Technology Applications (ICMiA), pp. 23–27 (2011)

    Google Scholar 

  2. Bao, Y., Du, X., Ishii, N.: Improving performance of the k-nearest neighbor classifier by tolerant rough sets. In: The Proceedings of the Third International Symposium on Cooperative Database Systems for Advanced Applications, CODAS 2001, pp. 167–171 (2001)

    Google Scholar 

  3. Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21–27 (1967)

    Article  Google Scholar 

  4. Devijver, P.A., Kittler, J.: Pattern Recognition: A Statistical Approach. Prentice Hall, London (1982)

    Google Scholar 

  5. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley INC., New York/Chichester/Weinheim/Brisbane/Singapore/Toronto, A Wiley-Interscience Publication (2001)

    Google Scholar 

  6. Hart, P.: The condensed nearest neighbor rule (corresp.). IEEE Trans. Inf. Theory 14(3), 515–516 (1968)

    Article  Google Scholar 

  7. Hastie, T., Tibshirani, R.: Discriminant adaptive nearest neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 18(6), 607–616 (1996)

    Article  Google Scholar 

  8. Ishii, N., Morioka, Y., Kimura, H., Bao, Y.: Classification by partil data of multiple reducts-knn with confidence. In: 2010 22nd IEEE International Conference on Tools with Artificial Intelligence (ICTAI), vol. 1, pp. 94–101 (2010)

    Google Scholar 

  9. Ishii, N., Torii, I., Bao, Y., Tanaka, H.: Mapping of nearest neighbor for classification. In: 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS), pp. 121–126 (2013)

    Google Scholar 

  10. Jonsson, P., Wohlin, C.: An evaluation of k-nearest neighbour imputation using Likert data. In: 2004 Proceedings of 10th International Symposium on Software Metrics, pp. 108–118 (2004)

    Google Scholar 

  11. Mic, M.L., Oncina, J., Vidal, E.: A new version of the nearest-neighbour approximating and eliminating search algorithm (AESA) with linear preprocessing time and memory requirements. Pattern Recognit. Lett. 15(1), 9–17 (1994)

    Google Scholar 

  12. Morin, R.L., Raeside, D.E.: A reappraisal of distance-weighted k-nearest neighbor classification for pattern recognition with missing data. IEEE Trans. Syst. Man Cybern. 11, 241–243 (1981)

    Google Scholar 

  13. Nowak, B.A., Nowicki, R.K., Woźniak, M., Napoli, C.: Multi-class Nearest Neighbour Classifier for Incomplete Data Handling, Lecture Notes in Computer Science, vol. 9119, pp. 469–480. Springer International Publishing, Cham (2015)

    Chapter  Google Scholar 

  14. Nowicki, R.K., Nowak, B.A., Woniak, M.: Rough k nearest neighbours for classification in the case of missing input data. In: Proceedings of the 9th International Conference on Knowledge, Information and Creativity Support Systems, pp. 196–207. Limassol, Cyprus (2014)

    Google Scholar 

  15. Nowicki, R.K., Nowak, B.A., Woźniak, M.: Application of Rough Sets in k Nearest Neighbours Algorithm for Classification of Incomplete Samples, pp. 243–257. Springer International Publishing, Cham (2016)

    Google Scholar 

  16. Pawlak, Z.: Rough sets. Int. J. Comput. Inf. Sci. 11(5), 341–356 (1982)

    Article  MathSciNet  Google Scholar 

  17. Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning About Data. Kluwer, Dordrecht (1991)

    Chapter  Google Scholar 

  18. Pawlak, Z.: Rough sets, decision algorithms and Bayes’ theorem. Eur. J. Oper. Res. 136, 181–189 (2002)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert K. Nowicki .

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Nowicki, R.K. (2019). Rough Nearest Neighbour Classifier. In: Rough Set–Based Classification Systems. Studies in Computational Intelligence, vol 802. Springer, Cham. https://doi.org/10.1007/978-3-030-03895-3_6

Download citation

Publish with us

Policies and ethics