Abstract
The nearest neighbour algorithm is an efficient but relatively time–consuming method of non-parametric regression and classification [9]. The method can be easily adapted to work with missing data using simple marginalisation or other preprocessing [1, 8, 10, 12]. Moreover, the efficiency of this solution is really high. In this chapter, a rough version of the algorithm will be presented. At the beginning, the basic version of the k-nearest neighbour classifier will be recalled, and then a rough version prepared for missing data will be proposed.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ashraf, M., Le, K., Huang, X.: Iterative weighted k-nn for constructing missing feature values in Wisconsin breast cancer dataset. In: 2011 3rd International Conference on Data Mining and Intelligent Information Technology Applications (ICMiA), pp. 23–27 (2011)
Bao, Y., Du, X., Ishii, N.: Improving performance of the k-nearest neighbor classifier by tolerant rough sets. In: The Proceedings of the Third International Symposium on Cooperative Database Systems for Advanced Applications, CODAS 2001, pp. 167–171 (2001)
Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theory 13(1), 21–27 (1967)
Devijver, P.A., Kittler, J.: Pattern Recognition: A Statistical Approach. Prentice Hall, London (1982)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley INC., New York/Chichester/Weinheim/Brisbane/Singapore/Toronto, A Wiley-Interscience Publication (2001)
Hart, P.: The condensed nearest neighbor rule (corresp.). IEEE Trans. Inf. Theory 14(3), 515–516 (1968)
Hastie, T., Tibshirani, R.: Discriminant adaptive nearest neighbor classification. IEEE Trans. Pattern Anal. Mach. Intell. 18(6), 607–616 (1996)
Ishii, N., Morioka, Y., Kimura, H., Bao, Y.: Classification by partil data of multiple reducts-knn with confidence. In: 2010 22nd IEEE International Conference on Tools with Artificial Intelligence (ICTAI), vol. 1, pp. 94–101 (2010)
Ishii, N., Torii, I., Bao, Y., Tanaka, H.: Mapping of nearest neighbor for classification. In: 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS), pp. 121–126 (2013)
Jonsson, P., Wohlin, C.: An evaluation of k-nearest neighbour imputation using Likert data. In: 2004 Proceedings of 10th International Symposium on Software Metrics, pp. 108–118 (2004)
Mic, M.L., Oncina, J., Vidal, E.: A new version of the nearest-neighbour approximating and eliminating search algorithm (AESA) with linear preprocessing time and memory requirements. Pattern Recognit. Lett. 15(1), 9–17 (1994)
Morin, R.L., Raeside, D.E.: A reappraisal of distance-weighted k-nearest neighbor classification for pattern recognition with missing data. IEEE Trans. Syst. Man Cybern. 11, 241–243 (1981)
Nowak, B.A., Nowicki, R.K., Woźniak, M., Napoli, C.: Multi-class Nearest Neighbour Classifier for Incomplete Data Handling, Lecture Notes in Computer Science, vol. 9119, pp. 469–480. Springer International Publishing, Cham (2015)
Nowicki, R.K., Nowak, B.A., Woniak, M.: Rough k nearest neighbours for classification in the case of missing input data. In: Proceedings of the 9th International Conference on Knowledge, Information and Creativity Support Systems, pp. 196–207. Limassol, Cyprus (2014)
Nowicki, R.K., Nowak, B.A., Woźniak, M.: Application of Rough Sets in k Nearest Neighbours Algorithm for Classification of Incomplete Samples, pp. 243–257. Springer International Publishing, Cham (2016)
Pawlak, Z.: Rough sets. Int. J. Comput. Inf. Sci. 11(5), 341–356 (1982)
Pawlak, Z.: Rough Sets: Theoretical Aspects of Reasoning About Data. Kluwer, Dordrecht (1991)
Pawlak, Z.: Rough sets, decision algorithms and Bayes’ theorem. Eur. J. Oper. Res. 136, 181–189 (2002)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Nowicki, R.K. (2019). Rough Nearest Neighbour Classifier. In: Rough Set–Based Classification Systems. Studies in Computational Intelligence, vol 802. Springer, Cham. https://doi.org/10.1007/978-3-030-03895-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-03895-3_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03894-6
Online ISBN: 978-3-030-03895-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)