Abstract
This paper presents a new approach optimizing the parameters in the K-nearest neighbors under possibility framework (KNN-PF) which is based on the classical K-nearest neighbors algorithm within the possibility theory. The KNN-PF method has provided good results comparing to other methods. However, the efficiency of this method is based on its parameters values. Therefore, in order to make this approach more effectiveness, we have to determine the optimal or near-optimal parameters values by maximizing its accuracy classification. In this paper, a novel method was proposed using the powerful evolutionary algorithm Immune Genetic Algorithm (IGA) as an optimizing algorithm. Experiments are conducted based on some real-world datasets and the experimental results show that our proposed method is powerful with respect to the accuracy.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Dempster., A.P.: Upper and lower probabilities induced by a multivalued mapping. Ann. Mathe. Stat. (1), 3–28 (1978)
Denoeux, T.: A k-nearest neighbor classification rule based on Dempster-Shafer theory. IEEE Trans. Syst. Man Cybern. 25, 804–813 (1995)
Dubois, D., Prade, H., Pap, E.: Possibility Theory: An Approach to Computerized Processing of Uncertainty. Plenum Press, New York (1988)
Dubois, D., Prade, H.: Possibility theory in information fusion. In: Proceedings of the 3rd International Conference On Information Fusion, pp. 6–19 (2000)
Dudani, S.A.: The distance weighted K-nearest neighbor rule. IEEE Trans. Syst. Man Cybern. 6, 325–327 (1976)
Fixe, E., Hodges, J.: Discriminatory analysis, nonparametric discrimination: consistency properties. Technical report (4), USAF School of Aviation Medicine, Randolph Field, Texas (1951)
Hentech, R., Jenhani, I., Elouedi, Z.: Possibilistic AIRS induction from uncertain data. Soft Comput. 20, 3 (2016)
Jiao, L.C., Wang, L.: A novel genetic algorithm based on immunity. IEEE Trans. Syst. Man Cybern. A Syst. Hum. 30, 552–561 (2000)
Keller, J.M., Gray, M.R., Givens, J.A.: A fuzzy K-nearest neighbor algorithm. IEEE Trans. Syst. Man Cybern. 4, 580–585 (1985)
Murphy, P.M., Aha, D.W.: UCI repository databases (1996). http://www.ics.uci.edu/ml-earn. Accessed 16 July 2018
Pawlak, Z.: Rough sets. Int. J. Inf. Comput. Sci. 11, 341–356 (1982)
Saied, S., Elouedi, Z.: K-nearest neighbors classifier under possibility framework. In: La Logique Floue est ses Applications 2018, LFA, pp. 1–8 (2018)
Shafer, G.: A Mathematical Theory of Evidence. Princeton University Press, Princeton (1976)
Smets, P., Kennes, R.: The transferable belief model. Artif. Intell. 66, 191–234 (1994)
Zadeh, L.: Fuzzy sets. Inf. Control 8, 338–353 (1965)
Zadeh, L.: Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets Syst. 1, 3–28 (1978)
Zouhal, L.M., Denoeux, T.: An evidence theoretic k-NN rule with parameter optimizatio. IEEE Trans. Syst. Man Cybern. 28, 263–271 (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Saied, S., Elouedi, Z. (2020). K-Nearest Neighbors Under Possibility Framework with Optimizing Parameters. In: Abraham, A., Cherukuri, A.K., Melin, P., Gandhi, N. (eds) Intelligent Systems Design and Applications. ISDA 2018 2018. Advances in Intelligent Systems and Computing, vol 940. Springer, Cham. https://doi.org/10.1007/978-3-030-16657-1_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-16657-1_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-16656-4
Online ISBN: 978-3-030-16657-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)