A Novel Distance Metric Based on Differential Evolution
- 3 Downloads
Distance has been employed as a representation of similarity for half a century. Many different distance metrics have been proposed in this duration such as Euclidean, Manhattan, Minkowski and weighted Euclidean distance metrics. Each of them has its own characteristics and is calculated in different formulations/manners. In this paper, a novel distance metric, which has a high adaptation capability, was proposed. In order to increase the adaptation ability of the proposed distance metric, its parameters were optimized according to the employed dataset by differential evolution (DE), which is a metaheuristic optimization method. The proposed distance metric was employed in the k-nearest neighbor, and 30 different benchmark datasets were used in the evaluation of the proposed approach. Each of the parameters of the novel distance metric and the parameters of DE was assessed based on the obtained accuracies. Obtained results validated the applicability of the proposed distance metric and the proposed approach.
KeywordsDistance metric k-nearest neighbor Differential evaluation Parameter optimization
Compliance with Ethical Standards
Conflict of interest
The author declares that he has no conflict of interest.
This article does not contain any studies with human participants or animals performed by any of the authors.
- 9.Joshi, A.; Mehta, A.: Analysis of K-nearest neighbor technique for breast cancer disease classification. Mach. Learn. 98, 13 (2018)Google Scholar
- 11.Zhang, M.L.; Zhou, Z.H.: A k-nearest neighbor based algorithm for multi-label classification. IEEE Int. Conf. Granul. Comput. 2, 718–721 (2005)Google Scholar
- 12.Beyer K; Goldstein J; Ramakrishnan R; Shaft U: When is “nearest neighbor” meaningful? In: International Conference on Database Theory, pp. 217–235 (1999)Google Scholar
- 17.Storn, R.; Price, K.V.: Differential evolution: a simple and efficient adaptive scheme for global optimization over continuous spaces. International Computer Science Institute (ICSI), USA, Technical Report TR-95-012. http://icsi.berkeley.edu/∼storn/litera.html (2015)
- 23.Omran, M.G.; Engelbrecht, A.P.; Salman, A.: Differential evolution methods for unsupervised image classification. In: The 2005 IEEE Congress on Evolutionary Computation, vol. 2, pp. 966–973 (2005)Google Scholar
- 27.Boriah, S.; Chandola, V.; Kumar, V.: Similarity measures for categorical data: a comparative evaluation. Red 30(2), 243–254 (2008)Google Scholar
- 28.Cha, S.H.: Comprehensive survey on distance/similarity measures between probability density functions. Int. J. Math. Models Methods Appl. Sci. 1(4), 300–3007 (2007)Google Scholar
- 31.Ozcan, K.; Velipasalar, S.; Varshney, P.K.: Autonomous fall detection with wearable cameras by using relative entropy distance measure. IEEE Trans. Hum. Mach. Syst. 47(1), 31–39 (2017)Google Scholar
- 35.Chernoff, K.; Nielsen, M.: Weighting of the k-nearest-neighbors. In: IEEE 20th International Conference on Pattern Recognition (ICPR), pp. 666–669 (2010)Google Scholar
- 38.Hechenbichler, K.; Schliep, K.: Weighted k-nearest-neighbor techniques and ordinal classification. Sonderforschungsbereich 386, Paper 399 (2004)Google Scholar
- 40.Duin, R.P.W.; Juszczak, P.; Paclik P.; Pekalska E.; de Ridder D.: PR-Tools 4.0, a Matlab Toolbox for Pattern Recognition, The Netherlands (2004)Google Scholar
- 41.Lichman, M.: UCI machine learning repository. http://archive.ics.uci.edu/ml, Irvine, CA University, California, School of Computing and Information Sciences
- 43.Bajpai, A.; Varshney, U.; Dubey, D: Performance enhancement of automatic speech recognition system using euclidean distance comparison and artificial neural network. In: 3rd International Conference On Internet of Things: Smart Innovation and Usages (IoT-SIU), pp. 1–5. IEEE (2018)Google Scholar
- 44.Pambudi, E.A.; Andono, P.N.; Pramunendar, R.A.: Image segmentation analysis based on K-means PSO by using three distance measures. ICTACT J. Image Video Process. 9(1), 1821–1826 (2018)Google Scholar