Abstract
This paper represents an algorithm for performing clustering and outlier detection simultaneously. As research says, clustering and outlier (anomaly) detection are not separate problems but they are co-related. So our algorithm provides a generalized solution for outlier detection as per application. It takes some threshold values as input, applies K-means algorithm for initial clustering and based on threshold values, outliers are detected. This approach is not strict to number of clusters k, but applies re-clustering where required. It helps to find local as well as global outliers of dataset. The results can be customized by varying the values of threshold limits. The algorithm works in two phases, first phase provides initial clustering using K-Means and second phase helps to find outliers.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hodge, Victoria, Austin, Jim: A survey of outlier detection methodologies. Artif. Intell. Rev. 22(2), 85–126 (2004)
Singh, Karanjit, Upadhyaya, Shuchita: Outlier detection: applications and techniques. Int. J. Comput. Sci. Issues 9(1), 307–323 (2012)
Jiang, Mon-Fong, Tseng, Shian-Shyong, Chih-Ming, Su: Two-phase clustering process for outliers detection. Pattern Recogn. Lett. 22(6), 691–700 (2001)
Hautamäki, V., Cherednichenko, S., Kärkkäinen, I., Kinnunen, T., Fränti, P.: Improving k-means by outlier removal. In: Scandinavian Conference on Image Analysis, pp. 978–987. Springer, Berlin (2005)
Chawla, S., Gionis, A.: k-means–: a unified approach to clustering and outlier detection. In: Proceedings of the 2013 SIAM International Conference on Data Mining, pp. 189–197. Society for Industrial and Applied Mathematics (2013)
Niu, Z., Shi, S., Sun, J., He, X.: A survey of outlier detection methodologies and their applications. In: Artificial Intelligence and Computational Intelligence, pp. 380–387 (2011)
Bansal, R., Gaur, N., Narayan Singh, S.: Outlier detection: applications and techniques in data mining. In: 2016 6th International Conference Cloud System and Big Data Engineering (Confluence), pp. 373–377. IEEE (2016)
Radovanović, Miloš, Nanopoulos, Alexandros, Ivanović, Mirjana: Reverse nearest neighbors in unsupervised distance-based outlier detection. IEEE Trans. Knowl. Data Eng. 27(5), 1369–1382 (2015)
Tang, G.: New Methods in Outlier Detection. Ph.D. diss. Simon Fraser University (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Saxena, S., Rajpoot, D.S. (2019). Density-Based Approach for Outlier Detection and Removal. In: Rawat, B., Trivedi, A., Manhas, S., Karwal, V. (eds) Advances in Signal Processing and Communication . Lecture Notes in Electrical Engineering, vol 526. Springer, Singapore. https://doi.org/10.1007/978-981-13-2553-3_27
Download citation
DOI: https://doi.org/10.1007/978-981-13-2553-3_27
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-2552-6
Online ISBN: 978-981-13-2553-3
eBook Packages: EngineeringEngineering (R0)