Abstract
Robust and efficient approaches are needed in real-time monitoring of data streams. In this paper, we focus on anomaly detection on data streams. Existing methods on anomaly detection suffer three problems. 1) A large volume of false positive results are generated. 2) The training data are needed, and the time window of appropriate size along with corresponding threshold has to be determined empirically. 3) Both time and space overhead is usually very high. We propose a novel self-similarity-based anomaly detection algorithm based on piecewise fractal model. This algorithm consumes only limited amount of memory and does not require training process. Theoretical analysis of the algorithm are presented. The experimental results on the real data sets indicate that, compared with existing anomaly detection methods, our algorithm can achieve higher precision with reduced space and time complexity.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Internet traffic archive, http://ita.ee.lbl.gov/
Barnsley, M., Elton, J., Hardin, D.: Recurrent iterated function systems. Constructive Approximation 5(1), 3–31 (1989)
Borgnat, P., Flandrin, P., Amblard, P.: Stochastic discrete scale invariance. IEEE Signal Processing Letters 9(6), 181–184 (2002)
Bulut, A., Singh, A.: A unified framework for monitoring data streams in real time. In: Proceedings of the 21st International Conference on Data Engineering, ICDE 2005, pp. 44–55. IEEE (2005)
Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: A survey. ACM Computing Surveys (CSUR)Â 41(3), 15 (2009)
Chen, Y., Dong, G., Han, J., Wah, B., Wang, J.: Multi-dimensional regression analysis of time-series data streams. In: Proceedings of the 28th International Conference on Very Large Data Bases, pp. 323–334. VLDB Endowment (2002)
Cormode, G., Muthukrishnan, S.: What’s new: Finding significant differences in network data streams. In: Twenty-third Annual Joint Conference of the IEEE Computer and Communications Societies, INFOCOM 2004, vol. 3, pp. 1534–1545. IEEE (2004)
Hart, J.: Fractal image compression and recurrent iterated function systems. IEEE Computer Graphics and Applications 16(4), 25–33 (1996)
Jain, A., Chang, E., Wang, Y.: Adaptive stream resource management using kalman filters. In: Proceedings of the 2004 ACM SIGMOD International Conference on Management of Data, pp. 11–22. ACM (2004)
Kifer, D., Ben-David, S., Gehrke, J.: Detecting change in data streams. In: Proceedings of the Thirtieth International Conference on Very Large Data Bases, vol. 30, pp. 180–191. VLDB Endowment (2004)
Krishnamurthy, B., Sen, S., Zhang, Y., Chen, Y.: Sketch-based change detection: methods, evaluation, and applications. In: Proceedings of the 3rd ACM SIGCOMM Conference on Internet Measurement, pp. 234–247. ACM (2003)
Mandelbrot, B.: The fractal geometry of nature. Times Books (1982)
Mazel, D., Hayes, M.: Using iterated function systems to model discrete sequences. IEEE Transactions on Signal Processing 40(7), 1724–1734 (1992)
Michael, F.: Fractals everywhere. Academic Press, San Diego (1988)
Patcha, A., Park, J.: An overview of anomaly detection techniques: Existing solutions and latest technological trends. Computer Networks 51(12), 3448–3470 (2007)
Qin, S., Qian, W., Zhou, A.: Approximately processing multi-granularity aggregate queries over data streams. In: Proceedings of the 22nd International Conference on Data Engineering, ICDE 2006, p. 67. IEEE (2006)
Shahabi, C., Tian, X., Zhao, W.: Tsa-tree: A wavelet-based approach to improve the efficiency of multi-level surprise and trend queries on time-series data. In: Proceedings of the 12th International Conference on Scientific and Statistical Database Management, pp. 55–68. IEEE (2000)
Wu, X., Barbará, D.: Using fractals to compress real data sets: Is it feasible. In: Proc. of SIGKDD (2003)
Zhou, A., Qin, S., Qian, W.: Adaptively detecting aggregation bursts in data streams. In: Zhou, L., Ooi, B.-C., Meng, X. (eds.) DASFAA 2005. LNCS, vol. 3453, pp. 435–446. Springer, Heidelberg (2005)
Zhu, Y., Shasha, D.: Efficient elastic burst detection in data streams. In: Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 336–345. ACM (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gong, X., Qian, W., Qin, S., Zhou, A. (2013). Fractal Based Anomaly Detection over Data Streams. In: Ishikawa, Y., Li, J., Wang, W., Zhang, R., Zhang, W. (eds) Web Technologies and Applications. APWeb 2013. Lecture Notes in Computer Science, vol 7808. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37401-2_54
Download citation
DOI: https://doi.org/10.1007/978-3-642-37401-2_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37400-5
Online ISBN: 978-3-642-37401-2
eBook Packages: Computer ScienceComputer Science (R0)