Abstract
With the development of the Internet of Things (IOT) technology, a large number of sensor data have been produced. Due to the complex acquisition environment and transmission condition, anomalies are prevalent. Sensor data is a kind of typical time series data, its anomaly refers to not only outliers, but also the anomaly of continuous data fragments, namely anomaly patterns. To achieve anomaly pattern detection on sensor data, the characteristics of sensor data are analyzed including temporal correlation, spatial correlation and high dimension. Then based on these characteristics and the real-time processing requirements of sensor data, a sensor data oriented anomaly pattern detection approach is proposed in this paper. In the approach, the frequency domain features of sensor data are obtained by Fast Fourier Transform, the dimension of the feature space is reduced by describing frequency domain features with statistical values, and the high-dimensional sensor data is processed in time on the basis of Isolation Forest algorithm. In order to verify the feasibility and effectiveness of the proposed approach, experiments are carried out on the open dataset IBRL. The experimental results show that the approach can effectively identify the pattern anomalies of sensor data, and has low time cost while ensuring the high accuracy.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hawkins, D.M.: Identification of Outliers. Springer, Netherlands (1980). https://doi.org/10.1007/978-94-015-3994-4
Xi, Y., Zhuang, X., Wang, X., et al.: A research and application based on gradient boosting decision tree. In: 15th International Conference on Web Information Systems and Applications, pp. 15–26 (2018)
Ramaswamy, S., Rastogi, R., Shim, K.: Efficient algorithms for mining outliers from large data sets. ACM SIGMOD Rec. 29(2), 427–438 (2000)
Frank, R., Jin, W., Ester, M.: Efficiently mining regional outliers in spatial data. In: Papadias, D., Zhang, D., Kollios, G. (eds.) SSTD 2007. LNCS, vol. 4605, pp. 112–129. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73540-3_7
Gaddam, S., Phoha, V., Balagani, K.: K-Means+ID3: a novel method for supervised anomaly detection by cascading K-Means clustering and ID3 decision tree learning methods. IEEE Trans. Knowl. Data Eng. 19(3), 345–354 (2007)
Kasliwal, B., Bhatia, S., Saini, S., et al.: A hybrid anomaly detection model using G-LDA. In: 2014 IEEE International Advance Computing Conference, Gurgaon, pp. 288–293 (2014)
Zhang, Y., Du, B., Zhang, L., et al.: A low-rank and sparse matrix decomposition-based Mahalanobis distance method for hyperspectral anomaly detection. IEEE Trans. Geosci. Remote Sens. 53(3), 1–14 (2015)
Huang, T., Zhu, Y., Zhang, Q., et al.: An LOF-based adaptive anomaly detection scheme for cloud computing. In: 37th Annual Computer Software and Applications Conference Workshops, Japan, pp. 206–211 (2013)
Münz, G., Li, S., Carle, G.: Traffic anomaly detection using K-Means clustering. In: 4th GI/ITG-Workshop MMBnet, Hamburg (2007)
Chen, Y.: Density-based clustering for real-time stream data. In: 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, California, pp. 133–142 (2007)
Yan, Q.Y., Xia, S.X., Feng, K.W.: Probabilistic distance based abnormal pattern detection in uncertain series data. Knowl. Based Syst. 36(11), 182–190 (2012)
Cai, L., Thornhill, N., Kuenzel, S., et al.: Real-time detection of power system disturbances based on k-nearest neighbor analysis. IEEE Access 99, 1–8 (2017)
Liu, F., Ting, K., Zhou, Z.H.: Isolation forest. In: 8th IEEE International Conference on Data Mining, Los Alamitos, pp. 413–422 (2008)
Intel Berkeley Research Lab dataset. http://db.csail.mit.edu/labdata/labdata.html. Accessed 18 Apr 2019
Acknowledgements
This paper is supported by the Scientific and Technological Research Program of Beijing Municipal Education Commission (KM201810009004) and the National Natural Science Foundation of China (61702014).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, H., Yu, B., Zhao, T. (2019). An Anomaly Pattern Detection Method for Sensor Data. In: Ni, W., Wang, X., Song, W., Li, Y. (eds) Web Information Systems and Applications. WISA 2019. Lecture Notes in Computer Science(), vol 11817. Springer, Cham. https://doi.org/10.1007/978-3-030-30952-7_28
Download citation
DOI: https://doi.org/10.1007/978-3-030-30952-7_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30951-0
Online ISBN: 978-3-030-30952-7
eBook Packages: Computer ScienceComputer Science (R0)