Advertisement

Data-Driven Pattern Identification and Outlier Detection in Time Series

  • Abdolrahman KhoshrouEmail author
  • Eric J. Pauwels
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 858)

Abstract

We address the problem of data-driven pattern identification and outlier detection in time series. To this end, we use singular value decomposition (SVD) which is a well-known technique to compute a low-rank approximation for an arbitrary matrix. By recasting the time series as a matrix it becomes possible to use SVD to highlight the underlying patterns and periodicities. This is done without the need for specifying user-defined parameters. From a data mining perspective, this opens up new ways of analyzing time series in a data-driven, bottom-up fashion. However, in order to get correct results, it is important to understand how the SVD-spectrum of a time series is influenced by various characteristics of the underlying signal and noise. In this paper, we have extended the work in earlier papers by initiating a more systematic analysis of these effects. We then illustrate our findings on some real-life data.

Keywords

Data mining Time series Outliers Singular value decomposition (SVD) Parameter-free approximation 

Notes

Acknowledgment

The authors would like to acknowledge partial support by the Dutch TTW-project SES-BE.

References

  1. 1.
    Wu, Z., Huang, N.E., Long, S.R., Peng, C.-K.: On the trend, detrending, and variability of nonlinear and nonstationary time series. In: Proceedings of the National Academy of Sciences, vol. 104, no. 38, pp. 14 889–14 894 (2007)CrossRefGoogle Scholar
  2. 2.
    Kantelhardt, J.W., Zschiegner, S.A., Koscielny-Bunde, E., Havlin, S., Bunde, A., Stanley, H.E.: Multifractal detrended fluctuation analysis of nonstationary time series. Phys. A: Stat. Mech. Its Appl. 316(1), 87–114 (2002)CrossRefGoogle Scholar
  3. 3.
    Kanjilal, P.P., Palit, S.: The singular value decomposition-applied in the modelling and prediction of quasiperiodic processes. Signal Process. 35(3), 257–267 (1994)CrossRefGoogle Scholar
  4. 4.
    Strang, G.: Introduction to Linear Algebra. Wellesley-Cambridge Press, Wellesley (1993)zbMATHGoogle Scholar
  5. 5.
    Kanjilal, P.P., Palit, S.: On multiple pattern extraction using singular value decomposition. IEEE Trans. Signal Process. 43(6), 1536–1540 (1995)CrossRefGoogle Scholar
  6. 6.
    Tao, T., Vu, V.H.: Random matrices: the distribution of the smallest singular values, ArXiv: 0903:0614 (2009)
  7. 7.
    Paul, D., Aue, A.: Random matrix theory in statistics: a review. J. Stat. Plan. Inference 150, 1–29 (2014)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Nguyen, H.H., Vu, V.: Random matrices: law of the determinant. Ann. Probab. 42(1), 146–167 (2014)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Ying, L.H.L.J.Z., Liangsheng, Q.: Improved singular value decomposition technique for detecting and extracting periodic impulse component in a vibration signal. Chin. J. Mech. Eng. 17(3), 1 (2004)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Centrum Wiskunde and InformaticaAmsterdamThe Netherlands

Personalised recommendations