Advertisement

Hybrid Model for Efficient Anomaly Detection in Short-timescale GWAC Light Curves and Similar Datasets

  • 3 Accesses

Abstract

Early warning during sky survey provides a crucial opportunity to detect low-mass, free-floating planets. In particular, to search short-timescale microlensing (ML) events from high-cadence and wide- field survey in real time, a hybrid method which combines ARIMA (Autoregressive Integrated Moving Average) with LSTM (Long-Short Time Memory) and GRU (Gated Recurrent Unit) recurrent neural networks (RNN) is presented to monitor all observed light curves and identify ML events at their early stages. Experimental results show that the hybrid models perform better in accuracy and less time consuming of adjusting parameters. ARIMA+LSTM and ARIMA+GRU can achieve improvement in accuracy by 14.5% and 13.2%, respectively. In the case of abnormal detection of light curves, GRU can achieve almost the same result as LSTM with less time by 8%. The hybrid models are also applied to MIT-BIH Arrhythmia Databases ECG dataset which has the similar abnormal pattern to ML. The experimental results from both data sets show that the hybrid model can save up to 40% of researchers' time in model adjusting and optimization to achieve 90% accuracy.

This is a preview of subscription content, log in to check access.

Access options

Buy single article

Instant unlimited access to the full article PDF.

US$ 39.95

Price includes VAT for USA

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.
Fig. 11.

REFERENCES

  1. 1

    Mayer-Schönberger, V. and Cukier, K., Big Data: a Revolution That Will Transform How We Live, Work and Think, Boston: Houghton Mifflin Harcourt, 2013.

  2. 2

    Siami-Namini, S. and Siami-Namin, A., Forecasting economics and financial time series: ARIMA vs. LSTM, 2018. https://arxiv.org/abs/1803.06386.

  3. 3

    Jenkins, G. and Box, G.E.P., Time Series Analysis, Forecasting and Control, San Francisco: Holden-Day, 1970.

  4. 4

    Zhang, G.P., “Time series forecasting using a hybrid arima and neural network model, Neurocomputing, 2003, vol. 50, p. 159175.

  5. 5

    Konar, A. and Bhattacharya, D., Time-Series Prediction and Applications, Ch. 1: An Introduction to Time-Series Prediction, New York: Springer-Verlag, 2017.

  6. 6

    Hochreiter, S. and Schmidhuber, J., “Long short-term memory, Neural Comput., 1997, vol. 9, no. 8, pp. 1735–1780.

  7. 7

    Graves, A. and Schmidhuber, J., Framewise phoneme classification with bidirectional LSTM and other neural network architectures, Neural Networks, 2005, vol. 18, nos. 5–6, pp. 602–610.

  8. 8

    Wan, M., Wu, C., Wang, J., et al., Publ. Astron. Soc. Pac., 2016, vol. 128, p. 114501.

  9. 9

    Udalski, A., Acta Astron., 2003, vol. 53, p. 291.

  10. 10

    Udalski, A., Szymanski, M.K., and Szymanski, G., Acta Astron., 2015, vol. 65, p. 1.

  11. 11

    Feng, T., Du, Z., Sun, Y., et al., in Proc. 6th IEEE Int. Congress on Big Data, Honolulu, 2017.

  12. 12

    Lipton, Z.C., Berkowitz, J., and Elkan, C., A critical review of recurrent neural networks for sequence learning, 2015. arXiv 1506.00019.

  13. 13

    Farmer, J.D. and Sidorowich, J.J., “Predicting chaotic time series, Phys. Rev. Lett., 1987, vol. 59, p. 845.

  14. 14

    Cho, K., van Merrienboer, B., Bahdanau, D., and Bengio, Y., “On the properties of neural machine translation: encoder-decoder approaches, Proc. 8th Workshop on Syntax, Semantics and Structure in Statistical Translation (SSST-8), Doha, 2014. arXiv: 1409.1259

  15. 15

    http://www.statisticshowto.com/akaikes-information-criterion.

  16. 16

    Meng Wan, An Application Research of Column store MonetDB database on GWAC Large-Scale Astronomical Data Management Chaoyang: Natl. Astron. Obs., Chin. Acad. Sci., 2016.

  17. 17

    https://en.wikipedia.org/wiki/Recurrent_neural_network.

  18. 18

    https://blog.csdn.net/lreaderl/article/details/78022724.

  19. 19

    MIT-BIHArrhythmiaDatabase. https://www.physionet.org/physiobank/database/mitdb/.

  20. 20

    Rajpurkar, P., Hannun, A.Y., Haghpanahi, M., Bourn, C., and Ng, A.Y., Cardiologist-level arrhythmia detection with convolutional neural networks, 2017. arXiv:1707.01836

Download references

ACKNOWLEDGMENTS

This research is supported in part by Key Research and Development Program of China (no. 2016YFB1000602), ”the Key Laboratory of Space Astronomy and Technology, National Astronomical Observatories, Chinese Academy of Sciences, Beijing ,100012, China,” National Natural Science Foundation of China (nos. 61440057, 61272087, 61363019 and 61073008, 11690023), MOE research center for online education foundation (no. 2016ZD302).

Author information

Correspondence to Z. Du.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Sun, Y., Zhao, Z., Ma, X. et al. Hybrid Model for Efficient Anomaly Detection in Short-timescale GWAC Light Curves and Similar Datasets. Program Comput Soft 45, 600–610 (2019) doi:10.1134/S0361768819080176

Download citation