Skip to main content
SpringerLink
Log in

Hybrid Model for Efficient Anomaly Detection in Short-timescale GWAC Light Curves and Similar Datasets

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

Early warning during sky survey provides a crucial opportunity to detect low-mass, free-floating planets. In particular, to search short-timescale microlensing (ML) events from high-cadence and wide- field survey in real time, a hybrid method which combines ARIMA (Autoregressive Integrated Moving Average) with LSTM (Long-Short Time Memory) and GRU (Gated Recurrent Unit) recurrent neural networks (RNN) is presented to monitor all observed light curves and identify ML events at their early stages. Experimental results show that the hybrid models perform better in accuracy and less time consuming of adjusting parameters. ARIMA+LSTM and ARIMA+GRU can achieve improvement in accuracy by 14.5% and 13.2%, respectively. In the case of abnormal detection of light curves, GRU can achieve almost the same result as LSTM with less time by 8%. The hybrid models are also applied to MIT-BIH Arrhythmia Databases ECG dataset which has the similar abnormal pattern to ML. The experimental results from both data sets show that the hybrid model can save up to 40% of researchers' time in model adjusting and optimization to achieve 90% accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.
Fig. 11.

Similar content being viewed by others

REFERENCES

  1. Mayer-Schönberger, V. and Cukier, K., Big Data: a Revolution That Will Transform How We Live, Work and Think, Boston: Houghton Mifflin Harcourt, 2013.

    Google Scholar 

  2. Siami-Namini, S. and Siami-Namin, A., Forecasting economics and financial time series: ARIMA vs. LSTM, 2018. https://arxiv.org/abs/1803.06386.

  3. Jenkins, G. and Box, G.E.P., Time Series Analysis, Forecasting and Control, San Francisco: Holden-Day, 1970.

    MATH  Google Scholar 

  4. Zhang, G.P., “Time series forecasting using a hybrid arima and neural network model, Neurocomputing, 2003, vol. 50, p. 159175.

    Article  Google Scholar 

  5. Konar, A. and Bhattacharya, D., Time-Series Prediction and Applications, Ch. 1: An Introduction to Time-Series Prediction, New York: Springer-Verlag, 2017.

  6. Hochreiter, S. and Schmidhuber, J., “Long short-term memory, Neural Comput., 1997, vol. 9, no. 8, pp. 1735–1780.

    Article  Google Scholar 

  7. Graves, A. and Schmidhuber, J., Framewise phoneme classification with bidirectional LSTM and other neural network architectures, Neural Networks, 2005, vol. 18, nos. 5–6, pp. 602–610.

    Article  Google Scholar 

  8. Wan, M., Wu, C., Wang, J., et al., Publ. Astron. Soc. Pac., 2016, vol. 128, p. 114501.

    Article  Google Scholar 

  9. Udalski, A., Acta Astron., 2003, vol. 53, p. 291.

    Google Scholar 

  10. Udalski, A., Szymanski, M.K., and Szymanski, G., Acta Astron., 2015, vol. 65, p. 1.

    Google Scholar 

  11. Feng, T., Du, Z., Sun, Y., et al., in Proc. 6th IEEE Int. Congress on Big Data, Honolulu, 2017.

  12. Lipton, Z.C., Berkowitz, J., and Elkan, C., A critical review of recurrent neural networks for sequence learning, 2015. arXiv 1506.00019.

  13. Farmer, J.D. and Sidorowich, J.J., “Predicting chaotic time series, Phys. Rev. Lett., 1987, vol. 59, p. 845.

    Article  MathSciNet  Google Scholar 

  14. Cho, K., van Merrienboer, B., Bahdanau, D., and Bengio, Y., “On the properties of neural machine translation: encoder-decoder approaches, Proc. 8th Workshop on Syntax, Semantics and Structure in Statistical Translation (SSST-8), Doha, 2014. arXiv: 1409.1259

  15. http://www.statisticshowto.com/akaikes-information-criterion.

  16. Meng Wan, An Application Research of Column store MonetDB database on GWAC Large-Scale Astronomical Data Management Chaoyang: Natl. Astron. Obs., Chin. Acad. Sci., 2016.

  17. https://en.wikipedia.org/wiki/Recurrent_neural_network.

  18. https://blog.csdn.net/lreaderl/article/details/78022724.

  19. MIT-BIHArrhythmiaDatabase. https://www.physionet.org/physiobank/database/mitdb/.

  20. Rajpurkar, P., Hannun, A.Y., Haghpanahi, M., Bourn, C., and Ng, A.Y., Cardiologist-level arrhythmia detection with convolutional neural networks, 2017. arXiv:1707.01836

Download references

ACKNOWLEDGMENTS

This research is supported in part by Key Research and Development Program of China (no. 2016YFB1000602), ”the Key Laboratory of Space Astronomy and Technology, National Astronomical Observatories, Chinese Academy of Sciences, Beijing ,100012, China,” National Natural Science Foundation of China (nos. 61440057, 61272087, 61363019 and 61073008, 11690023), MOE research center for online education foundation (no. 2016ZD302).

Author information

Authors and Affiliations

  1. Tsinghua University, Department of Computer Science and Technology Qinghua W Rd, Haidian, Beijing, China

    Y. Sun, Z. Zhao, X. Ma & Z. Du

Authors
  1. Y. Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Z. Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. X. Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Z. Du
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Z. Du.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, Y., Zhao, Z., Ma, X. et al. Hybrid Model for Efficient Anomaly Detection in Short-timescale GWAC Light Curves and Similar Datasets. Program Comput Soft 45, 600–610 (2019). https://doi.org/10.1134/S0361768819080176

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0361768819080176

Search

Navigation