Handling Concept Drift in Time-Series Data: Meta-cognitive Recurrent Recursive-Kernel OS-ELM

  • Zongying Liu
  • Chu Kiong Loo
  • Kitsuchart PasupaEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11306)


This paper proposes a meta-cognitive recurrent multi-step-prediction model called Meta-cognitive Recurrent Recursive Kernel Online Sequential Extreme Learning Machine with a new modified Drift Detector Mechanism (Meta-RRKOS-ELM-DDM). This model combines the strengths of Recurrent Kernel Online Sequential Extreme Learning Machine (RKOS-ELM) with the recursive kernel method and a new meta-cognitive learning strategy. We apply Drift Detector Mechanism to solve concept drift problem. Recursive kernel method successfully replaces the normal kernel method in RKOS-ELM and generates a fixed reservoir with optimised information. The new meta-cognitive learning strategy can reduce the computational complexity. The experimental results show that Meta-RRKOS-ELM-DDM has a superior prediction ability in different predicting horizons than the others.


Time series Recursive kernel Recurrent Kernel Adaptive Filter Concept drift Meta-cognitive learning 



The authors would like to express special thanks of gratitude to UM Grand Challenge from the University of Malaya under Grant GC003A-14HTM, FRGS grant from MOHE FP069-2015A, and the Thailand Research Fund under grant agreement No. TRG5680090 which support our research.


  1. 1.
    Kaur, T., Kumar, S., Segal, R.: Application of artificial neural network for short term wind speed forecasting. In: Proceedings of 2016 Biennial International Conference on Power and Energy Systems: Towards Sustainable Energy, pp. 1–5 (2016)Google Scholar
  2. 2.
    Pradeepkumar, D., Ravi, V.: Forecasting financial time series volatility using particle swarm optimization trained quantile regression neural network. Appl. Soft Comput. 58, 35–52 (2017)CrossRefGoogle Scholar
  3. 3.
    Scardapane, S., Comminiello, D., Scarpiniti, M., Uncini, A.: Online sequential extreme learning machine with kernels. IEEE Trans. Neural Netw. Learn. Syst. 26(9), 2214–2220 (2015)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Hammoodi, M., Stahl, F., Tennant, M.: Towards online concept drift detection with feature selection for data stream classification. In: Proceedings of the 22nd European Conference on Artificial Intelligence (2016)Google Scholar
  5. 5.
    Dehghan, M., Beigy, H., ZareMoodi, P.: A novel concept drift detection method in data streams using ensemble classifiers. Intell. Data Anal. 20(6), 1329–1350 (2016)CrossRefGoogle Scholar
  6. 6.
    Kulkarni, P., Ade, R.: Logistic regression learning model for handling concept drift with unbalanced data in credit card fraud detection system. In: Satapathy, S.C., Raju, K.S., Mandal, J.K., Bhateja, V. (eds.) Proceedings of the Second International Conference on Computer and Communication Technologies. AISC, vol. 380, pp. 681–689. Springer, New Delhi (2016). Scholar
  7. 7.
    Liu, Z., Loo, C.K., Masuyama, N., Pasupa, K.: Multiple steps time series prediction by a novel recurrent kernel extreme learning machine approach. In: Proceeding of the 9th International Conference on Information Technology and Electrical Engineering, p. SIG5.5 (2017)Google Scholar
  8. 8.
    Liu, Z., Loo, C.K., Masuyama, N., Pasupa, K.: Recurrent kernel extreme reservoir machine for time series prediction. IEEE Access 6, 19583–19596 (2018)CrossRefGoogle Scholar
  9. 9.
    Gonçalves, P.M., de Carvalho Santos, S.G., Barros, R.S., Vieira, D.C.: A comparative study on concept drift detectors. Expert Syst. Appl. 41(18), 8144–8156 (2014)CrossRefGoogle Scholar
  10. 10.
    Gama, J., Medas, P., Castillo, G., Rodrigues, P.: Learning with drift detection. In: Bazzan, A.L.C., Labidi, S. (eds.) SBIA 2004. LNCS (LNAI), vol. 3171, pp. 286–295. Springer, Heidelberg (2004). Scholar
  11. 11.
    Hermans, M.: Expanding the theoretical framework of reservoir computing. Ph.D. thesis, Ghent University (2012)Google Scholar
  12. 12.
    Yahoo: Shanghai stock exchange (2017).
  13. 13.
    Ministry of the Environment and Climate Change in Ontario: Air pollutant data (2000).

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Zongying Liu
    • 1
  • Chu Kiong Loo
    • 1
  • Kitsuchart Pasupa
    • 2
    Email author
  1. 1.Faculty of Computer Science and Information TechnologyUniversity of MalayaKuala LumpurMalaysia
  2. 2.Faculty of Information TechnologyKing Mongkut’s Institute of Technology LadkrabangBangkokThailand

Personalised recommendations