Comparison of Long-Term Adaptivity for Neural Networks

  • Frank-Florian Steege
  • Horst-Michael Groß
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7553)


Neural Networks can be used for the prognosis of important quality measures in industrial processes to complement or reduce costly laboratory analysis. Problems occur if the system dynamics change over time (concept drift). We survey different approaches to handle concept drift and to ensure good prognosis quality over long time ranges. Two main approaches - data accumulation and ensemble learning - are explained and implemented. We compare the concepts on artificial datasets and on industrial data from three cement production plants and analyse strengths and weaknesses of different approaches.


Neural Network Concept Drift Incremental Learning Long Term Learning 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Agachi, P.S., Nagy, Z.K., Cristea, M.V., Imre-Lucaci, A.: Model based control: Case Studies in Process Engineering. Wiley-VCH (2006)Google Scholar
  2. 2.
    Tsymbal, A.: The problem of concept drift: Definitions and related work. Technical Report, Department of Computer Science, Trinity College: Dublin, Ireland (2004)Google Scholar
  3. 3.
    Alsop, P.A.: The Cement Plant Operations Handbook, 5th edn. Tradeship Publications Ltd. (2007)Google Scholar
  4. 4.
    McCloskey, M., Cohen, N.: Catastrophic interference in connectionist networks: The sequential learning problem. Psychology of Learning and Motivation 24, 109–164 (1989)CrossRefGoogle Scholar
  5. 5.
    Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden context. Machine Learning 23(1), 69–101 (1996)Google Scholar
  6. 6.
    Pérez-Sánchez, B., Fontenla-Romero, O., Guijarro-Berdiñas, B.: An incremental learning method for neural networks in adaptive environments. In: Int. Joint Conf. on Neural Networks (IJCNN 2010), pp. 1–8 (2010)Google Scholar
  7. 7.
    Elwell, R., Polikar, R.: Incremental Learning of Concept Drift in Nonstationary Environments. IEEE Transactions on Neural Networks 22(10), 1517–1531 (2011)CrossRefGoogle Scholar
  8. 8.
    Kolter, J.Z., Maloof, M.A.: Dynamic weighted majority: A new ensemble method for tracking concept drift. In: Proc. IEEE Int. Conf. on Data Mining (ICDM 2003), pp. 123–130 (2003)Google Scholar
  9. 9.
    He, H.: Self-Adaptive Systems for Machine Intelligence. John Wiley & Sons (2011)Google Scholar
  10. 10.
    Kirstein, S., Wersing, H., Gross, H.-M., Koerner, E.: A life-long learning vector quantization approach for interactive learning of multiple categories. Neural Networks 28, 90–105 (2012)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Frank-Florian Steege
    • 1
    • 2
  • Horst-Michael Groß
    • 1
  1. 1.Neuroinformatics and Cognitive Robotics LabIlmenau Technical UniversityIlmenauGermany
  2. 2.Powitec Intelligent Technologies GmbHEssen-KettwigGermany

Personalised recommendations