RILL: Algorithm for Learning Rules from Streaming Data with Concept Drift

  • Magdalena Deckert
  • Jerzy Stefanowski
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8502)


Incremental learning of classification rules from data streams with concept drift is considered. We introduce a new algorithm RILL, which induces rules and single instances, uses bottom-up rule generalization based on nearest rules, and performs intensive pruning of the obtained rule set. Its experimental evaluation shows that it achieves better classification accuracy and memory usage than the related rule algorithm VFDR and it is also competitive to decision trees VFDT-NB.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aha, D.W., Kibler, D.: Instance-based learning algorithms. Machine Learning 6, 37–66 (1991)Google Scholar
  2. 2.
    Deckert, M.: Incremental Rule-based Learners for Handling Concept Drift: An Overview. Foundations of Computing and Decision Sciences 38(1), 35–65 (2013)CrossRefMathSciNetGoogle Scholar
  3. 3.
    Domingos, P., Hulten, G.: Mining high-speed data streams. In: Proceedings of the 6th ACM SIGKDD International Conference, KDD, pp. 71–80 (2000)Google Scholar
  4. 4.
    Ferrer-Troyano, F.J., Aguilar-Ruiz, J.A., Riquelme, J.C.: Data Streams Classification by Incremental Rule Learning with Parametrized Generalization. In: Proceedings of ACM Symposium on Applied Computing, SAC 2006, pp. 657–661. ACM (2006)Google Scholar
  5. 5.
    Fürnkranz, J., Gamberger, D., Lavrac, N.: Foundations of Rule Learning. Springer (2012)Google Scholar
  6. 6.
    Gama, J.: Knowledge Discovery from Data Streams. CRC Publishers (2010)Google Scholar
  7. 7.
    Gama, J., Kosina, P.: Learning Decision Rules from Data Streams. In: Proceedings of the 22th International Joint Conference on Artificial Intelligence, IJCAI 2011, vol. 2, pp. 1255–1260. AAAI Press (2011)Google Scholar
  8. 8.
    Kosina, P., Gama, J.: Handling time changing data with adaptive very fast decision rules. In: Proceedings of ECML/PKDD 2012, Bristol, United Kingdom, vol. 1, pp. 827–842 (2012)Google Scholar
  9. 9.
    Maloof, M.: Incremental Rule Learning with Partial Instance Memory for Changing Concepts. In: Proceedings of the International Joint Conference on Neural Networks, IJCNN 2003, vol. 4, pp. 2764–2769. IEEE Press (2003)Google Scholar
  10. 10.
    Napierala, K., Stefanowski, J.: BRACID: A comprehensive approach to learning rules from imbalanced data. Journal of Intelligent Information Systems 9(2), 335–373 (2012)CrossRefGoogle Scholar
  11. 11.
    Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Machine Learning 23, 69–101 (1996)Google Scholar
  12. 12.
    Wilson, D.R., Martinez, T.R.: Improved Heterogeneous Distance Functions. Journal of Artificial Intelligence Research 6(1), 1–34 (1997)zbMATHMathSciNetGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Magdalena Deckert
    • 1
  • Jerzy Stefanowski
    • 1
  1. 1.Institute of Computing SciencePoznań University of TechnologyPoznańPoland

Personalised recommendations