Choosing a Case Base Maintenance Algorithm using a Meta-Case Base

  • Lisa Cummins
  • Derek Bridge
Conference paper


In Case-Based Reasoning (CBR), case base maintenance algorithms remove noisy or redundant cases from case bases. The best maintenance algorithm to use on a particular case base at a particular stage in a CBR system’s lifetime will vary. In this paper, we propose a meta-case-based classifier for selecting the best maintenance algorithm. The classifier takes in a description of a case base that is to undergo maintenance, and uses meta-cases—descriptions of case bases that have undergone maintenance—to predict the best maintenance algorithm. For describing case bases, we use measures of dataset complexity. We present the results of experiments that show the classifier can come close to selecting the best possible maintenance algorithms.


Case Base Pareto Front Complexity Measure Good Algorithm Feature Selection Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aha, D.W., Bankert, R.L.: A comparative evaluation of sequential feature selection algorithms. In: Procs. of the Fifth International Workshop on Artificial Intelligence and Statistics, pp. 1–7 (1994)Google Scholar
  2. 2.
    Bensusan, H., Giraud-Carrier, C., Kennedy, C.: A higher-order approach to meta-learning. In: Procs. of the Workshop on Meta-Learning at the European Conference on Machine Learning, pp. 109–117 (2000)Google Scholar
  3. 3.
    Brighton, H., Mellish, C.: On the consistency of information filters for lazy learning algorithms. In: J. Rauch, J. Zytkow (eds.) Proceedings of the Third European Conference on Principles of Data Mining and Knowledge Discovery, pp. 283–288. Springer-Verlag (1999)Google Scholar
  4. 4.
    Cummins, L.: Combining and choosing case base maintenance algorithms. Ph.D. thesis, Department of Computer Science, University College Cork, Ireland (2011 (forthcoming))Google Scholar
  5. 5.
    Cummins, L., Bridge, D.: Maintenance by a committee of experts: The MACE approach to case-base maintenance. In: L. McGinty, D.C. Wilson (eds.) Procs. of the 8th Intl. Conference on Case-Based Reasoning, pp. 120–134 (2009)Google Scholar
  6. 6.
    Delany, S., Cunningham, P.: An analysis of case-based editing in a spam filtering system. In: P. Funk, P. González-Calero (eds.) Procs. of the Seventh European Conference on Case-Based Reasoning, vol. LNAI 3155, pp. 128–141. Springer (2004)Google Scholar
  7. 7.
    Doyle, D., Cunningham, P., Bridge, D., Rahman, Y.: Explanation oriented retrieval. In: P. Funk, P. González-Calero (eds.) Procs. of the Seventh European Conference on Case-Based Reasoning, Lecture Notes in Artificial Intelligence, vol. 3155, pp. 157–168. Springer (2004)Google Scholar
  8. 8.
    Fornells, A., Recio-García, J., Díaz-Agudo, B., Golobardes, E., Fornells, E.: Integration of a methodology for cluster-based retrieval in jcolibri. In: L. McGinty, D.C. Wilson (eds.) Procs. of the Eighth International Conference on Case-Based Reasoning, vol. LNCS 5650, pp. 418–433. Springer (2009)Google Scholar
  9. 9.
    Fox, S., Leake, D.: Using introspective reasoning to refine indexing. In: C. Mellish (ed.) Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, pp. 391–397. IJCAI, Morgan Kaufmann, San Francisco, California (1995)Google Scholar
  10. 10.
    Frank, A., Asuncion, A.: UCI machine learning repository (2010). URL
  11. 11.
    Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. Journal of Machine Learning Research 3, 1157–1182 (2003)MATHGoogle Scholar
  12. 12.
    Ho, T.K., Basu, M.: Measuring the complexity of classification problems. In: Proceedings of the Fifteenth International Conference on Pattern Recognition, pp. 43–47 (2000)Google Scholar
  13. 13.
    Ho, T.K., Basu, M.: Complexity measures of supervised classification problems. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(3), 289–300 (2002)CrossRefGoogle Scholar
  14. 14.
    Leake, D.B., Kinley, A., Wilson, D.C.: Learning to improve case adaption by introspective reasoning and CBR. In: M.M. Veloso, A. Aamodt (eds.) Proceedings of the First International Conference on Case-Based Reasoning, Lecture Notes in Computer Science, vol. 1010. ICCBR, Springer, Heidelberg, Germany (1995)Google Scholar
  15. 15.
    Lindner, G., Studer, R.: AST: Support for algorithm selection with a CBR approach. In: Procs. of the 3rd European Conference on Principles and Practice of Knowledge Discovery in Databases, pp. 418–423 (1999)Google Scholar
  16. 16.
    Liu, H., Yu, L.: Toward integrating feature selection algorithms for classification and clustering. IEEE Transactions on Knowledge and Data Engineering 17, 491–502 (2005)CrossRefGoogle Scholar
  17. 17.
    Massie, S., Craw, S., Wiratunga, N.: Complexity profiling for informed case-base editing. In: T. Roth-Berghofer, M. Göker, H.A. Güvenir (eds.) Procs. of the Eighth European Conference on Case-Based Reasoning, pp. 325–339. Springer-Verlag (2006)Google Scholar
  18. 18.
    McKenna, E., Smyth, B.: Competence-guided case-base editing techniques. In: E. Blanzieri, L. Portinale (eds.) Proceedings of the Fifth European Workshop on Case-Based Reasoning, vol. LNCS 1898, pp. 186–197. Springer-Verlag (2000)Google Scholar
  19. 19.
    Orriols-Puig, A., Macià, N., Bernadó-Mansilla, E., Ho, T.K.: Documentation for the data complexity library in C++. Tech. Rep. GRSI Report No. 2009001, Universitat Ramon Llull (2009)Google Scholar
  20. 20.
    Peng, Y., Flach, P., Soares, C., Brazdil, P.: Improved data set characterisation for metalearning. In: Procs. of the 5th International Conference on Discovery Science, pp. 141–152 (2002)Google Scholar
  21. 21.
    Pfahringer, B., Bensusan, H., Giraud-Carrier, C.: Meta-learning by landmarking various learning algorithms. In: Procs. of the Seventeenth International Conference on Machine Learning, pp. 743–750 (2000)Google Scholar
  22. 22.
    Recio-García, J.A., Bridge, D., Díaz-Agudo, B., González-Calero, P.A.: CBR for CBR: A case-based template recommender system for building case-based systems. In: K.D. Althoff, R. Bergmann, M. Minor, A. Hanft (eds.) Procs. of the Ninth European Conference on Case- Based Reasoning, vol. LNCS 5239, pp. 459–473. Springer-Verlag (2008)Google Scholar
  23. 23.
    van Setten, M.: Supporting people in finding information: Hybrid recommender systems and goal-based structuring. Ph.D. thesis, University of Twente (2005)Google Scholar
  24. 24.
    Smyth, B., McKenna, E.: Modelling the competence of case-bases. In: B. Smyth, P. Cunningham (eds.) Procs. of the Fourth European Workshop on Advances in Case-Based Reasoning, vol. LNCS 1488, pp. 208–220. Springer (1998)Google Scholar
  25. 25.
    Stefik, M.: Planning and meta-planning (MOLGEN: Part 2). Artificial Intelligence 16(2), 141–170 (1981)CrossRefGoogle Scholar
  26. 26.
    Tomek, I.: An experiment with the edited nearest-neighbor rule. IEEE Transactions on Systems, Man, and Cybernetics 6(6), 448–452 (1976)MathSciNetMATHCrossRefGoogle Scholar
  27. 27.
    Wilensky, R.: Meta-planning: Representing and using knowledge about planning in problem solving and natural language understanding. Cognitive Science 5(3), 197–233 (1981)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  1. 1.Department of Computer ScienceUniversity College CorkCorkIreland

Personalised recommendations