Skip to main content

Case-Based Reasoning and the Statistical Challenges II

  • Conference paper

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 242))

Abstract

Case-based reasoning (CBR) solves problems using the already stored knowledge, and captures new knowledge, making it immediately available for solving the next problem. Therefore, CBR can be seen as a method for problem solving, and also as a method to capture new experience and make it immediately available for problem solving. The CBR paradigm has been originally introduced by the cognitive science community. The CBR community aims to develop computer models that follow this cognitive process. Up to now many successful computer systems have been established on the CBR paradigm for a wide range of real-world problems. We will review in this paper the CBR process and the main topics within the CBR work. Hereby we try bridging between the concepts developed within the CBR community and the statistics community. The CBR topics we describe are: similarity, memory organization,CBR learning, and case-base maintenance. The incremental aspect arising with the CBR paradigm will be considered as well as the life-time aspect of a CBR system. We will point out open problems within CBR that need to be solved. Finally we show on application how the CBR paradigm can be applied. The applications we are focusing on are meta-learning for parameter selection in technical systems, image interpretation, incremental prototype-based classification and novelty detection and handling. Finally, we summarize our concept on CBR.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aha, D.W., Kibler, D., Albert, M.K.: Instance-based learning algorithm. Machine Learning 6(1), 37–66 (1991)

    Google Scholar 

  2. Ahmed, M.U., Begum, S., Funk, P.: An overview of three medical application using hybrid case-based reasoning. In: Bichindaritz, I., Perner, P., Ruß, G., Schmidt, R. (eds.) Proceedings of the Industrial Conference on Advances in Data Mining (ICDM 2012), Workshop Case-Based Reasoning, pp. 79–94 (2012)

    Google Scholar 

  3. Althoff, K.D.: Case-based reasoning. In: Chang, S.K. (ed.) Handbook of Software Engineering and Knowledge Engineering, Fundamentals, vol. 1, pp. 549–588. World Scientific (2001)

    Google Scholar 

  4. Attig, A., Perner, P.: The problem of normalization and a normalized similarity measure by online data. Transactions on Case-Based Reasoning 4(1), 3–17 (2011)

    Google Scholar 

  5. Bagherjeiran, A., Eick, C.F.: Distance function learning for supervised similarity assesment. In: Perner, P. (ed.) Case-Based Reasoning on Images and Signals. SCI, vol. 73, pp. 91–126. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  6. Bellazzi, R., Montani, S., Portinale, L.: Retrieval in a prototype-based case-library: A case study in diabetes therapy revision. In: Smyth, B., Cunningham, P. (eds.) EWCBR 1998. LNCS (LNAI), vol. 1488, pp. 64–75. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  7. Bentley, J.L.: Multidimensional binary search trees used for associative searching. Communication of the ACM 18(9), 509–517 (1975)

    Article  MathSciNet  MATH  Google Scholar 

  8. Bergmann, R., Richter, M.M., Schmitt, S., Stahl, A., Vollrath, I.: Utility-oriented matching: A new research direction for case-based reasoning. In: Schnurr, H.P., et al. (eds.) Professionelles Wissensmanagement, pp. 20–30. Shaker-Verlag (2001)

    Google Scholar 

  9. Bergmann, R., Wilke, W.: On the role of abstraction in case-based reasoning. In: Smith, I., Faltings, B. (eds.) EWCBR 1996. LNCS, vol. 1168, pp. 28–43. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  10. Bhanu, B., Dong, A.: Concepts learning with fuzzy clustering and relevance feedback. In: Perner, P. (ed.) MLDM 2001. LNCS (LNAI), vol. 2123, pp. 102–116. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  11. Bichindaritz, I.: Memory structures and organization in case-based reasoning. In: Perner, P. (ed.) Case-Based Reasoning on Images and Signals. SCI, vol. 73, pp. 175–194. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  12. Bichindaritz, I., Kansu, E., Sullivan, K.M.: Case-based reasoning in care-partner: Gathering evidence for evidence-based medical practice. In: Smyth, B., Cunningham, P. (eds.) EWCBR 1998. LNCS (LNAI), vol. 1488, pp. 334–345. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  13. Bobrowski, L., Topczewska, M.: Improving the K-NN classification with the euclidean distance through linear data transformations. In: Perner, P. (ed.) ICDM 2004. LNCS (LNAI), vol. 3275, pp. 23–32. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  14. Branting, L.K.: Integrating generalizations with exemplar-based reasoning. In: Proceedings of the 11th Annual Conference of the Cognitive Science Society, pp. 129–146. Lawrence Erlbaum (1989)

    Google Scholar 

  15. Commentaries, C.C.: The Knowledge Engineering Review 20(3) (2005)

    Google Scholar 

  16. Craw, S.: Introspective learning to build case-based reasoning (CBR) knowledge containers. In: Perner, P., Rosenfeld, A. (eds.) MLDM 2003. LNCS (LNAI), vol. 2734, pp. 1–6. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  17. Cunningham, P.: A taxonomy of similarity mechanisms for case-based reasoning. IEEE Transactions on Knowledge and Data Engineering 21(11), 1532–1543 (2009)

    Article  Google Scholar 

  18. Dingsoyr, T.: A lifecycle process for experience databases. In: Schmitt, S., Vollrath, I. (eds.) Challenges for Case-Based Reasoning - Proceedings of the ICCBR 1999 Workshops, pp. 9–14 (1999)

    Google Scholar 

  19. Fayyad, U.M., Piatesky-Shapiro, G., Smyth, P., Utuhrusamy, R. (eds.): Advance in Knowledge Discovery and Data Mining. AAAI Press (1996)

    Google Scholar 

  20. Fisher, D.H.: Knowledge acquisition via incremental conceptual clustering. Machine Learning 2(2), 139–172 (1987)

    Google Scholar 

  21. Fiss, P.: Data Reduction Methods for Industrial Robots with Direct Teach-In Programming, Diss A. Technical University Mittweida (1985)

    Google Scholar 

  22. Frucci, M., Perner, P., Sanniti di Baja, G.: Case-based reasoning for image segmentation by watershed transformation. In: Perner, P. (ed.) Case-Based Reasoning on Signals and Images. SCI, vol. 73, pp. 319–353. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  23. Gupta, K.M., Aha, D.W., Moore, P.: Case-based collective inference for maritime object classification. In: McGinty, L., Wilson, D.C. (eds.) ICCBR 2009. LNCS (LNAI), vol. 5650, pp. 434–449. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  24. Hegazy, O.M., Hemeida, I.H., Eldein, M.N., Elhusseiny, J.: Similarity assessment mechanism for spatiotemporal data sets in case-based reasoning. In: Bichindaritz, I., Perner, P., Ruß, G., Schmidt, R. (eds.) Proceedings of the Industrial Conference on Advances in Data Mining (ICDM 2012), Workshop on Case-Based Reasoning, pp. 62–78 (2012)

    Google Scholar 

  25. Holt, A., Bichindaritz, I., Schmidt, R., Perner, P.: Medical applications in case-based reasoning. The Knowledge Engineering Review 20(3), 289–292 (2005)

    Article  Google Scholar 

  26. Iglezakis, I., Reinartz, T., Roth-Berghofer, T.R.: Maintenance memories: Beyond concepts and techniques for case base maintenance. In: Funk, P., González Calero, P.A. (eds.) ECCBR 2004. LNCS (LNAI), vol. 3155, pp. 227–241. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  27. Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Prentice Hall, Inc., Upper Saddle River (1988)

    MATH  Google Scholar 

  28. Jänichen, S., Perner, P.: Conceptual clustering and case generalization of two dimensional forms. Computational Intelligence 22(3-4), 177–193 (2006)

    Article  MathSciNet  Google Scholar 

  29. Law, Y.N., Zaniolo, C.: An adaptive nearest neighbor classification algorithm for data streams. In: Jorge, A.M., Torgo, L., Brazdil, P.B., Camacho, R., Gama, J. (eds.) PKDD 2005. LNCS (LNAI), vol. 3721, pp. 108–120. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  30. Little, S., Colantonio, S., Salvetti, O., Perner, P.: Evaluation of feature subset selection, feature weighting, and prototype selection for biomedical applications. Journal of Software Engineering & Applications 3(1), 39–49 (2010)

    Article  Google Scholar 

  31. Lopez De Mantaras, R., Cunningham, P., Perner, P.: Emergent case-based reasoning applications. The Knowledge Engineering Review 20(3), 325–328 (2005)

    Article  Google Scholar 

  32. Markou, M., Singh, S.: Novelty detection: A review — part 1: Statistical approaches. Signal Processing 83(12), 2481–2497 (2003)

    Article  MATH  Google Scholar 

  33. Minor, M., Hanft, A.: Cases with a life-cycle. In: Schmitt, S., Vollrath, I. (eds.) Challenges for Case-Based Reasoning - Proceedings of the ICCBR 1999 Workshops, pp. 3–8. University of Kaiserslautern, Computer Science (1999)

    Google Scholar 

  34. Minor, M., Hanft, A.: The life cycle of test cases in a CBR system. In: Blanzieri, E., Portinale, L. (eds.) EWCBR 2000. LNCS (LNAI), vol. 1898, pp. 455–466. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  35. Nilsson, M., Funk, P.: A case-based classification of respiratory sinus arrhythmia. In: Funk, P., González Calero, P.A. (eds.) ECCBR 2004. LNCS (LNAI), vol. 3155, pp. 673–685. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  36. Pękalska, E., Duin, R.P.W.: The Dissimilarity Representation for Pattern Recognition. World Scientific (2005)

    Google Scholar 

  37. Perner, J., Zotenko, E.: Characterizing cell types through differentially expressed gene clusters using a model-based approach. Transactions on Case-Based Reasoning 4(1), 3–17 (2011)

    Google Scholar 

  38. Perner, P.: An architecture for a CBR image segmentation system. Engineering Application in Artificial Intelligence 12(6), 749–759 (1999)

    Article  Google Scholar 

  39. Perner, P.: Using CBR learning for the low-level and high-level unit of a image interpretation system. In: Singh, S. (ed.) Proceedings of the International Conference on Advances in Pattern Recognition (ICAPR 1998), pp. 45–54. Springer (1999)

    Google Scholar 

  40. Perner, P.: Why case-based reasoning is attractive for image interpretation. In: Aha, D.W., Watson, I. (eds.) ICCBR 2001. LNCS (LNAI), vol. 2080, pp. 27–43. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  41. Perner, P.: Case-base maintenance by conceptual clustering of graphs. Engineering Applications of Artificial Intelligence 19(4), 381–393 (2006)

    Article  Google Scholar 

  42. Perner, P.: Concepts for novelty detection and handling based on a case-based reasoning scheme. In: Perner, P. (ed.) ICDM 2007. LNCS (LNAI), vol. 4597, pp. 21–33. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  43. Perner, P.: Case-based reasoning and the statistical challenges. Quality and Reliability Engineering International 24(6), 705–720 (2008)

    Article  Google Scholar 

  44. Perner, P.: Prototype-based classification. Applied Intelligence 28(3), 238–246 (2008)

    Article  Google Scholar 

  45. Perner, P.: Incremental normalization for CBR. Transactions on Case-Based Reasoning 5(1), 35–50 (2012)

    Google Scholar 

  46. Perner, P.: Improving prototype-based classification by fitting the similarity. In: Proceedings of ISA International Conference Intelligent Systems and Agents (2013)

    Google Scholar 

  47. Perner, P. (ed.): Machine Learning, Software Engineering, and Standardization. Ibai-Publishing (2013)

    Google Scholar 

  48. Perner, P., Attig, A., Machnow, O.: A novel method for the interpretation of spectrometer signals based on delta-modulation and similarity determination. Transactions on Mass-Data Analysis of Images and Signals 3(1), 3–14 (2011)

    Google Scholar 

  49. Perner, P., Holt, A., Richter, M.: Image processing in case-based reasoning. The Knowledge Engineering Review 20(3), 311–314 (2005)

    Article  Google Scholar 

  50. Perner, P., Perner, H., Müller, B.: Similarity guided learning of the case description and improvement of the system performance in an image classification system. In: Craw, S., Preece, A.D. (eds.) ECCBR 2002. LNCS (LNAI), vol. 2416, pp. 604–612. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  51. Richter, M.M.: Introduction. In: Lenz, M., Bartsch-Spörl, B., Burkhard, H.-D., Wess, S. (eds.) Case-Based Reasoning Technology. LNCS (LNAI), vol. 1400, pp. 1–16. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  52. Richter, M.M.: Similarity. In: Perner, P. (ed.) Case-Based Reasoning on Images and Signals. SCI, vol. 73, pp. 1–21. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  53. Sankoff, D., Kruskal, J. (eds.): Time warps, string edits, and macromolecules: the theory and practice of sequence comparison. Addison-Wesley, Readings (1983)

    Google Scholar 

  54. Schank, R.C.: Dynamic Memory: A theory of reminding and learning in computers and people. Cambridge University Press, Cambridge (1983)

    Google Scholar 

  55. Schmidt, R., Gierl, L.: Temporal abstractions and case-based reasoning for medical course data: Two prognostic applications. In: Perner, P. (ed.) MLDM 2001. LNCS (LNAI), vol. 2123, pp. 23–34. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  56. Shapiro, L.G., Atmosukarto, I., Cho, H., Lin, H.J., Ruiz-Correa, S.: Similarity-based retrieval for biomedical applications. In: Perner, P. (ed.) Case-Based Reasoning on Signals and Images. SCI, vol. 73, pp. 355–388. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  57. Smith, E.E., Medin, D.L.: Categories and Concepts. Havard University Press (1981)

    Google Scholar 

  58. Smith, L.B.: From global similarities to kinds of similarities: the construction of dimensions in development. In: Vosniadou, S., Ortony, A. (eds.) Similarity and Analogical Reasoning, pp. 146–178. Cambridge University Press, New York (1989)

    Chapter  Google Scholar 

  59. Soares, C., Brazdil, P.B., Kuba, P.: A meta-learning method to select the kernel width in support vector regression. Machine Learning 54(3), 195–209 (2004)

    Article  MATH  Google Scholar 

  60. Song, X., Petrovic, S., Sundar, S.: A case-based reasoning approach to dose planning in radiotherapy. In: Wilson, D.C., Khemani, D. (eds.) Worshop Proceedings of the 7th International Conference on Case-Based Reasoning (ICCBR 2007), pp. 348–357 (2007)

    Google Scholar 

  61. Stahl, A.: Learning feature weights from case order feedback. In: Aha, D.W., Watson, I. (eds.) ICCBR 2001. LNCS (LNAI), vol. 2080, pp. 502–516. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  62. Vuori, V., Laaksonen, I., Oja, E., Kangas, J.: Experiments with adaptation strategies for a prototype-based recognition system for isolated handwritten characters. International Journal on Document Analysis and Recognition 3(3), 150–159 (2001)

    Article  Google Scholar 

  63. Wallace, C.S.: Statistical and Inductive Inference by Minimum Message Length. Information Science and Statistics. Springer(2005)

    Google Scholar 

  64. Weihs, C., Ligges, U., Mörchen, F., Müllensiefen, D.: Classification in music research. Advances in Data Analysis and Classification 1(3), 255–291 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  65. Wess, S., Althoff, K.D., Derwand, G.: Using k-d trees to improve the retrieval step in case-based reasoning. In: Wess, S., Althoff, K.-D., Richter, M.M. (eds.) EWCBR 1993. LNCS, vol. 837, pp. 167–182. Springer, Heidelberg (1994)

    Chapter  Google Scholar 

  66. Wess, S., Globig, C.: Case-based and symbolic classification. In: Wess, S., Althoff, K.-D., Richter, M.M. (eds.) EWCBR 1993. LNCS, vol. 837, pp. 77–91. Springer, Heidelberg (1994)

    Chapter  Google Scholar 

  67. Wettschereck, D., Aha, D.W., Mohri, T.: A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artificial Intelligence Review 11(1-5), 273–314 (1997)

    Article  Google Scholar 

  68. Wilson, D.C., O’Sullivan, D.: Medical imagery in case-based reasoning. In: Perner, P. (ed.) Case-Based Reasoning on Images and Signals. SCI, vol. 73, pp. 389–418. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  69. Wilson, D.R., Martinez, T.R.: Improved heterogeneous distance functions. Journal of Artificial Intelligence Research 6(1), 1–34 (1997)

    MathSciNet  MATH  Google Scholar 

  70. Wunsch, G.: Systemtheorie der Informationstechnik. Akademische Verlagsgesellschaft, Leipzig (1971)

    Google Scholar 

  71. Xiong, N., Funk, P.: Building similarity metrics reflecting utility in case-based reasoning. Journal of Intelligent & Fuzzy Systems 17(4), 407–416 (2006)

    MATH  Google Scholar 

  72. Zhang, L., Coenen, F., Leng, P.: Formalising optimal feature weight settings in case-based diagnosis as linear programming problems. Knowledge-Based Systems 15(7), 391–398 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Petra Perner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Perner, P. (2014). Case-Based Reasoning and the Statistical Challenges II. In: Gruca, D., Czachórski, T., Kozielski, S. (eds) Man-Machine Interactions 3. Advances in Intelligent Systems and Computing, vol 242. Springer, Cham. https://doi.org/10.1007/978-3-319-02309-0_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02309-0_2

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02308-3

  • Online ISBN: 978-3-319-02309-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics