Enhancing case-based regression with automatically-generated ensembles of adaptations
- 204 Downloads
Instance-based methods have been successfully applied to numerical prediction (regression) tasks in many domains. Such methods often rely on a simple combination function to generate a prediction from past instances. Case-based reasoning for regression adds a richer case adaptation step to adjust prior solutions to fit new problems. This article presents a new approach to case adaptation for case-based regression systems, based on applying an ensemble of case adaptation rules generated automatically from pairs of cases in the case base, using the case difference heuristic. It evaluates the method’s performance, considering in particular the effects of using local versus global case information to generate adaptation rules from the case base. Experimental results support that the proposed method generally outperforms baselines and that the accuracy of adaptation based on locally-generated rules is highly competitive with that of global rule-generation methods considering many more cases.
KeywordsAdaptation rule generation Adaptation rule ranking Case-based regression Ensemble of adaptation rules
This article is adapted and extended from Jalali and Leake (2013b).
- Aha, D., Kibler, D., & Albert, M. (1991). Instance-based learning algorithms. Machine Learning, 6(1), 37–66.Google Scholar
- Arshadi, N., & Jurisica, I. (2005). An ensemble of case-based classifiers for high-dimensional biological domains. In Proceedings of the sixth international conference on case-based resoning. ICCBR’05 (pp. 21–34). Berlin: Springer Verlag.Google Scholar
- Bay, S.D. (1998). Combining nearest neighbor classifiers through multiple feature subsets. In Proc. 15th international conf. on machine learning (pp. 37–45).Google Scholar
- Craw, S., Jarmulak, J., & Rowe, R. (2001). Learning and applying case-based adaptation knowledge. In Aha, D., & Watson, I. (Eds.) Proceedings of the fourth international conference on case-based reasoning (pp. 131–145). Berlin: Springer Verlag.Google Scholar
- Cunningham, P., & Zenobi, G. (2001). Case representation issues for case-based reasoning from ensemble research. In Case-based reasoning research and development: proceedings of the fourth international conference on case-based reasoning. Berlin: Springer Verlag.Google Scholar
- Frank, A., & Asuncion, A. (2010). UCI machine learning repository. http://archive.ics.uci.edu/ml.
- Hanney, K., & Keane, M. (1997). The adaptation knowledge bottleneck: How to ease it by learning from cases. In Proceedings of the Second International Conference on Case-Based Reasoning (pp. 359–370). Berlin: Springer Verlag.Google Scholar
- Jalali, V., & Leake, D. (2014a). Adaptation-guided case base maintenance. In Proceedings of the twenty-eighth conference on artificial intelligence (pp. 1875–1881). AAAI Press.Google Scholar
- Jalali, V., & Leake, D. (2014b). An ensemble approach to adaptation-guided retrieval. In Proceedings of the 2014 Florida AI research symposium (pp. 295–300). AAAI Press.Google Scholar
- Jalali, V., & Leake, D. (2014c). On retention of adaptation rules. In Case-based reasoning research and development, ICCBR (p. 2014). Berlin: Springer.Google Scholar
- Jarmulak, J., Craw, S., & Rowe, R. (2001). Using case-base data c for design. In Proceedings of the 17th international joint conference on artificial intelligence - Volume 2. IJCAI’01 (pp. 1011–1016). San Francisco: Morgan Kaufmann Publishers Inc.Google Scholar
- Kolodner, J., & Leake, D. (1996). A tutorial introduction to case-based reasoning. In Leake, D. (Ed.) Case-based reasoning: experiences, lessons, and future directions (pp. 31–65). Menlo Park: AAAI Press.Google Scholar
- López de Mántaras, R., McSherry, D., Bridge, D., Leake, D., Smyth, B., Craw, S., Faltings, B., Maher, M., Cox, M., Forbus, K., Keane, M., Aamodt, A., & Watson, I. (2005). Retrieval, reuse, revision, and retention in CBR. Knowledge Engineering Review, 20(3).Google Scholar
- McDonnell, N., & Cunningham, P. (2006). A knowledge-light approach to regression using case-based reasoning. In Proceedings of the 8th European conference on case-based reasoning. ECCBR’06 (pp. 91–105). Berlin: Springer-Verlag.Google Scholar
- Patterson, D., Rooney, N., & Galushka, M. (2002). A regression based adaptation strategy for case-based reasoning. In Proceedings of the eighteenth annual national conference on artificial intelligence (pp. 87–92): AAAI Press.Google Scholar
- Schapire, R.E. (1990). The strength of weak learnability. Machine Learning, 5 (2), 197–227.Google Scholar
- Wilke, W., Vollrath, I., Althoff, K.D., & Bergmann, R. (1997). A framework for learning adaptation knowledge based on knowledge light approaches. In Proceedings of the fifth german workshop on case-based reasoning (pp. 235–242).Google Scholar