Skip to main content

Evaluating a Textual Adaptation System

  • Conference paper
  • First Online:
Case-Based Reasoning Research and Development (ICCBR 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9343))

Included in the following conference series:

  • 993 Accesses

Abstract

This paper presents a CBR method to retrieve and adapt processes represented as instruction texts, as well as the evaluation methodology that we developed to evaluate it. The evaluation process is user-based, blind and comparative. It is less labour intensive than most existing approaches and is more open to a variety of possible solutions to the same query, among other benefits. It also makes it possible to evaluate separately the textual adaptation process and the underlying formal adaptation process. Craqpot, a CBR system that adapts recipe texts, using a case-based process to extract domain knowledge on the fly, is presented and evaluated. We show that it generates recipes of good quality and texts of acceptable quality.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.wi2.uni-trier.de/shared/eccbr/ccc09/.

  2. 2.

    http://wikitaaable.loria.fr.

References

  1. Adeyanju, I., Wiratunga, N., Lothian, R., Sripada, S., Lamontagne, L.: Case retrieval reuse net (CR2N): an architecture for reuse of textual solutions. In: McGinty, L., Wilson, D.C. (eds.) ICCBR 2009. LNCS, vol. 5650, pp. 14–28. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  2. Alchourrón, C.E., Gärdenfors, P., Makinson, D.: On the logic of theory change: partial meet contraction and revision functions. J. Symbolic Logic 50(2), 510–530 (1985)

    Article  MathSciNet  MATH  Google Scholar 

  3. Allen, J.F.: Maintaining knowledge about temporal intervals. Commun. ACM 26(11), 832–843 (1983)

    Article  MATH  Google Scholar 

  4. Badra, F., Cojan, J., Cordier, A., Lieber, J., Meilender, T., Mille, A., Molli, P., Nauer, E., Napoli, A., Skaf-Molli, H., Toussaint, Y.: Knowledge acquisition and discovery for the textual case-based cooking system WikiTaaable. In: Delany, S.J. (ed.) ICCBR 2009 Workshop Proceedings, pp. 249–258 (2009)

    Google Scholar 

  5. Brill, E.: A simple rule-based part of speech tagger. In: Workshop on Speech and Natural Language, Association for Computational Linguistics, pp. 112–116 (1992)

    Google Scholar 

  6. Cojan, J., Lieber, J.: Applying belief revision to case-based reasoning. In: Prade, H., Richard, G. (eds.) Computational Approaches to Analogical Reasoning: Current Trends, pp. 133–161. Springer, Heidelberg (2014)

    Chapter  Google Scholar 

  7. Cordier, A., Dufour-Lussier, V., Lieber, J., Nauer, E., Badra, F., Cojan, J., Gaillard, E., Infante-Blanco, L., Molli, P., Napoli, A., Skaf-Molli, H.: Taaable: a case-based system for personalized Cooking. Studies in Computational Intelligence. In: Successful Case-based Reasoning Applications. Springer, Heidelberg (2013, in press)

    Google Scholar 

  8. Dojat, M., Ramaux, N., Fontaine, D.: Scenario recognition for temporal reasoning in medical domains. Artif. Intell. Med. 14(1–2), 139–155 (1998). Selected Papers from AIME 1997

    Article  Google Scholar 

  9. Dufour-Lussier, V.: Spatial-temporal qualitative reasoning from textual cases. Ph.D. thesis, Université de Lorraine (2014)

    Google Scholar 

  10. Dufour-Lussier, V., Le Ber, F., Lieber, J., Martin, L.: Adapting spatial and temporal cases. In: Agudo, B.D., Watson, I. (eds.) ICCBR 2012. LNCS, vol. 7466, pp. 77–91. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  11. Dufour-Lussier, V., Le Ber, F., Lieber, J., Nauer, E.: Automatic case acquisition from texts for process-oriented case-based reasoning. Inf. Syst. 40, 153–167 (2014)

    Article  Google Scholar 

  12. Gaillard, E., Infante-Blanco, L., Lieber, J., Nauer, E.: Tuuurbine: a generic CBR engine over RDFS. In: Lamontagne, L., Plaza, E. (eds.) ICCBR 2014. LNCS, vol. 8765, pp. 140–154. Springer, Heidelberg (2014)

    Google Scholar 

  13. Gervás, P., Hervás, R., Recio-García, J.A.: The role of natural language generation during adaptation in textual CBR. In: 4th Workshop on Textual Case-Based Reasoning: Beyond Retrieval (ICCBR 2007), pp. 227–235 (2007)

    Google Scholar 

  14. Lamontagne, L., Lee, H.-H.: Textual reuse for email response. In: Funk, P., González Calero, P.A. (eds.) ECCBR 2004. LNCS (LNAI), vol. 3155, pp. 242–256. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  15. Ma, J., Knight, B.: A framework for historical case-based reasoning. In: Ashley, K.D., Bridge, D.G. (eds.) Case-Based Reasoning Research and Development. LNCS, vol. 2689, pp. 246–260. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  16. Minor, M., Bergmann, R., Görg, S., Walter, K.: Towards case-based adaptation of workflows. In: Bichindaritz, I., Montani, S. (eds.) ICCBR 2010. LNCS, vol. 6176, pp. 421–435. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  17. Minor, M., Islam, M.S., Schumacher, P.: Confidence in workflow adaptation. In: Agudo, B.D., Watson, I. (eds.) ICCBR 2012. LNCS, vol. 7466, pp. 255–268. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  18. Recio-García, J.A., Minor, M., Montani, S.: Process-oriented case-based reasoning. Inf. Syst. 40, 103–105 (2014)

    Article  Google Scholar 

  19. Minor, M., Schmalen, D., Bergmann, R.: XML-based representation of agile workflows. In: Bichler, M., Hess, T., Krcmar, H., Lechner, U., Matthes, F., Picot, A., Speitkamp, B., Wolf, P. (eds.) Multikonferenz Wirtschaftsinformatik, pp. 439–440. GITO, Berlin (2008)

    Google Scholar 

  20. Müller, G., Bergmann, R.: Workflow streams: a means for compositional adaptation in process-oriented CBR. In: Lamontagne, L., Plaza, E. (eds.) ICCBR 2014. LNCS, vol. 8765, pp. 315–329. Springer, Heidelberg (2014)

    Google Scholar 

  21. Newo, R., Bach, K., Hanft, A., Althoff, K.D.: On-demand recipe processing based on CBR. In: ICCBR 2010 Workshop Proceedings, pp.209–218 (2010)

    Google Scholar 

  22. Pujari, A.K., Kumari, G.V., Sattar, A.: INDU: an interval & duration network. In: Foo, N. (ed.) Advanced Topics in Artificial Intelligence. Lecture Notes in Computer Science, vol. 1747, pp. 291–303. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  23. Schumacher, P., Minor, M., Schulte-Zurhausen, E.: On the use of anaphora resolution for workflow extraction. In: Bouabana-Tebibel, T., Rubin, S.H. (eds.) Integration of Reusable Systems. Advances in Intelligent Systems and Computing, vol. 263, pp. 151–170. Springer, Cham (2014)

    Chapter  Google Scholar 

  24. Smyth, B., Keane, M.T.: Adaptation-guided retrieval: questioning the similarity assumption in reasoning. Artif. Intell. 102(2), 249–293 (1998)

    Article  MATH  Google Scholar 

  25. Sánchez-Marré, M., Cortés, U., Martínez, M., Comas, J., Rodríguez-Roda, I.: An approach for temporal case-based reasoning: episode-based reasoning. In: Muñoz-Ávila, H., Ricci, F. (eds.) ICCBR 2005. LNCS (LNAI), vol. 3620, pp. 465–476. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  26. Weber, R.O., Ashley, K.D., Brüninghaus, S.: Textual case-based reasoning. Knowl. Eng. Rev. 20(3), 255–260 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Valmi Dufour-Lussier .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Dufour-Lussier, V., Lieber, J. (2015). Evaluating a Textual Adaptation System. In: Hüllermeier, E., Minor, M. (eds) Case-Based Reasoning Research and Development. ICCBR 2015. Lecture Notes in Computer Science(), vol 9343. Springer, Cham. https://doi.org/10.1007/978-3-319-24586-7_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-24586-7_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24585-0

  • Online ISBN: 978-3-319-24586-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics