Skip to main content

Evaluating the Premises and Results of Four Metaphor Identification Systems

  • Conference paper
Computational Linguistics and Intelligent Text Processing (CICLing 2013)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7816))

Abstract

This study first examines the implicit and explicit premises of four systems for identifying metaphoric utterances from unannotated input text. All four systems are then evaluated on a common data set in order to see which premises are most successful. The goal is to see if these systems can find metaphors in a corpus that is mostly non-metaphoric without over-identifying literal and humorous utterances as metaphors. Three of the systems are distributional semantic systems, including a source-target mapping method [1-4]; a word abstractness measurement method [5], [6, 7]; and a semantic similarity measurement method [8, 9]. The fourth is a knowledge-based system which uses a domain interaction method based on the SUMO ontology [10, 11], implementing the hypothesis that metaphor is a product of the interactions among all of the concepts represented in an utterance [12, 13].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Shutova, E.: Models of metaphor in NLP. In: Hajiv, J., Carberry, S., Clark, S., Nivre, J. (eds.) Proceedings of ACL 2010, pp. 688–697. Association for Computational Linguistics, Stroudsburg (2010)

    Google Scholar 

  2. Shutova, E., Teufel, S.: Metaphor corpus annotated for source – target domain mappings. In: Calzolari, N., Choukri, K., Maegaard, B., Mariani, J., Odijk, J., Piperidis, S., Rosner, M., Tapias, D. (eds.) Proceedings of LREC 2010, pp. 3255–3261. European Language Resources Association, Paris (2010)

    Google Scholar 

  3. Shutova, E., Sun, L., Korhonen, A.: Metaphor identification using verb and noun clustering. In: Huang, C., Jurafsky, D. (eds.) Proceedings of COLING 2010, pp. 1002–1010. Tsinghua University Press, Beijing (2010)

    Google Scholar 

  4. Shutova, E., Teufel, S., Korhonen, A.: Statistical metaphor processing. Computational Linguistics 39 (2013) (forthcoming)

    Google Scholar 

  5. Neuman, Y., Nave, O.: Metaphor-based meaning excavation. Information Sciences 179, 2719–2728 (2009)

    Article  MATH  Google Scholar 

  6. Turney, P., Littman, M.: Measuring praise and criticism: Inference of semantic orientation from association. ACM Transactions on Information Systems 21, 315–346 (2003)

    Article  Google Scholar 

  7. Turney, P., Neuman, Y., Assaf, D., Cohen, Y.: Literal and metaphorical sense identification through concrete and abstract context. In: Barzilay, R., Johnson, M. (eds.) Proceedings of EMNLP 2011, pp. 680–690. Association for Computational Linguistics, Stroudsburg (2011)

    Google Scholar 

  8. Li, L., Sporleder, C.: Using Gaussian Mixture Models to detect figurative language in context. In: Kaplan, R., Burstein, J., Harper, M., Penn, G. (eds.) Proceedings of HLT-NAACL 2010, pp. 297–300. Association for Computational Linguistics, Stroudsburg (2010)

    Google Scholar 

  9. Sporleder, C., Li, L.: Contextual idiom detection without labelled data. In: Koehn, P., Mihalcea, R. (eds.) Proceedings of EMNLP 2009, pp. 315–323. Association for Computational Linguistics, Stroudsburg (2009)

    Google Scholar 

  10. Niles, I., Pease, A.: Towards a Standard Upper Ontology. In: Welty, C., Barry, C. (eds.) Proceedings of FOIS 2001, pp. 2–9. Association for Computational Linguistics, Stroudsburg (2001)

    Google Scholar 

  11. Niles, I., Pease, A.: Linking lexicons and ontologies: Mapping WordNet to the Suggested Upper Merged Ontology. In: Arabnia, H. (ed.) Proceedings of IEEE Intl. Conf. on Inf. and Knowl. Eng. (IKE 2003), pp. 412–416. IEEE Press, New York (2003)

    Google Scholar 

  12. Dunn, J.: Gradient semantic intuitions of metaphoric expressions. Metaphor and Symbol 26, 53–67 (2011)

    Article  Google Scholar 

  13. Dunn, J.: How linguistic structure influences and helps to predict metaphoric meaning. Cognitive Linguistics 24, 33–66 (2013)

    Article  Google Scholar 

  14. Davies, M.: The 385+ million word Corpus of Contemporary American English (1990–2008+): Design, architecture, and linguistic insights. International Journal of Corpus Linguistics 14, 159–190 (2009)

    Article  Google Scholar 

  15. Lakoff, G., Johnson, M.: Metaphors We Live By. University of Chicago Press, Chicago (1980)

    Google Scholar 

  16. Lakoff, G., Johnson, M.: Philosophy in the Flesh: The embodied mind and its challenge to western thought. Basic Books, New York (1999)

    Google Scholar 

  17. Briscoe, E., Carroll, J., Watson, R.: The second release of the RASP system, pp. 77–80 (2006)

    Google Scholar 

  18. Sun, L., Korhonen, A.: Improving verb clustering with automatically acquired selectional preferences. In: Koehn, P., Mihalcea, R. (eds.) Proceedings of EMNLP 2009, pp. 638–647. Association for Computational Linguistics, Stroudsburg (2009)

    Google Scholar 

  19. Sun, L., Korhonen, A., Krymolowski, Y.: Verb Class Discovery from Rich Syntactic Data. In: Gelbukh, A. (ed.) CICLing 2008. LNCS, vol. 4919, pp. 16–27. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  20. Shannon, B.: Metaphor: From fixedness and selection to differentiation and creation. Poetics Today 13, 659–685 (1992)

    Article  Google Scholar 

  21. Barnden, J.: Metaphor and metonymy: Making their connections more slippery. Cognitive Linguistics 21, 1–34 (2010)

    Article  Google Scholar 

  22. Nirenburg, S., Raskin, V.: Ontological Semantics. MIT Press, Cambridge (2004)

    Google Scholar 

  23. Raskin, V., Nirenburg, S.: An applied ontological semantic microtheory of adjective meaning for natural language processing. Machine Translation 13, 135–227 (1998)

    Article  Google Scholar 

  24. Cilibrasi, R., Vitanyi, P.: The Google similarity distance. IEEE Transactions on Knowledge and Data Engineering 19, 370–383 (2007)

    Article  Google Scholar 

  25. Gibbs, R.: Literal meaning and psychological theory. Cognitive Science 8, 275–304 (1984)

    Article  Google Scholar 

  26. Apache: OpenNLP (2011), http://opennlp.apache.org

  27. Guido, M., Carroll, J., Pearce, D.: Applied morphological processing of English. Natural Language Engineering 7, 207–223 (2001)

    Google Scholar 

  28. Princeton, U.: WordNet (2012), http://wordnet.princeton.edu/

  29. Iosif, E., Potamianos, A.: SemSim: Resources for normalized semantic similarity computation using lexical networks. In: Calzolari, N., Choukri, K., Declerck, T., Doğan, M., Maegaard, B., Mariani, J., Odijk, J., Piperidis, S. (eds.) Proceedings of LREC 2012, pp. 3499–3504. European Language Resources Association, Paris (2012)

    Google Scholar 

  30. Witten, I., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann, San Francisco (2005)

    Google Scholar 

  31. Ide, N., Suderman, K.: The American National Corpus first release. In: Lino, M., Xavier, M., Ferreira, F., Costa, R., Silva, R. (eds.) Proceedings of LREC 2004, pp. 1681–1684. European Language Resources Association, Paris (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Dunn, J. (2013). Evaluating the Premises and Results of Four Metaphor Identification Systems. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2013. Lecture Notes in Computer Science, vol 7816. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37247-6_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37247-6_38

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37246-9

  • Online ISBN: 978-3-642-37247-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics