Advertisement

Evaluating an Opinion Annotation Scheme Using a New Multi-Perspective Question and Answer Corpus

  • Veselin Stoyanov
  • Claire Cardie
  • Diane Litman
  • Janyce Wiebe
Part of the The Information Retrieval Series book series (INRE, volume 20)

Abstract

In recent work, Wiebe et al. (2003) propose a semantic representation for encoding the opinions and perspectives expressed at any given point in a text. This paper evaluates the opinion annotation scheme for multiperspective vs. fact-based question answering using a new question and answer corpus.

Keywords

multi-perspective question answering sentiment analysis opinions question and answer corpus 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

8. Bibliography

  1. Cardie, C., Ng, V., Pierce, D., and Buckley, C. (2000) Examining the role of statistical and linguistic knowledge sources in a general-knowledge question-answering system. In Proceedings of the Sixth Applied Natural Language Processing Conference. 180–187.Google Scholar
  2. Cardie, C., Wiebe, J., Wilson, T., and Litman, D. (2003) Combining low-level and summary representations of opinions for multi-perspective question answering. Working Notes of the 2003 AAAI Spring Symposium on New Directions in Question Answering.Google Scholar
  3. Harabagiu, S., Moldovan, D., Pasca, M., Surdeanu, M., Mihalcea, R., Girju, R., Rus, V., Lacatusu, F., Morarescu, P., and Bunescu, R. (2001) Answering complex, list and context questions with lcc’s question-answering server. In Voorhees, E., and Harman, D. K., (Eds.) Proceedings of the Tenth Text Retrieval Conference (TREC 2001). 355–362.Google Scholar
  4. Moldovan, D., Harabagiu, S., Pasca, M., Mihalcea, R., Girju, R., Goodrum, R. and Rus, V. (1999) Lasso: A tool for surfing the answer net. In Voorhees, E., and Harman, D. K., (Eds.) Proceedings of the Eighth Text Retrieval Conference (TREC-8).Google Scholar
  5. Moldovan, D., Harabagiu, S., Girju, R., Morarescu, P., Lacatusu, F., Novischi, A.., Badulescu, A., and Bolohan, O. (2002) Lcc tools for question answering. In Voorhees, E., and Buckland, L. P., (Eds.) Proceedings of the Eleventh Text REtrieval Conference (TREC 2002). 79–89.Google Scholar
  6. Pasca, M. and Harabagiu, S. (2000) High performance question/answering. In Proceedings of the 38th annual meeting of the association for computational linguistics (ACL-2000). 563–570.Google Scholar
  7. Quirk, R., Greenbaum, S., Leech, G., and Svartvik, J. (1985) A comprehensive grammar of the English language. New York. Longman.Google Scholar
  8. Salton, G. (Ed.) (1971) The SMART Retrieval System — Experiments in Automatic Document Processing. Englewood Cliffs, NJ. Prentice Hall Inc.Google Scholar
  9. Voorhees, E. and Tice, D. (1999) The TREC-8 question answering track evaluation. In Voorhees, E. and Harman, D. K., (Eds.) Proceedings of the Eighth Text Retrieval Conference (TREC-8). 83–105.Google Scholar
  10. Voorhees, E. (2000) The TREC-9 question answering track evaluation. In Voorhees, E. and Harman, D. K., (Eds.) Proceedings of the Ninth Text REtrieval Conference (TREC-9). 71–81.Google Scholar
  11. Voorhees, E. (2001) Overview of the TREC 2001 question answering track. In Voorhees, E. and Harman, D. K., (Eds.) Proceedings of the Tenth Text Retrieval Conference (TREC 2001). 42–52.Google Scholar
  12. Voorhees, E. (2002) Overview of the TREC 2002 question answering track. In Voorhees, E. and Buckland, L. P. (Eds.) Proceedings of the Eleventh Text REtrieval Conference (TREC 2002). 53–75.Google Scholar
  13. Wiebe, J., Breck, E., Buckley, C., Cardie, C., Davis, P., Fraser, B., Litman, D., Pierce, D., Riloff, E., Wilson, T., Day, D., and Maybury, M. (2003) Recognizing and organizing opinions expressed in the world press. Working Notes of the 2003 AAAI Spring Symposium on New Directions in Question Answering.Google Scholar
  14. Wiebe, J. (2002) Instructions for annotating opinions in newspaper articles. Department of Computer Science TR-02-101. University of Pittsburgh, Pittsburgh, PA.Google Scholar
  15. Wilson, T. and Wiebe, J. (2003) Annotating opinions in the world press. 4th SIGdial Workshop on Discourse and Dialogue (SIGdial-03).Google Scholar

Copyright information

© Springer 2006

Authors and Affiliations

  • Veselin Stoyanov
    • 1
  • Claire Cardie
    • 1
  • Diane Litman
    • 2
  • Janyce Wiebe
    • 2
  1. 1.Dept. of Computer ScienceCornell UniversityIthacaUSA
  2. 2.Dept. of Computer ScienceUniversity of PittsburghPittsburghUSA

Personalised recommendations