Advertisement

Question Answering By Passage Selection

  • Charles L. A. Clarke
  • Gordon V. Cormack
  • Thomas R. Lynam
  • Egidio L. Terra
Part of the Text, Speech and Language Technology book series (TLTB, volume 32)

The MultiText QA System performs question answering using a two step passage selection method. In the first step, an arbitrary passage retrieval algorithm efficiently identifies hotspots in a large target corpus where the answer might be located. In the second step, an answer selection algorithm analyzes these hotspots, considering such factors as answer type and candidate redundancy, to extract short answer snippets. This chapter describes both steps in detail, with the goal of providing sufficient information to allow independent implementation. The method is evaluated using the test collection developed for the TREC 2001 question answering track.

Keywords

Question Answering Candidate Term Terminal Symbol Question Categorization Access Function 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

6. References

  1. [1]
    Abney, Steven, Michael Collins, and Amit Singhal. Answer extraction. In Conference on Applied Natural Language Processing, 2000.Google Scholar
  2. [2]
    Allan, James Relevance feedback with too much data. In 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 337-343, Seattle, July 1995.Google Scholar
  3. [3]
    Breck, Eric, John Burger, David House, Marc Light, and Inderjeet Mani. Question answering from large document collections. In 1999 AAAI Fall Symposium on Question Answering Systems, North Falmouth, MA, 1999.Google Scholar
  4. [4]
    Brill, Eric, Jimmy Lin, Michele Banko, Susan Dumais, and Andrew Ng. Data-intensive question answering. In 2001 Text REtrieval Conference, Gaithersburg, Maryland, November 2001.Google Scholar
  5. [5]
    Callan, James Passage-level evidence in document retrieval. In 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 302-310, Dublin, July 1994.Google Scholar
  6. [6]
    Clarke, C. L. A., G. V. Cormack, D. I. E. Kisman, and T. R. Lynam. Question answering by passage selection. In 9th Text REtrieval Conference, Gaithersburg, MD, 2000.Google Scholar
  7. [7]
    Clarke, C. L. A., G. V. Cormack, T. R. Lynam, C. M. Li, and G. L. McLearn. Web reinforced question answering. In 2001 Text REtrieval Conference, Gaithersburg, MD, 2000.Google Scholar
  8. [8]
    Clarke, Charles L. A., G. V. Cormack, and F. J. Burkowski. Fast inverted indexes with on-line update. Technical Report CS-94-40, University of Waterloo Computer Science Department, November 1994.Google Scholar
  9. [9]
    Clarke, Charles L. A., Gordon, V. Cormack, and Thomas, R. Lynam. Exploiting redundancy in question answering. In 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 358-365, New Orleans, September 2001.Google Scholar
  10. [10]
    Clarke, Charles L. A., Gordon, V. Cormack, and Elizabeth, A. Tudhope. Relevance ranking for one to three term queries. Information Processing and Management, 36(2): 291-311, 2000.CrossRefGoogle Scholar
  11. [11]
    Cormack, G. V., C. L. A. Clarke, C. R. Palmer, and D. I. E. Kisman. Fast automatic passage ranking. In 8th Text REtrieval Conference, Gaithersburg, MD, November 1999.Google Scholar
  12. [12]
    Diekema, Anne, Xiaoyong Liu, Jiangping Chen, Hudong Wang, Nancy McCracken, Ozgur Yilmazel, and Elizabeth D. Liddy. Question answering: CNLP at the TREC-9 question answering track. In 9th Text REtrieval Conference, Gaithersburg, MD, 2000.Google Scholar
  13. [13]
    Dumais, Susan, Michele Banko, Eric Brill, Jimmy Lin, and Andrew Ng. Web question answering: Is more always better? In 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Tampere, Finland, August 2002.Google Scholar
  14. [14]
    Harabagiu, Sanda M. and Steven J. Maiorano. Finding answers in large collections of texts: Paragraph indexing + abductive inference. In 1999 AAAI Fall Symposium on Question Answering Systems, pages 63-71, North Falmouth, MA, 1999.Google Scholar
  15. [15]
    Hearst, Marti A. and Christian Plaunt. Subtopic structuring for full-length document access. In 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 59-68, Pittsburgh, July 1993.Google Scholar
  16. [16]
    Hovy, Eduard, Ulf Hermjakob, and Chin-Yew Lin. The use of external knowledge in factoid QA. In 2001 Text REtrieval Conference, Gaithersburg, MD, 2001.Google Scholar
  17. [17]
    Ittycheriah, Abraham, Martin Franz, Wei-Jing Zhu, and Adwait Ratnaparkhi. IBM’s statistical question answering system. In 9th Text REtrieval Conference, Gaithersburg, MD, 2000.Google Scholar
  18. [18]
    Kaszkiel, Marcin and Justin Zobel. Passage retrieval revisited. In 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 178-185, Philadelphia, July 1997.Google Scholar
  19. [19]
    Knaus, Daniel, Elke Mittendorf, Peter Schäauble, and Páraic Sheridan. Highlighting relevant passages for users of the interactive SPIDER retrieval system. In 4th Text REtrieval Conference, Gaithersburg, Maryland, 1995.Google Scholar
  20. [20]
    Kwok, Cody C. T., Oren Etzioni, and Daniel S Weld. Scaling question answering to the Web. In Tenth International World Wide Web Conference, pages 150-161, Hong Kong, May 2001.Google Scholar
  21. [21]
    Kwok, K. L., L. Grunfeld, N. Dinstl, and M. Chan. TREC 2001 question-answer, Web and cross language experiments using PIRCS. In 2001 Text REtrieval Conference, Gaithersburg, Maryland, November 2001.Google Scholar
  22. [22]
    Lam, Sunny K. S. and M. Tamer Ozsu. Querying web data — the WebQA approach. In 3rd International Conference on Web Information Systems Engineering, Singapore, December 2002.Google Scholar
  23. [23]
    Moffat Alistair and Justin Zobel. Self-indexing inverted files for fast text retrieval. ACM Transactions on Information Systems, 14(4):349-379, October 1996.CrossRefGoogle Scholar
  24. [24]
    Monz, Christof and Maarten de Rijke. Tequesta: The University of Amsterdam’s Textual Question Answering System. In 2001 Text REtrieval Conference, pages 519-530, Gaithersburg, Maryland, November 2001.Google Scholar
  25. [25]
    Najork, Marc and Janet L Wiener. Breadth-first search crawling yields high-quality pages. In 10th International World Wide Web Conference, pages 114-118, Hong Kong, May 2001.Google Scholar
  26. [26]
    O’Connor John. Answer-passage retrieval by text searching. Journal of the American Society for Information Science, 32(4):227-239, July 1980.CrossRefGoogle Scholar
  27. [27]
    Prager, John, Eric Brown, Amni Coden, and Dragomir Radev. Question-answering by predictive annotation. In 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 184-191, Athens, August 2000.Google Scholar
  28. [28]
    Prager, John, Dragomir Radev, Eric Brown, Anni Cohen, and Valerie Samn. The use of predictive annotation for question answering in TREC8. In 8th Text REtrieval Conference, Gaithersburg, MD, 1999.Google Scholar
  29. [29]
    Salton, Gerard, J. Allan, and C. Buckley. Approaches to passage retrieval in full text information systems. In 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 49-58, Pittsburgh, July 1993.Google Scholar
  30. [30]
    Singhal, Amit, Steve Abney, Michiel Bacchiani, Michael Collins, Donald Hindle, and Fernando Pereira. AT&T at TREC-8. In 8th Text REtrieval Conference, Gaithersburg, MD, 1999.Google Scholar
  31. [31]
    Srihari, Rohini and Wei Li. Information extraction supported question answering. In 8th Text REtrieval Conference, Gaithersburg, MD, 1999.Google Scholar
  32. [32]
    Voorhees, Ellen M. and Dawn Tice. Building a question answering test collection. In 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 200-207, Athens, August 2000.Google Scholar
  33. [33]
    Wilkinson, Ross Effective retrieval of structured documents. In 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 311-317, Dublin, July 1994.Google Scholar
  34. [34]
    Wilkinson, Ross and Justin Zobel. Comparison of fragmentation schemes for document retrieval. In 3rd Text REtrieval Conference, Gaithersburg, Maryland, November 1994.Google Scholar
  35. [35]
    Witten, Ian H., Alistair Moffat, and Timothy C. Bell. Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann Publishing, San Francisco, second edition, 1999.Google Scholar
  36. [36]
    Woods, W. A., Stephen Green, Paul Martin, and Ann Houston. Halfway to question answering. In 9th Text REtrieval Conference, Gaithersburg, MD, 2000.Google Scholar
  37. [37]
    Woods, William A., Lawrence A. Bookman, Ann Houston, Robert J. Kuhns, Paul Martin, and Stephen Green. Linguistic knowledge can improve information retrieval. In Applied Natural Language Processing Conference, Seattle, May 2000.Google Scholar
  38. [38]
    Zheng, Zhiping Answerbus question answering system. In Human Language Technology Conference, San Diego, March 2002.Google Scholar

Copyright information

© Springer 2008

Authors and Affiliations

  • Charles L. A. Clarke
    • 1
  • Gordon V. Cormack
    • 1
  • Thomas R. Lynam
    • 1
  • Egidio L. Terra
    • 1
  1. 1.School of Computer ScienceUniversity of WaterlooWaterlooCanada

Personalised recommendations