Abstract
In this Chapter we explore an anatomy of an arbitrary text with respect to how it can answer questions. One more opportunity for discourse analysis to assist with topical relevance of an answer is identified. We discover that a discourse tree of an answer sheds a light on how an answer is constructed, and how to treat keyword occurrence. There is a simple observation employed by search engines: keywords from a query need to occur in a single answer sentence, for this answer to be relevant. Relying on answer anatomy, we substantially extend the notion of how query keywords should occur in answer areas such as its elementary discourse units. We explore how to identify informative and uninformative parts of answers in terms of matching with questions. It turns out that discourse trees contribute a lot in building answer maps which are fairly important for determining whether this answer is good or not for a given question.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Asher N, Lascarides A (2003) Logics of conversation. Cambridge University Press, Cambridge
CarPros (2018) https://github.com/bgalitsky/relevance-based-on-parse-trees/blob/master/examples/CarRepairData_AnswerAnatomyDataset2.csv.zip
Chali Y, Joty SR, Hasan SA (2009) Complex question answering: unsupervised learning approaches and experiments. J Artif Intell Res 35(1):1–47
Croft B, Metzler D, Strohman T (2009) Search engines – information retrieval in practice. Pearson Education. North America
Fidelity (2018) https://github.com/bgalitsky/relevance-based-on-parse-trees/blob/master/examples/Fidelity_FAQs_AnswerAnatomyDataset1.csv.zip
Finn PJ (1975) A question writing algorithm. J Read Behav 7(4):341–367
Galitsky B (2014) Learning parse structure of paragraphs and its applications in search. Eng Appl Artif Intell 32:160–184
Galitsky B (2017a) Discovering rhetorical agreement between a request and response. Dialogue Discourse 8(2):167–205
Galitsky B (2017b) Matching parse thickets for open domain question answering. Data Knowl Eng 107:24–50
Galitsky B, Ilvovsky D (2017a) Chatbot with a discourse structure-driven dialogue management, EACL demo program
Galitsky B, Ilvovsky D (2017b) On a chat bot finding answers with optimal rhetoric representation. Proceedings of recent advances in natural language processing, pages 253–259, Varna, Bulgaria, Sept 4–6
Galitsky B, Kovalerchuk B (2014) Improving web search relevance with learning structure of domain concepts. In: Clusters, orders, and trees: methods and applications. Springer, New York, pp 341–376
Galitsky B, Lebedeva N (2015) Recognizing documents versus meta-documents by tree Kernel learning. FLAIRS conference, pp 540–545
Galitsky B, Gabor Dobrocsi J, Lluis de la R (2012) Inferring the semantic properties of sentences by mining syntactic parse trees. Data Knowl Eng 81:21–45
Galitsky B, Kuznetsov SO, Usikov D (2013) Parse thicket representation for multi-sentence search. International conference on conceptual structures, pp 153–172
Galitsky B, Ilvovsky D, Kuznetsov SO (2015a) Text classification into abstract classes based on discourse structure. Proceedings of recent advances in natural language processing, pages 200–207, Hissar, Bulgaria, Sep 7–9 2015
Galitsky B, Ilvovsky D, Kuznetsov SO (2015b) Rhetoric map of an answer to compound queries. Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing. Volume 2, pp 681–686
Hobbs JR (1979) Coherence and coreference. Cogn Sci 3(1):67–90
Hobbs JR (1985) On the coherence and structure of discourse. Report no. CSLI-85-37, center for the study of language and information, October
Ilvovsky D (2014) Going beyond sentences when applying tree kernels. Proceedings of the ACL 2014 student research workshop, pp 56–63
Jansen P, Surdeanu M, Clark P (2014) Discourse complements lexical semantics for nonfactoid answer reranking. ACL
Jasinskaja K, Karagjosova E (2017) Rhetorical relations. In: Matthewson L, Meier C, Rullmann H, Zimmermann TE (eds) The companion to semantics. Wiley, Oxford
Joty SR, Moschitti A (2014) Discriminative reranking of discourse parses using tree Kernels. Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP)
Joty SR, Carenini G, Ng RT, Mehdad Y (2013) Combining intra-and multi- sentential rhetorical parsing for document-level discourse analysis. In: ACL (1), pages 486–496
Mann W, Thompson S (1988) Rhetorical structure theory: towards a functional theory of text organization. Text-Interdiscip J Study of Discourse 8(3):243–281
Moschitti A (2006) Efficient convolution Kernels for dependency and constituent syntactic trees. In: Proceedings of the 17th european conference on machine learning, Berlin, Germany
QnAmaker (2018) Microsoft QnA Maker. https://www.qnamaker.ai/
Strok F, Galitsky B, Dmitry Ilvovsky, Kuznetsov SO (2014) Pattern structure projections for learning discourse structures. International conference on artificial intelligence: methodology, systems, and applications, pp 254–260
Surdeanu M, Hicks T, Valenzuela-Escarcega MA (2015) Two practical rhetorical structure theory parsers. Proceedings of the conference of the North American chapter of the association for computational linguistics – human language technologies: software demonstrations (NAACL HLT)
Sweetser E (1990) From etymology to pragmatics: metaphorical and cultural aspects of semantic structure (Cambridge studies in linguistics). Cambridge University Press, Cambridge
Yahoo! Answers (2018) https://answers.yahoo.com/
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Galitsky, B. (2019). Rhetorical Map of an Answer. In: Developing Enterprise Chatbots. Springer, Cham. https://doi.org/10.1007/978-3-030-04299-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-04299-8_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-04298-1
Online ISBN: 978-3-030-04299-8
eBook Packages: Computer ScienceComputer Science (R0)