Abstract
Dialogue act classification is an important component of dialogue management, which captures the user’s intention and chooses the appropriate response action. In this paper, we focus on the dialogue act classification in reference interviews to model the behaviors of librarians in the information seeking dialogues. Reference interviews sometimes include rare words and phrases. Therefore, the existing approaches that use words as units of input often do not work well here. We used the byte pair encoding compression algorithm to build a new vocabulary for the inputs of the classifier. By using this new unit as a feature of the convolutional neural network-based classifier, we improved the accuracy of the dialogue act classification while suppressing the size of vocabulary.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bunt H, Alexandersson J, Choe JW, Fang AC, Hasida K, Petukhova V, Popescu-Belis A, Traum DR (2012) Iso 24617-2: a semantically-based standard for dialogue annotation. In: LREC, pp 430–437
Gage P (1994) A new algorithm for data compression. C Users J 12(2):23–38
Inoue K (2013) An investigation of digital reference interviews: a dialogue act approach. PhD thesis, Syracuse University
Mikolov T, Sutskever I, Deoras A, Le HS, Kombrink S, Cernocky J (2012) Subword language modeling with neural networks. http://www.fit.vutbr.cz/imikolov/rnnlm/char.pdf
Misu T, Kawahara T (2006) Dialogue strategy to clarify users queries for document retrieval system with speech interface. Speech Commun 48(9):1137–1150
Radford ML, Connaway LS (2005) Seeking synchronicity: evaluating virtual reference services from user, non-user, and librarian perspectives. In: Proposal for a research project, submitted February, vol 1
Radford ML, Connaway LS, Confer PA, Sabolcsi-Boros S, Kwon H (2011) Are we getting warmer? Query clarification in live chat virtual reference. Reference & User Services Quarterly, pp 259–279
Ross CS, Radford ML, Nilsen K (2009) Conducting the reference interview: a how-to-do-it-manual for librarians. Neal-Schuman Publishers, Inc.
Sennrich R, Haddow B, Birch A (2015) Neural machine translation of rare words with subword units. arxiv:abs/1508.07909
Severyn A, Moschitti A (2015) Unitn: training deep convolutional neural network for twitter sentiment classification. In: SemEval@ NAACL-HLT, pp 464–469
Shi H, Ushio T, Endo M, Yamagami K, Horii N (2016) A multichannel convolutional neural network for cross-language dialog state tracking. In: 2016 IEEE Spoken Language Technology Workshop (SLT), pp 559–564. IEEE
Shibata Y, Kida T, Fukamachi S, Takeda M, Shinohara A, Shinohara T, Arikawa S (2000) Speeding up pattern matching by text compression. In: Algorithms and complexity, pp 06–315
Stolcke A, Ries K, Coccaro N, Shriberg E, Bates R, Jurafsky D, Taylor P, Martin R, Van Ess-Dykema C, Meteer M (2000) Dialogue act modeling for automatic tagging and recognition of conversational speech. Computat Linguist 26(3):339–373
Webb N, Hepple M, Wilks Y (2005) Dialogue act classification based on intra-utterance features. In: Proceedings of the AAAI workshop on spoken language understanding, vol 4, p 5
Williams JD, Young S (2007) Partially observable markov decision processes for spoken dialog systems. Comput Speech Lang 21(2):393–422
Yoshino K, Kawahara T (2015) Conversational system for information navigation based on pomdp with user focus tracking. Comput Speech Lang 34(1):275–291
Young S, Gašić M, Thomson B, Williams JD (2013) Pomdp-based statistical spoken dialog systems: A review. Proceedings of the IEEE 101(5):1160–1179
Yu B, Inoue K (2012) An investigation of digital reference interviews: dialogue act annotation with the hidden Markov support vector machine. OCLC/ALISE research grant report published electronically by OCLC research
Acknowledgements
This research and development work was supported by the JST PREST (JPMJPR165B) and JST CREST(JPMJCR1513).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Kawano, S., Yoshino, K., Suzuki, Y., Nakamura, S. (2019). Dialogue Act Classification in Reference Interview Using Convolutional Neural Network with Byte Pair Encoding. In: D'Haro, L., Banchs, R., Li, H. (eds) 9th International Workshop on Spoken Dialogue System Technology. Lecture Notes in Electrical Engineering, vol 579. Springer, Singapore. https://doi.org/10.1007/978-981-13-9443-0_2
Download citation
DOI: https://doi.org/10.1007/978-981-13-9443-0_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-9442-3
Online ISBN: 978-981-13-9443-0
eBook Packages: Literature, Cultural and Media StudiesLiterature, Cultural and Media Studies (R0)