Skip to main content

Mining Implicit Intention Using Attention-Based RNN Encoder-Decoder Model

  • Conference paper
  • First Online:
Intelligent Computing Methodologies (ICIC 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10363))

Included in the following conference series:

Abstract

Nowadays, people are increasingly inclined to use social tools to express their intentions explicitly and implicitly. Most of the work is dedicated to solving the explicit intention detection, ignoring the implicit intention detection, as the former is relatively easy to solve with the classification method. In this work, we use the Attention-Based Encoder-Decoder model which is specified for the sequence-to-sequence task for user implicit intention detection. Our key idea is to leverage the model to “translate” the implicit intention into the corresponding explicit intent by using the parallel corpora built on the social data. Specifically, our model has domain adaptability since the way people express implicit intentions for different domain is variable, while the way to express explicit intentions is mostly in the same form, such as “I want to do sth”. In order to demonstrate the effectiveness of our method, we conduct experiments in four domains. The results show that our method offers a powerful “translation” for the implicit intentions and consequently identifies them.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Agarwal, A., Xie, B., Vovsha, I., Rambow, O., Passonneau, R.: Sentiment analysis of Twitter data. In: Workshop on Languages in Social Media, pp. 30–38. Association for Computational Linguistics (2011)

    Google Scholar 

  2. Maynard, D., Funk, A.: Automatic detection of political opinions in tweets. In: Proceedings of the 1st Workshop on Making Sense of Microposts at ESWC 11 (2011)

    Google Scholar 

  3. Hollerit, B., Kröll, M., Strohmaier, M.: Towards linking buyers and sellers: detecting commercial intent on Twitter. In: the 22nd International Conference on World Wide Web Companion, pp. 629–632. International World Wide Web Conferences Steering Committee, Rio de Janeiro (2013)

    Google Scholar 

  4. Wang, J., Cong, G., Zhao, X.W., Li, X.: Mining user intents in Twitter: a semi-supervised approach to inferring intent categories for tweets. In: Twenty-Ninth AAAI Conference on Artificial Intelligence, Texas (2015)

    Google Scholar 

  5. Ding, X., Liu, T., Duan, J., Nie, J.-Y.: Mining user consumption intention from social media using domain adaptive convolutional neural network. In: AAAI (2015)

    Google Scholar 

  6. Cho, K., van Merrienboer, B., Gulcehre, C., Bougares, F., Schwenk, H., Bengio, Y.: Learning phrase representations using RNN Encoder-Decoder for statistical machine translation. In: Proceedings of the Empiricial Methods in Natural Language Processing (2014)

    Google Scholar 

  7. Chan, W., Jaitly, N., Le, Q.V., Vinyals, O.: Listen, attend and spell. arXiv preprint arXiv:1508.01211 (2015)

  8. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)

  9. Broder, A.: A taxonomy of web search. In: ACM SIGIR Forum, vol. 36, pp. 3–10. ACM (2002)

    Google Scholar 

  10. Dai, H.K., Zhao, L., Nie, Z., Wen, J.R., Wang, L., Li, Y.: Detecting online commercial intention (OCI). In: The 15th International Conference on World Wide Web, pp. 829–837. ACM, Edinburgh (2006)

    Google Scholar 

  11. Ashkan, A., Clarke, C.L.: Impact of query intent and search context on clickthrough behavior in sponsored search. J. KIS 34(2), 425–452 (2013)

    Google Scholar 

  12. Guo, Q., Agichtein, E.: Ready to buy or just browsing?: detecting web searcher goals from interaction data. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (2010)

    Google Scholar 

  13. Chen, Z., Liu, B., Hsu, M., Castellanos, M., Ghosh, R.: Identifying intention posts in discussion forums. In: HLT-NAACL, Atlanta, pp. 1041–1050 (2013)

    Google Scholar 

  14. Park, D.H., et al.: Mobile App Retrieval for Social Media Users via Inference of Implicit Intent in Social Media Text. In: the 25th ACM International Conference on Information and Knowledge. (2016)

    Google Scholar 

  15. Graves, A., Jaitly, N., Mohamed, A.-R.: Hybrid speech recognition with deep bidirectional LSTM. In: IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) (2013)

    Google Scholar 

  16. Sutskever, I., Vinyals, O., Le, Q.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems (2014)

    Google Scholar 

  17. Goodfellow, I., Warde-Farley, D., Mirza, M., Courville, A., Bengio, Y.: Maxout networks. In: Proceedings of the 30th International Conference on Machine Learning, pp. 1319–1327 (2013)

    Google Scholar 

  18. Pascanu, R., Gulcehre, C., Cho, K., Bengio, Y.: How to construct deep recurrent neural networks. In: Proceedings of the Second International Conference on Learning Representations (2014)

    Google Scholar 

  19. Graves, A.: Sequence transduction with recurrent neural networks. In: Proceedings of the 29th International Conference on Machine Learning (2012)

    Google Scholar 

  20. Boulanger-Lewandowski, N., Bengio, Y., Vincent, P.: Audio chord recognition with recurrent neural networks. In: ISMIR (2013)

    Google Scholar 

Download references

Acknowledgement

This work is supported by the National Nature Science Foundation of China (No. 61271413, 61472329, 61532009). Innovation Fund of Postgraduate, Xihua University.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to ChenXing Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Li, C., Du, Y., Wang, S. (2017). Mining Implicit Intention Using Attention-Based RNN Encoder-Decoder Model. In: Huang, DS., Hussain, A., Han, K., Gromiha, M. (eds) Intelligent Computing Methodologies. ICIC 2017. Lecture Notes in Computer Science(), vol 10363. Springer, Cham. https://doi.org/10.1007/978-3-319-63315-2_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-63315-2_36

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-63314-5

  • Online ISBN: 978-3-319-63315-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics