Advertisement

An Approach for Building Effective Real Estate Chatbots in Vietnamese

  • Tuan-Dung Cao
  • Quang H. NguyenEmail author
Chapter
  • 4 Downloads
Part of the Studies in Computational Intelligence book series (SCI, volume 899)

Abstract

This paper presents a method for building a real estate chatbot automatically to support customers in Vietnamese. The chatbot is trained with data set collected on Facebook groups and from the famous real estate website in Vietnam. Using Logistic Regression, user’s intent recognition task achieves precision = 0.93, recall = 0.87 and F1-score = 0.89, while the automatic entity labeling achieves 83% accuracy thanks to the development of a real estate knowledge base. Besides, we report our experience on the design of dialog management modules.

Notes

Acknowledgements

We wish to thank Hai Nguyen for his valuable assistance in the technical implementation of the system. We would like to thank reviewers for their insightful comments on the paper, which have improved our manuscript substantially.

References

  1. 1.
    Chatbot’s definition on Wikipedia. https://en.wikipedia.org/wiki/Chatbot
  2. 2.
    MacTear, M., Callejas, Z.: The History of Chatbots. https://onlim.com/en/the-history-of-chatbots/
  3. 3.
    Goebel, T.: Machine Learning or Linguistic Rules: Two Approaches to Building a Chatbot. https://www.cmswire.com/digital-experience/machine-learning-or-linguistic-rules-two-approaches-to-building-a-chatbot/
  4. 4.
    Pavel Surmenok, Chatbot Architecture 2016. https://medium.com/@surmenok/chatbot-architecture-496f5bf820ed
  5. 5.
    Chowdhury, G.G.: Natural language processing. Ann. Rev. Inf. Sci. Technol. 37(1), 51–89 (2003)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Nhat, M.P.Q.: Overview of natural language processing problems in chatbot system development 2017. https://techinsight.com.vn/khai-quat-cac-bai-toan-xu-ly-ngon-ngu-tu-nhien-trong-phat-trien-thong-chatbot/
  7. 7.
    Evgeniou, T., Pontil, M., Support vector machines: theory and applications. In: Advanced Course on Artificial Intelligence, vol. 5, pp. 249–257. Springer, Heidelberg (1999)Google Scholar
  8. 8.
    Rish, I.: An empirical study of the naive Bayes classifier. In: IJCAI 2001 workshop on empirical methods in artificial intelligence 4 August 2001, vol. 3, no. 22, pp. 41–46 (2001)Google Scholar
  9. 9.
    McGreal, S., Adair, A., McBurney, D., Patterson, D.: Neural networks: the prediction of residential values. J. Property Valuation Investment 16(1), 57–70 (1998)CrossRefGoogle Scholar
  10. 10.
    Li, S.: Named Entity Recognition and Classification with Scikit-Learn 2018. https://towardsdatascience.com/named-entity-recognition-and-classification-with-scikit-learn-f05372f07ba2
  11. 11.
    Rabiner, L.R., Juang, B.H.: An introduction to hidden Markov models. IEEE ASSP Mag. 3(1), 4–16 (1986)CrossRefGoogle Scholar
  12. 12.
    Berger, A.L., Pietra, V.J., Pietra, S.A.: A maximum entropy approach to natural language processing. Comput. Linguist. 22(1), 39–71 (1996)Google Scholar
  13. 13.
    Lafferty, J., McCallum, A., Pereira, F.C.N.: Conditional random fields: probabilistic models for segmenting and labeling sequence data (2001)Google Scholar
  14. 14.
    Jurafsky, D., Martin, J.H.: Dialog systems and chatbots. Speech Lang. Process. 3 (2017)Google Scholar
  15. 15.
    Robino, G.: Dialogs modeled as finite state machines 2016. https://medium.com/@solyarisoftware/dialoghi-come-macchine-a-stati-41bb748fd5b0
  16. 16.
    Reiter, E., Dale, R.: Building Natural Language Generation Systems. Cambridge University Press, Cambridge (2000)CrossRefGoogle Scholar
  17. 17.
    Weizenbaum, J.: ELIZA, a computer program for the study of natural language communication between man and machine. Commun. ACM 9(1), 36–45 (1966)CrossRefGoogle Scholar
  18. 18.
    Chamberlain, W.: The Policeman’s Beard is Half Constructed: Computer Prose and Poetry. Warner Books, New York (1984)Google Scholar
  19. 19.
    Performing Sequence Labelling using CRF in Python, Albert Au Yeung, May 23, 2017. http://www.albertauyeung.com/post/python-sequence-labelling-with-crf/

Copyright information

© The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2021

Authors and Affiliations

  1. 1.School of Information and Communication TechnologyHanoi University of Science and TechnologyHanoiVietnam

Personalised recommendations