Two-Way Sequence Modeling for Context-Aware Recommender Systems with Multiple Interactive Bidirectional Gated Recurrent Unit

  • K. U. Kala
  • M. Nandhini
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 637)


For modeling the user behavior in recommender systems, the task of combining the contexts of interactions corresponds to the sequential item history has inevitable role in improving the quality of recommendations. The resort of existing recommendation models is the left-to-right autoregressive training approach. While training a certain model at a specific time step, both future (right) context/data along with the past (left) is always available in the given training set sequences. It is intuitive that the current behavior of the user has certain connections with their future actions too. Future behaviors of users can boost the quality of recommendations. In this paper, two-way sequence modeling technique is proposed for concatenating both left-to-right (past) and right-to-left (future) dependencies in a user interaction sequence. Inspired from the text modeling techniques, a Multiple interactive Bidirectional Gated Recurrent Unit (MiBiGRU) architecture is proposed to model the two-way dependencies in recommender systems. Modeling future contexts along with past contexts is an auspicious way for attaining better recommendation accuracy.


Sequence-aware recommender system Context-aware recommender system (CARS) Deep learning Gated recurrent unit (GRU) Two-way sequence modeling Bidirectional GRU 


  1. 1.
    Quadrana, M., Cremonesi, P., Jannach, D.: Sequence-aware recommender systems. ACM Comput. Surv. 51(4), 36 Article 66 (2018)CrossRefGoogle Scholar
  2. 2.
    Chen, S., Moore, J.L., Turnbull, D., Joachims, T.: Playlist prediction via metric embedding. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 714–722. ACM (2012)Google Scholar
  3. 3.
    Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th International Conference on World Wide Web, pp. 811–820. ACM (2010)Google Scholar
  4. 4.
    Kang, W.-C., McAuley, J.: Self-attentive sequential recommendation. In: 2018 IEEE International Conference on Data Mining (ICDM), pp. 197–206, IEEE (2018)Google Scholar
  5. 5.
    Li, J., Ren, P., Chen, Z., Ren, Z., Lian, T., Ma, J.: Neural attentive session-based recommendation. In CIKM. ACM, pp. 1419–1428 (2017)Google Scholar
  6. 6.
    Tang, J., Wang, K.: Personalized top-N sequential recommendation via convolutional sequence embedding. In: ACM International Conference on Web Search and Data Mining (2018)Google Scholar
  7. 7.
    Tuan, T.X., Phuong, T.M.: 3D convolutional networks for session-based recommendation with content features. In: Rec Sys. ACM (2017)Google Scholar
  8. 8.
    Yuan, F., Karatzoglou, A., Arapakis, I., Jose, J.M., He, X.: A simple convolutional generative network for next item recommendation. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 582–590. ACM (2019)Google Scholar
  9. 9.
    Kala, K.U., Nandhini, M.: Applicability of deep learning techniques in recommender systems. IIOABJ 10(1), 11–20 (2018)Google Scholar
  10. 10.
    Kala, K.U., Nandhini, M.: Scope of context awareness in cross domain recommender system—a brief review. Int. J. Eng. Technol. 7(4), 5570–5579 (2019)Google Scholar
  11. 11.
    Liu, Q., Wu, S., Wang, D., Li, Z., Wang, L.: Context-aware sequential recommendation. In: ICDM, pp. 1053–1058 (2016)Google Scholar
  12. 12.
    Yu, F., Liu, Q., Wu, S., Wang, L., Tan, T.: A dynamic recurrent model for next basket recommendation. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 729–732. ACM (2016)Google Scholar
  13. 13.
    Yuan, F., He, X., Guo, G., Xu, Z., Xiong, J., He, X.: Modeling the Past and Future Contexts for Session-based Recommendation. CoRR, abs/1906.04473v2., (2019)Google Scholar
  14. 14.
    Rakkappan, L., Rajan, V.:. Context-aware sequential recommendations with stacked recurrent neural networks. In: Liu, L., White, R. (eds.) The World Wide Web Conference (WWW ‘19), pp. 3172–3178. ACM, New York, NY, USA (2019)Google Scholar
  15. 15.
    Liu, D.Z., Singh, G.: A Recurrent Neural Network Based Recommendation System. Available online: Accessed on 16 May 2018
  16. 16.
    Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 309, 1735–1780 (1997)CrossRefGoogle Scholar
  17. 17.
    Gers, F., Schraudolph, N., Schmidhuber, J.: Learning precise timing with LSTM recurrent networks. J. Mach. Learn. Res. 3, 115–143 (2002)MathSciNetzbMATHGoogle Scholar
  18. 18.
    Cho, K., van Merrienboer, B., Gulcehre, C., Bougares, F., Schwenk, H., Bengio, Y.: Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation, pp. 315 . arXiv preprint arXiv:1406.1078 (2014)
  19. 19.
    Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical Evaluation of Gated Re-current Neural Networks on Sequence Modeling. arXiv preprint arXiv:1412.3555 (2014)
  20. 20.
    Jozefowicz, R., Zaremba, W., Sutskever, I.: An empirical exploration of recurrent network architectures. In: Proceedings of the 32nd International Conference on Machine Learning (ICML-15), pp. 2342–2350 (2015)Google Scholar
  21. 21.
    Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. arXiv preprint arXiv:1409.0473 (2014)
  22. 22.
    Liu, Q., Wu, S., Wang, L., Tan, T.: Predicting the next location: A recurrent model with spatial and temporal contexts. In: AAAI, pp. 194–200 (2016)Google Scholar
  23. 23.
    Smirnova, E., Vasile, F.: Contextual sequence modeling for recommendation with recurrent neural networks. In: Proceedings of ACM Recommender Systems conference, Como, Italy, (RecSys ’17), ACM (2017)Google Scholar
  24. 24.
    Beutel, A., Covington, P., Jain, S., Xu, C., Li, J., Gatto, V., Chi, H.: Latent cross: making use of context in recurrent recommender systems. In: Proceedings of WSDM (2018)Google Scholar
  25. 25.
    Manotumruksa, J., Macdonald, C., Ounis, I.: A contextual attention recurrent architecture for context-aware venue recommendation. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 555–564. ACM (2018)Google Scholar
  26. 26.
    Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 45, 2673–2681 (1997)CrossRefGoogle Scholar
  27. 27.
    Baldi, P., Brunak, S., Frasconi, P., Soda, G., Pollastri, G.: Exploiting the past and the future in protein secondary structure prediction. BIOINF: Bioinf. 15 (1999)CrossRefGoogle Scholar
  28. 28.
    Graves, A., Schmidhuber, J.: Framewise Phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18(5–6), 602–610 (2005)CrossRefGoogle Scholar
  29. 29.
    Villatel, K., Smirnova, E., Mary, J., Preux, P.: Recurrent Neural Networks for Long and Short-Term Sequential Recommendation. ArXiv:abs/1807.09142 (2018)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • K. U. Kala
    • 1
  • M. Nandhini
    • 1
  1. 1.Department of Computer SciencePondicherry UniversityPuducherryIndia

Personalised recommendations