Skip to main content
SpringerLink
Log in

Robust Representations for Response Prediction

  • Chapter
  • First Online:
Robust Representation for Data Analytics

Part of the book series: Advanced Information and Knowledge Processing ((AI&KP))

Abstract

Measuring the performance of display advertising is an important problem in estimating campaign effectiveness and understanding user behaviors. The two key performance indicators are the click-through rates (CTR) of the ads and conversion rates (CVR) on the advertisers website. Existing approaches for conversion prediction and for click prediction usually look at the two problems in isolation. However there is considerable benefit in jointly solving the problems as the two goals are often intertwined. In this chapter, we aim to predict the conversion response of the users by jointly examining the past purchase behavior and the click response behavior. To achieve this, we explicitly model the temporal dynamics between the click response and purchase activity into a unified framework. More specifically, we propose a novel matrix factorization approach named the dynamic collective matrix factorization (DCMF) to address this problem. Our model considers temporal dynamics of post-click conversions and also takes advantages of the side information of users, advertisements, and items. An efficient optimization algorithm based on stochastic gradient descent is presented in the chapter. We further show that our approach can be used to measure the effectiveness of advertisements. Our approach and several representative baselines are evaluated on a public dataset and a real-world marketing dataset. Extensive experimental results demonstrate that our model achieves significant improvements over the baselines.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The details of this dataset will be presented in Sect. 8.6.2.

  2. 2.

    http://grouplens.org/datasets/movielens/

References

  1. Agarwal, D., Chen, B.-C., Elango, P.: Spatio-temporal models for estimating click-through rate. In: Proceedings of the 18th International Conference on World Wide Web, pp. 21–30 (2009)

    Google Scholar 

  2. Agarwal, D., Long, B., Traupman, J., Xin, D., Zhang, L.: LASER: a scalable response prediction platform for online advertising. In: Proceedings of the 7th ACM International Conference on Web Search and Data Mining, pp. 173–182 (2014)

    Google Scholar 

  3. Ahmed, A., Das, A., Smola, A.J.: Scalable hierarchical multitask learning algorithms for conversion optimization in display advertising. In: Proceedings of the 7th ACM International Conference on Web Search and Data Mining, pp. 153–162 (2014)

    Google Scholar 

  4. Barajas, J., Akella, R., Holtan, M., Kwon, J., Null, B.: Measuring the effectiveness of display advertising: a time series approach. In: Proceedings of the 20th International Conference on World Wide Web (Companion Volume), pp. 7–8 (2011)

    Google Scholar 

  5. Bouchard, G., Yin, D., Guo, S.: Convex collective matrix factorization. In: Proceedings of the 16th International Conference on Artificial Intelligence and Statistics, pp. 144–152 (2013)

    Google Scholar 

  6. Bulut, A.: Topicmachine: conversion prediction in search advertising using latent topic models. IEEE Trans. Knowl. Data Eng. 26(11), 2846–2858 (2014)

    Article  Google Scholar 

  7. Cai, Y., Leung, H., Li, Q., Min, H., Tang, J., Li, J.: Typicality-based collaborative filtering recommendation. IEEE Trans. Knowl. Data Eng. 26(3), 766–779 (2014)

    Article  Google Scholar 

  8. Cai, Y., Tong, H., Fan, W., Ji, P.: Fast mining of a network of coevolving time series. In: Proceedings of the SIAM International Conference on Data Mining. SIAM (2015)

    Book  Google Scholar 

  9. Chapelle, O.: Offline evaluation of response prediction in online advertising auctions. In: Proceedings of the 24th International Conference on World Wide Web Companion, pp. 919–922. International World Wide Web Conferences Steering Committee (2015)

    Google Scholar 

  10. Chapelle, O., Manavoglu, E., Rosales, R.: Simple and scalable response prediction for display advertising. ACM Trans. Intell. Syst. Technol. 5(4), (2014)

    Google Scholar 

  11. Chen, T., Zhang, W., Lu, Q., Chen, K., Zheng, Z., Yu, Y.: Svdfeature: a toolkit for feature-based collaborative filtering. J. Mach. Learn. Res. 13, 3619–3622 (2012)

    MathSciNet  MATH  Google Scholar 

  12. Cheng, H., Cantú-Paz, E.: Personalized click prediction in sponsored search. In: Proceedings of the 7th ACM International Conference on Web Search and Data Mining, pp. 351–360 (2010)

    Google Scholar 

  13. chih Lee, K., Orten, B., Dasdan, A., Li, W.: Estimating conversion rate in display advertising from past performance data. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 768–776 (2012)

    Google Scholar 

  14. Chua, F.C.T., Oentaryo, R.J., Lim, E.-P.: Modeling temporal adoptions using dynamic matrix factorization. In: Proceedings of the 13th IEEE International Conference on Data Mining, pp. 91–100 (2013)

    Google Scholar 

  15. Davis, J., Goadrich, M.: The relationship between precision-recall and ROC curves. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 233–240 (2006)

    Google Scholar 

  16. Devooght, R., Kourtellis, N., Mantrach, A.: Dynamic matrix factorization with priors on unknown values. In: Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 189–198. ACM (2015)

    Google Scholar 

  17. Drumond, L.R., Schmidt-Thieme, L., Freudenthaler, C., Krohn-Grimberghe, A.: Collective matrix factorization of predictors, neighborhood and targets for semi-supervised classification. In: Proceedings of the 18th Pacific-Asia Conference on the Advances in Knowledge Discovery and Data Mining, Part I, pp. 286–297 (2014)

    Google Scholar 

  18. Graepel, T., Candela, J.Q., Borchert, T., Herbrich, R.: Web-scale Bayesian click-through rate prediction for sponsored search advertising in Microsoft’s bing search engine. In: Proceedings of the 27th International Conference on Machine Learning, pp. 13–20 (2010)

    Google Scholar 

  19. Grotov, A., Chuklin, A., Markov, I., Stout, L., Xumara, F., de Rijke, M.: A comparative study of click models for web search. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction, pp. 78–90. Springer, Cham (2015)

    Google Scholar 

  20. Gunasekar, S., Yamada, M., Yin, D., Chang, Y.: Consistent collective matrix completion under joint low rank structure. In: Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics (AISTATS) (2015)

    Google Scholar 

  21. Hong, L., Doumith, A.S., Davison, B.D.: Co-factorization machines: modeling user interests and predicting individual decisions in twitter. In: Proceedings of the 6th ACM International Conference on Web Search and Data Mining, pp. 557–566 (2013)

    Google Scholar 

  22. Hu, L., Cao, J., Xu, G., Cao, L., Gu, Z., Zhu, C.: Personalized recommendation via cross-domain triadic factorization. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 595–606 (2013)

    Google Scholar 

  23. Huang, Y.-J., Xiang, E.W., Pan, R.: Constrained collective matrix factorization. In: Proceedings of the 6th ACM Conference on Recommender Systems, pp. 237–240 (2012)

    Google Scholar 

  24. Kim, Y.-D., Choi, S.: Scalable variational Bayesian matrix factorization with side information. In: Proceedings of the 17th International Conference on Artificial Intelligence and Statistics, pp. 493–502 (2014)

    Google Scholar 

  25. King, M.A., Abrahams, A.S., Ragsdale, C.T.: Ensemble learning methods for pay-per-click campaign management. Expert Syst. Appl. 42(10), 4818–4829 (2015)

    Article  Google Scholar 

  26. Koenigstein, N., Dror, G., Koren, Y.: Yahoo! music recommendations: modeling music ratings with temporal dynamics and item taxonomy. In: Proceedings of the 5th ACM Conference on Recommender Systems, pp. 165–172 (2011)

    Google Scholar 

  27. Koren, Y.: Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 447–456 (2009)

    Google Scholar 

  28. Koren, Y.: Factor in the neighbors: scalable and accurate collaborative filtering. ACM Trans. Knowl. Discov. Data (TKDD) 4(1), 1 (2010)

    Google Scholar 

  29. Li, B., Zhu, X., Li, R., Zhang, C., Xue, X., Wu, X.: Cross-domain collaborative filtering over time. In: Proceedings of the 22nd International Joint Conference on Artificial Intelligence, pp. 2293–2298 (2011)

    Google Scholar 

  30. Li, H., Hong, R., Wu, Z., Ge, Y.: A spatial-temporal probabilistic matrix factorization model for point-of-interest recommendation. In: Proceedings of the SIAM International Conference on Data Mining, pp. 117–125. SIAM (2016)

    Google Scholar 

  31. Li, S., Kawale, J., Fu, Y.: Deep collaborative filtering via marginalized denoising auto-encoder. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management, pp. 811–820. ACM (2015)

    Google Scholar 

  32. Li, S., Kawale, J., Fu, Y.: Predicting user behavior in display advertising via dynamic collective matrix factorization. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 875–878 (2015)

    Google Scholar 

  33. Li, S., Vlassis, N., Kawale, J., Fu, Y.: Matching via dimensionality reduction for estimation of treatment effects in digital marketing campaigns. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 3768–3774. AAAI Press (2016)

    Google Scholar 

  34. Li, Y., Zhai, C., Chen, Y.: Exploiting rich user information for one-class collaborative filtering. Knowl. Inf. Syst. 38(2), 277–301 (2014)

    Article  Google Scholar 

  35. Liu, Y., Pandey, S., Agarwal, D., Josifovski, V.: Finding the right consumer: optimizing for conversion in display advertising campaigns. In: Proceedings of the 5th ACM International Conference on Web Search and Data Mining, pp. 473–482 (2012)

    Google Scholar 

  36. Menon, A.K., Chitrapura, K.P., Garg, S., Agarwal, D., Kota, N.: Response prediction using collaborative filtering with hierarchies and side-information. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 141–149 (2011)

    Google Scholar 

  37. Oentaryo, R.J., Lim, E.-P., Low, J.-W., Lo, D., Finegold, M.: Predicting response in mobile advertising with hierarchical importance-aware factorization machine. In: Proceedings of the 7th ACM International Conference on Web Search and Data Mining, pp. 123–132 (2014)

    Google Scholar 

  38. Park, S., Kim, Y.-D., Choi, S.: Hierarchical Bayesian matrix factorization with side information. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence, pp. 1593–1599 (2013)

    Google Scholar 

  39. Porteous, I., Asuncion, A.U., Welling, M.: Bayesian matrix factorization with side information and dirichlet process mixtures. In: Proceedings of the 24th AAAI Conference on Artificial Intelligence, pp. 563–568 (2010)

    Google Scholar 

  40. Radinsky, K., Svore, K.M., Dumais, S.T., Shokouhi, M., Teevan, J., Bocharov, A., Horvitz, E.: Behavioral dynamics on the web: learning, modeling, and prediction. ACM Trans. Inf. Syst. 31(3), 16 (2013)

    Article  Google Scholar 

  41. Rafailidis, D., Nanopoulos, A.: Repeat consumption recommendation based on users preference dynamics and side information. In: Proceedings of the 24th International Conference on World Wide Web Companion (Companion Volume), pp. 99–100 (2015)

    Google Scholar 

  42. Rendle, S.: Factorization machines with libFM. ACM Trans. Intell. Syst. Technol. 3(3), 57:1–57:22 (2012)

    Google Scholar 

  43. Richardson, M., Dominowska, E., Ragno, R.: Predicting clicks: estimating the click-through rate for new ads. In: Proceedings of the 16th International Conference on World Wide Web, pp. 521–530 (2007)

    Google Scholar 

  44. Rosales, R., Cheng, H., Manavoglu, E.: Post-click conversion modeling and analysis for non-guaranteed delivery display advertising. In: Proceedings of the 5th ACM International Conference on Web Search and Data Mining, pp. 293–302 (2012)

    Google Scholar 

  45. Saha, A., Sindhwani, V.: Learning evolving and emerging topics in social media: a dynamic NMF approach with temporal regularization. In: Proceedings of the Fifth ACM International Conference on Web Search and Data Mining, pp. 693–702. ACM (2012)

    Google Scholar 

  46. Salakhutdinov, R., Mnih, A.: Probabilistic matrix factorization. In: Proceedings of the Advances in Neural Information Processing Systems 20, pp. 1257–1264 (2007)

    Google Scholar 

  47. Salakhutdinov, R., Mnih, A.: Bayesian probabilistic matrix factorization using Markov chain Monte Carlo. In: Proceedings of the 25th International Conference on Machine Learning, pp. 880–887 (2008)

    Google Scholar 

  48. Singh, A.P., Gordon, G.J.: Relational learning via collective matrix factorization. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 650–658 (2008)

    Google Scholar 

  49. Singh, A.P., Gordon, G.J.: A Bayesian matrix factorization model for relational data. In: Proceedings of the 26th Conference on Uncertainty in Artificial Intelligence, pp. 556–563 (2010)

    Google Scholar 

  50. Wang, C., Liu, Y., Wang, M., Zhou, K., Nie, J.-y., Ma, S.: Incorporating non-sequential behavior into click models. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 283–292. ACM (2015)

    Google Scholar 

  51. Wang, J., Yuan, S., Zhang, W.: Real-time bidding based display advertising: mechanisms and algorithms. In: Advances in Information Retrieval, pp. 897–901. Springer International Publishing, Cham (2016)

    Google Scholar 

  52. Xiong, C., Wang, T., Ding, W., Shen, Y., Liu, T.-Y.: Relational click prediction for sponsored search. In: Proceedings of the 5th ACM International Conference on Web Search and Data Mining, pp. 493–502 (2012)

    Google Scholar 

  53. Yan, L., Li, W., Xue, G., Han, D.: Coupled group lasso for web-scale CTR prediction in display advertising. In: Proceedings of the 31th International Conference on Machine Learning, pp. 802–810 (2014)

    Google Scholar 

  54. Yang, L., Jing, L., Ng, M.K.: Robust and non-negative collective matrix factorization for text-to-image transfer learning. IEEE Trans. Image Process. 24(12), 4701–4714 (2015)

    Article  MathSciNet  Google Scholar 

  55. Zhang, W., Du, T., Wang, J.: Deep learning over multi-field categorical data: a case study on user response prediction. CoRR (2016). arXiv:1601.02376

    Google Scholar 

  56. Zhang, X., Zhou, Y., Ma, Y., Chen, B.-C., Zhang, L., Agarwal, D.: GLMix: generalized linear mixed models for large-scale response prediction. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 363–372 (2016)

    Google Scholar 

  57. Zhu, K., Wu, R., Ying, L., Srikant, R.: Collaborative filtering with information-rich and information-sparse entities. Mach. Learn. 97(1–2), 177–203 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  58. Zhuang, Y., Chin, W.-S., Juan, Y.-C., Lin, C.-J.: A fast parallel SGD for matrix factorization in shared memory systems. In: Proceedings of the 7th ACM Conference on Recommender Systems, pp. 249–256 (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Northeastern University, Boston, MA, USA

    Sheng Li & Yun Fu

Authors
  1. Sheng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yun Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Li, S., Fu, Y. (2017). Robust Representations for Response Prediction. In: Robust Representation for Data Analytics. Advanced Information and Knowledge Processing. Springer, Cham. https://doi.org/10.1007/978-3-319-60176-2_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-60176-2_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-60175-5

  • Online ISBN: 978-3-319-60176-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation