Skip to main content

Learning What to Share in Online Social Networks Using Deep Reinforcement Learning

  • Chapter
  • First Online:
Machine Learning Techniques for Online Social Networks

Part of the book series: Lecture Notes in Social Networks ((LNSN))

  • 729 Accesses

Abstract

Online networking sites tried their best to have right privacy mechanisms in place for users, enabling them to share the right content with the right audience. With all these efforts, privacy customizations remain hard for users across the sites. Existing research that addresses this problem mainly focuses on semi-supervised strategies that introduce extra complexity by requiring the user to manually specify initial privacy preferences for their friends. In this work, we suggest a deep reinforcement learning framework that can dynamically generate privacy labels for users in OSNs. We evaluated our framework on a 1 year crawl of Twitter data, using different types of recurrent units in recurrent neural networks (RNN): Long Short Term Memory (LSTM), Gated Recurrent Unit (GRU), and Simple RNN. Our experiments revealed that LSTM performed better than GRU in terms of top users detection accuracy and the ranked dependence between the generated privacy labels and estimated user trust values.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    We extended the framework used in [34] to match the social networks context. The models were built on Keras http://keras.io/, a deep learning library based on Theano.

References

  1. Madejski, M., Johnson, M., Bellovin, S.M.: A study of privacy settings errors in an online social network. In: Proceedings of 4th IEEE International Workshop on Security and Social Networking, SESOC ’12, Lugano (2012)

    Google Scholar 

  2. Wang, X., Liu, Y., Sun, C., Wang, B., Wang, X.: Predicting polarities of tweets by composing word embeddings with long short-term memory. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, pp. 1343–1353 (2014)

    Google Scholar 

  3. Vilares, D., Doval, Y., Alonso, M.A.: Deep learning experiments for sentiment analysis on Spanish tweets. In: TASS 2015 Workshop on Sentiment Analysis at SEPLN. CEUR Workshop Proceedings, Alicante, vol. 1397, pp. 47–52 (2015)

    Google Scholar 

  4. Li, X., Du, N., Li, H., Li, K., Gao, J., Zhang, A.: A deep learning approach to link prediction in dynamic networks. In: Proceedings of SIAM International Conference on Data Mining (SDM’14) (2014)

    Chapter  Google Scholar 

  5. Hochreiter, S., Schmidhuber, J.: Long short-term memory. J. Neural Comput. 9, 1735–1780 (1997)

    Article  Google Scholar 

  6. Cho, K., Van Merrienboer, B., Bahdanau, D., Bengio, Y.: On the properties of neural machine translation: encoder-decoder approaches, pp. 1409–1259 (2014). Preprint. arXiv

    Google Scholar 

  7. Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. In: Proceedings NIPS Deep Learn Workshop (2014)

    Google Scholar 

  8. Greff, K., Srivastava, R.K., Kout, J., Steunebrink, B.R., Schmidhuber, J.: LSTM: a search space odyssey. In: International Conference on Machine Learning (2015)

    Google Scholar 

  9. Jaradat, S., Dokoohaki, D., Matskin, M., Ferrari, E.: Trust and privacy correlations in social networks: a deep learning framework. In: Advances in Social Network Analysis and Mining, pp. 203–206 (2016)

    Google Scholar 

  10. Carminati, B., Ferrari, E., Viviani, M. (eds.): Security and Trust in Online Social Networks. Synthesis Lectures on Information Security, Privacy, and Trust, vol. 4, pp. 1–120. Morgan & Claypool Publishers, San Rafael (2013)

    Google Scholar 

  11. Sherchan, W., Nepal, S., Paris, C.: A survey of trust in social networks. J. ACM Comput. Surv. 45, 47:1–47:33 (2013)

    Article  Google Scholar 

  12. Buskens, V.: The social structure of trust. J. Soc. Netw. 20, 265–298 (1998)

    Article  Google Scholar 

  13. Guha, R., Kumar, R., Raghavan, P., Tomkins, A.: Propagation of trust and distrust. In: Proceedings of the 13th International Conference on World Wide Web, New York, pp. 403–412 (2004)

    Google Scholar 

  14. Maheswaran, M., Tang, H.C., Ghunaim, A.: Towards a gravity-based trust model for social networking systems. In: Proceedings of the 27th International Conference on Distributed Computing Systems Workshops, p. 24 (2007)

    Google Scholar 

  15. Verbiest, N., Cornelis, C., Victor, P., Herrera-Viedma, E.: Trust and distrust aggregation enhanced with path length incorporation. J. Fuzzy Sets Syst. 202, 61–74 (2012)

    Article  Google Scholar 

  16. Liu, G., Wang, Y., Orgun, M.A.: Finding k optimal social trust paths for the selection of trustworthy service providers in complex social networks. J. IEEE Trans. Serv. Comput. 6, 41–48 (2011)

    Google Scholar 

  17. Adali, S., Escriva, R., Goldberg, M.K., Hayvanovych, M., Magdon-Ismail, M., Szymanski, B.K., Wallace, W.A., Williams, G.: Measuring behavioral trust in social networks. In: Proceedings of the IEEE International Conference on Intelligence and Security Informatics (ISI’10), Vancouver, BC, pp. 150–152 (2010)

    Google Scholar 

  18. Liu, H., Lim, E., Lauw, H.W., Le, M., Sun, A., Srivastava, J., Ae Kim, Y.: Predicting trusts among users of online communities: an epinions case study. In: Proceedings of the 9th ACM Conference on Electronic Commerce, Chicago, IL, pp. 310–319 (2008)

    Google Scholar 

  19. Yang, S., Smola, A.J., Long, B., Zha, H., Chang, Y.: Friend or frenemy? Predicting signed ties in social networks. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval, Portland, OR, pp. 555–564 (2012)

    Google Scholar 

  20. Carminati, B., Ferrari, E., Viviani, M.: A multi-dimensional and event-based model for trust computation in the social web. In: International Conference on Social Informatics, pp.323–336. Springer, Lausanne (2012)

    Google Scholar 

  21. Li, M., Bonti, A.: T-OSN: a trust evaluation model in online social networks. In: 2011 IFIP 9th International Conference on Embedded and Ubiquitous Computing, Melbourne, pp. 469–473 (2011)

    Google Scholar 

  22. Squicciarini, A.C., Paci, F., Sundareswaran, S.: Prima: a comprehensive approach to privacy protection in social network sites. J. Ann. Telecommun. - annales des Télécommunications 69, 21–36 (2014)

    Article  Google Scholar 

  23. Fang, L., LeFevre, K.: Privacy wizards for social networking sites. In: Proceedings of the 19th International Conference on World Wide Web, Raleigh, NC, pp. 351–360 (2010)

    Google Scholar 

  24. Dokoohaki, N., Kaleli, C., Polat, H., Matskin, M.: Achieving optimal privacy in trust-aware social recommender systems. In: Proceedings of the Second International Conference on Social Informatics, Laxenburg, pp.62–79 (2010)

    Google Scholar 

  25. Konstan, J.A., Riedl, J.: Recommender systems: from algorithms to user experience. J. User Model. User-Adap. Inter. 22, 101–123 (2012)

    Article  Google Scholar 

  26. Bunea, R., Mokarizadeh, S., Dokoohaki, N., Matskin, M.: Exploiting dynamic privacy in socially regularized recommenders. In: Data Mining Workshops (ICDMW), 2012 IEEE 12th International Conference on Data Mining Workshops, Brussels, pp. 539–546 (2012)

    Google Scholar 

  27. Dwyer, C., Hiltz, S.R., Passerini, K.: Trust and privacy concern within social networking sites: a comparison of Facebook and Myspace. In: Proceedings of the 13th Americas Conference on Information Systems (AMCIS), Keystone, CO (2007)

    Google Scholar 

  28. Bakker, B.: The state of mind: reinforcement learning with recurrent neural networks. Ph.D. dissertation, Leiden University (2004)

    Google Scholar 

  29. Watkins, C., Dayan, P.: Technical note: Q-learning. J. Mach. Learn. 8, 279–292 (1992)

    Article  Google Scholar 

  30. Harmon, M.E., Baird, L.C.: Multi-player residual advantage learning with general function approximation. Technical report, Wright-Patterson Air Force Base (1996)

    Google Scholar 

  31. Riedmiller, M.: Neural fitted Q iteration first experiences with a data efficient neural reinforcement learning method. In: Gama, J., Camacho, R., Brazdil, P.B., Jorge, A.M., Torgo, L. (eds.) Machine Learning: ECML 2005. ECML 2005. Lecture Notes in Computer Science, vol. 3720, pp. 317–328. Springer, Berlin (2005)

    Chapter  Google Scholar 

  32. Akcora, C., Carminati, B., Ferrari E.: Network and profile based measures for user similarities on social networks. In: Information Reuse and Integration (IRI), IEEE International Conference on Information Reuse & Integration, pp. 292–298. IEEE, Las Vegas (2011)

    Google Scholar 

  33. Dokoohaki, N., Zikou, F.,Gillblad, D., Matskin, M.: Predicting swedish elections using Twitter: a case for stochastic link structure analysis. In: The 5th workshop on Social Network Analysis in Applications (SNAA2015), Collocated with IEEE/ACM ASONAM, Paris, pp. 1269–1276 (2015)

    Google Scholar 

  34. Steckelmacher, D., Vancx, P.: An empirical comparison of neural architectures for reinforcement learning in partially observable environments. In: 27th Benelux Conference on Artificial Intelligence, Hasselt (2015)

    Google Scholar 

  35. Bengio, Y., Simard, P., Frasconi, P.: Learning long-term dependencies with gradient descent is difficult. J. IEEE Trans. Neural Netw. 5(2), 157–166 (1994)

    Article  Google Scholar 

  36. Singla, P., Richardson, M.: Yes, there is a correlation: - from social networks to personal behavior on the web. In: Proceedings of the 17th International Conference on World Wide Web, Beijing, pp. 655–664 (2008)

    Google Scholar 

  37. Anagnostopoulos, A., Kumar, R., Mahdian, M.: Influence and correlation in social networks. In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, pp. 7–15 (2008)

    Google Scholar 

  38. Zafarani, R., Liu, H.: Evaluation without ground truth in social media. Commun. ACM 58(6), 54–60 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shatha Jaradat .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Jaradat, S., Dokoohaki, N., Matskin, M., Ferrari, E. (2018). Learning What to Share in Online Social Networks Using Deep Reinforcement Learning. In: Özyer, T., Alhajj, R. (eds) Machine Learning Techniques for Online Social Networks. Lecture Notes in Social Networks. Springer, Cham. https://doi.org/10.1007/978-3-319-89932-9_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-89932-9_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-89931-2

  • Online ISBN: 978-3-319-89932-9

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics