A Java-Based Distributed Approach for Generating Large-Scale Social Network Graphs
Big Data management is an important topic of research not only in Computer Science, but also in several other domains. A challenging use of Big Data is the generation of large-scale graphs used to model social networks. In this paper, we present an actor-based Java library that eases the use of parallel and distributed programming using actors and scheduling algorithms in multi-threaded computing. We give a high-level description of a distributed algorithm used to construct a social network graph and implement the model into executable code. We present this solution as a means of analyzing and validating an algorithm, as well as a solution of developing and running an application in a large-scale distributed environment.
Partly funded by the EU project FP7-610582 ENVISAGE: Engineering Virtualized Services (http://www.envisage-project.eu). Partly funded by the EU project FP7-612985 UpScale: From Inherent Concurrency to Massive Parallelism through Type-based Optimizations (http://www.upscale-project.eu).
- 1.Alam, M., Khan, M., Marathe, M.V.: Distributed-memory parallel algorithms for generating massive scale-free networks using preferential attachment model. Proceedings of the International Conference on High Performance Computing, p. 91. Storage and Analysis, ACM, Networking (2013)Google Scholar
- 2.Azadbakht, K., Bezirgiannis, N., De Boer, F.S., Aliakbary, S.: A high-level and scalable approach for generating scale-free graphs using active objects. In: Proceeding of the ACM/SIGAPP Symposium on Applied Computing, To appear (2016)Google Scholar
- 3.Bader, D.A., Madduri, K.: Parallel algorithms for evaluating centrality indices in real-world networks. In: International Conference on Parallel Processing, 2006. ICPP 2006, 539–550. IEEE (2006)Google Scholar
- 5.De Boer, F.S., Clarke, D., Johnsen, E.B.: A complete guide to the future. In: Programming Languages and Systems, pp. 316–330. Springer (2007)Google Scholar
- 6.Johnsen, E.B., Hähnle, R., Schäfer, J., Schlatte, R., Steffen, M.: Abs: A core language for abstract behavioral specification. In: Formal Methods for Components and Objects, pp. 142–164. Springer (2010)Google Scholar
- 7.Johnsen, E.B., Schlatte, R., Tarifa, S.L.T.: Modeling resource-aware virtualized applications for the cloud in real-time abs. In: Formal Methods and Software Engineering, pp. 71–86 Springer (2012)Google Scholar
- 8.Kumar, R., Raghavan, P., Rajagopalan, S., Sivakumar, D., Tomkins, A., Upfal, E.: Stochastic models for the web graph. In: Proceedings of the 41st Annual Symposium on Foundations of Computer Science, 2000, pp. 57–65. IEEE (2000)Google Scholar
- 9.Nobakht, B., de Boer, F.S.: Programming with actors in java 8. In: Leveraging Applications of Formal Methods, Verification and Validation. Specialized Techniques and Applications, pp. 37–53. Springer (2014)Google Scholar
- 10.Serbanescu, V., Azadbakht, K., Boer, F., Nagarajagowda, C., Nobakht, B.: A Design Pattern for Optimizations in Data Intensive Applications Using Abs and Java 8. Practice and Experience, Concurrency and Computation (2015)Google Scholar
- 11.Serbanescu, V., Nagarajagowda, C., Azadbakht, K., de Boer, F., Nobakht, B.: Towards type-based optimizations in distributed applications using abs and java 8. In: Adaptive Resource Management and Scheduling for Cloud Computing, pp. 103–112. Springer (2014)Google Scholar
- 12.Serbanescu, V.N., Pop, F., Cristea, V., Achim, O.M.: Web services allocation guided by reputation in distributed soa-based environments. In: 2012 11th International Symposium on Parallel and Distributed Computing (ISPDC), pp. 127–134. IEEE (2012)Google Scholar
- 13.Tonelli, R., Concas, G., Locci, M.: Three efficient algorithms for implementing the preferential attachment mechanism in yule-simon stochastic process. WSEAS Trans. Inf. Sci. Appl. 7(2), 176–185 (2010)Google Scholar
- 14.Yoo, A., Henderson, K.: Parallel generation of massive scale-free graphs (2010). arXiv preprint arXiv:1003.3684