Advertisement

ClientNet Cluster an Alternative of Transferring Big Data Files by Use of Mobile Code

  • Waseem Akhtar MuftiEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11517)

Abstract

Big Data has become a nontrivial problem in the field of business as well as in scientific applications. It becomes more complex with the growth of data and scaling of data entry points. These points refer to the remote and local sources where huge data is generated within tiny slots of time. This may also refer to the end user devices including computers, sensors and wireless gadgets. As far as scientific applications are concerned, for example, Geo Physics applications or real time weather forecast requires heavy data and complex mathematical computations. Such applications generate large chunks of data that needs to transfer it through conventional computer networks. Problem with Big Data applications emerges when heavy amount of data is transferred or downloaded (files or objects) from remote locations. The results drawn in real-time from large data files/sets become obsolete due to the fact data keeps on adding new data into the files and the downloading by remote machines remains slower as compared to file growth. This paper addresses this problem and provides possible solution through ClientNet Cluster of remote computers, Specialized Cluster of Computers, as one of the alternative to deal with real-time data analytics under the hard constraints of network. The idea is moving code, for analytic processing, to the remotely available big size files and returning the results to distributed remote locations. The Big Data file does not need to move around network for uploading or downloading whenever the processing is required from distributed locations.

Keywords

Big data Mobile code File transfers Distributed clients 

References

  1. 1.
    Watson, H.J.: Tutorial: big data analytics: concepts, technologies and applications. Commun. Assoc. Inf. Syst. 34, Article no. 65 (2014)Google Scholar
  2. 2.
    Mary, A.J., Arockiam, L.: A study on basic concepts of big data. Int. J. Emerg. Trends Comput. Commun. Technol. 1, Article no. 3 (2015)Google Scholar
  3. 3.
    Wang, Y., Kung, L.A., Byrd, T.A.: Technol. Forecast. Soc. Change 126, 3–13 (2018)CrossRefGoogle Scholar
  4. 4.
    Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns: Elements of Reusable Object-Oriented Software, 1st edn. Addison-Wesley Professional, Boston (1995)zbMATHGoogle Scholar
  5. 5.
    Polato, I., Goldman, A., Re, R., Kon, F.: A comprehensive view of Hadoop research – a systematic literature review. J. Netw. Comput. Appl. 46, 1–25 (2014)CrossRefGoogle Scholar
  6. 6.
    Apache Software Foundation. Apache Spark Survey 2016 Report, DATABRICKS (2016)Google Scholar
  7. 7.
    Dontha, R.: Big Data. www.digitltransformationpro.com
  8. 8.
    Mohanty, H.: Big data: an introduction. In: Mohanty, H., Bhuyan, P., Chenthati, D. (eds.) Big Data. SBD, vol. 11, pp. 1–28. Springer, New Delhi (2015).  https://doi.org/10.1007/978-81-322-2494-5_1CrossRefGoogle Scholar
  9. 9.
    Demchenko, Y., Membrey, P.: Defining architecture components of the Big Data Ecosystem. In: International Conference on Collaboration Technologies and Systems (CTS) 2014. IEEE, Minneapolis, MN, USA (2014)Google Scholar
  10. 10.
    Oussous, A., Benjelloun, F.-Z., Lahcen, A.A., Belfkih, S.: Big data technologies: a survey. J. King Saud Univ. Comput. Inf. Sci. 30, 431–448 (2018)Google Scholar
  11. 11.
    Joseph, C.P., Thulasi, B.S., Susmitha, V.: Big data – concepts, analytics, architectures – overview. Int. J. Eng. Technol. (IRJET) 5(2), 125–129 (2018)CrossRefGoogle Scholar
  12. 12.
    Khan, N., et al.: Big data: surveys, technologies, opportunities, and challenges. Sci. World J. 2014, 18 (2014)Google Scholar
  13. 13.
    Zerhari, B., Mouline, S., Lahcen, AA.: Big data clustering: algorithms and challenges. In: International Conference on Big Data, Cloud and Applications BDCA 2015, Morocco (2015)Google Scholar
  14. 14.
  15. 15.
    Microsoft Azure Tutorial. www.tutorialspoint.com
  16. 16.
  17. 17.

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Alborg UniversityAalborgDenmark

Personalised recommendations