Abstract
Big Data is the complex, bulky, growing set of data coming from independent sources. In today’s modern age Big data has an essential part in nearly every field of human life including science, engineering, social, biological and biomedical departments. In the following paper importance of big data, stream learning, deep learning, Hadoop and its application are discussed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Labrinidis, A., Jagadish, H.: Challenges and opportunities with big data. Proc. VLDB Endowment 5, 2032–2033 (2012). https://doi.org/10.14778/2367502.2367572
Stouky, A., Jaoujane, B., Daoudi, R., Chaoui, H.: Improving Software Automation Testing Using Jenkins, and Machine Learning Under Big Data (2019). Accessed 24 Apr 2019
Saraladevi, B., Pazhaniraja, N., Paul, P., et al.: Big data and hadoop-a study in security perspective. Procedia Comput. Sci. 50, 596–601 (2015). https://doi.org/10.1016/j.procs.2015.04.091
Ji, C.: Big data processing in cloud computing environments. In: International Symposium on Pervasive Systems, Algorithms, and Networks
Song, Y.-S.: Storing Big Data- The rise of the Storage Cloud (2012)
Philip, R.: Managing Big Data. TDWI research (2013)
Hortonworks: What is Apache Spark. In: Hortonworks (2019). https://hortonworks.com/apache/spark/. Accessed 24 Apr 2019
Shay, C.: Application Denial of Service. Hack tics Ltd (2007)
Daniel, J.: Understanding brute force. National Science Foundation, Chicago (2019)
Bifet, A., De Francisci, M.: Big data stream learning with SAMOA. In: IEEE International Conference on Data Mining Workshops, ICDMW 2015, pp. 1199–1202 (2015). https://doi.org/10.1109/ICDMW.2014.24
Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Comput. 18(7), 1527–1554 (2006)
Bengio, Y.: Learning deep architectures for AI. Found. Trends® Mach. Learn. 2(1), 1–127 (2009)
Bengio, Y., LeCun, Y.: Scaling learning algorithms towards AI. Large-Scale Kernel Mach. 34(5), 1–41 (2007)
Bengio, Y., Courville, A., Vincent, P.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)
Arel, I., Rose, D.C., Karnowski, T.P.: Deep machine learning-a new frontier in artificial intelligence research [research frontier]. IEEE Comput. Intell. Mag. 5(4), 13–18 (2010)
Bengio, Y., Lamblin, P., Popovici, D., Larochelle, H.: Greedy layer-wise training of deep networks. Adv. Neural. Inf. Process. Syst. 19, 153 (2007)
Hordri, N.F., Yuhaniz, S.S., Shamsuddin, S.M.: Deep Learning and Its Applications: A Review (2016)
Jan, B., Farman, H., Khan, M., Imran, M., Islam, I., Ahmad, A., Ali, S., Jeon, G.: Deep learning in big data analytics: a comparative study. Comput. Electr. Eng. (2017). https://doi.org/10.1016/j.compeleceng.2017.12.009
Demchenko, Y., Grosso, P., de Laat, C., Membrey, P.: Addressing big data issues in scientific data infrastructure. In: 2013 International Conference on Collaboration Technologies and Systems (CTS), San Diego, CA, pp. 48–55 (2015). https://doi.org/10.1109/cts.2013.6567203
Louis Columbus Contributor @Forbes, 23 May 2018. https://www.forbes.com/sites/louiscolumbus/2018/05/23/10-charts-that-will-change-your-perspective-of-big-datas-growth/#2c9ba09b2926
El-Gayar, O., Timsina, P.: Opportunities for business intelligence and big data analytics in evidence based medicine. In: 2014 47th Hawaii International Conference on System Sciences, Waikoloa, HI, pp. 749–757 (2014). https://doi.org/10.1109/hicss.2014.100
Wu, J., Ota, K., Dong, M., Li, J., Wang, H.: Big data analysis-based security situational awareness for smart grid. IEEE Trans. Big Data 4(3), 408–417 (2018). https://doi.org/10.1109/tbdata.2016.2616146
Alfred, R.: The rise of machine learning for big data analytics. In: 2016 2nd International Conference on Science in Information Technology (ICSITech), Balikpapan, p. 1 (2016). https://doi.org/10.1109/icsitech.2016.7852593
Mazumder, S., Dhar, S.: Hadoop ecosystem as enterprise big data platform: perspectives and practices. Int. J. Inf. Technol. Manage. 17(4), 334–348 (2018). Inderscience Enterprises Ltd
Vora, M.N.: Hadoop-HBase for large-scale data. In: Proceedings of 2011 International Conference on Computer Science and Network Technology, Harbin, pp. 601–605 (2011). https://doi.org/10.1109/iccsnt.2011.6182030
Mondal, K., Dutta, P.: Big data parallelism: challenges in different computational paradigms. In: Proceedings of the 2015 Third International Conference on Computer, Communication, Control and Information Technology (C3IT), Hooghly, pp. 1–5 (2015). https://doi.org/10.1109/c3it.2015.7060186
Kasu, P., Kim, Y., Park, S., Atchley, S., Vallée, G.R.: Design and analysis of fault tolerance mechanisms for big data transfers. In: 2016 IEEE International Conference on Cluster Computing (CLUSTER), Taipei, pp. 138–139 (2016). https://doi.org/10.1109/cluster.2016.74
Chawda, R.K., Thakur, G.: Big data and advanced analytics tools. In: 2016 Symposium on Colossal Data Analysis and Networking (CDAN), Indore, pp. 1–8 (2016). https://doi.org/10.1109/CDAN.2016.7570890
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Benlachmi, Y., Hsnaoui, M.L. (2020). Current State and Challenges of Big Data. In: Ezziyyani, M. (eds) Advanced Intelligent Systems for Sustainable Development (AI2SD’2019). AI2SD 2019. Lecture Notes in Networks and Systems, vol 92. Springer, Cham. https://doi.org/10.1007/978-3-030-33103-0_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-33103-0_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-33102-3
Online ISBN: 978-3-030-33103-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)