Abstract
The boom of technologies such as social media, mobile devices, internet of things, and so on, has generated enormous amounts of data that represent a tremendous challenge, since they come from different sources, different formats and are being generated in real time at an exponential speed which brings with it new necessities, opportunities, and many challenges both in the technical and analytical area. Some of the prevailing necessities lie on the development of computationally efficient algorithms that can extract value and knowledge from data and can manage the noise within in it. Computational intelligence can be seen as a key alternative to manage inaccuracies and extract value from Big Data, using fuzzy logic techniques for a better representation of the problem. And, if the concept of granular computing is also added, we will have new opportunities to decomposition of a complex data model into smaller, more defined, and meaningful granularity levels, therefore different perspectives could yield more manageable models. In this paper, two related subjects are covered, (1) the fundamentals and concepts of Big Data are described, and (2) an analysis of how computational intelligence techniques could bring benefits to this area is discussed.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Brynjolfsson E, Kahin B (2000) Understanding the digital economy: data, tools and research. Massachusetts Institute of Technology
Rifkin J (2011) The third industrial revolution: how lateral power is transforming energy, the economy, and the world
Helbing D (2015) Thinking ahead—essays on big data, digital revolution, and participatory market society
Akoka J, Comyn-Wattaiau I, Laoufi N (2017) Research on big data—a systematic mapping study. Comput Stand Interfaces 54:105–115
Thomson JR (2015) High integrity systems and safety management in hazardous industries
Rodríguez-Mazahua L, Rodríguez-Enríquez CA, Sánchez-Cervantes JL, Cervantes J, García-Alcaraz JL, Alor-Hernández G (2016) A general perspective of big data: applications, tools, challenges and trends. J Supercomput 72(8):3073–3113
Oussous A, Benjelloun FZ, Ait Lahcen A, Belfkih S (2017) Big data technologies: a survey. J King Saud Univ Comput Inf Sci
McKinsey & Company (2011) Big data: the next frontier for innovation, competition, and productivity. McKinsey Global Institute, p 156
Niño M, Illarramendi A (2015) Entendiendo el Big Data: antecedentes, origen y desarrollo posterior. DYNA NEW Technol 2(3), p [8 p]–[8]
Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques, vol 2
Gandomi A, Haider M (2015) Beyond the hype: big data concepts, methods, and analytics. Int J Inf Manage 35(2):137–144
Srilekha M (2015) Page rank algorithm in map reducing for big data. Int J Conceptions Comput Inf Technol 3(1):3–5
Chen M, Mao S, Liu Y (2014) Big data: a survey. Mobile Netw Appl 19(2):171–209
Kacfah Emani C, Cullot N, Nicolle C (2015) Understandable big data: a survey. Comput Sci Rev 17:70–81
Hashem IAT, Yaqoob I, Anuar NB, Mokhtar S, Gani A, Ullah Khan S (2015) The rise of ‘big data’ on cloud computing: review and open research issues. Inf Syst 47:98–115
Lee I (2017) Big data: dimensions, evolution, impacts, and challenges. Bus Horiz 60(3):293–303
Wang H, Xu Z, Pedrycz W (2017) An overview on the roles of fuzzy set techniques in big data processing: trends, challenges and opportunities. Knowl Based Syst 118:15–30
Curry E (2016) The big data value chain: definitions, concepts, and theoretical approaches. In: New horizons for a data-driven economy: a roadmap for usage and exploitation of big data in Europe, pp 29–37
Lyko K, Nitzschke M, Ngomo A-CN (2016) Big data acquisition
Freitas A, Curry E (2016) Big data curation
Strohbach M, Daubert J, Ravkin H, Lischka M (2016) Big data storage. In: New horizons for a data-driven economy, pp 119–141
Yaqoob I et al (2016) Big data: from beginning to future. Int J Inf Manage 36(6):1231–1247 Pergamon
Jin X, Wah BW, Cheng X, Wang Y (2015) Significance and challenges of big data research. Big Data Res 2(2):59–64
Sivarajah U, Kamal MM, Irani Z, Weerakkody V (2017) Critical analysis of big data challenges and analytical methods. J Bus Res 70:263–286
Ahmed E et al (2017) The role of big data analytics in internet of things. Comput Netw
Alharthi A, Krotov V, Bowman M (2017) Addressing barriers to big data. Bus Horiz 60(3):285–292
Hill R (2010) Computational intelligence and emerging data technologies. In: Proceedings—2nd international conference on intelligent networking and collaborative systems, INCOS 2010, pp 449–454
Jang J, E M, Sun CT (1997) Neuro-fuzzy and soft computing-a computational approach to learning and machine intelligence. Autom Control IEEE 42(10):1482–1484
Engelbrecht AP (2007) Computational intelligence: an introduction, 2nd edn
Kruse R, Borgelt C, Klawonn F, Moewes C, Steinbrecher M, Held P (2013) Computational intelligence. Springer, Berlin
Kar AK (2016) Bio inspired computing—a review of algorithms and scope of applications. Expert Syst Appl 59:20–32
Kumar EP, Sharma EP (2014) Artificial neural networks—a study. Int J Emerg Eng Res Technol 2(2):143–148
Elmetwally MM, Aal FA, Awad ML, Omran S (2008) A hopfield neural network approach for integrated transmission network expansion planning. J Appl Sci Res 4(11):1387–1394
Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems. In: Artificial intelligence: a guide to intelligent systems. Pearson Education, pp 87–113
Biryulev C, Yakymiv Y, Selemonavichus A (2010) Research of ANN usage in data mining and semantic integration. In: MEMSTECH’2010
Mitchell M (1995) Genetic algorithms: an overview. Complexity 1(1):31–39
Govind Maheswaran JJ, Jayarajan P, Johnes J (2013) K-means clustering algorithms: a comparative study
Jain S (2017) Mining big data using genetic algorithm. Int Res J Eng Technol 4(7):743–747
Ross TJ et al (2004) Fuzzy logic with engineering applications. IEEE Trans Inf Theory 58(3):1–19
Fernández A, Carmona CJ, del Jesus MJ, Herrera F (2016) A view on fuzzy systems for big data: progress and opportunities. Int J Comput Intell Syst 9:69–80
Almejalli K, Dahal K, Hossain A (2007) GA-based learning algorithms to identify fuzzy rules for fuzzy neural networks. In: Proceedings of the 7th international conference on intelligent systems design and applications, ISDA 2007, pp 289–294
Pal SK, Meher SK, Skowron A (2015) Data science, big data and granular mining. Pattern Recogn Lett 67:109–112
Yao Y (2008) Human-inspired granular computing 2. Granular computing as human-inspired problem solving, No. 1972, pp 401–410
Qiu J, Wu Q, Ding G, Xu Y, Feng S (2016) A survey of machine learning for big data processing. EURASIP J Adv Sign Process 2016(1):67
Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297
Baum LE, Petrie T (1966) Statistical inference for probabilistic functions of finite state Markov chains. Ann Math Stat 37(6):1554–1563
Rish I (2001) An empirical study of the Naïve Bayes classifier. IJCAI 2001 Work Empir Meth Artif Intell 3
Zarikas V, Papageorgiou E, Regner P (2015) Bayesian network construction using a fuzzy rule based approach for medical decision support. Expert Syst 32:344–369
Erar B (2011) Mixture model cluster analysis under different covariance structures using information complexity
Pelleg D, Pelleg D, Moore AW, Moore AW (2000) X-means: extending K-means with efficient estimation of the number of clusters. In: Proceedings of the seventeenth international conference on machine learning, pp 727–734
Pandey D, Pandey P (2010) Approximate Q-learning: an introduction. In: 2010 second international conference on machine learning and computing, pp 317–320
Desai S, Joshi K, Desai B (2016) Survey on reinforcement learning techniques. Int J Sci Res Publ 6(2):179–2250
Abramson M, Wechsler H (2001) Competitive reinforcement learning for combinatorial problems. In: Proceedings of the international joint conference on neural networks IJCNN’01, vol 4, pp 2333–2338
Zhou L, Pan S, Wang J, Vasilakos AV (2017) Machine learning on big data: opportunities and challenges. Neurocomputing 237:350–361
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Nakasima-López, S., Sanchez, M.A., Castro, J.R. (2018). Big Data and Computational Intelligence: Background, Trends, Challenges, and Opportunities. In: Sanchez, M., Aguilar, L., Castañón-Puga, M., Rodríguez-Díaz, A. (eds) Computer Science and Engineering—Theory and Applications. Studies in Systems, Decision and Control, vol 143. Springer, Cham. https://doi.org/10.1007/978-3-319-74060-7_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-74060-7_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-74059-1
Online ISBN: 978-3-319-74060-7
eBook Packages: EngineeringEngineering (R0)