Skip to main content

Big Data and Computational Intelligence: Background, Trends, Challenges, and Opportunities

  • Chapter
  • First Online:

Part of the book series: Studies in Systems, Decision and Control ((SSDC,volume 143))

Abstract

The boom of technologies such as social media, mobile devices, internet of things, and so on, has generated enormous amounts of data that represent a tremendous challenge, since they come from different sources, different formats and are being generated in real time at an exponential speed which brings with it new necessities, opportunities, and many challenges both in the technical and analytical area. Some of the prevailing necessities lie on the development of computationally efficient algorithms that can extract value and knowledge from data and can manage the noise within in it. Computational intelligence can be seen as a key alternative to manage inaccuracies and extract value from Big Data, using fuzzy logic techniques for a better representation of the problem. And, if the concept of granular computing is also added, we will have new opportunities to decomposition of a complex data model into smaller, more defined, and meaningful granularity levels, therefore different perspectives could yield more manageable models. In this paper, two related subjects are covered, (1) the fundamentals and concepts of Big Data are described, and (2) an analysis of how computational intelligence techniques could bring benefits to this area is discussed.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Brynjolfsson E, Kahin B (2000) Understanding the digital economy: data, tools and research. Massachusetts Institute of Technology

    Google Scholar 

  2. Rifkin J (2011) The third industrial revolution: how lateral power is transforming energy, the economy, and the world

    Google Scholar 

  3. Helbing D (2015) Thinking ahead—essays on big data, digital revolution, and participatory market society

    Google Scholar 

  4. Akoka J, Comyn-Wattaiau I, Laoufi N (2017) Research on big data—a systematic mapping study. Comput Stand Interfaces 54:105–115

    Article  Google Scholar 

  5. Thomson JR (2015) High integrity systems and safety management in hazardous industries

    Google Scholar 

  6. Rodríguez-Mazahua L, Rodríguez-Enríquez CA, Sánchez-Cervantes JL, Cervantes J, García-Alcaraz JL, Alor-Hernández G (2016) A general perspective of big data: applications, tools, challenges and trends. J Supercomput 72(8):3073–3113

    Article  Google Scholar 

  7. Oussous A, Benjelloun FZ, Ait Lahcen A, Belfkih S (2017) Big data technologies: a survey. J King Saud Univ Comput Inf Sci

    Google Scholar 

  8. McKinsey & Company (2011) Big data: the next frontier for innovation, competition, and productivity. McKinsey Global Institute, p 156

    Google Scholar 

  9. Niño M, Illarramendi A (2015) Entendiendo el Big Data: antecedentes, origen y desarrollo posterior. DYNA NEW Technol 2(3), p [8 p]–[8]

    Google Scholar 

  10. Witten IH, Frank E (2005) Data mining: practical machine learning tools and techniques, vol 2

    Google Scholar 

  11. Gandomi A, Haider M (2015) Beyond the hype: big data concepts, methods, and analytics. Int J Inf Manage 35(2):137–144

    Article  Google Scholar 

  12. Srilekha M (2015) Page rank algorithm in map reducing for big data. Int J Conceptions Comput Inf Technol 3(1):3–5

    Google Scholar 

  13. Chen M, Mao S, Liu Y (2014) Big data: a survey. Mobile Netw Appl 19(2):171–209

    Article  Google Scholar 

  14. Kacfah Emani C, Cullot N, Nicolle C (2015) Understandable big data: a survey. Comput Sci Rev 17:70–81

    Article  MathSciNet  Google Scholar 

  15. Hashem IAT, Yaqoob I, Anuar NB, Mokhtar S, Gani A, Ullah Khan S (2015) The rise of ‘big data’ on cloud computing: review and open research issues. Inf Syst 47:98–115

    Article  Google Scholar 

  16. Lee I (2017) Big data: dimensions, evolution, impacts, and challenges. Bus Horiz 60(3):293–303

    Article  Google Scholar 

  17. Wang H, Xu Z, Pedrycz W (2017) An overview on the roles of fuzzy set techniques in big data processing: trends, challenges and opportunities. Knowl Based Syst 118:15–30

    Article  Google Scholar 

  18. Curry E (2016) The big data value chain: definitions, concepts, and theoretical approaches. In: New horizons for a data-driven economy: a roadmap for usage and exploitation of big data in Europe, pp 29–37

    Google Scholar 

  19. Lyko K, Nitzschke M, Ngomo A-CN (2016) Big data acquisition

    Google Scholar 

  20. Freitas A, Curry E (2016) Big data curation

    Google Scholar 

  21. Strohbach M, Daubert J, Ravkin H, Lischka M (2016) Big data storage. In: New horizons for a data-driven economy, pp 119–141

    Google Scholar 

  22. Yaqoob I et al (2016) Big data: from beginning to future. Int J Inf Manage 36(6):1231–1247 Pergamon

    Article  Google Scholar 

  23. Jin X, Wah BW, Cheng X, Wang Y (2015) Significance and challenges of big data research. Big Data Res 2(2):59–64

    Article  Google Scholar 

  24. Sivarajah U, Kamal MM, Irani Z, Weerakkody V (2017) Critical analysis of big data challenges and analytical methods. J Bus Res 70:263–286

    Article  Google Scholar 

  25. Ahmed E et al (2017) The role of big data analytics in internet of things. Comput Netw

    Google Scholar 

  26. Alharthi A, Krotov V, Bowman M (2017) Addressing barriers to big data. Bus Horiz 60(3):285–292

    Article  Google Scholar 

  27. Hill R (2010) Computational intelligence and emerging data technologies. In: Proceedings—2nd international conference on intelligent networking and collaborative systems, INCOS 2010, pp 449–454

    Google Scholar 

  28. Jang J, E M, Sun CT (1997) Neuro-fuzzy and soft computing-a computational approach to learning and machine intelligence. Autom Control IEEE 42(10):1482–1484

    Article  Google Scholar 

  29. Engelbrecht AP (2007) Computational intelligence: an introduction, 2nd edn

    Google Scholar 

  30. Kruse R, Borgelt C, Klawonn F, Moewes C, Steinbrecher M, Held P (2013) Computational intelligence. Springer, Berlin

    Book  MATH  Google Scholar 

  31. Kar AK (2016) Bio inspired computing—a review of algorithms and scope of applications. Expert Syst Appl 59:20–32

    Article  Google Scholar 

  32. Kumar EP, Sharma EP (2014) Artificial neural networks—a study. Int J Emerg Eng Res Technol 2(2):143–148

    Google Scholar 

  33. Elmetwally MM, Aal FA, Awad ML, Omran S (2008) A hopfield neural network approach for integrated transmission network expansion planning. J Appl Sci Res 4(11):1387–1394

    Google Scholar 

  34. Negnevitsky M (2005) Artificial intelligence: a guide to intelligent systems. In: Artificial intelligence: a guide to intelligent systems. Pearson Education, pp 87–113

    Google Scholar 

  35. Biryulev C, Yakymiv Y, Selemonavichus A (2010) Research of ANN usage in data mining and semantic integration. In: MEMSTECH’2010

    Google Scholar 

  36. Mitchell M (1995) Genetic algorithms: an overview. Complexity 1(1):31–39

    Article  MATH  Google Scholar 

  37. Govind Maheswaran JJ, Jayarajan P, Johnes J (2013) K-means clustering algorithms: a comparative study

    Google Scholar 

  38. Jain S (2017) Mining big data using genetic algorithm. Int Res J Eng Technol 4(7):743–747

    Google Scholar 

  39. Ross TJ et al (2004) Fuzzy logic with engineering applications. IEEE Trans Inf Theory 58(3):1–19

    MATH  Google Scholar 

  40. Fernández A, Carmona CJ, del Jesus MJ, Herrera F (2016) A view on fuzzy systems for big data: progress and opportunities. Int J Comput Intell Syst 9:69–80

    Article  Google Scholar 

  41. Almejalli K, Dahal K, Hossain A (2007) GA-based learning algorithms to identify fuzzy rules for fuzzy neural networks. In: Proceedings of the 7th international conference on intelligent systems design and applications, ISDA 2007, pp 289–294

    Google Scholar 

  42. Pal SK, Meher SK, Skowron A (2015) Data science, big data and granular mining. Pattern Recogn Lett 67:109–112

    Article  Google Scholar 

  43. Yao Y (2008) Human-inspired granular computing 2. Granular computing as human-inspired problem solving, No. 1972, pp 401–410

    Google Scholar 

  44. Qiu J, Wu Q, Ding G, Xu Y, Feng S (2016) A survey of machine learning for big data processing. EURASIP J Adv Sign Process 2016(1):67

    Article  Google Scholar 

  45. Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–297

    MATH  Google Scholar 

  46. Baum LE, Petrie T (1966) Statistical inference for probabilistic functions of finite state Markov chains. Ann Math Stat 37(6):1554–1563

    Article  MathSciNet  MATH  Google Scholar 

  47. Rish I (2001) An empirical study of the Naïve Bayes classifier. IJCAI 2001 Work Empir Meth Artif Intell 3

    Google Scholar 

  48. Zarikas V, Papageorgiou E, Regner P (2015) Bayesian network construction using a fuzzy rule based approach for medical decision support. Expert Syst 32:344–369

    Google Scholar 

  49. Erar B (2011) Mixture model cluster analysis under different covariance structures using information complexity

    Google Scholar 

  50. Pelleg D, Pelleg D, Moore AW, Moore AW (2000) X-means: extending K-means with efficient estimation of the number of clusters. In: Proceedings of the seventeenth international conference on machine learning, pp 727–734

    Google Scholar 

  51. Pandey D, Pandey P (2010) Approximate Q-learning: an introduction. In: 2010 second international conference on machine learning and computing, pp 317–320

    Google Scholar 

  52. Desai S, Joshi K, Desai B (2016) Survey on reinforcement learning techniques. Int J Sci Res Publ 6(2):179–2250

    Google Scholar 

  53. Abramson M, Wechsler H (2001) Competitive reinforcement learning for combinatorial problems. In: Proceedings of the international joint conference on neural networks IJCNN’01, vol 4, pp 2333–2338

    Google Scholar 

  54. Zhou L, Pan S, Wang J, Vasilakos AV (2017) Machine learning on big data: opportunities and challenges. Neurocomputing 237:350–361

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sukey Nakasima-López .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Nakasima-López, S., Sanchez, M.A., Castro, J.R. (2018). Big Data and Computational Intelligence: Background, Trends, Challenges, and Opportunities. In: Sanchez, M., Aguilar, L., Castañón-Puga, M., Rodríguez-Díaz, A. (eds) Computer Science and Engineering—Theory and Applications. Studies in Systems, Decision and Control, vol 143. Springer, Cham. https://doi.org/10.1007/978-3-319-74060-7_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-74060-7_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-74059-1

  • Online ISBN: 978-3-319-74060-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics