Abstract
This paper analyses the difficulty of big data analytics problems and the potential of swarm intelligence solving big data analytics problems. Nowadays, the big data analytics has attracted more and more attentions, which is required to manage immense amounts of data quickly. However, current researches mainly focus on the amount of data. In this paper, the other three properties of big data analytics, which include the high dimensionality of data, the dynamical change of data, and the multi-objective of problems, are discussed. Swarm intelligence, which works with a population of individuals, is a collection of nature-inspired searching techniques. It has effectively solved many large-scale, dynamical, and multi-objective problems. Based on the combination of swarm intelligence and data mining techniques, we can have better understanding of the big data analytics problems, and designing more effective algorithms to solve real-world big data analytics problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abraham, A., Grosan, C., Ramos, V. (eds.): Swarm Intelligence in Data Mining. SCI, vol. 34. Springer, Heidelberg (2006)
Bellman, R.: Adaptive Control Processes: A guided Tour. Princeton University Press, Princeton (1961)
Bosman, P.A.N., Thierens, D.: The balance between proximity and diversity in multiobjective evolutionary algorithms. IEEE Transactions on Evolutionary Computation 7(2), 174–188 (2003)
Brockhoff, D., Zitzler, E.: Objective reduction in evolutionary multiobjective optimization: Theory and applications. Evolutionary Computation 17(2), 135–166 (2009)
Cheng, S.: Population Diversity in Particle Swarm Optimization: Definition, Observation, Control, and Application. Ph.D. thesis, Department of Electrical Engineering and Electronics, University of Liverpool (May 2013)
Cheng, S., Shi, Y., Qin, Q.: Population diversity of particle swarm optimizer solving single and multi-objective problems. International Journal of Swarm Intelligence Research (IJSIR) 3(4), 23–60 (2012)
Cheng, S., Shi, Y., Qin, Q., Gao, S.: Solution clustering analysis in brain storm optimization algorithm. In: Proceedings of The 2013 IEEE Symposium on Swarm Intelligence (SIS 2013), pp. 111–118. IEEE, Singapore (2013)
Chui, M., Löffler, M., Roberts, R.: The internet of things. McKinsey Quarterly 2, 1–9 (2010)
Coello, C.A.C., Dehuri, S., Ghosh, S. (eds.): Swarm Intelligence for Multi-objective Problems in Data Mining. SCI, vol. 242. Springer, Heidelberg (2009)
Cohen, S.C.M., de Castro, L.N.: Data clustering with particle swarms. In: Proceedings of the 2006 IEEE Congress on Evolutionary Computations (CEC 2006), pp. 1792–1798 (July 2006)
Domingos, P.: A few useful things to know about machine learning. Communications of the ACM 55(10), 78–87 (2012)
Donoho, D.L.: Aide-Memoire. High-Dimensional Data Analysis: The Curses and Blessings of Dimensionality. Tech. rep., Stanford University (August 2000)
Dorigo, M., Maniezzo, V., Colorni, A.: Ant system: optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 26(1), 29–41 (1996)
Dorigo, M., Stützle, T.: Ant Colony Optimization. MIT Press (June 2004)
Eberhart, R., Shi, Y.: Computational Intelligence: Concepts to Implementations, 1st edn. Morgan Kaufmann Publisher (2007)
Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: From data mining to knowledge discovery in databases. AI Magazine 17(3), 37–54 (1996)
Ficici, S.G.: Monotonic solution concepts in coevolution. In: Genetic and Evolutionary Computation Conference (GECCO 2005), pp. 499–506 (June 2005)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd edn. Springer Series in Statistics. Springer (February 2009)
Jin, Y., Branke, J.: Evolutionary Optimization in Uncertain Environments – A Survey. IEEE Transactions on Evolutionary Computation 9(3), 303–317 (2005)
Jin, Y., Sendhoff, B.: A systems approach to evolutionary multiobjective structural optimization and beyond. IEEE Computational Intelligence Magazine 4(3), 62–76 (2009)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks (ICNN), pp. 1942–1948 (1995)
Kennedy, J., Eberhart, R., Shi, Y.: Swarm Intelligence. Morgan Kaufmann Publisher (2001)
Kulkarni, R.V., Venayagamoorthy, G.K.: Particle swarm optimization in wireless-sensor networks: A brief survey. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 41(2), 262–267 (2011)
Liu, Y., Zhou, G., Zhao, J., Dai, G., Li, X.Y., Gu, M., Ma, H., Mo, L., He, Y., Wang, J., Li, M., Liu, K., Dong, W., Xi, W.: Long-term large-scale sensing in the forest: recent advances and future directions of greenorbs. Frontiers of Computer Science in China 4(3), 334–338 (2010)
Lu, Y., Wang, S., Li, S., Zhou, C.: Particle swarm optimizer for variable weighting in clustering high-dimensional data. Machine Learning 82(1), 43–70 (2011)
Manyika, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., Byers, A.H.: Big data: The next frontier for innovation, competition, and productivity. Tech. rep., McKinsey Global Institute (May 2011)
Martens, D., Baesens, B., Fawcett, T.: Editorial survey: swarm intelligence for data mining. Machine Learning 82(1), 1–42 (2011)
Pal, S.K., Talwar, V., Mitra, P.: Web mining in soft computing framework: Relevance, state of the art and future directions. IEEE Transactions on Neural Networks 13(5), 1163–1177 (2002)
Rajaraman, A., Leskovec, J., Ullman, J.D.: Mining of Massive Datasets. Cambridge University Press (July 2012)
Scott, D.W., Thompson, J.R.: Probability density estimation in higher dimensions. In: Gentle, J.E. (ed.) Computer Science and Statistics: Proceedings of the Fifteenth Symposium on the Interface, pp. 173–179 (1983)
Sheppard, J.W., Salzberg, S.L.: A Teaching Strategy for Memory-Based Control. Artificial Intelligence Review 11(1-5), 343–370 (1997)
Shi, Y.: An optimization algorithm based on brainstorming process. International Journal of Swarm Intelligence Research (IJSIR) 2(4), 35–62 (2011)
Slaney, M., Casey, M.: Locality-sensitive hashing for finding nearest neighbors. IEEE Signal Processing Magazine 25(2), 128–131 (2008)
Teodorović, D.: Transport modeling by multi-agent systems: A swarm intelligence approach. Transportation Planning and Technology 26(4), 289–312 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cheng, S., Shi, Y., Qin, Q., Bai, R. (2013). Swarm Intelligence in Big Data Analytics. In: Yin, H., et al. Intelligent Data Engineering and Automated Learning – IDEAL 2013. IDEAL 2013. Lecture Notes in Computer Science, vol 8206. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41278-3_51
Download citation
DOI: https://doi.org/10.1007/978-3-642-41278-3_51
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41277-6
Online ISBN: 978-3-642-41278-3
eBook Packages: Computer ScienceComputer Science (R0)