Abstract
The paper describes the approach for a distributed execution of data mining algorithms and using this approach for building a Cloud for Data Mining. The suggested approach allows us to execute data mining algorithms in different parallel and distributed environments. Thus, the created Cloud for Data Mining can be used as an analytic service and a platform for research and debugging parallel and distributed data mining algorithms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Machine Learning Library (MLlib) Guide. http://spark.apache.org/docs/latest/mllib-guide.html. Accessed 05 Apr 2016
Grant, I.: Introducing Apache Mahout. http://www.ibm.com/developerworks/java/library/j-mahout/. Accessed 05 Apr 2016
Weka4WS. http://gridlab.dimes.unical.it/weka4ws/about/. Accessed 05 Apr 2016
Waikato Environment for Knowledge Analysis (Weka). www.cs.waikato.ac.nz/ml/weka/. Accessed 05 Apr 2016
The WS-Resource Framework. http://toolkit.globus.org/wsrf/. Accessed 05 Apr 2016
Gorlatch, S.: Extracting and implementing list homomorphisms in parallel program development. Sci. Comput. Program. 33(1), 1–27 (1999)
Gronlund, C.J.: Introduction to machine learning on Microsoft Azure. https://azure.microsoft.com/en-gb/documentation/articles/machine-learning-what-is-machine-learning/. Accessed 05 Apr 2016
Yu, L., Zheng, J., Shen, W.C., Wu, B., Wang, B., Qian, L., Zhang, B.R.: BC-PDM: data mining, social network analysis and text mining system based on cloud computing. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, pp. 1496–1499 (2012)
Kholod, I., Petukhov, I.: Creation of data mining algorithms as functional expression for parallel and distributed execution. In: Malyshkin, V. (ed.) PaCT 2015. LNCS, vol. 9251, pp. 62–67. Springer, Heidelberg (2015)
Alonzo, C., Rosser, B.J.: Some properties of conversion. Trans. AMS 39, 472–482 (1936)
Kholod, I.: Framework for multi threads execution of data mining algorithms. In: Proceeding of 2015 IEEE North West Russia Section Young Researchers in Electrical and Electronic Engineering Conference (2015 ElConRusW), pp. 74–80. IEEE Xplore (2015)
Common Warehouse Metamodel (CWM) Specification. http://www.omg.org/spec/CWM/1.1/. Accessed 05 Apr 2016
Akka Documentation. http://akka.io/docs/. Accessed 05 Apr 2016
Acknowledgments
The work has been performed in Saint Petersburg Electrotechnical University “LETI” within the scope of the contract Board of Education of Russia and science of the Russian Federation under the contract № 02.G25.31.0058 from 12.02.2013. The paper has been prepared within the scope of the state project “Organization of scientific research” of the main part of the state plan of the Board of Education of Russia, the project part of the state plan of the Board of Education of Russia (task 2.136.2014/K) as well as supported by grant of RFBR (projects 16-07-00625).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Kholod, I., Kuprianov, M., Petukhov, I. (2016). Parallel and Distributed Data Mining in Cloud. In: Perner, P. (eds) Advances in Data Mining. Applications and Theoretical Aspects. ICDM 2016. Lecture Notes in Computer Science(), vol 9728. Springer, Cham. https://doi.org/10.1007/978-3-319-41561-1_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-41561-1_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41560-4
Online ISBN: 978-3-319-41561-1
eBook Packages: Computer ScienceComputer Science (R0)