Definition
Deep Learning or also known as deep structured learning or hierarchical learning is a part of a broader family of Machine Learning methods based on learning data representations (Bengio et al. 2013). Giving that Hordri et al. (2017) have systematically reviewed that the features of the Deep Learning are a hierarchical layer, high-level abstraction, process a high volume of data, universal model, and does not overfit training data. Deep Learning can be applied to learn from labeled data if it is available in sufficiently large amounts; it is particularly interesting to learn from large amounts of unlabeled/unsupervised data (Bengio et al. 2013; Bengio 2013), so it is also interesting to extract meaningful representations and patterns from Big Data. Since data keeps getting bigger, several Deep Learning tools have appeared to enable efficient development and implementation of Deep Learning method in Big Data (Bahrampour et al. 2015). Due to Deep Learning having different...
This is a preview of subscription content, log in via an institution to check access.
References
Ahmed E, Jones M, Marks TK (2015) An improved deep learning architecture for person re-identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, pp 3908–3916
Al-Rfou R, Alain G, Almahairi A, Angermueller C, Bahdanau D, Ballas N, Bastien F, Bayer J, Belikov A, Belopolsky A, Bengio Y (2016) Theano: A Python framework for fast computation of mathematical expressions. arXiv preprint arXiv:1605.02688, pp 472–473
Bahrampour S, Ramakrishnan N, Schott L, Shah M (2015) Comparative study of caffe, neon, theano, and torch for deep learning. arXiv preprint arXiv:1511.06435
Bastien F, Lamblin P, Pascanu R, Bergstra J, Goodfellow I, Bergeron A, Warde-Farley D, Bengio Y (2012) Theano: new features and speed improvements. arXiv preprint arXiv:1211.5590
Bengio Y (2013) Deep learning of representations: looking forward. In: International conference on statistical language and speech processing, Springer, Berlin/Heidelberg, pp 1–37
Bengio Y, Bengio S (2000) Modeling high-dimensional discrete data with multi-layer neural networks. In: Solla SA, Leen TK, Muller KR (eds) Advances in neural information processing systems. MIT Press, Boston, pp 400–406
Bengio Y, Courville A, Vincent P (2013) Representation learning: a review and new perspectives. IEEE Trans Pattern Anal Mach Intell 35(8):1798–1828. https://doi.org/10.1109/tpami.2013.50. arXiv: 1206.5538
Bergstra J, Bastien F, Breuleux O, Lamblin P, Pascanu R, Delalleau O, Desjardins G, Warde-Farley D, Goodfellow I, Bergeron A, Bengio Y (2011) Theano: Deep learning on gpus with python. In NIPS 2011, BigLearning Workshop, Granada, Spain, vol. 3
Boureau YL, Cun YL (2008) Sparse feature learning for deep belief networks. In: Advances in neural information processing systems, NIPS Press, Vancouver, pp 1185–1192
Caffe Tutorial (2018) https://web.archive.org/web/20170405073658/https://vision.princeton.edu/courses/COS598/2015sp/slides/Caffe/caffe_tutorial.pdf
Chen XW, Lin X (2014) Big data deep learning: challenges and perspectives. IEEE Access 2:514–525
Chetlur S, Woolley C, Vandermersch P, Cohen J, Tran J, Catanzaro B, Shelhamer E (2014) cuDNN: efficient primitives for deep learning. arXiv preprint arXiv:1410.0759
Collobert R, Kavukcuoglu K, Farabet C (2011) Torch7: a matlab-like environment for machine learning. In: BigLearn, NIPS workshop, no. EPFL-CONF-192376
Efrati A (2013) How ‘deep learning’ works at Apple, beyond. Information (online). https://www.theinformation.com/How-Deep-Learning-Works-at-Apple-Beyond
Glorot X, Bordes A, Bengio Y (2011) Domain adaptation for large-scale sentiment classification: a deep learning approach. In: Proceedings of the 28th international conference on machine learning (ICML-11), Washington, pp 513–520
Goodfellow IJ, Warde-Farley D, Lamblin P, Dumoulin V, Mirza M, Pascanu R, Bergstra J, Bastien F, Bengio Y (2013) Pylearn2: a machine learning research library. stat, 1050, p. 20
Hordri NF, Samar A, Yuhaniz SS, Shamsuddin SM (2017) A systematic literature review on features of deep learning in big data analytics. Int J Adv Soft Comput Appl 9(1):32–49
Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T (2014) Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the 22nd ACM international conference on Multimedia, ACM, New York, pp 675–678
Jones N (2014) Computer science: the learning machines. Nature 505(7482):146–148
Kirk J (2013) Universities, IBM join forces to build a brain-like computer. PCWorld. http://www.pcworld.com/article/2051501/universities-join-ibm-in-cognitive-computing-researchproject.html
Kokkinos I (2015) Pushing the boundaries of boundary detection using deep learning. arXiv preprint arXiv:1511.07386
Lane ND, Bhattacharya S, Georgiev P, Forlivesi C, Kawsar F (2015) An early resource characterization of deep learning on wearables, smartphones and internet-of-things devices. In: Proceedings of the 2015 international workshop on internet of things towards applications, ACM, New York, pp 7–12
Lerer A, Gross S, Fergus R (2016) Learning physical intuition of block towers by example. In: International conference on machine learning, pp 430–438
Litjens G, Sánchez CI, Timofeeva N, Hermsen M, Nagtegaal I, Kovacs I, …, Van Der Laak J (2016) Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Sci Rep 6:26286
National Research Council (2013) Frontiers in massive data analysis. The National Academies Press, Washington, DC. http://www.nap.edu/openbook.php?record_id=18374
Sherkhane P, Vora D (2017) Survey of deep learning software tools. In: 2017 International conference on data management, analytics and innovation (ICDMAI), IEEE, Pune, pp 236–238
Shokri R, Shmatikov V (2015) Privacy-preserving deep learning. In: Proceedings of the 22nd ACM SIGSAC conference on computer and communications security, ACM, New York, pp 1310–1321
Tokui S, Oono K, Hido S, Clayton J (2015) Chainer: a next-generation open source framework for deep learning. In: Proceedings of workshop on machine learning systems (LearningSys) in the twenty-ninth annual conference on neural information processing systems (NIPS), vol 5
Acknowledgments
This work is supported by The Ministry of Higher Education, Malaysia under Fundamental Research Grant Scheme: 4F877.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this entry
Cite this entry
Hordri, N.F., Yuhaniz, S.S., Shamsuddin, S.M., Mohd Azmi, N.F. (2018). Big Data Deep Learning Tools. In: Sakr, S., Zomaya, A. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-63962-8_310-1
Download citation
DOI: https://doi.org/10.1007/978-3-319-63962-8_310-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63962-8
Online ISBN: 978-3-319-63962-8
eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering