Abstract
In this chapter, we shall introduce various kinds of neural network architectures, including the infamous Convolutional network that showed how such networks when combined with the backpropagation algorithm for minimizing the errors was able to recognize handwritten characters, that was later used by the US postal service to recognize zip codes (post codes).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes and References
Minsky, M. and Papert, S. (1969). Perceptrons. MIT Press.
Turing, A.M. (1952). The chemical basis of morphogenesis. Transactions. Royal Series B, Biological Sciences, 237 (641): 37–72.
Sieglmann and Sontag (1991). Applied Mathematics Letters, 4, 77–80.
Ackley, D.H., Hinton, G.E., and Sejnowski, T.J. (1985). A learning algorithm for Boltzmann machines. Cognitive Science, Elsevier, 9 (1): 147–169.
Smolensky, P. (1986). Information processing in dynamical systems: Foundations of harmony theory. In Rumelhart, D. and McLelland, J.L. (1986) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol.1, pp.194–281. MIT Press, Cambridge.
Hinton, G.E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14 (8): 1711–1800.
Rumerlhart, D.E., Hinton, G.E., and Williams, R.J. (1986). Learning representations by back-propagating errors. Nature, 323 (9): 533–536.
Lecun, Y., Bottou, L., Bengio, Y., and Haffner, P. (2001). Gradient-based learning applied to document recognition. In Intelligent Signal Processing. IEEE Press, pp. 306–351.
Topological Data Analysis and Machine Learning: Better Together (2015). http://cdn.ayasdi.com/wp-content/uploads/2015/02/wp-tda-and-machine-learning.pdf.
Hochreiter, S., and Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9 (8): 1735–1780.
Graves, A. et al. (2016). Hybrid computing using a neural network with dynamic external memory. Nature, 538, 471–476 (27 October 2016).
Differentiable neural computers, https://deepmind.com/blog/differentiable-neural-computers/.
Hinton, G. (2016). Google’s AI Chief Geoffrey Hinton how neural networks really work, https://youtu.be/EInQoVLg_UY.
Bengio, Y. (2015). Scaling up deep learning, http://www.iro.umontreal.ca/~bengioy/talks/IBM_13Oct2015.pdf.
Di Bono, M.G., and Zorzi, M. (2013). Deep generative learning location-invariant visual word recognition. Frontiers in Psychology, 4, 635. doi: 10.3389/fpsyg.2013.00635.
LeCun, Y. (2017). Facebook’s Yann LeCun: Predictive learning: The next frontier in A.I. https://youtu.be/qjI8lJn8Mss.
Zadeh, L. (1965). Fuzzy logic. Information and Control, 8, 338–353.
Rezende, D.J., Mohamed, S., and Wierstra, D. (2014). Stochastic backpropagation and approximate inference in deep generative models. In ICML’2014. Preprint: arXiv:1401.4082.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2018 The Author(s)
About this chapter
Cite this chapter
Skilton, M., Hovsepian, F. (2018). Advanced Neural Networks. In: The 4th Industrial Revolution. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-319-62479-2_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-62479-2_6
Published:
Publisher Name: Palgrave Macmillan, Cham
Print ISBN: 978-3-319-62478-5
Online ISBN: 978-3-319-62479-2
eBook Packages: Business and ManagementBusiness and Management (R0)