Abstract
The reservoir computation (RC) is a recurrent neural network architecture that is very suitable for time series prediction tasks. Its implementation in specific hardware can be very useful in relation to software approaches, especially when low consumption is an essential requirement. However, the hardware realization of RC systems is expensive in terms of circuit area and power dissipation, mainly due to the need of a large number of multipliers at the synapses. In this paper, we present an implementation of an RC network with cyclic topology (simple cyclic reservoir) in which we limit the available synapses’ weights, which makes it possible to replace the multiplications with simple addition operations. This design is evaluated to implement the equalization of a non-linear communication channel, and allows significant savings in terms of hardware resources, presenting an accuracy comparable to previous works.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Baptista, D., Abreu, S., Freitas, F., Vasconcelos, R., Morgado-Dias, F.: A survey of software and hardware use in artificial neural networks. Neural Comput. Appl. 23(3–4), 591–599 (2013)
Misra, J., Saha, I.: Artificial neural networks in hardware: a survey of two decades of progress. Neurocomputing 74(1–3), 239–255 (2010)
Amir, M.F., Kim, D., Kung, J., Lie, D., Yalamanchili, S., Mukhopadhyay, S.: NeuroSensor: a 3D image sensor with integrated neural accelerator. In: 2016 SOI-3D-Subthreshold Microelectronics Technology Unified Conference, S3S 2016 (2017)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25(NIPS2012), 1–9 (2012)
Morro, A., Canals, V., Oliver, A., Alomar, M.L., Galan-Prado, F., Ballester, P.J., Rossello, J.L.: A stochastic spiking neural network for virtual screening (2017)
Li, H., Zhang, D., Foo, S.Y.: A stochastic digital implementation of a neural network controller for small wind turbine systems. IEEE Trans. Power Electron. 21(5), 1502–1507 (2006)
Chauhan, A., Semwal, S., Chawhan, R.: Artificial neural network-based forest fire detection system using wireless sensor network. In: 2013 Annual IEEE India Conference (INDICON), pp. 1–6 (2013)
Raghunathan, S., Gupta, S.K., Ward, M.P., Worth, R.M., Roy, K., Irazoqui, P.P.: The design and hardware implementation of a low-power real-time seizure detection algorithm. J. Neural Eng. 6(5), 056005 (2009)
Lee, M., Hwang, K., Park, J., Choi, S., Shin, S., Sung, W.: FPGA-based low-power speech recognition with recurrent neural networks. In: IEEE Workshop on Signal Processing Systems, SiPS: Design and Implementation, pp. 230–235 (2016)
Basterretxea, K., Tarela, J.M., del Campo, I.: Digital design of sigmoid approximator for artificial neural networks. Electron. Lett. 38(1), 35–37 (2002)
Baptista, D., Morgado-Dias, F.: Low-resource hardware implementation of the hyperbolic tangent for artificial neural networks. Neural Comput. Appl. 23(3–4), 601–607 (2013)
Carrasco-Robles, M., Serrano, L.: Accurate differential tanh(nx) implementation. Int. J. Circuit Theory Appl. 37(5), 613–629 (2009)
Nedjah, N., De MacEdo Mourelle, L.: Reconfigurable hardware for neural networks: binary versus stochastic. Neural Comput. Appl. 16(3), 249–255 (2007)
Lotrič, U., Bulić, P.: Applicability of approximate multipliers in hardware neural networks. Neurocomputing 96, 57–65 (2012)
Lukoševičius, M., Jaeger, H., Schrauwen, B.: Reservoir computing trends. KI - Künstliche Intell. 26(4), 365–371 (2012)
Antonelo, E.A., Schrauwen, B.: On learning navigation behaviors for small mobile robots with reservoir computing architectures. IEEE Trans. Neural Netw. Learn. Syst. 26(4), 763–780 (2015)
Jalalvand, A., Wallendael, G.V., Walle, R.V.D.: Real-time reservoir computing network-based systems for detection tasks on visual contents. In: Proceedings - 7th International Conference on Computational Intelligence, Communication Systems and Networks, CICSyN 2015, pp. 146–151 (2015)
Lin, X., Yang, Z., Song, Y.: Short-term stock price prediction based on echo state networks. Expert Syst. Appl. 36(3 PART 2), 7313–7317 (2009)
Alomar, M.L., Canals, V., Perez-Mora, N., Martínez-Moll, V., Rosselló, J.L.: FPGA-based stochastic echo state networks for time-series forecasting. Comput. Intell. Neurosci. 2016 (2016)
Alomar, M.L., Soriano, M.C., Escalona-Morán, M., Canals, V., Fischer, I., Mirasso, C.R., Rosselló, J.L.: Digital implementation of a single dynamical node reservoir computer. IEEE Trans. Circuits Syst. II Express Briefs 62(10), 977–981 (2015)
Benedetto, S., Biglieri, E.: Principles of Digital Transmission: With Wireless Applications. Kluwer Academic Publishers, Norwell (1999)
Boccato, L., Lopes, A., Attux, R., Von Zuben, F.J.: An echo state network architecture based on Volterra filtering and PCA with application to the channel equalization problem. In: Proceedings of the International Joint Conference on Neural Networks, pp. 580–587 (2011)
Rossello, J.L., Alomar, M.L., Morro, A., Oliver, A., Canals, V.: High-density liquid-state machine circuitry for time-series forecasting. Int. J. Neural Syst. 26(5), 1550036 (2016)
Rodan, A., Tiño, P.: Minimum complexity echo state network. IEEE Trans. Neural Netw. 22(1), 131–144 (2011)
Jaeger, H., Haas, H.: Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304(5667), 78–80 (2004)
Bauduin, M., Smerieri, A., Massar, S., Horlin, F.: Equalization of the non-linear satellite communication channel with an Echo state network. In: IEEE Vehicular Technology Conference, vol. 2015 (2015)
Mathews, V.J., Lee, J.: Adaptive algorithms for bilinear filtering. In: Proceedings of SPIE - The International Society for Optical Engineering, vol. 2296, pp. 317–327 (1994)
Nguimdo, R.M., Verschaffelt, G., Danckaert, J., Van Der Sande, G.: Simultaneous computation of two independent tasks using reservoir computing based on a single photonic nonlinear node with optical feedback. IEEE Trans. Neural Netw. Learn. Syst. 26(12), 3301–3307 (2015)
Ortín, S., Soriano, M.C., Pesquera, L., Brunner, D., San-Martín, D., Fischer, I., Mirasso, C.R., Gutiérrez, J.M.: A unified framework for reservoir computing and extreme learning machines based on a single time-delayed neuron. Scientific Reports 5 (2015)
Vinckier, Q., Duport, F., Smerieri, A., Haelterman, M., Massar, S.: Autonomous bio-inspired photonic processor based on reservoir computing paradigm. In: 2016 IEEE Photonics Society Summer Topical Meeting Series, SUM 2016. pp. 183–184 (2016)
Acknowledgment
This work has been partially supported by the Spanish Ministry of Economy and Competitiveness (MINECO), the Regional European Development Funds (FEDER), and the Comunitat Autonoma de les Illes Balears under grant contracts TEC2014-56244-R, TEC2017-84877-R and a fellowship (FPI/1513/2012) financed by the European Social Fund (ESF) and the Govern de les Illes Balears (Conselleria d’Educació, Cultura i Universitats).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Skibinsky-Gitlin, E.S. et al. (2018). Cyclic Reservoir Computing with FPGA Devices for Efficient Channel Equalization. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J. (eds) Artificial Intelligence and Soft Computing. ICAISC 2018. Lecture Notes in Computer Science(), vol 10841. Springer, Cham. https://doi.org/10.1007/978-3-319-91253-0_22
Download citation
DOI: https://doi.org/10.1007/978-3-319-91253-0_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-91252-3
Online ISBN: 978-3-319-91253-0
eBook Packages: Computer ScienceComputer Science (R0)