Introduction to Hybrid Intelligent Networks pp 93-126 | Cite as

# Multistability of Delayed Hybrid Impulsive Neural Networks

## Abstract

The important topic of multistability of continuous- and discrete-time neural network models has been investigated rather extensively. Concerning the design of associative memories, this chapter introduces the multistability of delayed hybrid impulsive neural networks and lays emphasis on the impulse effect. Arising from the spikes in biological networks, impulsive neural networks provide an efficient model for synaptic interconnections among neurons. Using state-space decomposition, the coexistence of multiple equilibria of hybrid impulsive neural networks is analyzed. Multistability criteria are then established regrading delayed hybrid impulsive neurodynamics, for which both the impulse effect on convergence rate and the basin of attraction of equilibria are discussed. Illustrative examples are given to verify the theoretical results and demonstrate an application to the design of associative memories. It is shown by an experimental example that delayed hybrid impulsive neural networks have the advantages of high storage capacity and high fault tolerance when used for associative memories.

## References

- 1.G. A Carpenter, “Neural network models for pattern recognition and associative memory,”
*Neural Netw.*, vol. 2, no. 4, pp. 243–257, 1989.CrossRefGoogle Scholar - 2.Z. Chen, Z. Li, and C. L. P. Chen, “Adaptive neural control of uncertain MIMO nonlinear systems with state and input constraints,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 28, no. 6, pp. 1318–1330, 2017.CrossRefGoogle Scholar - 3.B. Talaei, S. Jagannathan, and J. Singler, “Output feedback-based boundary control of uncertain coupled semilinear parabolic PDE using neurodynamic programming,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 29, no. 4, pp. 1263–1274, 2018.CrossRefGoogle Scholar - 4.T. Shiraishi, S. Matsuyama, and H. Kitano, “Large-scale analysis of network bistability for human cancers,”
*PLoS Computat. Biol.*, vol. 6, no. 7, e1000851, 2010.CrossRefGoogle Scholar - 5.M. Forti and P. Nistri, “Global convergence of neural networks with discontinuous neuron activations,”
*IEEE Trans. Circuits Syst. I*, vol. 50, no. 11, pp. 1421–1435, 2003.MathSciNetCrossRefGoogle Scholar - 6.H. Chen, P. Shi, C.-C. Lim, and P. Hu, “Exponential stability for neutral stochastic markov systems with time-varying delay and its applications,”
*IEEE Trans. Cybern.*, vol. 46, no. 6, pp. 1350–1362, 2016CrossRefGoogle Scholar - 7.C. K. Zhang, Y. He, L. Jiang, and M. Wu, “Stability analysis for delayed neural networks considering both conservativeness and complexity,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 27, no. 7, pp. 1486–1501, 2016.MathSciNetCrossRefGoogle Scholar - 8.Q. Han, X. Liao, T. Huang, J. Peng, C. Li, and H. Huang, “Analysis and design of associative memories based on stability of cellular neural networks,”
*Neurocomputing*, vol. 97, pp. 192–200, 2012.CrossRefGoogle Scholar - 9.D. Liu and A. N. Michel, “Cellular neural networks for associative memories,”
*IEEE Trans. Circuits Syst. II*, vol. 40, no. 2, pp. 119–121, 1993.CrossRefGoogle Scholar - 10.G. Grassi, “A new approach to design cellular neural networks for associative memories,”
*IEEE Trans. Circuits Syst. I*, vol. 44, no. 9, pp. 835–838, 1997.CrossRefGoogle Scholar - 11.I. Stamova and G. Stamov, “Impulsive neural networks, In: Applied Impulsive Mathematical Models, CMS books in mathematics.”
*Cham: Springer*, 2016.Google Scholar - 12.H. Bao, J. H. Park, and J. Cao, “Exponential synchronization of coupled stochastic memristor-based neural networks with time-varying probabilistic delay coupling and impulsive delay,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 27, no. 1, pp. 190–201, 2016.MathSciNetCrossRefGoogle Scholar - 13.Z. H. Guan and G. Chen, “On delayed impulsive Hopfield neural networks,”
*Neural Netw.*, vol. 12, no. 2, pp. 273–280, 1999.CrossRefGoogle Scholar - 14.Z. H. Guan, J. Lam, and G. Chen, “On impulsive autoassociative neural networks,”
*Neural Netw.*, vol. 13, no. 1, pp. 63–69, 2000.CrossRefGoogle Scholar - 15.L. Wang, Q. Song, Y. Liu, Z. Zhao, and F. E. Alsaadi, “Global asymptotic stability of impulsive fractional-order complex-valued neural networks with time delay,”
*Neurocomputing*, vol. 243, pp. 49–59, 2017.CrossRefGoogle Scholar - 16.Z. Yang and D. Xu, “Stability analysis of delay neural networks with impulsive effects,”
*IEEE Trans. Circuits Syst. II*, vol. 52, no. 8, pp. 517–521, 2005.CrossRefGoogle Scholar - 17.S. Yang, Z. Guo, and J. Wang, “Global synchronization of multiple recurrent neural networks with time delays via impulsive interactions,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 28, no. 7, pp. 1657–1667, 2017.MathSciNetCrossRefGoogle Scholar - 18.W. Zhang, C. Li, T. Huang, and X. He, “Synchronization of memristor-based coupling recurrent neural networks with time-varying delays and impulses,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 26, no. 12, pp. 3308–3313, 2015.MathSciNetCrossRefGoogle Scholar - 19.S. Duan, H. Wang, L. Wang, T. Huang, and C. Li, “Impulsive effects and stability analysis on memristive neural networks with variable delays,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 28, no. 2, pp. 476–481, 2017.CrossRefGoogle Scholar - 20.B. Hu, Z. H. Guan, T. H. Qian, and G. Chen, “Dynamic analysis of hybrid impulsive delayed neural networks with uncertainties,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 29, no. 9, pp. 4370–4384, 2018.CrossRefGoogle Scholar - 21.J. Lu, D. W. C. Ho, and J. Cao, “A unified synchronization criterion for impulsive dynamical networks,”
*Automatica*, vol. 46, no. 7, pp. 1215–1221, 2010.MathSciNetCrossRefGoogle Scholar - 22.M.-F. Danca, M. Feckan, and G. Chen, “Impulsive stabilization of chaos in fractional-order systems,”
*Nonlin. Dyn.*, vol. 89, no. 3, pp. 1889–1903, 2017.MathSciNetCrossRefGoogle Scholar - 23.J. Lu, J. Kurths, J. Cao, N. Mahdavi, and C. Huang, “Synchronization control for nonlinear stochastic dynamical networks: Pinning impulsive strategy,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 23, no. 2, pp. 285–292, 2012.CrossRefGoogle Scholar - 24.Z. H. Guan, B. Hu, M. Chi, D. X. He, and X. M. Cheng, “Guaranteed performance consensus in second-order multi-agent systems with hybrid impulsive control,”
*Automatica*, vol. 50, no. 9, pp. 2415–2418, 2014.MathSciNetCrossRefGoogle Scholar - 25.E. Kaslik and S. Sivasundaram, “Multistability in impulsive hybrid Hopfield neural networks with distributed delays,”
*Nonlin. Anal.: Real World Applic.*, vol. 12, no. 3, pp. 1640–1649, 2011.MathSciNetCrossRefGoogle Scholar - 26.L. Wang and T. Chen, “Multistability of neural networks with Mexican-hat-type activation functions,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 23, no. 11, pp. 1816–1826, 2012.CrossRefGoogle Scholar - 27.Z. Zeng and W. X. Zheng, “Multistability of neural networks with time varying delays and concave-convex characteristics,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 23, no. 2, pp. 293–305, 2012.CrossRefGoogle Scholar - 28.X. Nie and W. X. Zheng, “Multistability and instability of neural networks with discontinuous nonmonotonic piecewise linear activation functions,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 26, no. 11, pp. 2901–2913, 2015.MathSciNetCrossRefGoogle Scholar - 29.P. Liu, Z. Zeng, and J. Wang, “Multistability of recurrent neural networks with nonmonotonic activation functions and mixed time delays,”
*IEEE Trans. Syst., Man, Cybern., Syst.*, vol. 46, no. 4, pp. 512–523, 2016.CrossRefGoogle Scholar - 30.M. D. Marco, M. Forti, and L. Pancioni, “Convergence and multistability of nonsymmetric cellular neural networks with memristors,”
*IEEE Trans. Cybern.*, vol. 47, no. 10, pp. 2970–2983, 2017.CrossRefGoogle Scholar - 31.Z. Guo, J. Wang, and Z. Yan, “Attractivity analysis of memristor-based cellular neural networks with time-varying delays,”
*IEEE Trans. Neural Netw. Learn. Syst.*, vol. 25, no. 4, pp. 704–717, 2014.CrossRefGoogle Scholar - 32.W. Lu, L. Wang, and T. Chen, “On attracting basins of multiple equilibria of a class of cellular neural networks,”
*IEEE Trans. Neural Netw.*, vol. 22, no. 3, pp. 381–394, 2011.CrossRefGoogle Scholar - 33.H. Zhang, T. Ma, G. B. Huang, and Z. Wang, “Robust global exponential synchronization of uncertain chaotic delayed neural networks via dual-stage impulsive control,”
*IEEE Trans. Syst., Man, Cybern. B, Cybern.*, vol. 40, no. 3, pp. 831–844, 2010.CrossRefGoogle Scholar - 34.W. He, F. Qian, and J. Cao, “Pinning-controlled synchronization of delayed neural networks with distributed-delay coupling via impulsive control,”
*Neural Netw.*, vol. 85, pp. 1–9, 2017.CrossRefGoogle Scholar - 35.I. Stamova and G. Stamov, “Mittag-Leffler synchronization of fractional neural networks with time-varying delays and reaction-diffusion terms using impulsive and linear controllers,”
*Neural Netw.*, vol. 96, pp. 22–32, 2017.CrossRefGoogle Scholar - 36.X. Yang, J. Cao, and Z. Yang, “Synchronization of coupled reaction-diffusion neural networks with time-varying delays via pinning-impulsive controller,”
*Siam J. Control Optim.*, vol. 51, no. 5, pp. 3486–3510, 2013.MathSciNetCrossRefGoogle Scholar - 37.Y. Liu, Z. Wang, and X. Liu, “Global exponential stability of generalized recurrent neural networks with discrete and distributed delays,”
*Neural Netw.*, vol. 19, no. 5, pp. 667–675, 2006.CrossRefGoogle Scholar - 38.Y. Liu, Z. Wang, J. Liang, and X. Liu, “Synchronization of coupled neutral-type neural networks with jumping-mode-dependent discrete and unbounded distributed delays,”
*IEEE Trans. Cybern.*, vol. 43, no. 1, pp. 102–114, 2013.CrossRefGoogle Scholar