Abstract
A new method to design learning laws for neural networks with continuous dynamics is proposed in this study. The learning method is based on the so-called double-averaged descendant technique (DASGDT), which is a variant of the gradient-descendant method. The learning law implements a double averaged algorithm which filters the effect of uncertainties of the states, which are continuously measurable. The learning law overcomes the classical assumption on the strict convexity of the functional with respect to the weights. The photocatalytic ozonation process of a single contaminant is estimated using the learning law design proposed in this study.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andreozzi, R., Caprio, V., Insola, A., Marotta, R.: Advanced oxidation processes (AOP) for water purification and recovery. Catal. Today 53(1), 51–59 (1999)
Beck, A., Teboulle, M.: Mirror descent and nonlinear projected subgradient methods for convex optimization. Oper. Res. Lett. 31(3), 167–175 (2003)
Cotter, N.: The stone-weierstrass theorem and its application to neural networks. IEEE Trans. Neural Netw. 1, 290–295 (1990)
Cybenko, G.: Approximation by superpositions of sigmoidal function. Math. Control Sig. Syst. 1989(2), 303–314 (1989)
Haddad, W., Chellaboina, V.: Nonlinear Dynamical Systems and Control. Princeton University Press, Princeton (2008)
Haykin, S.: Neural Networks and Learning Machines. Prentice Hall, Upper Saddle River (2009)
Kim, C.T., Lee, J.J.: Training two-layered feedforward networks with variable projection method. IEEE Trans. Neural Netw. 19(2), 371–375 (2008)
Malato, S., Oller, I., Fernández-Ibánez, P., Fuerhacker, M.: Technologies for advanced wastewater treatment in the mediterranean region. In: Barcelá, D., Petrovic, M. (eds.) Waste Water Treatment and Reuse in the Mediterranean Region, pp. 1–28. Springer, Heidelberg (2010). https://doi.org/10.1007/698_2010_59
Nazin, A.V.: Algorithms of inertial mirror descent in convex problems of stochastic optimization. Autom. Remote Control 79(1), 78–88 (2018)
Nemirovsky, A., Yudin, D.: Problem Complexity and Optimization Method Efficiency. Nauka, Moscow (1979)
Pérez-Sánchez, B., Fontenla-Romero, O., Guijarro-Berdiñas, B.: A review of adaptive online learning for artificial neural networks. Artif. Intell. Rev. 49(2), 281–299 (2018)
Poznyak, A.: Advanced Mathematical Tools for Automatic Control Engineers: Volume 1: Deterministic Systems. Elsevier Science, Amsterdam (2008)
Poznyak, A., Sanchez, E., Yu, W.: Differential Neural Networks for Robust Nonlinear Control (Identification, State Estimation and Trajectory Tracking). World Scientific, Singapore (2001)
Poznyak, T., Chairez, I., Poznyak, A.: Ozonation and Biodegradation in Environmental Engineering. Dynamic Neural Network Approach. Elsevier, Amsterdam (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Chairez, I., Poznyak, A., Nazin, A., Poznyak, T. (2019). Projectional Learning Laws for Differential Neural Networks Based on Double-Averaged Sub-Gradient Descent Technique. In: Lu, H., Tang, H., Wang, Z. (eds) Advances in Neural Networks – ISNN 2019. ISNN 2019. Lecture Notes in Computer Science(), vol 11554. Springer, Cham. https://doi.org/10.1007/978-3-030-22796-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-22796-8_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-22795-1
Online ISBN: 978-3-030-22796-8
eBook Packages: Computer ScienceComputer Science (R0)