Regularization Methods for the Stable Identification of Probabilistic Characteristics of Stochastic Structures

  • Vladimir KulikovEmail author
  • Alexander Kulikov
Part of the Studies in Systems, Decision and Control book series (SSDC, volume 259)


This chapter covers the method of experimental data analysis and processing in cyber-physical systems for medical monitoring, control of manufacturing processes and management of industrial facilities. The suggested methods are used to develop mathematical models of dynamic systems with stochastic properties for managing complex structural subsystems of cyber-physical systems. The most important computational stage of the simulation is thereat the identification of multimodal (in general) densities of the random variable distribution. A matrix conditioning analysis is herein suggested with minimizing relevant functionals of the identification problem. For the method of identifying multimodal densities of random variable distribution a matrix condition analysis is suggested with minimizing the relevant functionals of the problem. It is shown that under ill-conditioning of the equivalent system of equations an algorithm for regularization of solutions is needed. The regularization of the basic method for identifying distribution densities based on the ridge regression-algorithm (RRA) is proposed and substantiated. The classical RRA is improved and modified for local regularization showing the advantage of the high-order unstable SLAEs over the classical Tikhonov method. The suggested regularization algorithms and programs are universal, applicable to the study of random structures in natural science, biomedicine, and computational mathematics.


Cyber-physical systems (CPS) Parameter monitoring Identification Multimodal densities Ill-conditioning of matrices Ridge regression-algorithm Minimization of functionals 



The study was carried out with the financial support from the Russian Fund for Basic Research as part of a research project № 19-07-00926_a.


  1. 1.
    Kulikov, V.: The identification of the distribution density in the realization of stochastic processes by the regularization method. Appl. Mathem. Sci. 9(137), 6827–6834 (2015)Google Scholar
  2. 2.
    Kulikov, V., Kulikov, A.: Applied problems of the identification and regression analysis in stochastic structures with multimodal properties. ITM Web of Conferences, vol. 6, article 03008 (2016)Google Scholar
  3. 3.
    Kulikov, V.B., Kulikov, A.B., Khranilov, V.P.: The analysis of stochastic properties of the SVD decomposition at approximation of the experimental data. Procedia Comput. Sci. 103, 114–119 (2017)CrossRefGoogle Scholar
  4. 4.
    Tikhonov, A.N., Arsenin, V.Y.: Methods of Ill-Conditioned Problems Solution. Nauka, Moscow (1986). (in Russian)Google Scholar
  5. 5.
    Bertero, M.: Regularized and positive-constrained inverse methods in the problem of object restoration. Opt. Act. 28(12), 1635–1649 (1981)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Engl, H.W.: Regularization Methods for Inverse Problems. Kluwer Academic Publishers (1996)Google Scholar
  7. 7.
    Golub, G.H.: Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21, 215–222 (1979)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Urmanov, A.M.: Information complexity-based regularization parameter selection for the solution of ill-conditioned inverse problems. Inverse Prob. 18(2), L1–L9 (2002)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Karajiannis, N.B.: Regularization theory in image restoration—the stabilizing functional approach. IEEE Trans. Acoust. Speech Sign. Process. 38(7), 1155–1179 (1990)Google Scholar
  10. 10.
    Lukas, M.A.: Comparison of parameter choice methods for regularization with discrete noisy data. Inverse Prob. 14(2), 161–184 (2000)MathSciNetGoogle Scholar
  11. 11.
    Reginska, T.: A regularization parameter in discrete ill-posed problems. SIAM J. Sci. Comput. 17(6), 740–749 (1996)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Neto, F.D.M.: Introduction to inverse problems with applications. Springer, Cham (2013)CrossRefGoogle Scholar
  13. 13.
    Gebali, F.: Solving Systems of Linear Equations. Algorithms and Parallel Computing. Wiley (2011)Google Scholar
  14. 14.
    Hansen, P.C.: Rank-Deficient and Discrete Ill-posed Problems. Numerical Aspects of Linear Inversion. SIAM, Philadelphia (1998)CrossRefGoogle Scholar
  15. 15.
    Hoang, N.S.: Solving ill-conditioned linear algebraic systems by the dynamical systems method. Inverse Probl. Sci. Eng. 16(5), 617–630 (2008)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Hoerl, A.E., Kennard, R.W.: Ridge regression: biased estimation for non-orthogonal problems. Technometrics 12, 55–67 (1970)CrossRefGoogle Scholar
  17. 17.
    Vapnik, V.N.: Algorithms and Programs for Recovery of Dependence. Nauka, Moscow (1984). (in Russian)Google Scholar
  18. 18.
    Binder, K.: Monte Carlo Simulation in Statistical Physics. An Introduction. Springer, Berlin (1992)CrossRefGoogle Scholar
  19. 19.
    Goos, P.: Optimal Design of Experiments. A Case Study Approach. Wiley (2011)Google Scholar
  20. 20.
    Hansen, P.C.: Regularization tools: a Matlab package for analysis and solution of discrete ill-posed problems. Numer. Algorithms 6(1), 1–35 (1994)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Siebertz, K.: Statistische Versuchsplanung. Design of Experiments. Springer, Heidelberg, Dordrecht, London, New York (2010)CrossRefGoogle Scholar
  22. 22.
    Wang, Y.: Optimization and Regularization of Computational Inverse Problems and Applications. Springer, (2011)Google Scholar
  23. 23.
    Voskoboinikov, Y.E., Mukhina, I.N.: Local regularizing algorithm for high-contrast image and signal restoration. Optoelectron. Instrum. Data Process. 3, 41–48 (2000)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Nizhny Novgorod State Technical University n. a. R. E. AlekseevNizhny NovgorodRussia

Personalised recommendations