Skip to main content

Automatic Study in Stochastic Control

  • Conference paper

Part of the book series: The IMA Volumes in Mathematics and Its Applications ((IMA,volume 10))

Abstract

The purpose of this paper is to give an example of automatic generation of a complete study in stochastic control done by an expert system designed at INRIA by the authors. This study includes the:

  • automatic choice of an algorithm

  • automatic checking of the mathematical well posedness of the problem

  • automatic generation of a numerical routine

  • automatic test of this routine on a numerical example

  • automatic generation of graphics

  • automatic writing of a report describing all the obtained results.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. J.P. AUBIN, Approximation of elliptic Boundary-value Problems. Wiley Inter-science, New-York, 1972.

    MATH  Google Scholar 

  2. F. BASKET, M. CHANDY, R. MONTZ, J. PALACIOS Open Closed Mixed Network Of Queus With Different Class of Customers, J.A.C.M n’22, p. 248–260, 1975.

    Google Scholar 

  3. R.BELLMAN, Dynamic Programming,Princeton University Press,1957.

    Google Scholar 

  4. A. BENSOOSSAN, Stochastic Control by Functional Analysis Method, North-Holland 1982.

    Google Scholar 

  5. A. BENSOOSSAN, Méthodes de Perturbartion en Contrôle Optima1,1985.

    Google Scholar 

  6. A. BENSOUSSAN, J.L. LIONS, Applications des inéquations variationnelles en contrôle stochastique, Dunod,1978.

    MATH  Google Scholar 

  7. P.F. CIARLET, The finite element method for elliptic problems, North Holland, 1978.

    MATH  Google Scholar 

  8. D. CLAUDE, Decoupling of Nonlinear Systems, Systems Control Letters n’1, p242–248, 1982.

    Article  MathSciNet  Google Scholar 

  9. A.et C.COLMERAOER, Prolog en 10 figures, La Recherche 1985.

    Google Scholar 

  10. J.B. CRUZ, Feedback Systems, McGraw-Hill, 1972.

    Google Scholar 

  11. F. DELEBECQUE, J. P. QUADRAT, Sur l’Estimation des Caractéristiques Locales d’un Processus de diffusion avec Sauts, Rapport INRIA 1978.

    Google Scholar 

  12. F. DELEBECQUE, J. P. QUADRAT, Contribution of Stochastic Control Singular Perturbation Averaging and Team Theories to an Example of Large-Scale System: Management of Hydropower Production, IEEE AC23 n’2, p209–221 1978.

    MathSciNet  Google Scholar 

  13. J.C. DODO, M. GOURSAT, A. HERTZ, J.P. QUADRAT, M. VIOT Méthodes de gradient stochastique pour l’optimisation des investissements dans un réseau électrique, EDF Bulletin Serie C, n’2, 1981

    Google Scholar 

  14. I. ERLAND, R. TEMAM, Analyse convexe et problèmes variationnels, Dunod, 1974.

    Google Scholar 

  15. W.H. FLEMING, Control for small noise intensities, SIAM J.Control, vol.9, n’3, 1971.

    Google Scholar 

  16. W.H. FLEMING, R. RISHEL, Optimal Deterministic and Stochastic Control, Springer-Verlag, 1975.

    MATH  Google Scholar 

  17. F. GEROMEL, J. LEVINE, P. WILLIS, A fast Algorithm for Systems Decoupling using Formal Calculus, L.N.C.I.S n’63, Springer-Verlag 1984.

    Google Scholar 

  18. P. GLOESS, Logis User’s manual, Université de Compiegne, janvier 1984.

    Google Scholar 

  19. P. GLOESS, Understanding Expert Systems,Université de Compiegne, janvier 1964.

    Google Scholar 

  20. C. GOMEZ, J.P. QUADRAT, A. SULEM, Towards an Expert System in Stochastic Control: the Hamilton-Jacobi equation Part, L.N.C.I.S n’63, Springer-Verlag 1984.

    Google Scholar 

  21. C. GOMEZ, J.P. QUADRAT, A. SULEM, Towards an Expert System in Stochastic Control: the Local-feedback Part, Congrés Rome sur le contrôle Stochastique, L.N.C.I.S Springer-Verlag 1985.

    Google Scholar 

  22. TREOSYS Numerical methods in stochastic control., RAIRO Automatique 1983.

    Google Scholar 

  23. M. GOURSAT, J.P. QUADRAT, Analyse numériques d’inéquations quasi variationnelles elliptiques associées à des problèmes de contrôle impulsionnel, IRIA Rapport,1975.

    Google Scholar 

  24. M. GOURSAT, J.P. QUADRAT, Analyse numériques d’inéquations variationnelles elliptiques associées à des problèmes de temps d’arrêt optimaux, IRIA Rapport,1975.

    Google Scholar 

  25. J. JACOD, Calcul Stochastique et Problèmes de Martingale, Springer-Verlag, 1979.

    Google Scholar 

  26. E. RIEFER, J. WOLFOWITZ, Stochastic estimation of the maximum of a regression function, Ann. Math. Statistic, 23,n’3,1952.

    Google Scholar 

  27. H.J. KUSHNER, Probabilty methods in stochastic control and for elliptic equations, Academic Press, 1977.

    Google Scholar 

  28. B.J. KUSHNER, D.S. CLARK, Stochastic approximation methods for constrained and unconstrained systems, Springer Verlag,1978.

    Google Scholar 

  29. P.L. LIONS, B. MERCIER, Approximation numérique des équations de Jacobi-Bellman, RAIRO,14,pp.369–393, 1980.

    MathSciNet  MATH  Google Scholar 

  30. P. LIPCER A. SHIRIAEV Statistique des Processus Stochastiques, Presse Universitaire Moscou, 1974.

    Google Scholar 

  31. LISP Machine Lisp Manual, MIT Press,1982.

    Google Scholar 

  32. MACSYMA Manual,MIT Press,1983.

    Google Scholar 

  33. B.T. POLYAK, Convergence and convergence rate of iterative stochastic algorithms. Automatica i Telemekhanika, Vol.12,1976,pp.83–94.

    MathSciNet  Google Scholar 

  34. B.T. POLYAR, Subgradient methods a survey of soviet research in nonsmooth optimization, C. Lemarechal and K. Mifflin eds.Pergamon Press, 1978.

    Google Scholar 

  35. B.T. POLYAR, Y.Z. TSYPRIN, Pseudogradient adaptation and training algorithms. Automatica i Telemekhanika,Vol.3, 1973.

    Google Scholar 

  36. J.P. QUADRAT, Existence de solution et algorithme de résolutions numériques de problèmes stochastiques dégénérés ou non, SIAM Journal of Control, mars 1980.

    Google Scholar 

  37. J.B. QUADRAT, Analyse numérique de l’équation de Bellman stochastique, IRIA Report,1975.

    Google Scholar 

  38. J.P. QUADRAT, On optimal stochastic control problem of large systems, Advances in filtering and optimal stochastic control, Lecture Notes in Control and Computer Science n° 42, Springer-Verlag,1982.

    Google Scholar 

  39. J.P. QUADRAT, M. VIOT, Product form and optimal local feedback for multi-index Markov chains, Allerton Conference,1980.

    Google Scholar 

  40. C. QUEINNEC, LISP Langage d’un autre type, Eyrolles, 1983.

    Google Scholar 

  41. H. ROBBINS, S. MONRO, A stochastic approximation method. Ann. Math. Statist., 22, pp400–407, 1951.

    Article  MathSciNet  MATH  Google Scholar 

  42. F. STROOCR, S.R.S. VARADHAN, Multidimensional Diffusion Processes, Springer-Verlag,1979.

    Google Scholar 

  43. TORRION, Differentes méthodes d’optimisation appliquées à la gestion annuelle du système offre-demande français. Note EDF, EEG 1985.

    Google Scholar 

  44. TURGEON, Optimal operation of multi-reservoir power system with stochastic inflows. Water resource resarch. April 1980

    Google Scholar 

  45. CHANCELIER-GOMEZ-QUADRAT-SULEM Un systeme expert pour l’optimisation de système dynamique, Congres d’Analyse Numerique INRIA Versailles Decembre 85, North Holland.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1988 Springer-Verlag New York Inc.

About this paper

Cite this paper

Chancelier, J.P., Gomez, C., Quadrat, J.P., Sulem, A. (1988). Automatic Study in Stochastic Control. In: Fleming, W., Lions, PL. (eds) Stochastic Differential Systems, Stochastic Control Theory and Applications. The IMA Volumes in Mathematics and Its Applications, vol 10. Springer, New York, NY. https://doi.org/10.1007/978-1-4613-8762-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-1-4613-8762-6_5

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4613-8764-0

  • Online ISBN: 978-1-4613-8762-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics