Mathematics of Control, Signals, and Systems

, Volume 31, Issue 3, pp 333–362 | Cite as

Approximately reachable directions for piecewise linear switched systems

  • Dan GoreacEmail author
Original Article


This paper deals with some reachability issues for piecewise linear switched systems with time-dependent coefficients and multiplicative noise. Namely, it aims at characterizing data that are almost reachable at some fixed time \(T>0\) (belong to the closure of the reachable set in a suitable \({\mathbb {L}}^2\)-sense). From a mathematical point of view, this provides the missing link between approximate controllability toward 0 and approximate controllability toward given targets. The methods rely on linear–quadratic control and Riccati equations. The main novelty is that we consider an LQ problem with controlled backward stochastic dynamics and, since the coefficients are not deterministic (unlike some of the cited references), neither is the backward stochastic Riccati equation. Existence and uniqueness of the solution of such equations rely on structure arguments [inspired by Confortola (Ann Appl Probab 26(3):1743–1773, 2016)]. Besides solvability, Riccati representation of the resulting control problem is provided as is the synthesis of optimal (non-Markovian) control. Several examples are discussed.


Reachability Approximate controllability Controlled switch process Linear–quadratic control Backward stochastic Riccati equation Stochastic gene networks 

Mathematics Subject Classification

93B05 93B25 60J75 



  1. 1.
    Barbu V, Răşcanu A, Tessitore G (2003) Carleman estimates and controllability of linear stochastic heat equations. Appl Math Optim 47(2):97–120MathSciNetzbMATHCrossRefGoogle Scholar
  2. 2.
    Bismut J-M (1973) Conjugate convex functions in optimal stochastic control. J Math Anal Appl 44:384–404MathSciNetzbMATHCrossRefGoogle Scholar
  3. 3.
    Brémaud P (1981) Point processes and queues: martingale dynamics. Springer series in statistics. Springer, New YorkzbMATHCrossRefGoogle Scholar
  4. 4.
    Buckdahn R, Quincampoix M, Tessitore G (2006) A characterization of approximately controllable linear stochastic differential equations. In: Stochastic partial differential equations and applications—VII, volume 245 of lecture notes in pure and applied mathematics. Chapman & Hall/CRC, Boca Raton, pp 53–60Google Scholar
  5. 5.
    Confortola F, Fuhrman M (2014) Backward stochastic differential equations associated to jump Markov processes and applications. Stoch Process Appl 124(1):289–316MathSciNetzbMATHCrossRefGoogle Scholar
  6. 6.
    Confortola F, Fuhrman M, Guatteri G, Tessitore G (2018) Linear-quadratic optimal control under non-Markovian switching. Stoch Anal Appl 36(1):166–180MathSciNetzbMATHCrossRefGoogle Scholar
  7. 7.
    Confortola F, Fuhrman M, Jacod J (2016) Backward stochastic differential equation driven by a marked point process: an elementary approach with an application to optimal control. Ann Appl Probab 26(3):1743–1773MathSciNetzbMATHCrossRefGoogle Scholar
  8. 8.
    Crudu A, Debussche A, Radulescu O (2009) Hybrid stochastic simplifications for multiscale gene networks. BMC Syst Biol 3:89CrossRefGoogle Scholar
  9. 9.
    Curtain RF (1986) Invariance concepts in infinite dimensions. SIAM J Control Optim 24(5):1009–1030MathSciNetzbMATHCrossRefGoogle Scholar
  10. 10.
    Davis MHA (1984) Piecewise-deterministic Markov-processes—a general-class of non-diffusion stochastic-models. J R Stat Soc Ser B Methodol 46(3):353–388MathSciNetzbMATHGoogle Scholar
  11. 11.
    Davis MHA (1993) Markov models and optimization, volume 49 of monographs on statistics and applied probability. Chapman & Hall, LondonGoogle Scholar
  12. 12.
    Fernández-Cara E, Garrido-Atienza MJ, Real J (1999) On the approximate controllability of a stochastic parabolic equation with a multiplicative noise. Comptes rendus Acad Sci Paris Sér I Math 328(8):675–680MathSciNetzbMATHCrossRefGoogle Scholar
  13. 13.
    Goreac D (2008) A Kalman-type condition for stochastic approximate controllability. Comptes Rendus Math 346(3–4):183–188MathSciNetzbMATHCrossRefGoogle Scholar
  14. 14.
    Goreac D, Grosu AC, Rotenstein E-P (2016) Approximate and approximate null-controllability of a class of piecewise linear Markov switch systems. Syst Control Lett 96:118–123MathSciNetzbMATHCrossRefGoogle Scholar
  15. 15.
    Goreac D, Martinez M (2015) Algebraic invariance conditions in the study of approximate (null-) controllability of Markov switch processes. Math Control Signals Syst 27(4):551–578MathSciNetzbMATHCrossRefGoogle Scholar
  16. 16.
    Hautus MLJ (1969) Controllability and observability conditions of linear autonomous systems. Nederl. Akad. Wetensch. Proc Ser A 72 Indag Math 31:443–448MathSciNetzbMATHGoogle Scholar
  17. 17.
    Ikeda N, Watanabe S (1981) Stochastic differential equations and diffusion processes, volume 24 of North-Holland mathematical library. North-Holland, Kodansha, Ltd., Amsterdam, TokyoGoogle Scholar
  18. 18.
    Jacob B, Partington JR (2006) On controllability of diagonal systems with one-dimensional input space. Syst Control Lett 55(4):321–328MathSciNetzbMATHCrossRefGoogle Scholar
  19. 19.
    Kalman R (1959) On the general theory of control systems. IRE Trans Autom Control 4(3):110–110CrossRefGoogle Scholar
  20. 20.
    Li X, Sun J, Xiong J (2017) Linear quadratic optimal control problems for mean-field backward stochastic differential equations. Appl Math Optim 78:145–183Google Scholar
  21. 21.
    Lim AEB, Zhou XY (2001) Linear-quadratic control of backward stochastic differential equations. SIAM J Control Optim 40(2):450–474MathSciNetzbMATHCrossRefGoogle Scholar
  22. 22.
    Lü Q, Yong J, Zhang X (2012) Representation of Itô integrals by Lebesgue/Bochner integrals. J Eur Math Soc 14:1795–1823MathSciNetzbMATHCrossRefGoogle Scholar
  23. 23.
    Merton RC (1976) Option pricing when underlying stock returns are discontinuous. J Financ Econ 3:125–144zbMATHCrossRefGoogle Scholar
  24. 24.
    Pardoux E, Peng SG (1990) Adapted solution of a backward stochastic differential equation. Syst Control Lett 14(1):55–61MathSciNetzbMATHCrossRefGoogle Scholar
  25. 25.
    Peng S (1994) Backward stochastic differential equation and exact controllability of stochastic control systems. Prog Nat Sci (Engl Ed) 4:274–284MathSciNetGoogle Scholar
  26. 26.
    Russell D, Weiss G (1994) A general necessary condition for exact observability. SIAM J Control Optim 32(1):1–23MathSciNetzbMATHCrossRefGoogle Scholar
  27. 27.
    Schmidt EJPG, Stern RJ (1980) Invariance theory for infinite dimensional linear control systems. Appl Math Optim 6(2):113–122MathSciNetzbMATHCrossRefGoogle Scholar
  28. 28.
    Sirbu M, Tessitore G (2001) Null controllability of an infinite dimensional SDE with state- and control-dependent noise. Syst Control Lett 44(5):385–394MathSciNetzbMATHCrossRefGoogle Scholar
  29. 29.
    Wang Y, Yang D, Yong J, Yu Z (2017) Exact controllability of linear stochastic differential equations and related problems. Math Control Relat Fields 7(2):305–345MathSciNetzbMATHCrossRefGoogle Scholar
  30. 30.
    Yong J, Zhou XY (1999) Stochastic controls. Hamiltonian systems and HJB equations. Springer, New YorkzbMATHGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Mathematics and StatisticsShandong University at WeihaiWeihaiP.R. China
  2. 2.LAMA (UMR 8050), UPEMLV, UPEC, CNRSUniversité Paris-EstMarne-la-ValléeFrance

Personalised recommendations