Tunneling Algorithm for Solving Nonconvex Optimal Control Problems

  • Alexander Yurievich Gornov
  • Tatiana Sergeevna Zarodnyuk
Part of the Springer Optimization and Its Applications book series (SOIA, volume 76)


This chapter considers a new method of search for the global extremum in a nonlinear nonconvex optimal control problem. The method employs a curvilinear search technique to implement the tunneling phase of the algorithm. Local search in the minimization phase is carried out with the standard algorithm that combines the methods of conjugate and reduced gradients.

The software implementation of the suggested tunneling algorithm was tested on a collection of nonconvex optimal control problems and demonstrated efficiency of the this approach.

Key words

Optimal control Global optimization Tunneling methods Curvilinear search 



This work is partly supported by Grants N 12-01-00193 and N 10-01-00595 of the Russian Foundation for Basic Research.


  1. 1.
    Banga, J.R., Seider, W.D.: Global optimization of chemical processes using stochastic algorithms. In: Floudas, C.A., Pardalos, P.M. (eds.) State of the Art in Glob. Optim., 563–583 (1996)Google Scholar
  2. 2.
    Banga, J.R., Versyck, K.J., Van Impe, J.F.: Computation of optimal identification experiments for nonlinear dynamic process models: a stochastic global optimization approach. Ind. Eng. Chem. Res. 41, 2425–2430 (2002)CrossRefGoogle Scholar
  3. 3.
    Bobbin, J., Yao, X.: Solving optimal control problems with a cost on changing control by evolutionary algorithms. Proc. IEEE Int. Conf. Evol. Comput., Indianapolis, USA, 331–336 (1997)Google Scholar
  4. 4.
    Chachuat, B., Latifi, M.A.: A new approach in deterministic global optimization of problems with ordinary differential equations. In: Floudas, C.A., Pardalos, P.M. (eds.) Front. in Glob. Optim., 83–108 (2003)Google Scholar
  5. 5.
    Chentsov, A.G.: Asymptotic attainability. Kluwer, Dordrecht (1997)MATHGoogle Scholar
  6. 6.
    Esposito, W.R., Floudas, C.A.: Determistic global optimization in nonlinear optimal control problems. J. Glob. Optim. 17, 97–126 (2000b)MathSciNetMATHCrossRefGoogle Scholar
  7. 7.
    Gornov, A.Yu.: The computational technologies for solving optimal control problems. Nauka, Novosibirsk (2009) (in Russian)Google Scholar
  8. 8.
    Gornov, A.Yu., Zarodnyuk, T.S.: Method of curvilinear search for global extremum in optimal control problems. Contemp. Technol. Syst. Anal. Simul. 3, 19–27 (2009) (in Russian)Google Scholar
  9. 9.
    Hashem, M.M.A., Watanabe, K., Izumi, K., A new evolution strategy and its application to solving optimal control problems. JSME Int. J., 41(3), 406–412 (1998)CrossRefGoogle Scholar
  10. 10.
    Levy, A.V., Montalvo, A.: The tunneling algorithm for the global minimization of functions. SIAM J. Sci. Stat. Comput. 6, 15–29 (1985)MathSciNetMATHCrossRefGoogle Scholar
  11. 11.
    Lin, Y.D., Stadtherr, M.A.: Deterministic global optimization of nonlinear dynamic systems. AIChE J. 53(4), 866–875 (2007)CrossRefGoogle Scholar
  12. 12.
    Liu, Y., Teo, K.L.: An adaptive dual parametrization algorithm for quadratic semi-infinite programming problems. J. Glob. Optim. 24(2), 205–217 (2002)MathSciNetMATHCrossRefGoogle Scholar
  13. 13.
    Long, C.E., Polisetty, P.K., Gatzke, E.P.: Deterministic global optimization for nonlinear model predictive control of hybrid dynamic systems. Int. J. Robust Nonlinear Control 17(13), 1232–1250 (2007)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Lopez-Cruz, I.L.: Efficient Evolutionary Algorithms for Optimal Control. PhD Thesis, Wageningen University, The Netherlands (2002)Google Scholar
  15. 15.
    Luus, R.: Piecewise linear continuous optimal control by using iterative dynamic programming. Ind. Eng. Chem. Res. 32, 859–865 (1993)CrossRefGoogle Scholar
  16. 16.
    Papamichail, I., Adjiman, C.S.: A rigorous global optimization algorithm for problems with ordinary differential equations. J. Glob. Optim. 24, 1–33 (2002)MathSciNetMATHCrossRefGoogle Scholar
  17. 17.
    Pardalos, P., Yatsenko, V.: Optimization approach to the estimation and control of lyapunov exponents journal of optimization theory and its applications 128(1), 29–48 (2006)Google Scholar
  18. 18.
    Roubos, J.A., Van Straten, G., Van Boxtel, A.J.B.: An evolutionary strategy for fed-batch bioreactor optimization: concepts and performance. J. Biotechnol. 67, 173–187 (1999)CrossRefGoogle Scholar
  19. 19.
    Sim, Y.C., Leng, S.B., Subramaniam, V.: A combined genetic algorithms-shooting method approach to solving optimal control problems. Int. J. Syst. Sci. 31(1), 83–89 (2000)MATHCrossRefGoogle Scholar
  20. 20.
    Singer, A.B., Barton, P.I.: Global solution of optimization problems with dynamic systems embedded. In: Floudas, C.A., Pardalos, P.M. (eds.) Front. in Glob. Optim., 477–498 (2003)Google Scholar
  21. 21.
    Singer, A.B., Barton, P.I.: Global optimization with nonlinear ordinary differential equations. J. Glob. Optim. 34(2), 159–190 (2006)MathSciNetMATHCrossRefGoogle Scholar
  22. 22.
    Smith, S., Stonier, R.: Applying evolution program techniques to constrained continuous optimal control problems. Proc. IEEE Conf. Evol. Comput., Piscataway, USA, 285–290 (1996)Google Scholar
  23. 23.
    Storn, R., Price, K., Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces. J. Glob. Optim. 11, 341–359 (1997)MathSciNetMATHCrossRefGoogle Scholar
  24. 24.
    Vilkov, A.V., Zhidkov, N.P., Shchedrin, B.M.: A method of search for the global minimum of the single-variable function. J. Comput. Math. and Math. Phys. 4, 1040–1042 (1975) (in Russian)Google Scholar
  25. 25.
    Wang, F.S., Chiou, J.P.: Optimal control and optimal time location problems of differential-algebraic systems by differential evolution. Ind. Eng. Chem. Res. 36, 5348–5357 (1997)CrossRefGoogle Scholar
  26. 26.
    Yamashita, Y., Shima, M.: Numerical computational method using genetic algorithm for the optimal control problem with terminal constraints and free parameters. Nonlin. Anal., Theory, Meth. and Appl. 30(4), 2285–2290 (1997)Google Scholar
  27. 27.
    Zarodnyuk, T.S., Gornov, A.Yu.: Test collection of nonconvex optimal control problems. Proc. Conf. “Lyapunov Read. and Present. of Inf. Technol.”, Irkutsk, Russia (2008) (in Russian)Google Scholar
  28. 28.
    Zarodnyuk, T.S., Gornov, A.Yu.: The basic components of program software OPTCON-III for solving nonconvex optimal control problem. Proc. of XVI Baikal All-Russian Conf. “Inf. and Math. Technol. in Sci. and Control”, Irkutsk, Russia (2010) (in Russian)Google Scholar
  29. 29.
    Zhigljavsky, A.A., Zhilinskas, A.G.: The methods for global extremum search. Nauka, Moscow (1991) (in Russian)Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Alexander Yurievich Gornov
    • 1
  • Tatiana Sergeevna Zarodnyuk
    • 1
  1. 1.Institute for System Dynamics and Control Theory SB RASIrkutskRussia

Personalised recommendations