Adaptive Numerical Approach for Optimal Control of a Single Train

  • Xiang WuEmail author
  • Kanjian Zhang
  • Ming Cheng


This paper considers the optimal control problem of a single train, which is formulated as an optimal control problem of nonlinear systems with switching controller. The switching sequence and the switching time are decision variables to be chosen optimally. Generally speaking, it is very difficult to solve this problem analytically due to its nonlinear nature, the complexity of the controller, and the existence of system state and control input constraints. To obtain the numerical solution, by introducing binary functions for every value of the control input, relaxing the binary functions, and imposing a penalty function on the relaxation, the problem is transformed into a parameter optimization problem, which can be efficiently solved by using any gradient-based numerical approach. Then, the authors propose an adaptive numerical approach to solve this problem. Convergence results indicate that any optimal solution of the parameter optimization problem is also an optimal solution of the original problem. Finally, an optimal control problem of a single train illustrates that the adaptive numerical approach proposed by us is less time-consuming and obtains a better cost function value than the existing approaches.


Adaptive numerical approach nonlinear system optimal control switching controller train control 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Khmelnitsky E, On an optimal control problem of train operation, IEEE Trans. Autom. Control, 2000, 45: 1257–1266.MathSciNetCrossRefzbMATHGoogle Scholar
  2. [2]
    Howlett P, The optimal control of a train, Ann. Oper. Res., 2000, 98: 65–87.MathSciNetCrossRefzbMATHGoogle Scholar
  3. [3]
    Howlett P, An optimal strategy for the control of a train, J. Aust. Math. Soc. Ser. B. Appl. Math., 1990, 31: 454–471.MathSciNetCrossRefzbMATHGoogle Scholar
  4. [4]
    Howlett P G, Milroy I P, and Pudney P J, Energy-efficient train control, Control Engi. Pract., 1994, 2: 193–200.CrossRefGoogle Scholar
  5. [5]
    Howlett P G, Pudney P J, and Vu X, Local energy minimization in optimal train control, Automatica, 2009, 45: 2692–2698.MathSciNetCrossRefzbMATHGoogle Scholar
  6. [6]
    Su S, Li X, Tang T, et al., A subway train timetable optimization approach based on energyefficient operation strategy, IEEE Trans. Intell. Transport. Syst., 2013, 14: 883–893.CrossRefGoogle Scholar
  7. [7]
    Albrecht A R, Howlett P G, Pudney P J, et al., Energy-efficient train control: From local convexity to global optimization and uniqueness, Automatica, 2013, 49: 3072–3078.MathSciNetCrossRefzbMATHGoogle Scholar
  8. [8]
    Li X and Lo H K, Energy minimization in dynamic train scheduling and control for metro rail operations, Transport. Res. B Meth., 2014, 70: 269–284.CrossRefGoogle Scholar
  9. [9]
    Su S, Tang T, and Roberts C, A cooperative train control model for energy saving, IEEE Trans. Intell. Transporta. Syst., 2015, 16: 622–631.CrossRefGoogle Scholar
  10. [10]
    Li S, De Schutter B, Yang L, et al., Robust model predictive control for train regulation in underground railway transportation, IEEE Trans. Control Syst. Technol., 2016, 24: 1075–1083.CrossRefGoogle Scholar
  11. [11]
    Ye H and Liu R, A multiphase optimal control method for multi-train control and scheduling on railway lines, Transport. Res. B Meth., 2016, 93: 377–393.CrossRefGoogle Scholar
  12. [12]
    Scheepmaker G M, Goverde R M, and Kroon L G, Review of energy-efficient train control and timetabling, Eur. J. Oper. Res., 2017, 257: 355–376.MathSciNetCrossRefzbMATHGoogle Scholar
  13. [13]
    Wu X, Lei B, Zhang K, et al., Hybrid stochastic optimization method for optimal control problems of chemical processes, Chem. Eng. Res. Design, 2017, 126: 297–310.CrossRefGoogle Scholar
  14. [14]
    Liu D and Wei Q, Finite-approximation-error-based optimal control approach for discrete-time nonlinear systems, IEEE Trans. Cybern., 2013, 43: 779–789.CrossRefGoogle Scholar
  15. [15]
    Wu X, Zhang K, and Cheng M, Computational method for optimal control of switched systems with input and state constraints, Nonlinear Anal. Hybrid Syst., 2017, 26: 1–18.MathSciNetCrossRefzbMATHGoogle Scholar
  16. [16]
    Kirk D E, Optimal Control Theory: An Introduction, Courier Corporation, New York, 2012.Google Scholar
  17. [17]
    Wu S and Shu L, Maximum principle for partially-observed optimal control problems of stochastic delay systems, Journal of Systems Science & Complexity, 2017, 30(2): 316–328.MathSciNetCrossRefzbMATHGoogle Scholar
  18. [18]
    Jiang Y and Jiang Z P, Global adaptive dynamic programming for continuous-time nonlinear systems, IEEE Trans. Autom. Control, 2015, 60: 2917–2929.MathSciNetCrossRefzbMATHGoogle Scholar
  19. [19]
    Wu X, Liu Q, Zhang K, et al., Optimal switching control for drug therapy process in cancer chemotherapy, Eur. J. Control, 2018, DOI: 10.1016/j.ejcon.2018.02.004.Google Scholar
  20. [20]
    Wu X, Zhang K, and Cheng M, Optimal control of bioprocess systems using hybrid numerical optimization algorithms, Optimization, 2018, DOI: 10.1080/02331934.2018.1466299.Google Scholar
  21. [21]
    Aseev S M and Kryazhimskiy A V, The Pontryagin maximum principle and transversality conditions for a class of optimal control problems with infinite time horizons, SIAM J. Control Optim., 2004, 43: 1094–1119.MathSciNetCrossRefzbMATHGoogle Scholar
  22. [22]
    Wei Q, Liu D, and Lin H, Value iteration adaptive dynamic programming for optimal control of discrete-time nonlinear systems. IEEE Trans. Cybern., 2016, 46: 840–853.CrossRefGoogle Scholar
  23. [23]
    Liu R and Li S, Suboptimal integral sliding mode controller design for a class of affine systems, J. Optim. Theory Appl., 2014, 161: 877–904.MathSciNetCrossRefzbMATHGoogle Scholar
  24. [24]
    Guo B Z and Wu T T, Numerical solution to optimal feedback control by dynamic programming approach: A local approximation algorithm, Journal of Systems Science & Complexity, 2017, 30(2): 782–802.MathSciNetCrossRefzbMATHGoogle Scholar
  25. [25]
    Karuppiah R and Grossmann I E, Global optimization for the synthesis of integrated water systems in chemical processes, Comput. Chem. Eng., 2006, 30: 650–673.CrossRefGoogle Scholar
  26. [26]
    Banga J R, Balsa-Canto E, Moles C G, et al., Dynamic optimization of bioprocesses: Efficient and robust numerical strategies, J. Biotechnol., 2005, 117: 407–419.CrossRefGoogle Scholar
  27. [27]
    Xu X and Antsaklis P J, Optimal control of switched systems via non-linear optimization based on direct differentiations of value functions, Int. J. Control, 2002, 75: 1406–1426.MathSciNetCrossRefzbMATHGoogle Scholar
  28. [28]
    Xu X and Antsaklis P J, Optimal control of switched systems based on parameterization of the switching instants, IEEE Trans. Auto. Control, 2004, 49: 2–16.MathSciNetCrossRefzbMATHGoogle Scholar
  29. [29]
    Sager S, Bock H G, and Diehl M, The integer approximation error in mixed-integer optimal control, Math. Program., 2012, 133: 1–23.MathSciNetCrossRefzbMATHGoogle Scholar
  30. [30]
    Hante F M and Sager S, Relaxation methods for mixed-integer optimal control of partial differential equations, Comput. Optim. Appl., 2013, 55: 197–225.MathSciNetCrossRefzbMATHGoogle Scholar
  31. [31]
    Sager S, Claeys M, and Messine F, Efficient upper and lower bounds for global mixed-integer optimal control, J. Global Optim., 2015, 61: 721–743.MathSciNetCrossRefzbMATHGoogle Scholar
  32. [32]
    Moehle N and Boyd S, A perspective-based convex relaxation for switched-affine optimal control, Syst. Control Lett., 2015, 86: 34–40.MathSciNetCrossRefzbMATHGoogle Scholar
  33. [33]
    Wu X, Zhang K, and Sun C, Parameter tuning of multi-proportional-integral-derivative controllers based on optimal switching algorithms, J. Optim. Theory Appl., 2013, 159: 454–472.MathSciNetCrossRefzbMATHGoogle Scholar
  34. [34]
    Wu X, Zhang K, and Sun C, Constrained optimal control of switched systems based on modified BFGS algorithm and filled function method, Int. J. Comput. Math., 2014, 91: 1713–1729.MathSciNetCrossRefzbMATHGoogle Scholar
  35. [35]
    Wu X and Zhang K, Three-dimensional trajectory design for horizontal well based on optimal switching algorithms, ISA Trans., 2015, 58: 348–356.CrossRefGoogle Scholar
  36. [36]
    Wu X, Zhang K, and Cheng M, Computational method for optimal machine scheduling problem with maintenance and production, Int. J. Prod. Res., 2017, 55: 1791–1814.CrossRefGoogle Scholar
  37. [37]
    Wu X, Zhang K, and Sun C, Numerical algorithm for a class of constrained optimal control problems of switched systems, Numer. Algorithms, 2014, 67: 771–792.MathSciNetCrossRefzbMATHGoogle Scholar
  38. [38]
    Howlett P, Optimal strategies for the control of a train, Automatica, 1996, 32: 519–532.MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Institute of Systems Science, Academy of Mathematics and Systems Science, Chinese Academy of Sciences and Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Mathematical SciencesGuizhou Normal UniversityGuiyangChina
  2. 2.School of Electrical EngineeringSoutheast UniversityNanjingChina
  3. 3.School of AutomationSoutheast UniversityNanjingChina
  4. 4.Key Laboratory of Measurement and Control of CSE, Ministry of EducationSoutheast UniversityNanjingChina

Personalised recommendations