Online optimizing hot forming parameters for alloy parts based on action-dependent heuristic dynamic programming

  • Dong-Dong Chen
  • Y. C. LinEmail author


The microstructural evolution is complex and time-varying in the practice hot forming process of alloy parts. Therefore, accurately online optimizing forming parameters and controlling microstructural evolution are the urgent tasks. In this work, an action-dependent heuristic dynamic programming (ADHDP) is developed to online optimize processing parameters during hot deformation of alloys. The ADHDP is based on adaptive dynamic programming and only contains action/critic neural networks (ANN/CNN). ANN is utilized to determine the next control signals (processing parameters) of hot deformation, while CNN is used to obtain the approximation of cost-to-go function. The weights of these neural networks are online-updated by back-propagation algorithm. The control goals include the recrystallization volume fraction and average grain size. The proposed ADHDP method is successfully applied to online optimize processing parameters of GH4169 superalloy during hot deformation, and its effectiveness is verified by numerical simulations. According to the optimized processing parameters, the hot compressive tests of GH4169 superalloy are conducted to further verify the validity of the developed method. Furthermore, the microstructures, which are obtained by the proposed method, are more uniform and fine than those obtained by the traditional processing without online optimization.


Alloy Hot deformation Action-dependent heuristic dynamic programming Online optimization Processing parameter 


Funding information

This work was supported by the National Natural Science Foundation Council of China (Grant No. 51775564).


  1. 1.
    Lin YC, Chen XM (2011) A critical review of experimental results and constitutive descriptions for metals and alloys in hot working. Mater Des 32:1733–1759Google Scholar
  2. 2.
    Samantaray D, Mandal S, Bhaduri AK (2011) Optimization of hot working parameters for thermo- mechanical processing of modified 9Cr-1Mo (P91) steel employing dynamic materials model. Mater Sci Eng A 528:5204–5211Google Scholar
  3. 3.
    Ji HC, Liu JP, Wang BY, Tang XF, Huo YM, Zhou J, Hu ZH (2016) Constitutive relationship of 4Cr9Si2 and technological parameters on the inner bore of cross wedge rolling for preform hollow valves. Int J Adv Manuf Technol 86(9-12):2621–2633Google Scholar
  4. 4.
    Cui MC, Zhao SD, Zhang DW, Chen C, Li YY (2017) Finite element analysis on axial-pushed incremental warm rolling process of spline shaft with 42CrMo steel and relevant improvement. Int J Adv Manuf Technol 90(9-12):2477–2490Google Scholar
  5. 5.
    Chen F, Cui ZS, Ou HG, Long H (2016) Mesoscale modeling and simulation of microstructure evolution during dynamic recrystallization of a Ni-based superalloy. Appl Phys A Mater Sci Process 122:890Google Scholar
  6. 6.
    Chen F, Liu J, Ou HG, Lu B, Cui ZS, Long H (2015) Flow characteristics and intrinsic workability of IN718 superalloy. Mater Sci Eng A 642:279–287Google Scholar
  7. 7.
    Zhang CS, Yang S, Wang CX, Zhao GQ, Gao AJ, Wang LJ (2016) Numerical and experimental investigation on thermo-mechanical behavior during transient extrusion process of high-strength 7××× aluminum alloy profile. Int J Adv Manuf Technol 85(5-8):1915–1926Google Scholar
  8. 8.
    Prasad YV, Gegel HL, Doraivelu SM, Malas JC, Morgan JT, Lark KA, Barker DR (1984) Modeling of dynamic material behavior in hot deformation: forging of Ti-6242. Metall Mater TransA 15:1883–1892Google Scholar
  9. 9.
    Jenab A, Taheri AK (2014) Experimental investigation of the hot deformation behavior of AA7075: Development and comparison of flow localization parameter and dynamic material model processing maps. Int J Mech Sci 78:97–105Google Scholar
  10. 10.
    Lin YC, Li LT, Xia YC, Jiang YQ (2013) Hot deformation and processing map of a typical Al–Zn–Mg–Cu alloy. J Alloys Compd 550:438–445Google Scholar
  11. 11.
    Wen DX, Lin YC, Li HB, Chen XM, Deng J, Li LT (2014) Hot deformation behavior and processing map of a typical Ni-based superalloy. Mater Sci Eng A 591:183–192Google Scholar
  12. 12.
    Wen DX, Lin YC, Chen J, Deng J, Chen XM, Zhang JL, He M (2015) Effects of initial aging time on processing map and microstructures of a nickel-based superalloy. Mater Sci Eng A 620:319–332Google Scholar
  13. 13.
    Momeni A, Dehghani K, Ebrahimi GR, Kazemi S (2013) Developing the processing maps using the hyperbolic sine constitutive equation. Metall Mater Trans A 44:5567–5576Google Scholar
  14. 14.
    Quan GZ, Liang JT, Liu YY, Luo GC, Zhou J (2013) Identification of optimal deforming parameters from a large range of strain, strain rate and temperature for 3Cr20Ni10W2 heat-resistant alloy. Mater Des 52:593–601Google Scholar
  15. 15.
    Mehtedi ME, Gabrielli F, Spigarelli S (2014) Hot workability in process modeling of a bearing steel by using combined constitutive equations and dynamic material model. Mater Des 53:398–404Google Scholar
  16. 16.
    Abbasi SM, Momeni A (2012) Hot working behavior of Fe–29Ni–17Co analyzed by mechanical testing and processing map. Mater Sci Eng A 552:330–335Google Scholar
  17. 17.
    Frazier WG, Malas JC, Medina EA, Medeiros S, Venugopal S, Mullins WM, Chaudhary A, Irwin RD (1998) Application of control theory principles to optimization of grain size during hot extrusion. Mater Sci Tech-Lond 14:25–31Google Scholar
  18. 18.
    Malas JC, Frazier WG, Venugopal S, Medina EA, Medeiros S, Srinivasan R, Irwin RD, Mullins WM, Chaudhary A (1997) Optimization of microstructure development during hot working using control theory. Metall Mater Trans A 28:1921–1930Google Scholar
  19. 19.
    Venugopal S, Medina EA, Malas JC, Medeiros S, Frazier WG, Mullins WM, Srinivasan R (1997) Optimization of microstructure during deformation processing using control theory principles. Scr Mater 36:347–353Google Scholar
  20. 20.
    Chen DD, Lin YC, Zhou Y, Chen MS, Wen DX (2017) Dislocation substructures evolution and an adaptive-network-based fuzzy inference system model for constitutive behavior of a Ni-based superalloy during hot deformation. J Alloys Compd 708:938–946Google Scholar
  21. 21.
    Lin YC, Chen DD, Chen MS, Chen XM, Li J (2018) A precise BP neural network-based online model predictive control strategy for die forging hydraulic press machine. Neural Comput & Applic 29:585–596Google Scholar
  22. 22.
    Lin YC, Nong FQ, Chen XM, Chen DD, Chen MS (2017) Microstructural evolution and constitutive models to predict hot deformation behaviors of a nickel-based superalloy. Vacuum 137:104–114Google Scholar
  23. 23.
    Shojaeefard MH, Behnagh RA, Akbari M, Givi MKB, Farhani F (2013) Modelling and Pareto optimization of mechanical properties of friction stir welded AA7075/AA5083 butt joints using neural network and particle swarm algorithm. Mater Des 44:190–198Google Scholar
  24. 24.
    Werbos PJ (1977) Advanced forecasting methods for global crisis warning and models of intelligence. General Systems Yearbook 22:25–38Google Scholar
  25. 25.
    Huang T, Liu DR (2013) A self-learning scheme for residential energy system control and management. Neural Comput & Applic 22:259–269Google Scholar
  26. 26.
    Tang YF, He HB, Wen JY, Liu Y (2015) Power system stability control for a wind farm based on adaptive dynamic programming. IEEE T Smart Grid 6:166–177Google Scholar
  27. 27.
    Szuster M, Gierlak P (2016) Approximate dynamic programming in tracking control of a robotic manipulator. Int J Adv Robot Syst 13:1–18Google Scholar
  28. 28.
    Dierks T, Brenner B, Jagannathan S (2013) Neural network-based optimal control of mobile robot formations with reduced information exchange. IEEE T Contr Syst T 21:1407–1415Google Scholar
  29. 29.
    Rakhshkhorshid M (2017) A robust RBF-ANN model to predict the hot deformation flow curves of API X65 pipeline steel. Int J Mater Form 4:12–20Google Scholar
  30. 30.
    Mirzaei A, Zarei-Hanzaki A, Pishbin MH, Imandoust A, Khoddam S (2015) Evaluating the hot deformation behavior of a super-austenitic steel through microstructural and neural network analysis. J Mater Eng Perform 24:2412–2421Google Scholar
  31. 31.
    Lin YC, Liang YJ, Chen MS, Chen XM (2017) A comparative study on phenomenon and deep belief network models for hot deformation behavior of an Al-Zn-Mg-Cu alloy. Appl Phys A Mater Sci Process 123:68Google Scholar
  32. 32.
    Garg A, Tai K, Gupta AK (2014) A modified multi-gene genetic programming approach for modelling true stress of dynamic strain aging regime of austenitic stainless steel 304. Meccanica 49:1193–1209zbMATHGoogle Scholar
  33. 33.
    Vafaeenezhad H, Seyedein SH, Aboutalebi MR, Eivani AR (2017) Application of constitutive description and integrated ANFIS – ICA analysis to predict hot deformation behavior of Sn-5Sb lead-free solder alloy. J Alloys Compd 697:287–299Google Scholar
  34. 34.
    Jung C, Zaefferer M, Bartz-Beielstein T, Rudolph G (2017) Metamodel-based optimization of hot rolling processes in the metal industry. Int J Adv Manuf Technol 90:421–435Google Scholar
  35. 35.
    Hu D, Yang Q, Liu H, Mao J, Meng F, Wang Y, Ren M, Wang R (2017) Crack closure effect and crack growth behavior in GH2036 superalloy plates under combined high and low cycle fatigue. Int J Fatigue 95:90–103Google Scholar
  36. 36.
    Zhu SP, Liu Q, Lei Q, Wang QY (2018) Probabilistic fatigue life prediction and reliability assessment of a high pressure turbine disc considering load variations. Int J Damage Mech 27:1569–1588Google Scholar
  37. 37.
    Zhu SP, Huang HZ, Peng W, Wang HK, Mahadevan S (2016) Probabilistic physics of failure-based framework for fatigue life prediction of aircraft gas turbine discs under uncertainty. Reliab Eng Syst Saf 146:1–12Google Scholar
  38. 38.
    Wang R, Liu X, Hu D, Meng F, Li D, Li B (2017) Zone-based reliability analysis on fatigue life of GH720Li turbine disk concerning uncertainty quantification. Aerosp Sci Technol 70:300–309Google Scholar
  39. 39.
    Loyda A, Reyes LA, Hernández-Muñoz GM, García-Castillo FA, Zambrano-Robledo P (2018) Influence of the incremental deformation during rotary forging on the microstructure behaviour of a nickel-based superalloy. Int J Adv Manuf Technol 97:2383–2396Google Scholar
  40. 40.
    Azarbarmas M, Aghaie-Khafri M, Cabrera JM, Calvo J (2016) Dynamic recrystallization mechanisms and twining evolution during hot deformation of Inconel 718. Mater Sci Eng A 678:137–152Google Scholar
  41. 41.
    Wen DX, Lin YC, Chen J, Chen XM, Zhang JL, Liang YJ (2015) Work-hardening behaviors of typical solution-treated and aged Ni-based superalloys during hot deformation. J Alloys Compd 617:372–379Google Scholar
  42. 42.
    Sohrabi MJ, Mirzadeh H, Rafiei M (2018) Solidification behavior and Laves phase dissolution during homogenization heat treatment of Inconel 718 superalloy. Vacuum 154:235–243Google Scholar
  43. 43.
    Zhang HJ, Li C, Liu YC, Guo QY, Li HJ (2016) Precipitation behavior during high-temperature isothermal compressive deformation of Inconel 718 alloy. Mater Sci Eng A 677:515–521Google Scholar
  44. 44.
    Pradhan SK, Mandal S, Athreya CN, Arun Babu K, de Boer B, Sarma VS (2017) Influence of processing parameters on dynamic recrystallization and the associated annealing twin boundary evolution in a nickel base superalloy. Mater Sci Eng A 700:49–58Google Scholar
  45. 45.
    Zhang C, Zhang LW, Shen WF, Xu QH, Cui Y (2017) The processing map and microstructure evolution of Ni-Cr-Mo-based C276 superalloy during hot compression. J Alloys Compd 728:1269–1278Google Scholar
  46. 46.
    Lin YC, Chen XM, Wen DX, Chen MS (2014) A physically-based constitutive model for a typical nickel-based superalloy. Comput Mater Sci 83:282–289Google Scholar
  47. 47.
    Lin YC, He DG, Chen MS, Chen XM, Zhao CY, Ma X (2016) Study of flow softening mechanisms of a Nickel-based superalloy with δ phase. Arch Metall Mater 61:1537–1546Google Scholar
  48. 48.
    Chen XM, Lin YC, Wen DX, Zhang JL, He M (2014) Dynamic recrystallization behavior of a typical nickel-based superalloy during hot deformation. Mater Des 57:568–577Google Scholar
  49. 49.
    Lin YC, Huang J, He DG, Zhang XY, Wu Q, Wang LH, Chen C, Zhou KC (2019) Phase transformation and dynamic recrystallization behaviors in a Ti55511 titanium alloy during hot compression. J Alloys Compd 795:471–482Google Scholar
  50. 50.
    Lin YC, Huang J, Li HB, Chen DD (2018) Phase transformation and constitutive models of a hot compressed TC18 titanium alloy in the α+β regime. Vacuum 157:83–91Google Scholar
  51. 51.
    Chen MS, Yuan WQ, Li HB, Zou ZH (2017) Modeling and simulation of dynamic recrystallization behaviors of magnesium alloy AZ31B using cellular automaton method. Comput Mater Sci 136:163–172Google Scholar
  52. 52.
    Chen MS, Yuan WQ, Li HB, Zou ZH (2019) New insights on the relationship between flow stress softening and dynamic recrystallization behavior of magnesium alloy AZ31B. Mater Charact 147:173–183Google Scholar
  53. 53.
    Lin YC, He DG, Chen MS, Chen XM, Zhao CY, Ma X, Long ZL (2016) EBSD analysis of evolution of dynamic recrystallization grains and δ phase in a nickel-based superalloy during hot compressive deformation. Mater Des 97:13–24Google Scholar
  54. 54.
    Chen DD, Lin YC, Chen XM (2019) A strategy to control microstructures of a Ni-based superalloy during hot forging based on particle swarm optimization algorithm. Adv Manuf 7(2):238–247Google Scholar
  55. 55.
    Chen DD, Lin YC (2019) A particle swarm optimization-based multi-level processing parameters optimization method for controlling microstructures of an aged superalloy during isothermal forging. Met Mater Int. Google Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Mechanical and Electrical EngineeringCentral South UniversityChangshaChina
  2. 2.State Key Laboratory of High Performance Complex ManufacturingChangshaChina

Personalised recommendations