Skip to main content

Exploiting Second Order Information in Computational Multi-objective Evolutionary Optimization

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4874))

Abstract

Evolutionary algorithms are efficient population based algorithms for solving multi-objective optimization problems. Recently various authors have discussed the efficacy of combining gradient based classical methods with evolutionary algorithms. This is done since gradient information leads to convergence to Pareto-optimal solutions with a linear convergence rate. However none of existing studies have explored how to exploit second order or Hessian information in evolutionary multi-objective algorithms. Second order information though costly, leads to a quadratic convergence to Pareto-optimal solutions. In this paper, we take Levenberg-Marquardt methods from classical optimization and show two possible ways of hybrid algorithms. These algorithms require gradient and Hessian information which is obtained using finite difference techniques. Computational studies on a number of test problems of varying complexity demonstrate the efficiency of resulting hybrid algorithms in solving a large class of complex multi-objective optimization problems.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bosman, P.A.N., de Jong, E.D.: Combining gradient techniques for numerical multi-objective evolutionary optimization. In: GECCO 2006. Proceedings of the 8th annual conference on Genetic and evolutionary computation, pp. 627–634. ACM Press, New York (2006)

    Chapter  Google Scholar 

  2. Deb, K.: Multi-objective optimization using evolutionary algorithms. Wiley, Chichester (2001)

    MATH  Google Scholar 

  3. Deb, K., Agrawal, S., Pratap, A., Meyarivan, T.: A fast and elitist multi-objective genetic algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6(2), 182–197 (2002)

    Article  Google Scholar 

  4. Ehrgott, M.: Multicriteria Optimization. Springer, Berlin (2000)

    MATH  Google Scholar 

  5. Fan, J.-y., Yuan, Y.-x.: On the quadratic convergence of the Levenberg-Marquardt method without nonsingularity assumption. Computing 74(1), 23–39 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  6. Fonesca, C.M., Fleming, P.J.: On the performance assessment and comparison of stochastic multiobjective optimizers. In: Ebeling, W., Rechenberg, I., Voigt, H.-M., Schwefel, H.-P. (eds.) PPSN IV. LNCS, vol. 1141, pp. 584–593. Springer, Heidelberg (1996)

    Chapter  Google Scholar 

  7. Harada, K., Sakuma, J., Kobayashi, S.: Local search for multiobjective function optimization: pareto descent method. In: GECCO 2006. Proceedings of the 8th annual conference on Genetic and evolutionary computation, pp. 659–666. ACM Press, New York (2006)

    Chapter  Google Scholar 

  8. Levenberg, K.: A method for the solution of certain non-linear problems in least squares. Quart. Appl. Math. 2, 164–168 (1944)

    MATH  MathSciNet  Google Scholar 

  9. Marquardt, D.W.: An algorithm for least-squares estimation of nonlinear parameters. J. Soc. Indust. Appl. Math. 11, 431–441 (1963)

    Article  MATH  MathSciNet  Google Scholar 

  10. Mukai, H.: Algorithms for multicriterion optimization. IEEE Trans. Automat. Control 25(2), 177–186 (1980)

    Article  MATH  MathSciNet  Google Scholar 

  11. Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, Heidelberg (1999)

    MATH  Google Scholar 

  12. Shukla, P.K., Deb, K.: On finding multiple pareto-optimal solutions using classical and evolutionary generating methods. European Journal of Operational Research 181(3), 1630–1652 (2007)

    Article  MATH  Google Scholar 

  13. Zitzler, E., Thiele, L.: Multiobjective optimization using evolutionary algorithms – A comparative case study. In: Eiben, A.E., Bäck, T., Schoenauer, M., Schwefel, H.-P. (eds.) PPSN V. LNCS, vol. 1498, pp. 292–301. Springer, Heidelberg (1998)

    Google Scholar 

  14. Zitzler, E., Thiele, L., Laumanns, M., Fonseca, C.M., da Fonseca, V.G.: Performance Assessment of Multiobjective Optimizers: An Analysis and Review. IEEE Transactions on Evolutionary Computation 7(2), 117–132 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

José Neves Manuel Filipe Santos José Manuel Machado

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shukla, P.K. (2007). Exploiting Second Order Information in Computational Multi-objective Evolutionary Optimization. In: Neves, J., Santos, M.F., Machado, J.M. (eds) Progress in Artificial Intelligence. EPIA 2007. Lecture Notes in Computer Science(), vol 4874. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77002-2_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-77002-2_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-77000-8

  • Online ISBN: 978-3-540-77002-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics