Abstract
Bi-level programming problems arise in situations when the decision maker has to take into account the responses of the users to his decisions. Several problems arising in engineering and economics can be cast within the bi-level programming framework. The bi-level programming model is also known as a Stackleberg or leader-follower game in which the leader chooses his variables so as to optimise his objective function, taking into account the response of the follower(s) who separately optimise their own objectives, treating the leader’s decisions as exogenous. In this chapter, we present a unified framework fully consistent with the Stackleberg paradigm of bi-level programming that allows for the integration of meta-heuristic algorithms with traditional gradient based optimisation algorithms for the solution of bi-level programming problems. In particular we employ Differential Evolution as the main meta-heuristic in our proposal.We subsequently apply the proposed method (DEBLP) to a range of problems from many fields such as transportation systems management, parameter estimation and game theory. It is demonstrated that DEBLP is a robust and powerful search heuristic for this class of problems characterised by non smoothness and non convexity.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aarts, E., Korst, J.: Simulated Annealing and Boltzmann Machines. John Wiley, Chichester (1988)
Aiyoshi, E., Shimizu, K.: Hierarchical decentralized systems and its new solution by a barrier method. IEEE Transactions on Systems, Man, and Cybernetics 11(6), 444–449 (1981)
Allsop, R.E.: Some possibilities for using traffic control to influence trip distribution and route choice. In: Buckley, D.J. (ed.) Transportation and Traffic Theory: Proceedings of the Sixth International Symposium on Transportation and Traffic Theory, pp. 345–375. Elsevier, New York (1974)
Aussel, D., Dutta, J.: Generalized Nash equilibrium problem, variational inequality and quasiconvexity. Operations Research Letters 36(4), 461–464 (2008)
Bard, J.F.: An efficient point algorithm for a linear two-stage optimization problem. Operations Research 31(4), 670–684 (1983)
Bard, J.F.: Convex two-level optimization. Mathematical Programming 40(1), 15–27 (1988)
Bard, J.F.: Practical Bilevel Optimisation: Algorithms and Applications. Kluwer, Dordrecht (1998)
Bard, J.F., Plummer, J., Sourie, J.C.: A bilevel programming approach to determining tax credits for biofuel production. European Journal of Operational Research 120(1), 30–46 (2000)
Bazaraa, M.S., Sherali, H.D., Shetty, C.M.: Nonlinear Programming: Theory and Algorithms, 3rd edn. Wiley, Hoboken (2006)
Bellman, R.E.: Adaptive control processes: a guided tour. Princeton University Press, Princeton (1961)
Ben-Ayed, O., Blair, C.E.: Computational difficulties of bilevel linear programming. Operations Research 38(3), 556–560 (1990)
Ben-Ayed, O.: Bilevel linear programming. Computers & Operations Research 20(5), 485–501 (1993)
Bialas, W.F., Karwan, M.H.: Two-Level Linear Programming. Management Science 30(8), 1004–1020 (1984)
Bouza Allende, G.B.: On the calculation of Nash Equilibrium points with the aid of the smoothing approach. Revista Investigación Operacional 29(1), 71–76 (2008)
Beckmann, M., McGuire, C., Winsten, C.: Studies in the Economics of Transportation. Yale University Press, New Haven (1956)
Britt, H., Luecke, R.: The Estimation of Parameters in Nonlinear Implicit Models. Technometrics 15(2), 233–247 (1973)
Braess, D.: Über ein paradoxon aus der verkehrsplanung. Unternehmenforschung 12, 258–268 (1968)
Bracken, J., McGill, J.: Mathematical programs with optimization problems in the constraints. Operations Research 21(1), 37–44 (1973)
Bracken, J., McGill, J.: Defense applications of mathematical programs with optimization problems in the constraints. Operations Research 22(5), 1086–1096 (1978)
Candler, W., Norton, R.: Multi-level programming. Technical Report DRD-20, World Bank (January 1977)
Candler, W., Townsley, R.: A linear two-level programming problem. Computers & Operations Research 9(1), 59–76 (1982)
Červinka, M.: Hierarchical structures in equilibrium problems. PhD Thesis, Charles University, Prague, Czech Republic (2008)
Chen, Y., Florian, M.: The nonlinear bilevel programming problem: Formulations, regularity and optimality conditions. Optimization 32(3), 193–209 (1995)
Chiou, S.: Bilevel programming formulation for the continuous network design problem. Transportation Research 39B(4), 361–383 (2005)
Coello-Coello, C.A.: Treating constraints as objectives for single-objective evolutionary optimization. Engineering Optimization 32(13), 275–308 (1999)
Colson, B., Marcotte, P., Savard, G.: An overview of bilevel optimization. Annals of Operations Research 153(1), 235–256 (2007)
Cree, N.D., Maher, M.J., Paechter, B.: The continuous equilibrium optimal network design problem: a genetic approach. In: Bell, M.G.H. (ed.) Transportation Networks: Recent Methodological Advances, Pergamon, pp. 163–174. Pergamon Press, London (1996)
Dafermos, S.C.: Traffic equilibrium and variational inequalities. Transportation Science 14(1), 42–54 (1980)
Deb, K.: Multi-objective genetic algorithms: Problem difficulties and construction of test problems. Evolutionary Computation 7(3), 205–230 (1999)
Deb, K.: Multi-objective Optimization using Evolutionary Algorithms. John Wiley, Chichester (2001)
Deb, K., Sinha, A.: An efficient and accurate solution methodology for bilevel multi-objective programming problems using a hybrid evolutionary-local-search algorithm. Evolutionary Computation 18(3), 403–449 (2010)
Dempe, S.: Foundations Of Bilevel Programming. Kluwer, Dordrecht (2002)
Dempe, S.: Annotated bibliography on bilevel programming and mathematical programs with equilibrium constraints. Optimization 52(3), 333–359 (2003)
Dorigo, M., Stützle, T.: Ant Colony Optimization. MIT Press, Cambridge (2004)
Ehrenmann, A.: Equilibrium Problems with Equilibrium Constraints and their Application to Electricity Markets. PhD Thesis, Fitzwilliam College, University of Cambridge, UK (2004)
Engel, E., Fischer, R., Galetovic, A.: A new approach to private roads. Regulation 25(3), 18–22 (2002)
Esposito, W.R., Floudas, C.A.: Global Optimization in Parameter Estimation of Nonlinear Algebraic Models via the Error-in-Variables Approach. Industrial Engineering and Chemistry Research 37(5), 1841–1858 (1998)
Facchinei, F., Jiang, H., Qi, L.: A smoothing method for mathematical programs with equilibrium constraints. Mathematical Programming 85B(1), 107–134 (1999)
Facchinei, F., Kanzow, C.: Generalized Nash equilibrium problems. Annals of Operations Research 175(1), 177–211 (2010)
Fisk, C.S.: Game theory and transportation systems modelling. Transportation Research 18B(4-5), 301–313 (1984)
Fortuny-Amat, J., McCarl, B.: A representation and economic interpretation of a two-Level programming problem. Journal of the Operational Research Society 32(9), 783–792 (1981)
Friesz, T.: Harker PT Properties of the iterative optimization-equilibrium algorithm. Civil Engineering Systems 2(3), 142–154 (1985)
Friesz, T., Cho, H., Mehta, N., Tobin, R., Anandalingam, G.: A simulated annealing approach to the network design problem with variational inequality Constraints. Transportation Science 26(1), 18–26 (1992)
Friesz, T., Anandalingam, G., Mehta, N.J., Nam, K., Shah, S., Tobin, R.: The multiobjective equilibrium network design problem revisited: A simulated annealing approach. European Journal of Operational Research 65(1), 44–57 (1993)
Gabay, D., Moulin, H.: On the uniqueness and stability of Nash-equilibria in non cooperative games. In: Bensoussan, A., Dorfer, P.K., Tapiero, C. (eds.) Applied Stochastic Control in Econometrics and Management Science, pp. 271–293. North Holland, Amsterdam (1980)
Gau, C.Y., Stadtherr, M.A.: Deterministic global optimization for error-in-variables parameter estimation. AIChE Journal 48(6), 1192–1197 (2002)
Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading (1989)
Glover, F., Laguna, M.: Tabu Search. Kluwer, Norwell (1997)
Gümüş, Z.H., Floudas, C.A.: Global optimization of nonlinear bilevel programming problems. Journal of Global Optimization 20(1), 1–31 (2001)
Harker, P.T.: A variational inequality approach for the determination of oligopolistic market equilibrium. Mathematical Programming 30(1), 105–111 (1984)
Harker, P.T.: Generalized Nash games and quasi-variational inequalities. European Journal of Operations Research 54(1), 81–94 (1991)
Haurie, A., Krawczyk, J.: Optimal charges on river effluent from lumped and distributed sources. Environment Modelling and Assessment 2(3), 177–189 (1997)
von Heusinger, A., Kanzow, C.: Relaxation methods for generalized Nash equilibrium problems with inexact line search. Journal of Optimization Theory and Applications 143(1), 159–183 (2009)
von Heusinger, A.: Numerical Methods for the Solution of the Generalized Nash Equilibrium Problem. PhD Thesis, Institute of Mathematics, University of Wüzburg, Würzburg (2009)
Hu, X., Ralph, D.: Using EPECs to model bilevel games in restructured electricity markets with locational prices. Operations Research 55(5), 809–827 (2007)
Karamardian, S.: Generalized complementarity problems. Journal of Optimization Theory and Applications 8(3), 161–168 (1971)
Kennedy, J.: Eberhart RC Particle swarm optimization. In: Proceedings of the IEEE International Conference on Neural Networks, pp. 1942–1948 (1995)
Kesselman, A., Leonardi, S., Bonifaci, V.: Game-Theoretic Analysis of Internet Switching with Selfish Users. In: Deng, X., Ye, Y. (eds.) WINE 2005. LNCS, vol. 3828, pp. 236–245. Springer, Heidelberg (2005)
Kim, I.W., Liebman, M.J., Edgar, T.F.: Robust nonlinear error-in-variables estimation method using nonlinear programming techniques. AIChE Journal 36(7), 985–993 (1990)
Koh, A., Watling, D.: Traffic Assignment Modelling. In: Button, K., Vega, H., Nijkamp, P. (eds.) A Dictionary of Transport Analysis, Edward Elgar,Cheltenham, pp. 418–420 (2010)
Koh, A.: Solving transportation bi-level programs with Differential Evolution. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 2243–2250 (2007)
Koh, A.: An evolutionary algorithm based on Nash dominance for equilibrium problems with equilibrium constraints. Applied Soft Computing (2011) (in press), http://dx.doi.org/10.1016/j.asoc.2011.08.056
Korilis, Y., Lazar, A., Orda, A.: Avoiding the Braess paradox in non-cooperative networks. Journal of Applied Probability 36(1), 211–222 (1999)
Krawczyk, J., Uryasev, S.: Relaxation algorithms to find Nash equilibria with economic applications. Environmental Modelling and Assessment 5(1), 63–73 (2000)
Lampinen, J.: A constraint handling approach for the differential evolution algorithm. In: Procedings of the IEEE Congress on Evolutionary Computation, pp. 1468–1473 (2002)
Lawphongpanich, S., Hearn, D.W.: An MPEC approach to second-best toll pricing. Mathematical Programming 101B(1), 33–55 (2004)
Leyffer, S.: The penalty interior-point method fails to converge. Optimization Methods and Software 20(4-5), 559–568 (2005)
Leyffer, S., Munson, T.: Solving multi-leader-common-follower games. Optimization Methods and Software 25(4), 601–623 (2010)
Liu, B.: Stackelberg-Nash equilibrium for multilevel programming with multiple followers using genetic algorithms. Computers & Mathematics with Applications 36(7), 79–89 (1998)
Luenberger, D.G., Ye, Y.: Linear and Nonlinear Programming. Springer, Berlin (2008)
Lung, R.I., Dumitrescu, D.: Computing Nash equilibria by means of evolutionary computation. International Journal of Computers, Commmunications and Control III, 364–368 (2008)
Luo, Z.Q., Pang, J.S., Ralph, D.: Mathematical Programs with Equilibrium Constraints. Cambridge University Press, Cambridge (1996)
Matthieu, R., Pittard, L., Anandalingam, G.: Genetic algorithm based approach bi-level linear programming. RAIRO-Operations Research 28(1), 1–21 (1994)
Marcotte, P., Savard, G.: Bilevel programming: applications. In: Floudas, C.A., Pardalos, P.M. (eds.) Encyclopedia of Optimization, 2nd edn., pp. 241–242. Springer, New York (2009)
Meng, Q., Yang, H., Bell, M.G.H.: An equivalent continuously differentiable model and a locally convergent algorithm for the continuous network design problem. Transportation Research 35B(1), 83–105 (2000)
Moore, R.E., Hansen, E., Leclerc, A.: Rigorous methods for global optimization. In: Floudas, C.A., Pardalos, P.M. (eds.) Recent Advances in Global Optimization, pp. 321–342. Princeton University Press, Princeton (1992)
Mordukhovich, B.S., Outrata, J.V., Červinka, M.: Equilibrium problems with complementarity constraints: Case study with applications to oligopolistic markets. Optimization 56(4), 479–494 (2007)
Mordukhovich, B.S.: Optimization and equilibrium problems with equilibrium constraints. Omega 33(5), 379–384 (2005)
Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation, I: Basic Theory. Springer, Berlin (2006)
Mordukhovich, B.S.: Variational Analysis and Generalized Differentiation, II: Applications. Springer, Berlin (2006)
Murphy, F.H., Sherali, H.D., Soyster, A.L.: A mathematical programming approach for determining oligopolistic market equilibrium. Mathematical Programming 24(1), 92–106 (1982)
Nagurney, A.: Network Economics: A Variational Inequality Approach. Kluwer, Boston (1999)
Nash, J.: Equilibrium points in N-person games. Proceedings of the National Academy of Science of the USA 36(1), 48–49 (1950)
Nash, J.: Non-Cooperative games. Annals of Mathematics Second Series 54(2), 286–295 (1951)
Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, New York (1999)
Oduguwa, V., Roy, R.: Bi-level optimisation using genetic algorithms. In: Proceedings of the IEEE Conference on Artificial Intelligence Systems, pp. 322–327 (2002)
Outrata, J.V., Kočvara, M., Zowe, J.: Nonsmooth Approach to Optimization Problems with Equilibrium Constraints. Kluwer, Dordrecht (1998)
Outrata, J.V.: A note on a class of equilibrium problems with equilibrium constraints. Kybernetika 40(5), 585–594 (2004)
Ortuzar, J.D.: Willumsen L Modelling Transport. Wiley, Chichester (1998)
Osyzcka, A.: Multicriterion optimization in engineering with FORTRAN programs. Ellis Horwood, Wiley, Chichester (1998)
Pampara, G., Engelbrecht, A.P., Franken, N.: Binary differential evolution. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 1873–1879 (2006)
Pan, Q., Tasgetiren, M.F., Liang, Y.C.: A discrete differential evolution algorithm for the permutation flowshop scheduling problem. Computers & Industrial Engineering 55(4), 795–816 (2008)
Poorzahedy, H., Abulghasemi, F.: Application of ant system to network design problem. Transportation 32(3), 251–273 (2005)
Price, K.: An Introduction to Differential Evolution. In: Corne, D., Dorigo, M. (eds.) New Techniques in Optimization, pp. 79–108. McGraw Hill, London (1999)
Price, K., Storn, R., Lampinen, J.: Differential evolution: a practical approach to global optimization. Springer, Berlin (2005)
Rajesh, J., Gupta, K., Kusumakar, H.S., Jayaraman, V.K., Kulkarni, B.: A tabu search based approach for solving a class of bilevel programming problems in chemical engineering. Journal of Heuristics 9(4), 307–319 (2003)
Rosen, J.B.: Existence and uniqueness of equilibrium points for concave N-person games. Econometrica 33(3), 520–534 (1965)
Rod, V., Hančil, V.: Iterative estimation of model parameters when measurements of all variables are subject to error. Computers & Chemical Engineering 4(2), 33–38 (1980)
Runarsson, T.P., Yao, X.: Stochastic ranking for constrained evolutionary optimization. IEEE Transactions on Evolutionary Computation 4(3), 284–294 (2000)
Sahin, K.H., Ciric, A.R.: A dual temperature simulated annealing approach for solving bilevel programming problems. Computers & Chemical Engineering 23(1), 11–25 (1998)
Runarsson, T.P., Yao, X.: Search biases in constrained evolutionary optimization. IEEE Transactions on Systems, Man and Cybernetics Part C 35(2), 233–243 (2005)
Scheel, H., Scholtes, S.: Mathematical Programs with Complementarity Constraints: Stationarity, Optimality, and Sensitivity. Mathematics of Operations Research 25(1), 1–22 (2000)
Sheffi, Y.: Urban Transportation Networks: Equilibrium Analysis with Mathematical Programming Methods. Prentice Hall, Englewood Cliffs (1985)
Smith, A., Tate, D.: Genetic optimization using a penalty function. In: Proceedings of the 5th International Conference on Genetic Algorithms, pp. 499–503 (1993)
Smith, M.J.: The existence, uniqueness and stability of traffic equilibria. Transportation Research 13B(4), 295–304 (1979)
von Stackelberg, H.H.: The theory of the market economy. William Hodge, London (1952)
Steenbrink, P.A.: Optimization of Transportation Networks. John Wiley, London (1974)
Storn, R., Price, K.: Differential Evolution - a simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization 11(4), 341–359 (1997)
Su, C.: Equilibrium problems with equilibrium constraints: stationarities, algorithms and applications. PhD Thesis, Stanford University, California, USA (2005)
Sumalee, A., May, A., Shepherd, S.: Road user charging design: dealing with multi-objectives and constraints. Transportation 36(2), 167–186 (2009)
Sumalee, A.: Optimal Road Pricing Scheme Design. PhD Thesis, Institute for Transport Studies, University of Leeds, UK (2004)
Sun, L.: Equivalent Bilevel Programming Form for the Generalized Nash Equilibrium Problem. Journal of Mathematics Research 2(1), 8–13 (2010)
Tjoa, T., Biegler, L.: A reduced successive quadratic programming strategy for errors-in-variables estimation. Computers & Chemical Engineering 16(6), 523–533 (1992)
Wang, Y., Jiao, Y., Li, H.: An evolutionary algorithm for solving nonlinear bilevel programming based on a new constraint handling scheme. IEEE Transactions on Systems, Man and Cybernetics Part C 35(2), 221–232 (2005)
Wardrop, J.G.: Some theoretical aspects of road traffic research. Proceedings of the Institution of Civil Engineers Part II 1(36), 325–378 (1952)
Webb, J.N.: Game theory: Decisions, Interaction and Evolution. Springer, London (2007)
Wen, U., Hsu, S.: Linear bi-level programming problems – a review. Journal of the Operational Research Society 42(2), 125–133 (1991)
Yang, H., Lam, H.K.: Optimal road tolls under conditions of queuing and congestion. Transportation Research 30A(5), 319–332 (1996)
Yang, H., Feng, X., Huang, H.: Private road competition and equilibrium with traffic equilibrium constraints. Journal of Advanced Transportation 43(1), 21–45 (2009)
Ye, J.J., Zhu, Q.J.: Multiobjective optimization problem with variational inequality constraints. Mathematical Programming 96A(1), 139–160 (2003)
Yeniay, Ö.: Penalty function methods for constrained optimization with genetic algorithms. Mathematical and Computational Applications 10(1), 45–56 (2005)
Yin, Y.: Genetic Algorithm based approach for bilevel programming models. ASCE Journal of Transportation Engineering 126(2), 115–120 (2000)
Yin, Y.: Multiobjective bilevel optimization for transportation planning and management problems. Journal of Advanced Transportation 36(1), 93–105 (2002)
Yuchi, M., Kim, J.H.: Grouping-based evolutionary algorithm: seeking balance between feasible and infeasible individuals of constrained optimization problems. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 280–287 (2004)
Zhang, X.P.: Overview of electricity market equilibrium problems and market power analysis. In: Zhang, X.P. (ed.) Restructured Electric Power Systems: Analysis of Electricity Markets with Equilibrium Models, pp. 99–137. John Wiley, Hoboken (2010)
Zhao, Z., Gu, X.: Particle swarm optimization based algorithm for bilevel programming problems. In: Proceedings of the Sixth IEEE International Conference on Intelligent Systems Design and Applications, pp. 951–956 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Koh, A. (2013). A Metaheuristic Framework for Bi-level Programming Problems with Multi-disciplinary Applications. In: Talbi, EG. (eds) Metaheuristics for Bi-level Optimization. Studies in Computational Intelligence, vol 482. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37838-6_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-37838-6_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37837-9
Online ISBN: 978-3-642-37838-6
eBook Packages: EngineeringEngineering (R0)