Using Surrogate Constraints in Genetic Algorithms for Solving Multidimensional Knapsack Problems

  • Christian Haul
  • Stefan Voß
Part of the Operations Research/Computer Science Interfaces Series book series (ORCS, volume 9)


In the multidimensional knapsack problem (or multiconstraint zero-one knapsack problem) one has to decide on how to make efficient use of an entity which consumes multiple resources. The problem is known to be NP-hard, thus heuristics come into consideration for a solution. In this paper we investigate genetic algorithms as a solution approach. Surrogate constraints are generated by several different methods and are utilized as one of the stages in genetic algorithms for solving the multidimensional knapsack problem. This approach as a standalone method does not improve results but in conjunction with a greedy local search strategy results may be improved for problem instances with small object-constraint ratio.


Genetic Algorithm Local Search Problem Instance Knapsack Problem Random Search 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Bäck, T. and Schütz, M. (1996). Intelligent mutation rate control in canonical genetic algorithms. In Ras, Z. W. and Michalewicz, M., editors, Foundation of Intelligent Systems 9th International Symposium, ISMIS ‘86, pages 158–167, Berlin. Springer.Google Scholar
  2. [2]
    Beasley, J. E. (1990). Or-library: distributing test problems by electronic mail. Journal of the Operational Research Society,41:1069–1072. Scholar
  3. [3]
    Bornhold, S. and Schuster, H.–G. (1995). Hierarchical crossover and probability landscapes of genetic operators. Technical Report 95–04–43, The Santa Fe Institute.–Papers/9504–
  4. [4]
    Chu, P. C. and Beasley, J. E. (1997). A genetic algorithm for the multiconstraint knapsack problem. Working Paper, Imperial College, London.Google Scholar
  5. [5]
    Fréville, A. and Plateau, G. (1986). Heuristics and reduction methods for multiple constraints 0–1 linear programming problems. European Journal of Operational Research, 24: 206–215.CrossRefGoogle Scholar
  6. [6]
    Fréville, A. and Plateau, G. (1994). An efficient preprocessing procedure for the multidimensional 0–1 knapsack problem. Discrete Applied Mathematics, 49: 189–212.CrossRefGoogle Scholar
  7. [7]
    Garey, M. and Johnson, D. S. (1979). Computers and Intractibility - A Guide to the Theory of NP-Completeness. Freeman, San Francisco.Google Scholar
  8. [8]
    Gavish, B. and Pirkul, H. (1985). Efficient algorithms for solving multiconstraint zero-one knapsack problems to optimality. Mathematical Programming, 31: 78–105.CrossRefGoogle Scholar
  9. [9]
    Glover, F. (1965). A multiphase-dual algorithm for the zero-one integer programming problem. Operations Research, 13: 879–919.CrossRefGoogle Scholar
  10. [10]
    Goldberg, D. E. (1990). Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley.Google Scholar
  11. [11]
    Goldberg, D. E. and Deb, K. (1991). A comparative analysis of selection schemes used in genetic algorithms. In Rawlings, G., editor, Foundations of Genetic Algorithms, pages 69–93. Morgan Kaufmann, San Mateo.Google Scholar
  12. [12]
    Gordon, V. S., Böhm, A. P. W., and Whitley, D. L. (1993). A note on the performance of genetic algorithms on zero-one knapsack problems. Technical Report CS-93–108, Colorado State University.
  13. [13]
    Gordon, V. S. and Whitley, D. L. (1993). Serial and parallel genetic algorithms as function optimizers. In Forrest, S., editor, ICGA-93: The 5th International Conference on Genetic Algorithms, pages 177–183, Urbana-Champaign. Morgan-Kaufmann.Google Scholar
  14. [14]
    Greenberg, H. J. and Pierskalla, W. P. (1970). Surrogate mathematical programming. Operations Research, 18: 924–939.CrossRefGoogle Scholar
  15. [15]
    Hoff, A., LOkketangen, A., and Mittet, I. (1996). Genetic algorithms for 0/1 multidimensional knapsack problems. In Proceedings Norsk Informatikk Konferanse, NIK’96, pages 291–301, Trondheim. Tapir.Google Scholar
  16. [16]
    Holland, J. (1975). Adaption in Natural and Artificial Systems. University of Michigan Press.Google Scholar
  17. [17]
    Karp, R. M. (1972). Reducibility among combinatorial problems. In Miller, R. E. and Thatcher, J. W., editors, Complexity of Computer Computations, pages 85–103, New York. Plenum Press.CrossRefGoogle Scholar
  18. [18]
    Khuri, S., Bäck, T., and Heitkötter, J. (1994). The zero/one multiple knapsack problem and genetic algorithms. In Proceedings of the 1994 ACM Symposium on Applied Computing (SAC’94),Genetic Algorithms and Optimization Track. ACM, ACM Press.Google Scholar
  19. [19]
    Macready, W. G. and Wolpert, D. H. (1995). What makes an optimization problem hard? Technical Report SFT–TR–95–05–046, The Santa Fe Institute.–
  20. [20]
    Mangano, S. R. (1996). A genetic algorithm white paper. Man Machine Interfaces Inc.
  21. [21]
    Martello, S. and Toth, P. (1990). Knapsack Problems: Algorithms and Computer Implementations. Wiley, Chichester.Google Scholar
  22. [22]
    Mathias, K. E. and Whitley, D. L. (1994). Remapping subpartitions of hyperspace using iterative genetic search. Technical report, Colorado State University. http: //“ftppub/TechReports/1994/ Scholar
  23. [23]
    Petersen, C. C. (1967). Computational experience with variants of the Balas algorithm applied to the selection of r d projects. Management Science, 13: 736–750.CrossRefGoogle Scholar
  24. [24]
    Pirkul, H. (1987). A heuristic solution procedure for the multiconstraint zero-one knapsack problem. Naval Research Logistics, 34: 161–172.CrossRefGoogle Scholar
  25. [25]
    Radcliffe, N. J. and Surry, P. D. (1995). Fundamental limita- tions on search algorithms: Evolutionary computing in perspective. Fundament al_limitations_on_search_algorithms_
  26. [26]
    Richardson, J., Palmer, M., Liepins, G., and Hillard, M. (1989). Some guidelines for genetic algorithms with penalty functions. In Proceedings of the Third International Conference on Genetic Algorithms,pages 191–197. Morgan-Kaufmann.Google Scholar
  27. [27]
    Rinnooy Kan, A. H. G., Stougie, L., and Vercellis, C. (1993). A class of generalized greedy algorithms for the multi-knapsack problem. Discrete Applied Mathematics, 42: 279–290.CrossRefGoogle Scholar
  28. [28]
    Senju, S. and Toyoda, Y. (1968). An approach to linear programming with 0–1 variables. Management Science, 15 B:196 — 207.Google Scholar
  29. [29]
    Shih, W. (1979). A branch and bound method for the multiconstraint zero-one knapsack problem. Journal of the Operational Research Society, 30:369 — 378.Google Scholar
  30. [30]
    Smith, A. E. and Tate, D. M. (1993). Genetic optimization using a penalty-function. In Forrest, S., editor, ICGA-93: The 5th International Conference on Genetic Algorithms, pages 499 — 505, Urbana-Champaign. Morgan-Kaufmann.Google Scholar
  31. [31]
    Thiel, J. and Voß, S. (1994). Some experiences on solving multiconstraint zero-one knapsack problems with genetic algorithms. INFOR, 32:226 — 243.Google Scholar
  32. [32]
    Weingartner, H. M. and Ness, D. N. (1967). Methods for the solution of multidimensional 0/1 knapsack problems. Operations Research, 15:83 —103.Google Scholar
  33. [33]
    Whitley, D. L. (1994). A genetic algorithm tutorial. Statistics and Computing, 4:65 — 85.Google Scholar
  34. [34]
    Whitley, D. L., Gordon, V. S., and Mathias, K. E. (1994). Lamarckian evolution, the baldwin effect and function optimization. In Davidor, Y., Schwefel, H. P., and Manner, R., editors, Parallel Problem Solving from Nature—PPSN III, pages 6 —15. Springer.Google Scholar
  35. [35]
    Wolpert, D. H. and Macready, W. G. (1995). No free lunch theorems for search. Technical Report SFI–TR–95–02–010, The Santa Fe Institute. Free_Lunch

Copyright information

© Springer Science+Business Media New York 1998

Authors and Affiliations

  • Christian Haul
    • 1
  • Stefan Voß
    • 2
  1. 1.Fachbereich InformatikTechnische Universität DarmstadtDarmstadtGermany
  2. 2.Abt. ABWL, Wirtschaftsinformatik und InformationsmanagementTechnische Universität BraunschweigBraunschweigGermany

Personalised recommendations