Abstract
Variable neighborhood search (VNS) is a metaheuristic for solving combinatorial and global optimization problems whose basic idea is a systematic change of neighborhood both within a descent phase to find a local optimum and in a perturbation phase to get out of the corresponding valley. In this chapter we present the basic schemes of VNS and some of its extensions. We then describe recent developments, i.e., formulation space search and variable formulation search. We then present some families of applications in which VNS has proven to be very successful: (1) exact solution of large scale location problems by primal-dual VNS; (2) generation of solutions to large mixed integer linear programs, by hybridization of VNS and local branching; (3) generation of solutions to very large mixed integer programs using VNS decomposition and exact solvers (4) generation of good feasible solutions to continuous nonlinear programs; (5) adaptation of VNS for solving automatic programming problems from the Artificial Intelligence field and (6) exploration of graph theory to find conjectures, refutations and proofs or ideas of proofs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Available at http://math.nist.gov/MatrixMarket/data/Harwell-Boeing/.
References
D.J. Aloise, D. Aloise, C.T.M. Rocha, C.C. Ribeiro, J.C. Ribeiro, L.S.S. Moura, Scheduling work-over rigs for onshore oil production. Discrete Appl. Math. 154, 695–702 (2006)
D.V. Andrade, M.G.C. Resende, GRASP with path-relinking for network migration scheduling, in Proceedings of International Network Optimization Conference (INOC) (2007)
M. Aouchiche, P. Hansen, Recherche à voisinage variable de graphes extrèmes 13. À propos de la maille (French). RAIRO Oper. Res. 39, 275–293 (2005)
M. Aouchiche, P. Hansen, Automated results and conjectures on average distance in graphs, in Graph Theory in Paris, ed. by A. Bondy, J. Fonlupt, J.L. Fouquet, J.C. Fournier, J.L. Ramírez Alfonsń. Trends in Mathematics (Birkhäuser, Basel, 2006), pp. 21–36
M. Aouchiche, P. Hansen, On a conjecture about the Randic index. Discrete Math. 307, 262–265 (2007)
M. Aouchiche, P. Hansen, Bounding average distance using minimum degree. Graph Theory Notes N. Y. 56, 21–29 (2009)
M. Aouchiche, P. Hansen, Nordhaus-Gaddum relations for proximity and remoteness in graphs. Comput. Math. Appl. 59, 2827–2835 (2010)
M. Aouchiche, G. Caporossi, D. Cvetković, Variable neighborhood search for extremal graphs 8. Variations on Graffiti 105. Congressus Numerantium 148, 129–144 (2001)
M. Aouchiche, G. Caporossi, P. Hansen, M. Laffay, AutoGraphiX: a survey. Electron Notes Discrete Math. 22, 515–520 (2005)
M. Aouchiche, J.M. Bonnefoy, A. Fidahoussen, G. Caporossi, P. Hansen, L. Hiesse, J. Lacheré, A. Monhait, Variable neighborhood search for extremal graphs 14. The AutoGraphiX 2 system, in Global Optimization: From Theory to Implementation, ed. by L. Liberti, N. Maculan (Springer, Berlin, 2005), pp. 281–309
M. Aouchiche, P. Hansen, M. Zheng, Variable neighborhood search for extremal graphs 18. Conjectures and results about the Randic index. MATCH. Commun. Math. Comput. Chem. 56, 541–550 (2006)
M. Aouchiche, O. Favaron, P. Hansen, Recherche à voisinage variable de graphes extrèmes 26. Nouveaux résultats sur la maille (French). Les Cahiers du GERAD, G-2007-55, 2007
M. Aouchiche, G. Caporossi, P. Hansen, Variable Neighborhood search for extremal graphs 20. Automated comparison of graph invariants. MATCH. Commun. Math. Comput. Chem. 58, 365–384 (2007)
M. Aouchiche, G. Caporossi, P. Hansen, Variable neighborhood search for extremal graphs 27. Families of extremal graphs. Les Cahiers du GERAD, G-2007-87, 2007
M. Aouchiche, P. Hansen, M. Zheng, Variable neighborhood search for extremal graphs 19. Further conjectures and results about the Randic index. MATCH. Commun. Math. Comput. Chem. 58, 83–102 (2007)
M. Aouchiche, F.K. Bell, D. Cvetković, P. Hansen, P. Rowlinson, S.K. Simić, D. Stevanović, Variable neighborhood search for extremal graphs 16. Some conjectures related to the largest eigenvalue of a graph. Eur. J. Oper. Res. 191, 661–676 (2008)
M. Aouchiche, G. Brinkmann, P. Hansen, Variable neighborhood search for extremal graphs 21. Conjectures and results about the independence number. Discrete Appl. Math. 156, 2530–2542 (2009)
M. Aouchiche, O. Favaron, P. Hansen, Variable neighborhood search for extremal graphs 22. Extending bounds for independence to upper irredundance. Discrete Appl. Math. 157, 3497–3510 (2009)
M. Aouchiche, P. Hansen, D. Stevanović, Variable neighborhood search for extremal graphs 17. Further conjectures and results about the index. Discussiones Mathematicae: Graph Theory 29, 15–37 (2009)
C. Audet, V. Bachard, S. Le Digabel, Nonsmooth optimization through mesh adaptive direct search and variable neighborhood search. J. Glob. Optim. 41, 299–318 (2008)
J. Beasley, OR-Library: distributing test problems by electronic mail. J. Oper. Res. Soc. 41(11), 1069–1072 (1990)
N. Belacel, P. Hansen, N. Mladenović, Fuzzy J-means: a new heuristic for fuzzy clustering. Pattern Recognit. 35, 2193–2200 (2002)
S. Belhaiza, de, N. Abreu, HanP. sen, C. Oliveira, Variable neighborhood search for extremal graphs 11. Bounds on algebraic connectivity, in Graph Theory and Combinatorial Optimization, ed. by D. Avis, A. Hertz, O. Marcotte (2007), pp. 1–16
S. Bouaziz, H. Dhahri, A.M. Alimi, A. Abraham, A hybrid learning algorithm for evolving flexible beta basis function neural tree model. Neurocomputing 117, 107–117 (2013)
J. Brimberg, N. Mladenović, A variable neighborhood algorithm for solving the continuous location-allocation problem. Stud. Locat. Anal. 10, 1–12 (1996)
J. Brimberg, P. Hansen, N. Mladenović, É. Taillard, Improvements and comparison of heuristics for solving the multisource Weber problem. Oper. Res. 48, 444–460 (2000)
S. Canuto, M. Resende, C. Ribeiro, Local search with perturbations for the prize-collecting Steiner tree problem in graphs. Networks 31, 201–206 (2001)
G. Caporossi, P. Hansen, Variable neighborhood search for extremal graphs 1. The AutoGraphiX system. Discrete Math. 212, 29–44 (2000)
G. Caporossi, P. Hansen, Variable neighborhood search for extremal graphs 5. Three ways to automate finding conjectures. Discrete Math. 276, 81–94 (2004)
G. Caporossi, A.A. Dobrynin, I. Gutman, P. Hansen, Trees with palindromic Hosoya polynomials. Graph Theory Notes N. Y. 37, 10–16 (1999)
G. Caporossi, D. Cvetković, I. Gutman, P. Hansen, Variable neighborhood search for extremal graphs 2. Finding graphs with extremal energy. J. Chem. Inform. Comput. Sci. 39, 984–996 (1999)
G. Caporossi, I. Gutman, P. Hansen, Variable neighborhood search for extremal graphs 4. Chemical trees with extremal connectivity index. Comput. Chem. 23, 469–477 (1999)
G. Caporossi, I. Gutman, P. Hansen, L. Pavlović, Graphs with maximum connectivity index. Comput. Biol. Chem. 27, 85–90 (2003)
J. Cohoon, S. Sahni, Heuristics for backplane ordering. J. VLSI Comput. Syst. 2, 37–61 (1987)
D. Cvetkovic, S. Simic, G. Caporossi, P. Hansen, Variable neighborhood search for extremal graphs 3. On the largest eigenvalue of color-constrained trees. Linear Multilinear Algebra 49, 143–160 (2001)
W.C. Davidon, Variable metric algorithm for minimization. Argonne National Laboratory Report ANL-5990 (1959)
J. Desrosiers, N. Mladenović, D. Villeneuve, Design of balanced MBA student teams. J. Oper. Res. Soc. 56, 60–66 (2005)
H. Dhahri, A.M. Alimi, A. Abraham, Hierarchical multi-dimensional differential evolution for the design of beta basis function neural network. Neurocomputing 97, 131–140 (2012)
A. Djenic, N. Radojicic, M. Maric, N. Mladenović, Parallel VNS for bus terminal location problem. Appl. Soft Comput. 42, 448–458 (2016)
M. Dražić, V. Kovacevic-Vujcić, M. Cangalović, N. Mladenović, GLOB - a new VNS-based software for global optimization, in Global Optimization: From Theory to Implementation, ed. by L. Liberti, N. Maculan (Springer, Berlin, 2006), pp. 135–144
S. Elleuch, B. Jarboui, N. Mladenović, Reduced variable neighborhood programming for the preventive maintenance planning of railway infrastructure. GERAD Technical report, G-2016-92, Montreal (2016)
S. Elleuch, B. Jarboui, N. Mladenović, Variable neighborhood programming - A new automatic programming method in artificial intelligence. GERAD Technical report, G-2016-21, Montreal (2016)
M. Fischetti, A. Lodi, Local branching. Math. Program. 98, 23–47 (2003)
R. Fletcher, M.J.D. Powell, Rapidly convergent descent method for minimization. Comput. J. 6, 163–168 (1963)
P.W. Fowler, P. Hansen, G. Caporossi, A. Soncini, Variable neighborhood search for extremal graphs 7. Polyenes with maximum HOMO-LUMO gap. Chem. Phys. Lett. 49, 143–146 (2001)
M.R. Garey, D.S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness (Freeman, New York, 1978)
P. Gill, W. Murray, M.A. Saunders, SNOPT: an SQP algorithms for largescale constrained optimization. SIAM J. Optim. 12, 979–1006 (2002)
R.E. Griffith, R.A. Stewart, A nonlinear programming technique for the optimization of continuous processing systems. Manag. Sci. 7, 379–392 (1961)
I. Gutman, O. Miljković, G. Caporossi, P. Hansen, Alkanes with small and large Randić connectivity indices. Chem. Phys. Lett. 306, 366–372 (1999)
I. Gutman, P. Hansen, H. Mélot, Variable neighborhood search for extremal graphs 10. Comparison of irregularity indices for chemical trees. J. Chem. Inform. Model. 45, 222–230 (2005)
S. Hanafi, J. Lazić, N. Mladenović, C. Wilbaut, I. Crévits, New variable neighborhood search based 0-1 MIP heuristic. Yugoslav J. Oper. Res. 25, 343–360 (2015)
P. Hansen, Computers in graph theory. Graph Theory Notes N. Y. XLIII, 20–39 (2002)
P. Hansen, How far is, should and could be conjecture-making in graph theory an automated process? in Graph and Discovery. DIMACS Series in Discrete Mathematics and Theoretical Computer Science, vol.69 (American Mathematical Society, Providence, 2005), pp. 189–229
P. Hansen, H. Mélot, Computers and discovery in algebraic graph theory. Linear Algebra Appl. 356, 211–230 (2002)
P. Hansen, H. Mélot, Variable neighborhood search for extremal graphs 6. Analyzing bounds for the connectivity index. J. Chem. Inform. Comput. Sci. 43, 1–14 (2003)
P. Hansen, H. Mélot, Variable neighborhood search for extremal graphs 9. Bounding the irregularity of a graph. Graphs Discov. 69, 253–264 (2005)
P. Hansen, N. Mladenović, J-Means: a new local search heuristic for minimum sum-of-squares clustering. Pattern Recognit. 34, 405–413 (2001)
P. Hansen, N. Mladenović, Variable neighborhood search: principles and applications. Eur. J. Oper. Res. 130, 449–467 (2001)
P. Hansen, N. Mladenović, Variable neighborhood search, in Handbook of Metaheuristics, ed. by F. Glover, G. Kochenberger (Kluwer, Boston, 2003), pp. 145–184
P. Hansen, D. Stevanović, Variable neighborhood search for extremal graphs 15. On bags and bugs. Discrete Appl. Math. 156, 986–997 (2005)
P. Hansen, D. Vukičević, Variable neighborhood search for extremal graphs 23. On the Randic index and the chromatic number. Discrete Math. 309, 4228–4234 (2009)
P. Hansen, B. Jaumard, N. Mladenović, A. Parreira, Variable neighborhood search for weighted maximum satisfiability problem. Les Cahiers du GERAD, G-2000-62, 2000
P. Hansen, N. Mladenović, D. Pérez-Brito, Variable neighborhood decomposition search. J. Heuristics 7, 335–350 (2001)
P. Hansen, H. Mélot, I. Gutman, Variable neighborhood search for extremal graphs 12. A note on the variance of bounded degrees in graphs. MATCH Commun. Math. Comput. Chem. 54, 221–232 (2005)
P. Hansen, M. Aouchiche, G. Caporossi, H. Mélot, D. Stevanović, What forms do interesting conjectures have in graph theory? in Graph and Discovery. DIMACS Series in Discrete Mathematics and Theoretical Computer Science, vol. 69 (American Mathematical Society, Providence, 2005), pp. 231–251
P. Hansen, N. Mladenović, D. Urošević, Variable neighborhood search and local branching. Comput. Oper. Res. 33, 3034–3045 (2006)
P. Hansen, J. Brimberg, D. Urošević, N. Mladenović, Primal-dual variable neighborhood search for the simple plant location problem. INFORMS J. Comput. 19, 552–564 (2007)
P. Hansen, N. Mladenović, J.A. Moreno Pérez, Variable neighborhood search. Eur. J. Oper. Res. 191, 593–595 (2008)
P. Hansen, N. Mladenović, J.A. Moreno Pérez, Variable neighborhood search: methods and applications. 4OR. Q. J. Oper. Res. 6, 319–360 (2008)
A. Hertz, M. Plumettaz, N. Zufferey, Variable space search for graph coloring. Discrete Appl. Math. 156, 2551–2560 (2008)
ILOG CPLEX 10.1. User’s Manual (2006)
K. Jornsten, A. Lokketangen, Tabu search for weighted k-cardinality trees. Asia-Pacific J. Oper. Res. 14, 9–26 (1997)
J.R. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection (MIT, Cambridge, 1992)
J. Lazić, S. Hanafi, N. Mladenović, D. Urošević, Variable neighbourhood decomposition search for 0–1 mixed integer programs. Comput. Oper. Res. 37, 1055–1067 (2010)
L. Liberti, M. Dražić, Variable neighbourhood search for the global optimization of constrained NLPs, in Proceedings of GO Workshop, Almeria, 2005
B. Melián, N. Mladenović, Editorial. IMA J. Manag. Math. 18, 99–100 (2007)
N. Mladenović, A variable neighborhood algorithm – a new metaheuristic for combinatorial optimization. Abstracts of papers presented at Optimization Days, Montréal (1995), p. 112
N. Mladenović, Formulation space search – a new approach to optimization (plenary talk), in Proceedings of XXXII SYMOPIS’05, ed. by J. Vuleta (Vrnjacka Banja, Serbia, 2005)
N. Mladenović, P. Hansen, Variable neighborhood search. Comput. Oper. Res. 24, 1097–1100 (1997)
N. Mladenović, J. Petrović, V. Kovačević-Vujčić, M. Čangalović, Solving spread spectrum radar polyphase code design problem by tabu search and variable neighborhood search. Eur. J. Oper. Res. 151, 389–399 (2003)
N. Mladenović, F. Plastria, D. Urošević, Reformulation descent applied to circle packing problems. Comput. Oper. Res. 32, 2419–2434 (2005)
N. Mladenović, F. Plastria, D. Urošević, Formulation space search for circle packing problems. Lect. Notes Comput. Sci. 4638, 212–216 (2007)
N. Mladenović, M. Dražić, V. Kovačevic-Vujčić, M. Čangalović, General variable neighborhood search for the continuous optimization. Eur. J. Oper. Res. 191, 753–770 (2008)
N. Mladenović, D. Urošević, D. Pérez-Brito, C.G. García-González, Variable neighbourhood search for bandwidth reduction. Eur. J. Oper. Res. 200, 14–27 (2010)
N. Mladenovic, J. Kratica, V. Kovacevic-Vujcic, M. Cangalovic, Variable neighborhood search for metric dimension and minimal doubly resolving set problems. Eur. J. Oper. Res. 220, 328–337 (2012)
J.M. Moreno-Vega, B. Melián, Introduction to the special issue on variable neighborhood search. J. Heuristics 14, 403–404 (2008)
J.J. Pantrigo, R. Marti, A. Duarte, E.G. Pardo, Scatter search for the cutwidth minimization problem. Ann. Oper. Res. 199, 285–304 (2012)
E.G. Pardo, N. Mladenović, J.J. Pantrigo, A. Duarte, Variable formulation search for the cut-width minimization problem. Appl. Soft Comput. 13, 2242–2252 (2014)
F. Plastria, N. Mladenović, D. Urošević, Variable neighborhood formulation space search for circle packing, in 18th Mini Euro Conference VNS, Tenerife, 2005
J. Puchinger, G. Raidl, Bringing order into the neighborhoods: relaxation guided variable neighborhood search. J. Heuristics 14, 457–472 (2008)
C.C. Ribeiro, M.C. de Souza, Variable neighborhood search for the degree-constrained minimum spanning tree problem. Discrete Appl. Math. 118, 43–54 (2002)
C.C. Ribeiro, E. Uchoa, R. Werneck, A hybrid GRASP with perturbations for the Steiner problem in graphs. INFORMS J. Comput. 14, 228–246 (2002)
J. Rolim, O. Sýkora, I. Vrt’o, Optimal cutwidths and bisection widths of 2- and 3-dimensional meshes, in Graph-Theoretic Concepts in Computer Science. Lecture Notes in Computer Science, vol. 1017 (1995), pp. 252–264
J. Sedlar, D. Vukicevic, M. Aouchiche, P. Hansen, Variable neighborhood search for extremal graphs 24. Conjectures and results about the clique number. Les Cahiers du GERAD G-2007-33, 2007
J. Sedlar, D. Vukicevic, M. Aouchiche, P. Hansen, Variable neighborhood search for extremal graphs 25. Products of connectivity and distance measures. Les Cahiers du GERAD, G-2007-47, 2007
D. Stevanovic, M. Aouchiche, P. Hansen, On the spectral radius of graphs with a given domination number. Linear Algebra Appl. 428, 1854–1864 (2008)
B. Subudhi, D. Jena, A differential evolution based neural network approach to nonlinear system identification. Appl. Soft Comput. 11, 861–871 (2011)
A.D. Toksari, E. Güner, Solving the unconstrained optimization problem by a variable neighborhood search. J. Math. Anal. Appl. 328, 1178–1187 (2007)
D. Urošević, J. Brimberg, N. Mladenović, Variable neighborhood decomposition search for the edge weighted k-cardinality tree problem. Comput. Oper. Res. 31, 1205–1213 (2004)
Y. Vimont, S. Boussier, M. Vasquez, Reduced costs propagation in an efficient implicit enumeration for the 01 multidimensional knapsack problem. J. Comb. Optim. 15, 165–178 (2008)
R. Whitaker, A fast algorithm for the greedy interchange of large-scale clustering and median location problems. INFOR 21, 95–108 (1983)
Acknowledgements
The work of Nenad Mladenović was conducted at the National Research University Higher School of Economics, Nizhni Novgorod, Russia, and supported by RSF grant 14-41-00039. The fourth author is partially funded by Ministerio de Economía y Competitividad (Spanish Government) with FEDER funds, grant TIN2015-70226-R, and by Fundación Cajacanarias, grant 2016TUR19.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this chapter
Cite this chapter
Hansen, P., Mladenović, N., Brimberg, J., Pérez, J.A.M. (2019). Variable Neighborhood Search. In: Gendreau, M., Potvin, JY. (eds) Handbook of Metaheuristics. International Series in Operations Research & Management Science, vol 272. Springer, Cham. https://doi.org/10.1007/978-3-319-91086-4_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-91086-4_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-91085-7
Online ISBN: 978-3-319-91086-4
eBook Packages: Business and ManagementBusiness and Management (R0)