Characterization of Neighborhood Behaviours in a Multi-neighborhood Local Search Algorithm

  • Nguyen Thi Thanh DangEmail author
  • Patrick De Causmaecker
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10079)


We consider a multi-neighborhood local search framework with a large number of possible neighborhoods. Each neighborhood is accompanied by a weight value which represents the probability of being chosen at each iteration. These weights are fixed before the algorithm runs, and can be tuned by off-the-shelf off-line automated algorithm configuration tools (e.g., SMAC). However, the large number of parameters might deteriorate the tuning tool’s efficiency, especially in our case where each run of the algorithm is not computationally cheap, even when the number of parameters has been reduced by some intuition. In this work, we propose a systematic method to characterize each neighborhood’s behaviours, representing them as a feature vector, and using cluster analysis to form similar groups of neighborhoods. The novelty of our characterization method is the ability of reflecting changes of behaviours according to hardness of different solution quality regions based on simple statistics collected during any algorithm runs. We show that using neighborhood clusters instead of individual neighborhoods helps to reduce the parameter configuration space without misleading the search of the tuning procedure. Moreover, this method is problem-independent and potentially can be applied in similar contexts.


Algorithm configuration Clustering Multi-neighborhood local search 



This work is funded by COMEX (Project P7/36), a BELSPO/IAP Programme. We thank Túlio Toffolo for his great help during the course of this research, Thomas Stützle and Jan Verwaeren for their valuable remarks. The computational resources and services used in this work were provided by the VSC (Flemish Supercomputer Center), funded by the Hercules Foundation and the Flemish Government department EWI.


  1. 1.
    Wauters, T., Toffolo, T., Christiaens, J., Van Malderen, S.: The winning approach for the verolog solver challenge 2014: the swap-body vehicle routing problem. In: Proceedings of ORBEL29 (2015)Google Scholar
  2. 2.
    Heid, W., Hasle, G., Vigo, D.: Verolog solver challenge 2014-vsc2014 problem description. In: VeRoLog (EURO Working Group on Vehicle Routing and Logistics Optimization) and PTV Group, pp. 1–6 (2014)Google Scholar
  3. 3.
    Lourenço, H.R., Martin, O.C., Stützle, T.: Iterated local search: framework and applications. In: Gendreau, M., Potvin, J.-Y. (eds.) Handbook of Metaheuristics. International Series in Operations Research and Management Science, vol. 146, pp. 363–397. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  4. 4.
    Burke, E.K., Bykov, Y.: A late acceptance strategy in hill-climbing for exam timetabling problems. In: PATAT 2008: Conference, Montreal, Canada (2008)Google Scholar
  5. 5.
    Mısır, M., Handoko, S.D., Lau, H.C.: OSCAR: online selection of algorithm portfolios with case study on memetic algorithms. In: Dhaenens, C., Jourdan, L., Marmion, M.-E. (eds.) LION 2015. LNCS, vol. 8994, pp. 59–73. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-19084-6_6 CrossRefGoogle Scholar
  6. 6.
    Kolde, R., Laur, S., Adler, P., Vilo, J.: Robust rank aggregation for gene list integration and meta-analysis. Bioinformatics 28(4), 573–580 (2012)CrossRefGoogle Scholar
  7. 7.
    Egozcue, J.J., Pawlowsky-Glahn, V., Mateu-Figueras, G., Barcelo-Vidal, C.: Isometric logratio transformations for compositional data analysis. Math. Geol. 35(3), 279–300 (2003)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Bergé, L., Bouveyron, C., Girard, S.: HDclassif: an r package for model-based clustering and discriminant analysis of high-dimensional data. J. Stat. Softw. 46(6), 1–29 (2012). CrossRefGoogle Scholar
  9. 9.
    Hutter, F., Hoos, H.H., Leyton-Brown, K.: Sequential model-based optimization for general algorithm configuration. In: Coello, C.A.C. (ed.) LION 2011. LNCS, vol. 6683, pp. 507–523. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-25566-3_40 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Nguyen Thi Thanh Dang
    • 1
    Email author
  • Patrick De Causmaecker
    • 1
  1. 1.KU Leuven KULAK, CODeS, iMinds-ITECKortrijkBelgium

Personalised recommendations