Solving Job Shop Scheduling with Parallel Population-Based Optimization and Apache Spark

  • Piotr Jedrzejowicz
  • Izabela WierzbowskaEmail author
Conference paper
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 193)


The paper proposes an architecture for the population-based optimization in which Apache Spark is used as a platform enabling parallelization of the process of search for the best solution. The suggested architecture, based on the A-Team concept, is used to solve the Job Shop Scheduling Problem (JSP) instances. Computational experiment is carried out to compare the results from solving a benchmark set of the problem instances obtained using the proposed approach with other, recently reported, results.


optimization Apache spark Job shop scheduling 


  1. 1.
    Abdel-Kader, R.F.: An improved pso algorithm with genetic and neighborhood-based diversity operators for the job shop scheduling problem. Appl. Artif. Intell. 32(5), 433–462 (2018).
  2. 2.
    Alba, E., Luque, G., Nesmachnow, S.: Parallel metaheuristics: recent advances and new trends. Int. Trans. Oper. Res. 20(1), 1–48 (2013)
  3. 3.
    Barbucha, D., Czarnowski, I., Jdrzejowicz, P., Ratajczak-Ropel, E., Wierzbowska, I.: JABAT Middleware as a Tool for Solving Optimization Problems, pp. 181–195. Springer, Berlin, Heidelberg, Berlin, Heidelberg (2010).
  4. 4.
    Boussaid, I., Lepagnot, J., Siarry, P.: A survey on optimization metaheuristics. Inf. Sci. 237, 82 – 117 (2013). Prediction, Control and Diagnosis using Advanced Neural ComputationsGoogle Scholar
  5. 5.
    Dorigo, M., Maniezzo, V., Colorni, A.: Ant system: optimization by a colony of cooperating agents. IEEE Trans. Syst. Man Cybern. Part B (Cybernetics) 26(1), 29–41 (1996)Google Scholar
  6. 6.
    Fogel, D.: Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, vol. 1. IEEE Press piscataway NJ (01 1995)Google Scholar
  7. 7.
    Geem, Z.W., Kim, J., Loganathan, G.: A new heuristic optimization algorithm: harmony search. Simul. 76, 60–68 (02 2001)Google Scholar
  8. 8.
    Goldberg, D.E.: Genetic Algorithms in Search Optimization and Machine Learning, 1st edn. Addison-Wesley Longman Publishing Co. Inc., Boston, MA, USA (1989)zbMATHGoogle Scholar
  9. 9.
    González, P., Pardo Martínez, X., Doallo, R., Banga, J.: Implementing cloud-based parallel metaheuristics: an overview. J. Comput. Sci. Technol. 18(03), e26 (2018).
  10. 10.
    Hatamlou, A.: Solving travelling salesman problem using black hole algorithm. Soft Comput. 22 (2017)Google Scholar
  11. 11.
    Jedrzejowicz, P.: Current trends in the population-based optimization. In: Nguyen, N.T., Chbeir, R., Exposito, E., Aniorté, P., Trawiński, B. (eds.) Computational Collective Intelligence, pp. 523–534. Springer International Publishing, Cham (2019)CrossRefGoogle Scholar
  12. 12.
    Jedrzejowicz, P., Wierzbowska, I.: Experimental investigation of the synergetic effect produced by agents solving together instances of the euclidean planar travelling salesman problem. In: Jedrzejowicz, P., Nguyen, N.T., Howlet, R.J., Jain, L.C. (eds.) Agent and Multi-Agent Systems: Technologies and Applications, pp. 160–169. Springer, Berlin, Heidelberg (2010)CrossRefGoogle Scholar
  13. 13.
    Jedrzejowicz, P., Wierzbowska, I.: Apache spark as a tool for parallel population-based optimization. In: Czarnowski, I., Howlett, R.J., Jain, L.C. (eds.) Intelligent Decision Technologies 2019, pp. 181–190. Springer Singapore, Singapore (2020)CrossRefGoogle Scholar
  14. 14.
    Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of ICNN’95—International Conference on Neural Networks. vol. 4, pp. 1942–1948 (1995)Google Scholar
  15. 15.
    Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA (1992)zbMATHGoogle Scholar
  16. 16.
    Michalewicz, Z.: Genetic Algorithm+Data Structures=Evolution Programs. Springer, Berlin, Heidelberg (1996)CrossRefGoogle Scholar
  17. 17.
    Lawrence, S.R.: Resource constrained project scheduling-a computational comparison of heuristic techniques (1985)Google Scholar
  18. 18.
    Radenski, A.: Distributed simulated annealing with mapreduce. In: Di Chio, C., Agapitos, A., Cagnoni, S., Cotta, C., de Vega, F.F., Di Caro, G.A., Drechsler, R., Ekárt, A., Esparcia-Alcázar, A.I., Farooq, M., Langdon, W.B., Merelo-Guervós, J.J., Preuss, M., Richter, H., Silva, S., Simões, A., Squillero, G., Tarantino, E., Tettamanzi, A.G.B., Togelius, J., Urquhart, N., Uyar, A.Ş., Yannakakis, G.N. (eds.) Applications of Evolutionary Computation, pp. 466–476. Springer, Berlin, Heidelberg (2012)CrossRefGoogle Scholar
  19. 19.
    Sato, T., Hagiwara, M.: Bee system: finding solution by a concentrated search. In: 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation. vol. 4, pp. 3954–3959 (1997)Google Scholar
  20. 20.
    Semlali, S., Riffi, M., Chebihi, F.: Memetic chicken swarm algorithm for job shop scheduling problem. Int. J. Electr. Comput. Eng. (IJECE) 9, 2075 (2019)Google Scholar
  21. 21.
    Silva, M.A.L., de Souza, S.R., Souza, M.J.F., de França Filho, M.F.: Hybrid metaheuristics and multi-agent systems for solving optimization problems: a review of frameworks and a comparative analysis. Appl. Soft Comput. 71, 433–459 (2018).
  22. 22.
    Sun, L., Lin, L., Lib, H., Genc, M.: Large scale flexible scheduling optimization by a distributed evolutionary algorithm. Comput. Ind. Eng. 128 (2018)Google Scholar
  23. 23.
    Talukdar, S., Baerentzen, L., Gove, A., De Souza, P.: Asynchronous teams: cooperation schemes for autonomous agents. J. Heuristics 4(4), 295–321 (1998).
  24. 24.
    Wu, G., Mallipeddi, R., Suganthan, P.: Ensemble strategies for population-based optimization algorithms—a survey. Swarm Evolut. Comput. 44, 695–711 (2019)CrossRefGoogle Scholar

Copyright information

© The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.Department of Information SystemsGdynia Maritime UniversityGdyniaPoland

Personalised recommendations