Advertisement

Computational grid scheduling architecture using MapReduce model-based non-dominated sorting genetic algorithm

  • D. RajeswariEmail author
  • M. Prakash
  • J. Suresh
Focus
  • 19 Downloads

Abstract

Computational grid (CG) environment has a group of autonomous dissimilar distributed computing systems to provide service to user tasks. To attain the auspicious usefulness of CG resources, basically best scheduling algorithms are important. The CG service users are very cautious in time needed for task completion. To meet multiple requirements of the user, the job allocation problem in CG is designed as a multi-objective problem. Evolutionary algorithms have an efficient meta-heuristic technique for optimization problem solving. This work introduces a MapReduce model for non-dominated sorting genetic algorithm (NSGA-II) for independent job scheduling in a CG. This research work attempts to find the optimal schedules by considering makespan and flowtime minimization. A fuzzy membership function is used to analyze the efficiency of the schedule. Set of benchmark instances is used to test the algorithm. Experimental results show that MapReduce model-based NSGA-II generated finer solutions in less time than the MapReduce model-based weighted sum multi-objective genetic algorithm (WMOGA) which is also implemented in this paper.

Keywords

Computational grid MapReduce Multi-objective Task scheduling Non-dominated sorting Genetic algorithm 

Notes

Compliance with ethical standards

Conflict of interest

All authors declare that they have no conflicts of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

References

  1. Abraham A, Buyya R, Nath B (2000) Nature’s heuristics for scheduling jobs on computational grids. In: The 8th IEEE international conference on advanced computing and communications (ADCOM 2000), pp 14–16Google Scholar
  2. Abraham A, Liu H, Zhang W, Chang TG (2006) Scheduling jobs on computational grids using fuzzy particle swarm algorithm. Springer, Berlin, pp 500–507Google Scholar
  3. Abraham A, Liu H, Grosan C, Xhafa F (2008) Nature inspired meta-heuristics for grid scheduling: single and multi-objective optimization approaches. Stud Comput Intell 146:247–272zbMATHGoogle Scholar
  4. Braun TD, Siegel HJ, Beck N, Boloni LL, Maheswaran M, Reuther AI, Robertson JP, Theys MD, Yao B (2001) A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J Parall Distrib Comput 61(6):810–837CrossRefzbMATHGoogle Scholar
  5. Carretero J, Xhafa F, Abraham A (2007) Genetic algorithm based schedulers for grid computing systems. Int J Innov Comput Inf Control 3(6):1–19Google Scholar
  6. Chao J, Christian V, Buyya R (2008) MRPGA: an extension of MapReduce for parallelizing genetic algorithms. In: Proceedings of the 4th international conference on e-science, USA, pp 214–221Google Scholar
  7. Deb K (2002) Multi-objective optimization using evolutionary algorithms. Wiley, LondonzbMATHGoogle Scholar
  8. Deb K, Pratap A, Agarwal S, Meyarivan T (2002) A fast elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans Evol Comput 6:182–197CrossRefGoogle Scholar
  9. Dhole Poonam B, Gunjal Baisa L (2013) Survey paper on traditional hadoop and pipelined map reduce. Int J Comput Eng Res 3(12):32–36Google Scholar
  10. Durillo JJ, Nebro AJ, Luna F, Alba E (2008) A study of master–slave approaches to parallelize NSGA-II. In: Proceedings of the 22nd IEEE international symposium on parallel and distributed processing, USA, pp 1–8Google Scholar
  11. Guzek Mateusz, Pecero Johnatan E, Dorronsoro Bernabe, Bouvry Pascal (2014) Multi-objective evolutionary algorithm for energy-aware scheduling on distributed computing systems. Appl Soft Comput 24:432–446CrossRefGoogle Scholar
  12. Izakian H, Abraham A, Snasel V (2009) Comparison of heuristics for scheduling independent tasks on heterogeneous distributed environments. In: Proceedings of international joint conference on computational sciences and optimization, pp 8–12Google Scholar
  13. Izakian H, Tork Ladani B, Zamanifar K, Abraham A (2009) A novel particle swarm optimization approach for grid job scheduling. In: Proceedings of the 3rd international conference on information systems, technology and management, pp 100–110Google Scholar
  14. Kaiwartya O, Prakash S, Abdullah AH, Hassan AN (2015) Minimizing energy consumption in scheduling of dependent tasks using genetic algorithm in computational grid. KSII Trans Interent Inf Syst 9(8):2821–2839Google Scholar
  15. Keerthika P, Suresh P (2015) A multiconstrained grid scheduling algorithm with load balancing and fault tolerance. Sci World J 2015:1–10.  https://doi.org/10.1155/2015/349576 CrossRefGoogle Scholar
  16. Li Jun-Qing, Pan Quan-ke (2014) Solving the large-scale hybrid flow shop scheduling problem with limited buffers by a hybrid artificial bee colony algorithm. Inf Sci 316:487–502CrossRefGoogle Scholar
  17. Lim D, Ong Y-S, Jin Y, Sendhoff B, Lee B-S (2007) Efficient hierarchical parallel genetic algorithms using grid computing. Fut Gener Comput Syst 23:658–670CrossRefGoogle Scholar
  18. Malarvizhi N, Uthariaraj VR (2009) A minimum time to release job scheduling algorithm in computational grid environment. In: Proceedings of the 5th international joint conference on INC, IMS, and IDC (NCM’09), pp 13–18Google Scholar
  19. Maseli M, Twala B (2017) An adaptive Cuckoo Search algorithm for optimization. Appl Comput Inform 14:107–115Google Scholar
  20. Nandhagopal M, Uthariaraj VR (2010) Fault tolerant scheduling strategy for computational grid environment. Int J Eng Sci Technol 2(9):4361–4372Google Scholar
  21. Niimura T, Nakashima T (2003) Multi-objective tradeoff analysis of deregulated electricity transactions. Int J Electr Power Energy Syst 25:179–185CrossRefGoogle Scholar
  22. Page A, Naughton J (2005) Framework for task scheduling in heterogeneous distributed computing using genetic algorithms. Artif Intell 24:415–429CrossRefGoogle Scholar
  23. Parsa S, Maleki RE (2009) RASA: a new grid task scheduling algorithm. World Appl Sci J 7:152–160Google Scholar
  24. Subashini G, Bhuvaneswari MC (2011) Non dominated particle swarm optimization for scheduling independent tasks on heterogeneous distributed environments. Int J Adv Soft Comput Appl 3(1):1–17Google Scholar
  25. Subhashini G, Bhuvaneswari MC (2010) A fast and elitist bi-objective evolutionary algorithm for scheduling independent tasks on heterogeneous systems. ICTACT J Soft Comput 01:9–17CrossRefGoogle Scholar
  26. Verma A, Llora X, Goldberg DE, Campbell RH (2009) Scaling genetic algorithms using MapReduce. In: Proceedings of the 9th international conference on intelligent systems design and applications, USA, pp 13–18Google Scholar
  27. Wang F, Qiu J, Yang J, Dong B, Li X, Li Y (2009) Hadoop high availability through metadata replication. In: Cloud DB 2009: proceedings of the first international workshop on cloud data managementGoogle Scholar
  28. Wang L, Wang Z, Hu S, Liu L (2015) Ant colony optimization for task allocation in multi-agent systems. China Commun 10(3):125–132CrossRefGoogle Scholar
  29. Yarkhan A, Dongarra J (2002) Experiments with scheduling using simulated annealing in a grid environment. In: Proceedings of the 3rd international workshop on grid computing (GRID2002), pp 232–242Google Scholar
  30. Yuan Hao, Wang Yong, Chen Long (2010) An availability-aware task scheduling for heterogeneous systems using quantum-behaved particle swarm optimization. Lect Notes Comput Sci 6145:120–127CrossRefGoogle Scholar
  31. Zhang Q, Li Z (2010) Design of grid resource management system based on information service. J Comput 5(5):687–694MathSciNetGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringSRM Institute of Science and TechnologyKattankulathur, KancheepuramIndia
  2. 2.Department of Computer Science and EngineeringCK College of Engineering and TechnologyCuddaloreIndia

Personalised recommendations