Abstract
This paper addresses the problem of scheduling discretely divisible applications in heterogeneous desktop systems with limited memory by relying on realistic performance models for computation and communication, through bidirectional asymmetric full-duplex buses. We propose an algorithm for multi-installment processing with multi-distributions that allows to efficiently overlap computation and communication at the device level in respect to the supported concurrency. The presented approach was experimentally evaluated for a real application; 2D FFT batch collaboratively executed on a Graphic Processing Unit and a multi-core CPU. The experimental results obtained show the ability of the proposed approach to outperform the optimal implementation for about 4 times, whereas it is not possible with the current state of the art approaches to determine a load balanced distribution.
Chapter PDF
Similar content being viewed by others
Keywords
References
Barlas, G.D., Hassan, A., Jundi, Y.A.: An Analytical Approach to the Design of Parallel Block Cipher Encryption/Decryption: A CPU/GPU Case Study. In: PDP, pp. 247–251 (2011)
Beaumont, O., et al.: Scheduling divisible loads on star and tree networks: results and open problems. IEEE Trans. Parallel Distributed Systems 16, 2005 (2003)
Berlińska, J., Drozdowski, M.: Heuristics for multi-round divisible loads scheduling with limited memory. Parallel Comput. 36, 199–211 (2010)
Clarke, D., Lastovetsky, A., Rychkov, V.: Dynamic load balancing of parallel computational iterative routines on platforms with memory heterogeneity. In: HeteroPar 2010 (2010)
Drozdowski, M., Lawenda, M.: A New Model of Multi-installment Divisible Loads Processing in Systems with Limited Memory. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds.) PPAM 2007. LNCS, vol. 4967, pp. 1009–1018. Springer, Heidelberg (2008)
Galindo, I., Almeida, F., BadÃa-Contelles, J.M.: Dynamic Load Balancing on Dedicated Heterogeneous Systems. In: Lastovetsky, A., Kechadi, T., Dongarra, J. (eds.) EuroPVM/MPI 2008. LNCS, vol. 5205, pp. 64–74. Springer, Heidelberg (2008)
Ghatpande, A., Nakazato, H., Watanabe, H., Beaumont, O.: Divisible load scheduling with result collection on heterogeneous systems. In: IPDPS, pp. 1–8 (2008)
Ilic, A., Sousa, L.: Algorithm for divisible load scheduling on heterogeneous systems with realistic performance models. Tech. rep., INESC-ID (May 2011)
Ilic, A., Sousa, L.: Collaborative execution environment for heterogeneous parallel systems. In: APDCM/IPDPS 2010 (2010)
Lastovetsky, A., Reddy, R.: Data partitioning with a functional performance model of heterogeneous processors. Int. J. High Perform. Comput. Appl. 21, 76–90 (2007)
Shokripour, A., Othman, M.: Survey on divisible load theory and its applications. In: ICIME 2009, pp. 300–304 (2009)
Veeravalli, B., Ghose, D., Robertazzi, T.G.: Divisible load theory: A new paradigm for load scheduling in distributed systems. Cluster Computing 6, 7–17 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ilic, A., Sousa, L. (2012). Scheduling Divisible Loads on Heterogeneous Desktop Systems with Limited Memory. In: Alexander, M., et al. Euro-Par 2011: Parallel Processing Workshops. Euro-Par 2011. Lecture Notes in Computer Science, vol 7155. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29737-3_54
Download citation
DOI: https://doi.org/10.1007/978-3-642-29737-3_54
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29736-6
Online ISBN: 978-3-642-29737-3
eBook Packages: Computer ScienceComputer Science (R0)