Thread Migration and Load Balancing in Heterogeneous Environments

Abstract

Networks of workstations are fast becoming the standard envi- ronment for parallel applications. However, the use of “found” resources as a platform for tightly-coupled runtime environments has at least three obsta- cles: contention for resources, differing processor speeds, and processor heterogeneity. All three obstacles result in load imbalance, leading to poor performance for scientific applications. This paper describes the use of thread migration in transparently addressing this load imbalance in the con- text of the CVM software distributed shared memory system. We describe the implementation and performance of mechanisms and policies that accom- modate both resource contention, and heterogeneity in clock speed and processor type. Our results show that these cycles can indeed be effectively exploited, and that the runtime cost of processor heterogeneity can be quite manageable. Along the way, however, we identify a number of problems that need to be addressed before such systems can enjoy widespread use.