Abstract
On cc-NUMA multi-processors, the non-uniformity of main memory latencies motivates the need for co-location of threads and data. We call this special form of data locality, geographical locality, as one aspect of the non-uniformity is the physical distance between the cc-NUMA nodes. We compare the well established first-touch strategy to an application-initiated page migration strategy as means of increasing the geographical locality for a set of important scientific applications.
The main conclusions of the study are: (1) that geographical locality is important for the performance of the applications, (2) that application-initiated migration outperforms the first-touch scheme in almost all cases, and in some cases even results in performance which is close to what is obtained if all threads and data are allocated on a single node.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Noordergraaf, L., van der Pas, R.: Performance experiences on Sun’s Wildfire prototype. In: Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM), p. 38. ACM Press, New York (1999)
Bircsak, J., Craig, P., Crowell, R., Cvetanovic, Z., Harris, J., Nelson, C.A., Offner, C.D.: Extending OpenMP for NUMA machines. Scientific Programming 8, 163–181 (2000)
Nikolopoulos, D.S., Papatheodorou, T.S., Polychronopoulos, C.D., Labarta, J., Ayguade, E.: A transparent runtime data distribution engine for OpenMP. Scientific Programming 8, 143–162 (2000)
Bull, J.M., Johnson, C.: Data Distribution, Migration and Replication on a cc-NUMA Architecture. In: Proceedings of the Fourth European Workshop on OpenMP (2002), http://www.caspur.it/ewomp2002/
Hagersten, E., Koster, M.: WildFire: A Scalable Path for SMPs. In: Proceedings of the 5th International Symposium on High-Performance Architecture (1999)
Nikolopoulos, D.S., Polychronopoulos, C.D., Ayguadi, E.: Scaling irregular parallel codes with minimal programming effort. In: Proceedings of the 2001 ACM/IEEE conference on Supercomputing (CDROM), pp. 16–16. ACM Press, New York (2001)
Verghese, B., Devine, S., Gupta, A., Rosenblum, M.: Operating system support for improving data locality on CC-NUMA compute servers. In: Proceedings of the seventh international conference on Architectural support for programming languages and operating systems, pp. 279–289. ACM Press, New York (1996)
Chandra, R., Devine, S., Verghese, B., Gupta, A., Rosenblum, M.: Scheduling and page migration for multiprocessor compute servers. In: Proceedings of the sixth international conference on Architectural support for programming languages and operating systems, pp. 12–24. ACM Press, New York (1994)
Corbalan, J., Martorell, X., Labarta, J.: Evaluation of the memory page migration influence in the system performance: the case of the sgi o2000. In: Proceedings of the 17th annual international conference on Supercomputing, pp. 121–129. ACM Press, New York (2003)
Jin, H., Frumkin, M., Yan, J.: The OpenMP Implementation of NAS Parallel Benchmarks and Its Performance. NAS Technical Report NAS-99-011, NASA Ames Research Center (1999)
Löf, H., Nordén, M., Holmgren, S.: Improving geographical locality of data for shared memory implementations of pde solvers. Technical Report 006, Department of Information Technology, Uppsala University (2004)
Sun Microsystems Solaris Memory Placement Optimization and Sun Fire servers (2003), http://www.sun.com/servers/wp/docs/mpo_v7_CUSTOMER.pdf
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Löf, H., Nordén, M., Holmgren, S. (2004). Improving Geographical Locality of Data for Shared Memory Implementations of PDE Solvers. In: Bubak, M., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds) Computational Science - ICCS 2004. ICCS 2004. Lecture Notes in Computer Science, vol 3037. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24687-9_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-24687-9_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22115-9
Online ISBN: 978-3-540-24687-9
eBook Packages: Springer Book Archive