Abstract
The EU-funded XtreemOS project implements a grid operating system (OS) transparently exploiting distributed resources through the SAGA and POSIX interfaces. XtreemOS uses an integrated grid checkpointing service (XtreemGCP) for implementing migration and fault tolerance for grid applications. Checkpointing and restarting applications in a grid requires saving and restoring distributed/parallel applications in distributed heterogeneous environments. In this paper we present the architecture of the XtreemGCP service integrating existing system-specific checkpointer solutions. We propose to bridge the gap between grid semantics and system-specific checkpointers by introducing a common kernel checkpointer API that allows using different checkpointers in a uniform way. Our architecture is open to support different checkpointing strategies that can be adapted according to evolving failure situations or changing application requirements. Finally, we discuss measurements numbers showing that the XtreemGGP architecture introduces only minimal overhead.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Badia, R., Hood, R., Kielmann, T., Merzky, A., Morin, C., Pickles, S., Sgaravatto, M., Stodghill, P., Stone, N., Yeom, H.: Use-Cases and Requirements for Grid Checkpoint and Recovery. Technical Report GFD-I.92, Open Grid Forum (2004)
Bhattiprolu, S., Biederman, E.W., Hallyn, S., Lezcano, D.: Virtual servers and checkpoint/restart in mainstream linux. SIGOPS Operting Systems Review 42(5), 104–113 (2008)
Coti, C., Herault, T., Lemarinier, P., Pilard, L., Rezmerita, A., Rodriguez, E., Cappello, F.: Blocking vs. non-blocking coordinated checkpointing for large-scale fault tolerant mpi. In: SC 2006: Proceedings of the 2006 ACM/IEEE conference on Supercomputing, Tampa, USA (2006)
Foster, I., Kesselman, C.: The globus project: a status report. Future Generation Computer Systems 15(5-6), 607–621 (1999)
Hupfeld, F., Cortes, T., Kolbeck, B., Focht, E., Hess, M., Malo, J., Marti, J., Stender, J., Cesario, E.: Xtreemfs - a case for object-based file systems in grids. Concurrency and Computation: Practice and Experience 20(8) (2008)
Hursey, J., Squyres, J.M., Mattox, T.I., Lumsdaine, A.: The Design and Implementation of Checkpoint/Restart Process Fault Tolerance for Open MPI. In: Int’l Parallel and Distributed Processing Symposium, Long Beach, CA, USA (2007)
Duell, J., Hargrove, P., Roman, E.: The Design and Implementation of Berkeley Lab’s Linux Checkpoint/Restart. Technical Report LBNL-54941 (2003)
Jankowski, G., Januszewski, R., Mikolajczak, R., Stroinski, M., Kovacs, J., Kertesz, A.: Grid checkpointing architecture - integration of low-level checkpointing capabilites with grid. Technical Report TR-0075, CoreGRID, May 22 (2007)
Litzkow, M., Solomon, M.: The evolution of condor checkpointing. In: Mobility: processes, computers, and agents, pp. 163–164 (1999)
Mehnert-Spahn, J., Schoettner, M., Morin, C.: Checkpoint process groups in a grid environment. In: Int’l Conference on Parallel and Distributed Computing, Applications and Technologies, Dunedin, New Zealand (December 2008)
Ni, L., Harwood, A.: An adaptive checkpointing scheme for peer-to-peer based volunteer computing work flows. ArXiv e-prints (November 2007)
Plank, J.S., Beck, M., Kingsley, G., Li, K.: Libckpt: Transparent Checkpointing under Unix. In: Proceedings of USENIX Winter 1995 Technical Conference, New Orleans, Louisiana, USA, January 1995, pp. 213–224 (1995)
Reiser, H.P., Kapitza, R., Domaschka, J., Hauck, F.J.: Fault-tolerant replication based on fragmented objects. In: Eliassen, F., Montresor, A. (eds.) DAIS 2006. LNCS, vol. 4025, pp. 256–271. Springer, Heidelberg (2006)
Sankaran, S., Squyres, J.M., Barrett, B., Sahay, V., Lumsdaine, A., Duell, J., Hargrove, P., Roman, E.: The LAM/MPI Checkpoint/Restart Framework: System-Initiated Checkpointing. International Journal of High Performance Computing Applications 19(4), 479–493 (2005)
Stone, N., Simmel, D., Kielmann, T., Merzky, A.: An Architecture for Grid Checkpoint and Recovery Services. Technical Report GFD-I.93, OGF (2007)
Vallée, G., Lottiaux, R., Rilling, L., Berthou, J.-Y., Dutka-Malhen, I., Morin, C.: A Case for Single System Image Cluster Operating Systems: the Kerrighed Approach. Parallel Processing Letters 13(2) (June 2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mehnert-Spahn, J., Ropars, T., Schoettner, M., Morin, C. (2009). The Architecture of the XtreemOS Grid Checkpointing Service. In: Sips, H., Epema, D., Lin, HX. (eds) Euro-Par 2009 Parallel Processing. Euro-Par 2009. Lecture Notes in Computer Science, vol 5704. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03869-3_42
Download citation
DOI: https://doi.org/10.1007/978-3-642-03869-3_42
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03868-6
Online ISBN: 978-3-642-03869-3
eBook Packages: Computer ScienceComputer Science (R0)