Abstract
In 1999, the impending launch of the Terra satellite, combined with concerns about the ability of commercial software to process its high data volumes, led the Goddard Earth Sciences Distributed Active Archive Center (GES DAAC) to develop a contingency science processing system. Severe time and money constraints forced the GES DAAC towards a minimalist architecture that eventually becomes the Simple, Scalable, Script-based Science Processor (S4P). It was named Simple for its architecture and small size (a few thousand lines of code), Scalable for its ability to scale up to heavy processing loads or down to modest automation tasks, Script-based for its reliance on the Perl scripting language for its infrastructure, and Science Processor for its genesis in running scientific algorithms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arrington D (2000) Release 6A SDP Toolkit Users Guide for the ECS Project. EOSDIS Core System Project Document 333-CD-600-001 http://edhs1.gsfc.nasa.gov/waisdata/sdp/html/cd33360001.html
Beck K (2000) Extreme Programming Explained. Addison-Wesley, Boston, p. 224
Earth Science Data and Information Systems Project (2002) Interface Control Document between the EOSDIS Core System (ECS) and the Science Investigator-Led Processing Systems (SIPS) Volume 0: Interface Mechanisms, NASA/GSFC
Howe AE (1995) Improving the reliability of artificial intelligence planning systems by analyzing their failure recovery. IEEE Transactions on Knowledge and Data Engineering 7(1): 14–25
Juran JM, Gryna FM (1951) Juran’s Quality Control Handbook. McGraw-Hill, New York
Lynnes CS, Mack RM (2001) KDD Services at the Goddard Earth Sciences Distributed Active Archive Center. In: Grossman RL, Kamath C, Kegelmeyer P, Kumar V, Namburu RR (eds) Data Mining for Scientific and Engineering Applications. Kluwer, Dordrecht, 165–182
Musa J (1975) A theory of software reliability and its application. IEEE Trans. Software Eng. 1(3): 312–327
Taylor J (2002) Parallelization and Load Balancing of the Simple, Scalable, Script-Based Science Processor (S4P) with a Dynamic Job Router. University of South Florida Honor’s College Thesis
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Tsinghua University Press, Beijing and Springer-Verlag GmbH Berlin Heidelberg
About this chapter
Cite this chapter
Lynnes, C. (2006). A Simple, Scalable, Script-Based Science Processor. In: Qu, J.J., Gao, W., Kafatos, M., Murphy, R.E., Salomonson, V.V. (eds) Earth Science Satellite Remote Sensing. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-37294-3_8
Download citation
DOI: https://doi.org/10.1007/978-3-540-37294-3_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35630-1
Online ISBN: 978-3-540-37294-3
eBook Packages: Earth and Environmental ScienceEarth and Environmental Science (R0)