Skip to main content
SpringerLink
Log in

Auspice: Automatic Service Planning in Cloud/Grid Environments

  • Chapter
Grids, Clouds and Virtualization

Part of the book series: Computer Communications and Networks ((CCN))

  • 1339 Accesses

Abstract

Recent scientific advances have fostered a mounting number of services and data sets available for utilization. These resources, though scattered across disparate locations, are often loosely coupled both semantically and operationally. This loosely coupled relationship implies the possibility of linking together operations and data sets to answer queries. This task, generally known as automatic service composition, therefore abstracts the process of complex scientific workflow planning from the user. We have been exploring a metadata-driven approach toward automatic service workflow composition, among other enabling mechanisms, in our system, Auspice: Automatic Service Planning in Cloud/Grid Environments. In this paper, we present a complete overview of our system’s unique features and outlooks for future deployment as the Cloud computing paradigm becomes increasingly eminent in enabling scientific computing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    For instance, a series of scientific observations is easily represented by arrays but not relational tables.

  2. 2.

    Other derivation paths may exist within a certain ontology, but for simplicity, we show just one here.

References

  1. Agrawal, S.: Dbxplorer: a system for keyword-based search over relational databases. In: ICDE, pp. 5–16 (2002)

    Google Scholar 

  2. Altintas, I., Berkley, C., Jaeger, E., Jones, M., Ludscher, B., Mock, S.: Kepler: an extensible system for design and execution of scientific workflows (2004)

    Google Scholar 

  3. Amazon elastic compute cloud. http://aws.amazon.com/ec2

  4. Armbrust, M., et al.: Above the clouds: a Berkeley view of cloud computing. Technical Report UCB/EECS-2009-28, EECS Department, University of California, Berkeley, Feb 2009

    Google Scholar 

  5. The atlas experiment. http://atlasexperiment.org

  6. Beynon, M.D., Kurc, T., Catalyurek, U., Chang, C., Sussman, A., Saltz, J.: Distributed processing of very large datasets with datacutter. Parallel Comput. 27(11), 1457–1478 (2001)

    Article  MATH  Google Scholar 

  7. Brandic, I., Pllana, S., Benkner, S.: An approach for the high-level specification of QoS-aware grid workflows considering location affinity. Sci. Program. 14(3–4), 231–250 (2006)

    Google Scholar 

  8. Brandic, I., Pllana, S., Benkner, S.: Specification, planning, and execution of QoS-aware grid workflows within the Amadeus environment. Concurr. Comput. Pract. Exp. 20(4), 331–345 (2008)

    Article  Google Scholar 

  9. Brooks, C., Lee, E.A., Liu, X., Neuendorffer, S., Zhao, Y., Zheng, H.: Heterogeneous concurrent modeling and design in Java (vol. 2: Ptolemy II software architecture). Technical Report 22, EECS Dept., UC Berkeley, July 2005

    Google Scholar 

  10. Casati, F., Ilnicki, S., Jin, L., Krishnamoorthy, V., Shan, M.-C.: Adaptive and dynamic service composition in eFlow. In: Conference on Advanced Information Systems Engineering, pp. 13–31 (2000)

    Google Scholar 

  11. Chiu, D., Agrawal, G.: Enabling ad hoc queries over low-level scientific datasets. In: Proceedings of the 21th International Conference on Scientific and Statistical Database Management (SSDBM’09) (2009)

    Google Scholar 

  12. Chiu, D., Agrawal, G.: Flexible caches for derived scientific data over cloud environments. Technical Report OSU-CISRC-7/09-TR35, Department of Computer Science and Engineering, The Ohio State University, July 2009

    Google Scholar 

  13. Chiu, D., Agrawal, G.: Hierarchical caches for grid workflows. In: Proceedings of the 9th IEEE International Symposium on Cluster Computing and the Grid (CCGRID). IEEE, New York (2009)

    Google Scholar 

  14. Chiu, D., Deshpande, S., Agrawal, G., Li, R.: Composing geoinformatics workflows with user preferences. In: Proceedings of the 16th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (GIS’08), New York, NY, USA (2008)

    Google Scholar 

  15. Chiu, D., Deshpande, S., Agrawal, G., Li, R.: Cost and accuracy sensitive dynamic workflow composition over grid environments. In: Proceedings of the 9th IEEE/ACM International Conference on Grid Computing (Grid’08) (2008)

    Google Scholar 

  16. Chiu, D., Deshpande, S., Agrawal, G., Li, R.: A dynamic approach toward QoS-aware service workflow composition. In: Proceedings of the 7th IEEE International Conference on Web Services (ICWS’09). IEEE Computer Society, Los Alamitos (2009)

    Google Scholar 

  17. Condor dagman. http://www.cs.wisc.edu/condor/dagman

  18. Dublin core metadata element set, version 1.1 (2008)

    Google Scholar 

  19. Deelman, E., Singh, G., Su, M.-H., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Berriman, G.B., Good, J., Laity, A.C., Jacob, J.C., Katz, D.S.: Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci. Program. 13(3), 219–237 (2005)

    Google Scholar 

  20. Fellbaum, C. (ed.): WordNet: An Electronic Lexical Database. MIT Press, Cambridge (1998)

    MATH  Google Scholar 

  21. Metadata ad hoc working group.content standard for digital geospatial metadata (1998)

    Google Scholar 

  22. Federal geospatial data clearinghouse. http://clearinghouse.fgdc.gov

  23. Foster, I.: Service-oriented science. Science 308(5723), 814–817 (2005)

    Article  Google Scholar 

  24. Foster, I., Kesselman, C.: Globus: a metacomputing infrastructure toolkit. Int. J. Supercomput. Appl. 11, 115–128 (1996)

    Article  Google Scholar 

  25. Frey, J., Tannenbaum, T., Foster, I., Livny, M., Tuecke, S.: Condor-G: a computation management agent for multi-institutional grids. In: Proceedings of the Tenth IEEE Symposium on High Performance Distributed Computing (HPDC), San Francisco, CA, August 2001, pp. 7–9 (2001)

    Google Scholar 

  26. gbio: Grid for bioinformatics. http://gbio-pbil.ibcp.fr

  27. Bioinfogrid. http://www.bioinfogrid.eu

  28. Biomedical informatics research network. http://www.nbirn.net

  29. Cyberstructure for the geosciences. http://www.geongrid.org

  30. The geography network. http://www.geographynetwork.com

  31. Glatard, T., Montagnat, J., Pennec, X.: Efficient services composition for grid-enabled data-intensive applications (2006)

    Google Scholar 

  32. Ioannidis, Y.E., Livny, M., Gupta, S., Ponnekanti, N.: Zoo: a desktop experiment management environment. In: VLDB ’96: Proceedings of the 22th International Conference on Very Large Data Bases, pp. 274–285. Morgan Kaufmann, San Francisco (1996)

    Google Scholar 

  33. Jensen, C.S., Lin, D., Ooi, B.C.: Query and update efficient B+-tree based indexing of moving objects. In: Proceedings of Very Large Databases (VLDB), pp. 768–779 (2004)

    Google Scholar 

  34. Karger, D., et al.: Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the world wide web. In: ACM Symposium on Theory of Computing, pp. 654–663 (1997)

    Google Scholar 

  35. Kumar, V.S., Sadayappan, P., Mehta, G., Vahi, K., Deelman, E., Ratnakar, V., Kim, J., Gil, Y., Hall, M., Kurc, T., Saltz, J.: An integrated framework for performance-based optimization of scientific workflows. In: HPDC ’09: Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing, pp. 177–186. ACM, New York (2009)

    Chapter  Google Scholar 

  36. Lera, I., Juiz, C., Puigjaner, R.: Performance-related ontologies and semantic web applications for on-line performance assessment intelligent systems. Sci. Comput. Program. 61(1), 27–37 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  37. Litzkow, M., Livny, M., Mutka, M.: Condor—a hunter of idle workstations. In: Proceedings of the 8th International Conference of Distributed Computing Systems, June 1988

    Google Scholar 

  38. Majithia, S., Shields, M.S., Taylor, I.J., Wang, I.: Triana: a graphical web service composition and execution toolkit. In: Proceedings of the IEEE International Conference on Web Services (ICWS’04), pp. 514–524. IEEE Computer Society, Los Alamitos (2004)

    Chapter  Google Scholar 

  39. Biological data working group. Biological data profile (1999)

    Google Scholar 

  40. Oinn, T., Addis, M., Ferris, J., Marvin, D., Senger, M., Greenwood, M., Carver, T., Glover, K., Pocock, M.R., Wipat, A., Li, P.: Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20(17), 3045–3054 (2004)

    Article  Google Scholar 

  41. Sloan digital sky survey. http://www.sdss.org

  42. Sirin, E., Parsia, B., Hendler, J.: Filtering and selecting semantic web services with interactive composition techniques. IEEE Intell. Syst. 19(4), 42–49 (2004)

    Article  Google Scholar 

  43. University, V.H., Hristidis, V.: Discover: keyword search in relational databases. In: VLDB, pp. 670–681 (2002)

    Google Scholar 

  44. Wan, M., Rajasekar, A., Moore, R., Andrews, P.: A simple mass storage system for the SRB data grid. In: MSS ’03: Proceedings of the 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS’03), p. 20. IEEE Computer Society, Washington (2003)

    Chapter  Google Scholar 

  45. Extensible markup language (xml) 1.1 (second edition)

    Google Scholar 

Download references

Acknowledgements

This work is supported by NSF grants 0541058, 0619041, and 0833101. The equipment used for the experiments reported here was purchased under the grant 0403342.

Author information

Authors and Affiliations

  1. School of Engineering and Computer Science, Washington State University, Vancouver, WA, 98686, USA

    David Chiu

  2. Department of Computer Science and Engineering, The Ohio State University, Columbus, OH, 43210, USA

    Gagan Agrawal

Authors
  1. David Chiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gagan Agrawal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David Chiu .

Editor information

Editors and Affiliations

  1. Dipto. Ingegneria dell’Innovazione, Università del Salento, Via per Monteroni, Lecce, 73100, Italy

    Massimo Cafaro

  2. Dipto. Ingegneria dell’Innovazione, Università del Salento, Via per Monteroni, Lecce, 73100, Italy

    Giovanni Aloisio

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Chiu, D., Agrawal, G. (2011). Auspice: Automatic Service Planning in Cloud/Grid Environments. In: Cafaro, M., Aloisio, G. (eds) Grids, Clouds and Virtualization. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-0-85729-049-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-0-85729-049-6_5

  • Publisher Name: Springer, London

  • Print ISBN: 978-0-85729-048-9

  • Online ISBN: 978-0-85729-049-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation