Skip to main content
SpringerLink
Log in
Book cover

New Frontiers in Information and Software as Services pp 132–154Cite as

Adaptive Parallelization of Queries Calling Dependent Data Providing Web Services

  • Conference paper

  • 854 Accesses

Part of the book series: Lecture Notes in Business Information Processing ((LNBIP,volume 74))

Abstract

A common pattern in queries calling web services is that the output of one web service call is the input for another. The challenge addressed in this chapter is to develop methods to speed up such dependent calls by parallelization. We developed a system, WSMED, to provide a web service query service. WSMED automatically parallelizes the web service calls by starting separate query processes, each managing a parameterized sub-query, a plan function. The parallel plan is defined in terms of an operator, FF_APPLYP, to ship in parallel to other query processes the same plan function for different parameters. By using FF_APPLYP we first investigated ways to set up different process trees manually to find a best one. To automatically achieve the optimal process tree we modified FF_APPLYP to an operator AFF_APPLYP that adapts a parallel plan locally in each query process until an optimized performance is achieved. The query execution time obtained with AFF_APPLYP is shown to be close to the best process tree obtained with FF_APPLYP.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Abiteboul, S., Benjelloun, O., Cautis, B., Manolescu, I., Milo, T., Preda, N.: Lazy query evaluation for active XML. In: ACM SIGMOD International Conference on Management of Data, pp. 227–238. ACM, New York (2004)

    Google Scholar 

  2. Barhamgi, M., Benslimane, D., Ouksel, A.M.: Composing and optimizing data providing web services. In: 17th International World Wide Web Conference, pp. 1141–1142. ACM, New York (2008)

    Google Scholar 

  3. Business Process Execution Language for Web Services version 1.1., http://www.ibm.com/developerworks/library/specification/ws-bpel/

  4. Castor, http://www.castor.org/index.html

  5. Ceri, S.: Search Computing. In: International Conference on Data Engineering, pp. 1–3. IEEE, Los Alamitos (2009)

    Google Scholar 

  6. codeBump- GeoPlaces web service, http://codebump.com/services/PlaceLookup.asmx

  7. codeBump- Zipcodes web service, http://codebump.com/services/ZipCodeLookup.asmx

  8. Dean, J., Ghemawat, S.: MAPREDUCE: Simplified Data Processing on Large Clusters. Communications of the ACM 51(1), 107–113 (2008)

    Article  Google Scholar 

  9. Fahl, G., Risch, R.: Query Processing over Object Views of Relational Data. The VLDB Journal 6(4), 261–281 (1997)

    Article  Google Scholar 

  10. Florescu, D., Levy, A., Manolescu, I., Suciu, D.: Query Optimization in the Presence of Limited Access Patterns. In: ACM SIGMOD International Conference on Management of Data, pp. 311–322. ACM, New York (1999)

    Google Scholar 

  11. Goldman, R., Widom, J.: WSQ/DSQ: a practical approach for combined querying of databases and the Web. In: ACM SIGMOD International Conference on Management of Data, pp. 285–296. ACM, New York (2000)

    Google Scholar 

  12. Gounaris, A., Yfoulis, C., Sakellariou, R., Dikaiakos, M.D.: Robust Runtime Optimization of Data Transfer in Queries Over Web Services. In: International Conference on Data Engineering, pp. 596–605. IEEE, Los Alamitos (2008)

    Google Scholar 

  13. Hasan, W., Florescu, D., Valduriez, P.: Open Issues in Parallel Query Optimization. SIGMOD Record 25(3), 28–33 (1996)

    Article  Google Scholar 

  14. HP Labs Innovation Research Program, http://www.hpl.hp.com/open_innovation/irp/2008_HPL_IRP_Research_Topics_Americas.pdf

  15. Josifovski, V., Massmann, S., Naumann, F.: Super-Fast XML Wrapper Generation in DB2: A Demonstration. In: International Conference of Data Engineering, pp. 756–758. IEEE, Los Alamitos (2003)

    Google Scholar 

  16. Litwin, W., Risch, T.: Main Memory Oriented Optimization of OO Queries using Typed Datalog with Foreign Predicates. IEEE Transactions on Knowledge and Data Engineering 4(6), 517–528 (1992)

    Article  Google Scholar 

  17. Query as a Web Service, http://help.sap.com/businessobject/product_guides/boexir31/en/xi3-1_query_as_a_web_service_en.pdf

  18. Quick Server, http://www.quickserver.org/

  19. Risch, T., Josifovski, V., Katchaounov, T.: Functional Data Integration in a Distributed Mediator System. In: Gray, P., Kerschberg, L., King, Poulovassilis, P. (eds.) Functional Approach to Data Management - Modeling, Analyzing and Integrating Heterogeneous Data, pp. 211–238. Springer, Heidelberg (2003)

    Google Scholar 

  20. SAAJ, https://saaj.dev.java.net/

  21. Sabesan, M.: Querying Mediated Web Services. Licentiate Thesis, Department of Information Technology, Uppsala University (2007)

    Google Scholar 

  22. Sabesan, M., Risch, T.: Adaptive Parallelization of Queries over Dependent Web Service Calls. In: First IEEE Workshop on Information & Software as Services, pp. 1725–1732. IEEE Computer Society, Los Alamitos (2009)

    Google Scholar 

  23. Sabesan, M., Risch, T.: Web Service Mediation through Multi-level Views. In: Frasincar, F., Houben, G., Thiran, P. (eds.) Fourth International Workshop on Web Information System Modeling, Tapir, Trondheim, pp. 755–766 (2007)

    Google Scholar 

  24. Srivastava, U., Widom, J., Munagala, K., Motwani, R.: Query Optimization over Web Services. In: Very Large Database Conference, pp. 355- -366. VLDB Endowment (2006)

    Google Scholar 

  25. TerraServer, TerraService, http://terraservice.net/webservices.aspx

  26. The Next Wave: Everything as a Service, http://www.hp.com/hpinfo/execteam/articles/robison/08eaas.html

  27. USZip web service, http://www.webservicex.net/uszip.asmx

  28. Ullman, J.D.: Information Integration Using Logical Views. In: Afrati, F.N., Kolaitis, P.G. (eds.) ICDT 1997. LNCS, vol. 1186, pp. 19–40. Springer, Heidelberg (1997)

    Chapter  Google Scholar 

  29. Web Services Description Language for Java Toolkit, http://sourceforge.net/projects/wsdl4j

  30. WSMED Demo, http://udbl2.it.uu.se/WSMED/wsmed.html

  31. WSMED WSDL, http://udbl2.it.uu.se/WSMED/wsmed.wsdl

Download references

Author information

Authors and Affiliations

  1. Uppsala DataBase Laboratory, Department of Information Technology, Uppsala University, Sweden

    Manivasakan Sabesan & Tore Risch

Authors
  1. Manivasakan Sabesan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tore Risch
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, University of California at Santa Barbara, 93106, Santa Barbara, CA, USA

    Divyakant Agrawal

  2. Computer Science and Engineering Department, Arizona State University, 85287-8809, Tempe, AZ, USA

    K. Selçuk Candan

  3. SAP China, 201203, Shanghai, China

    Wen-Syan Li

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sabesan, M., Risch, T. (2011). Adaptive Parallelization of Queries Calling Dependent Data Providing Web Services. In: Agrawal, D., Candan, K.S., Li, WS. (eds) New Frontiers in Information and Software as Services. Lecture Notes in Business Information Processing, vol 74. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19294-4_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19294-4_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19293-7

  • Online ISBN: 978-3-642-19294-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation