Skip to main content

k-QTPT: A Dynamic Query Optimization Approach for Autonomous Distributed Database Systems

  • Conference paper
Advances in Computing, Communication, and Control (ICAC3 2013)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 361))

  • 2821 Accesses

Abstract

Query processing in a distributed database system requires the transmission of data between sites using communication networks. Distributed query processing is an important factor in the overall performance of a distributed database system. In distributed query optimization, complexity and cost increases with increasing number of relations in the query. Cost is the sum of local cost (I/O cost and CPU cost at each site) and the cost of transferring data between sites. Extensive research has been done for query processing and optimization in distributed databases. Numerous search strategies like static, dynamic and randomized strategies are available for determining an optimal plan. However these search strategies are not suitable for the autonomous distributed database systems. These search strategies make certain assumptions (like all sites have same processing capability), which do not hold for autonomous systems. Mariposa, Query Trading (QT) and Query Trading with Processing Task Trading (QTPT) are the query processing algorithms developed for autonomous distributed database systems. However, they incur high optimization cost due to involvement of all nodes in generating optimal plan. We present our solution k-QTPT, to reduce the high optimization cost incurred by QTPT. In k-QTPT, only k nodes participate in generating optimal plans. We discuss implementation details of QT, QTPT algorithm and our solution k-QTPT. We evaluate k-QTPT through emulation. We show that the cost of optimization reduces substantially in k-QTPT as compared to QT and QTPT.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Oszu, M.T., Valduriez, P.: Principles of Distributed database systems. Prentice Hall international, NJ (1999)

    Google Scholar 

  2. Aljanabv, A., Abuelrub, E., Odeh, M.: A survey of Distributed Query Optimization. The International Arab Journal of Information Technology 2(1) (2005)

    Google Scholar 

  3. Ioannidis, Y.E.: Query Optimization. In: Trucker, A. (ed.) The Computer Science and Engineering Handbook, pp. 1038–1054 (1997)

    Google Scholar 

  4. Selinger, P.G., Astrahan, M.M., Chamberlin, D.D., Lorie, R.A., Price, T.G.: Access Path selection in a relational database management system. In: ACM SIGMOD Conference on Management of Data, pp. 23–24. s.n., Boston (1979)

    Google Scholar 

  5. Palerno, F.P.: A database search problem. In: Tou, J.T. (ed.) Information Systems COINS, pp. 67–101. Plenum Press, New York (1974)

    Chapter  Google Scholar 

  6. Kossmann, D., Stocker, K.: Iterative dynamic programming: A new class of query optimization algorithms. ACM Transactions on Database Systems 25(1) (2000)

    Google Scholar 

  7. Stonebraker, M., Aoki, P.M., Litwin, W., Pfeffer, A., Sah, A., Sidell, J., Stalien, C., Yu, A.: Mariposa: a wide area distributed database system. The VLDB Journal, 48–63 (March 1996)

    Google Scholar 

  8. Deshpande, A.V., Hellerstein, J.M.: Decoupled Query Optimization for Federated Database Systems. In: 18th International Conference of Data Engineering, pp. 716–792. IEEE Computer Society, Los Alamitos

    Google Scholar 

  9. Pentaris, F., Ioannidis, Y.: Query Optimization in Distributed Netwroks of Autonomous Database Systems. ACM Transactions on Database Systems 31(2), 537–583 (2006)

    Article  Google Scholar 

  10. Doshi, P., Raisinghani, V.: Review of Dynamic Query Optimization Strategies in Distributed Database. In: International Conference on Network and Computer Science. IEEE Explorer, India (2011)

    Google Scholar 

  11. http://www.mckoi.com/mckoiddb/index.html

  12. Zurek, T., DipperWaldrof, S., Na, K.: Gel. Data Query Cost Estimation. 7,668,803 US, Heidelberg (February 2010)

    Google Scholar 

  13. Ray, C.: Distributed Database Systems. Pearson Publication, s.l. (2009)

    Google Scholar 

  14. Jacobs, B.E., Walczak, C.A.: Optimization algorithms for distributed queries. IEEE Transactions on Software Engineering 9(1) (January 1983)

    Google Scholar 

  15. Ghaemi, R., Fard, A.M., Tabatabee, H., Sadeghizadeh, M.: Evolutionary query optimization for heterogenous database systems. World Academy of Science, Engineering and Technology 23 (2008)

    Google Scholar 

  16. Kossmann, D.: The state of art in distributed query processing. ACM Computing surveys 32(4), 422–469 (2000)

    Article  Google Scholar 

  17. Bernstein, P., Goodman, N., Wong, E., Reeve, C., Rothine: Query Processing in a system for distributed databases (SDD-1). ACM Trasactions on Database Systems 6(4), 602–625 (1981)

    Article  MATH  Google Scholar 

  18. Hass, L.M.: R*: A research project on distributed relational DBMS. Database Engineering 5 (1982)

    Google Scholar 

  19. Ono, K., Lohman, G.: Measuring complexity of join emumeration in query optimization. In: 16th International Conference on Very Large Databases (VLDB), pp. 314–325. s.n., Berkley (1990)

    Google Scholar 

  20. Ioannidis, Y.E., Kang, Y.C.: Randomized algorithms for optimizing large join queries. In: Proceedings of the ACM SIGMOD Conference on Management of Data, pp. 312–321. s.n., Atlantic city (1990)

    Google Scholar 

  21. Kirkpatrick, S., Gelatt, C.D., Vecchi, M.P.: Optimization by simulated Annealing. Science 220, 671–680 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  22. Nahar, S., Sahni, S., Shragowitz, E.: Simulated Annealing and Combinatorial Optimization. In: Proceedings of the 23rd Design Automation Conference, pp. 293–299 (1986)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Doshi, P., Raisinghani, V. (2013). k-QTPT: A Dynamic Query Optimization Approach for Autonomous Distributed Database Systems. In: Unnikrishnan, S., Surve, S., Bhoir, D. (eds) Advances in Computing, Communication, and Control. ICAC3 2013. Communications in Computer and Information Science, vol 361. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36321-4_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-36321-4_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-36320-7

  • Online ISBN: 978-3-642-36321-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics