Skip to main content

Hierarchical Group-Based Sampling

  • Conference paper
Database: Enterprise, Skills and Innovation (BNCOD 2005)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3567))

Included in the following conference series:

Abstract

Approximate query processing is an adequate technique to reduce response times and system load in cases where approximate results suffice. In database literature, sampling has been proposed to evaluate queries approximately by using only a subset of the original data. Unfortunately, most of these methods consider either only certain problems arising due to the use of samples in databases (e.g. data skew) or only join operations involving multiple relations. We describe how well-known sampling techniques dealing with group-by operations can be combined with foreign-key joins such that the join is computed after the generation of the sample. In detail, we show how senate sampling and small group sampling can be combined efficiently with the idea of join synopses. Additionally, we introduce different algorithms which maintain the sample if the underlying data changes. Finally, we prove the superiority of our method to the naive approach in an extensive set of experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. University of California at Berkeley: How much Information? (2003), http://www.sims.berkeley.edu/research/projects/how-much-info-2003/

  2. Acharya, S., Gibbons, P., Poosala, V.: Congressional Samples for Approximate Answering of Group-By Queries. In: Proc. ACM SIGMOD, pp. 487–498 (2000)

    Google Scholar 

  3. Babcock, B., Chaudhuri, S., Das, G.: Dynamic sample selection for approximate query processing. In: Proc. ACM SIGMOD, pp. 539–550 (2003)

    Google Scholar 

  4. Acharya, S., Gibbons, P., Poosala, V., Ramaswamy, S.: Join synopses for approximate query answering. In: Proc. ACM SIGMOD, pp. 275–286 (1999)

    Google Scholar 

  5. Barbará, D., DuMouchel, W., Faloutsos, C., Haas, P., Hellerstein, J., Ioannidis, Y., Jagadish, H., Johnson, T., Ng, R., Poosala, V., Ross, K., Sevcik, K.: The New Jersey Data Reduction Report. IEEE Data Eng. Bull. 20, 3–45 (1997)

    Google Scholar 

  6. Hellerstein, J., Haas, P., Wang, H.: Online Aggregation. In: Proc. ACM SIGMOD, pp. 171–182 (1997)

    Google Scholar 

  7. Vitter, J.: Random Sampling with a Reservoir. ACM Transactions on Mathematical Software 11, 37–57 (1985)

    Article  MATH  MathSciNet  Google Scholar 

  8. Gemulla, R., Lehner, W.: On Incremental Maintenance of Materialized Offline Samples (2005) (submitted for publication)

    Google Scholar 

  9. Ganti, V., Lee, M., Ramakrishnan, R.: ICICLES: Self-Tuning Samples for Approximate Query Answering. The VLDB Journal, 176–187 (2000)

    Google Scholar 

  10. Chaudhuri, S., Das, G., Datar, M., Motwani, R., Narasayya, V.: Overcoming Limitations of Sampling for Aggregation Queries. In: Proc. ICDE, pp. 534–544 (2001)

    Google Scholar 

  11. Chaudhuri, S., Motwani, R., Narasayya, V.: On Random Sampling over Joins. In: Proc. ACM SIGMOD, pp. 263–274 (1999)

    Google Scholar 

  12. Gemulla, R., Berthold, H., Lehner, W.: Hierarchical Group-based Sampling (2005), Full version available at http://wwwdb.inf.tu-dresden.de/files/team/gemulla/files/hgs-fullversion.pdf

  13. Transaction Processing Performance Council: TPC-D Benchmark Version 2.1 (1998), http://www.tpc.org

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gemulla, R., Berthold, H., Lehner, W. (2005). Hierarchical Group-Based Sampling. In: Jackson, M., Nelson, D., Stirk, S. (eds) Database: Enterprise, Skills and Innovation. BNCOD 2005. Lecture Notes in Computer Science, vol 3567. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11511854_10

Download citation

  • DOI: https://doi.org/10.1007/11511854_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-26973-1

  • Online ISBN: 978-3-540-31677-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics