Improving the Performance of OLAP Queries Using Families of Statistics Trees
We present a novel approach to speeding up the evaluation of OLAP queries that return aggregates over dimensions containing hierarchies. Our approach is based on our previous version of CubiST (Cubing with Statistics Trees), which pre-computes and stores all possible aggregate views in the leaves of a statistics tree during a one-time scan of the data. However, it uses a single statistics tree to answer all possible OLAP queries. Our new version remedies this limitation by materializing a family of derived trees from the single statistics tree. Given an input query, our new query evaluation algorithm selects the smallest tree in the family which can provide the answer. Our experiments have shown drastic reductions in processing times compared with the original CubiST as well as existing ROLAP and MOLAP systems.
Unable to display preview. Download preview PDF.
- 1.Arbor Systems, “Large-Scale Data Warehousing Using Hyperion Essbase OLAP Technology,” Arbor Systems, White Paper, http://www.hyperion.com/whitepapers.cfm
- 3.L. Fu and J. Hammer, “CubiST: A New Algorithm for Improving the Performance of Adhoc OLAP Queries,” Proceedings of the ACM Third International Workshop on Data Warehousing and OLAP (DOLAP), Washington, DC, pp. 72–79, 2000Google Scholar
- 5.A. Gupta, V. Harinarayan, and D. Quass, “Aggregate-query Processing in Data Warehousing Environments,” Proceedings of the Eighth International Conference on Very Large Databases, Zurich, Switzerland, pp. 358–369, 1995Google Scholar
- 6.H. Gupta and I. Mumick, “Selection of Views to Materialize Under a Maintenance Cost Constraint,” Stanford University, Technical ReportGoogle Scholar
- 7.J. Hammer and L. Fu, “Speeding Up Data Cube Queries with Statistics Trees,” University of Florida, Gainesville, FL, Research report TR01-007, January 2001Google Scholar
- 8.W. Labio, D. Quass, and B. Adelberg, “Physical Database Design for Data Warehouses,” in Proceedings of the International Conference on Database Engineering, Birmingham, England, pp. 277–288, 1997Google Scholar
- 9.M. Lee and J. Hammer, “Speeding Up Warehouse Physical Design Using A Randomized Algorithm,” Proceedings of the International Workshop on Design and Management of Data Warehouses (DMDW’ 99), Heidelberg, Germany, 1999Google Scholar
- 10.D. Lomet, ed. Bulletin of the Technical Committee on Data Engineering. Special Issue on Materialized Views and Data Warehousing, ed. J. Widom. 18, IEEE Computer Society, 1995Google Scholar
- 11.MicroStrategy Inc., “The Case For Relational OLAP,” MicroStrategy, White Paper, http://www.microstrategy.com/publications/whitepapers/Case4Rolap/
- 14. Oracle Corp., “Oracle Express OLAP Technology,” http://www.oracle.com/olap/
- 15.Redbrick Systems, “Informix Redbrick Decision Server,” Redbrick, Los Gatos, CA, Product Overview and Data Sheet, http://www.informix.com/redbrick/
- 16.W.P. Yan and P. Larson, “Eager Aggregation and Lazy Aggregation,” Proceedings of the Eighth International Conference on Very Large Databases, Zurich, Switzerland, pp. 345–357, 1995Google Scholar