Advertisement

Implementation and Comparative Evaluation of Maintenance Policies in a Data Warehouse Environment

  • Henrik Engström
  • Sharma Chakravarthy
  • Brian Lings
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2405)

Abstract

Data warehouse maintenance is the task of updating a materialised view to reflect changes to autonomous, heterogeneous and distributed sources. Selection of a maintenance policy has been shown to depend on source and view properties, and on the user specified criteria (such as staleness, response time etc.), which are mapped on to evaluation criteria. In our previous work, we have analysed source and view characteristics, and user requirements to derive a cost-model. Maintenance policy selection has thus been cast as an optimisation problem.

This paper takes a complementary approach to evaluating maintenance policies, by implementing a test-bed which allows us to vary source characteristics and wrapper location. The test-bed is instrumented to allow costs associated with a policy to be measured. An actual DBMS (InterBase) has been used as a relational source and an XML web server has been used as a non-relational source. The experiments clearly show that maintenance policy performance can be highly sensitive to source capabilities, which can therefore significantly affect policy selection. They have further substantiated some of the conjectures found in the literature. Some of the lessons learnt from this test-bed implementation and evaluation are reviewed.

Keywords

Optimal Policy Data Warehouse Policy Selection Maintenance Policy Periodic Policy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    D. Agrawal, A.E. Abbadi, A.K. Singh, T. Yurek: Efficient View Maintenance at Data Warehouses. SIGMOD Conference (1997)Google Scholar
  2. 2.
    M.A. Ali, A.A.A. Fernandes, N.W. Paton: Incremental Maintenance of Materialized OQL Views. DOLAP (2000)Google Scholar
  3. 3.
    S.S. Chawathe, H. Garcia-Molina: Meaningful Change Detection in Structured Data. SIGMOD Conference (1997)Google Scholar
  4. 4.
    L.S. Colby, A. Kawaguchi, D.F. Lieuwen, I.S. Mumick, K.A. Ross: Supporting Multiple View Maintenance Policies. SIGMOD Conference (1997)Google Scholar
  5. 5.
    H. Engström, S. Chakravarthy, B. Lings: A User-centric View of Data Warehouse Maintenance Issues. 17th British National Conference on Databases (2000)Google Scholar
  6. 6.
    H. Engström, G. Gelati, B. Lings: A Benchmark Comparison of Maintenance Policies in a Data Warehouse Environment. Technical report HS-IDA-TR-01-005 (2001)Google Scholar
  7. 7.
    H. Engström, S. Chakravarthy, B. Lings: A Systematic Approach to Selecting Maintenance Policies in a Data Warehouse Environment. EDBT (2002)Google Scholar
  8. 8.
    S. Gatziu, A. Vavouras: Data Warehousing: Concepts and Mechanisms. Informatik (Zeitschrift der Schweizerischen Informatikorganisationen) 0:1 (1999)Google Scholar
  9. 9.
    A. Gupta, I.S. Mumick: Maintenance of Materialized Views: Problems, Techniques, and Applications. IEEE Data Engineering Bulletin 18(2) (1995)Google Scholar
  10. 10.
    J. Hammer, H. Garcia-Molina, J. Widom, W Labio, Y. Zhuge: The Stanford Data Warehousing Project. IEEE Data Engineering Bulletin 18(2) (1995)Google Scholar
  11. 11.
    E.N. Hanson: A Performance Analysis of View Materialization Strategies. SIGMOD Conference (1987)Google Scholar
  12. 12.
    R. Hull, G. Zhou: A Framework for Supporting Data Integration Using the Materialized and Virtual Approaches. SIGMOD Conference (1996)Google Scholar
  13. 13.
    A. Labrinidis, N. Roussopoulos: WebView materialization. SIGMOD Conference (2000)Google Scholar
  14. 14.
    W.J. Labio, H. Garcia-Molina: Efficient Snapshot Differential Algorithms for Data Warehousing. VLDB (1996)Google Scholar
  15. 15.
    D. Lomet (editor), J. Widom (editor): Special Issue on Materialized Views and Data Warehousing. IEEE Data Engineering Bulletin 18(2) (1995)Google Scholar
  16. 16.
    A. Segev, J. Park: Updating Distributed Materialized Views. IEEE TKDE 1(2) (1989)Google Scholar
  17. 17.
    D. Theodoratos, M. Bouzeghoub: Data Currency Quality Satisfaction in the Design of a Data Warehouse. IJCIS 10(3) (2001)Google Scholar
  18. 18.
    A. Vavouras, S. Gatziu, K.R. Dittrich: The SIRIUS Approach for Refreshing Data Warehouses Incrementally. BTW (1999)Google Scholar
  19. 19.
    G. Zhou, R. Hull, R. King, J.C. Franchitti: Data Integration and Warehousing Using H2O. IEEE Data Engineering Bulletin 18(2) (1995)Google Scholar
  20. 20.
    Y Zhuge: Incremental Maintenance of Consistent Data Warehouses. PhD Thesis Stanford University (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Henrik Engström
    • 1
  • Sharma Chakravarthy
    • 2
  • Brian Lings
    • 3
  1. 1.Department of Computer ScienceUniversity of SkövdeSweden
  2. 2.Computer Science and Engineering DepartmentUniversity of Texas at ArlingtonUSA
  3. 3.Department of Computer ScienceUniversity of ExeterUK

Personalised recommendations