Advertisement

PVM: Parallel View Maintenance under Concurrent Data Updates of Distributed Sources⋆

  • Xin Zhang
  • Lingli Ding
  • Elke A. Rundensteiner
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2114)

Abstract

Data warehouses (DW) are built by gathering information from distributed information sources (ISs) and integrating it into one customized repository. In recent years, work has begun to address the problem of view maintenance of DWs under concurrent data updates of different ISs. The SWEEP solution is one solution that does not require the ISs to be quiescence, as required by previous strategies, by employing a local compensation strategy. SWEEP however processes all update messages in a sequential manner. To optimize upon this sequential processing, we now propose a parallel view maintenance algorithm, called PVM, that incorporates all benefits of previous maintenance approaches while offering improved performance due to parallelism. We have identified two issues critical for supporting parallel view maintenance: (1) detecting maintenance-concurrent data updates in a parallel mode, and (2) correcting the problem that the DW commit order may not correspond to the DW update processing order due to parallel maintenance handling. In this work, we provide solutions to both issues. We have implemented both SWEEP and PVM in our EVE data warehousing system, and our studies confirm the multi-fold performance improvement of PVM over SWEEP.

Keywords

Middle Layer Query Result Parallel Execution Concurrent Data Worcester Polytechnic Institute 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    D. Agrawal, A. El Abbadi, A. Singh, and T. Yurek. Efficient View Maintenance at Data Warehouses. In Proceedings of SIGMOD, pages 417–427, 1997.Google Scholar
  2. 2.
    E. Baralis, S. Ceri, and S. Paraboschi. Conservative TimeStamp Revised for Materialized View Maintenance in a Data Warehouse. In Workshop on Materialized Views, pages 1–9, 1996.Google Scholar
  3. 3.
    J. Chen, X. Zhang, S. Chen, A. Koeller, and E.A. Rundensteiner. DyDa: Data Warehouse Maintenance in Fully Concurrent Environments. In Proceedings of SIGMOD’01 Demo Session, May 2001.Google Scholar
  4. 4.
    H. García-Molina, W. Labio, J.L. Wiener, and Y. Zhuge. Distributed and Parallel Computing Issues in Data Warehousing. In Symposium on Principles of Distributed Computing, page 7, 1998. Abstract.Google Scholar
  5. 5.
    A. Gupta, H.V. Jagadish, and I.S. Mumick. Maintenance and Self-Maintenance of Outer-Join Views. In Next Generation Information Technologies and Systems, 1997.Google Scholar
  6. 6.
    A. Gupta and I. Mumick. Maintenance of Materialized Views: Problems, Techniques, and Applications. IEEE Data Engineering Bulletin, Special Issue on Materialized Views and Warehousing, 18(2):3–19, 1995.Google Scholar
  7. 7.
    A. Gupta, I.S. Mumick, and V.S. Subrahmanian. Maintaining Views Incrementally. In Proceedings of SIGMOD, pages 157–166, 1993.Google Scholar
  8. 8.
    M.K. Mohania, S. Konomi, and Y. Kambayashi. Incremental Maintenance of Materialized Views. In Database and Expert Systems Applications (DEXA), pages 551–560, 1997.Google Scholar
  9. 9.
    A. Nica and E.A. Rundensteiner. View Maintenance after View Synchronization. In International Database Engineering and Applications Symposium (IDEAS’99), pages 213–215, August, Montreal, Canada 1999.Google Scholar
  10. 10.
    E.A. Rundensteiner, A. Koeller, X. Zhang, A. Lee, A. Nica, A. VanWyk, and Y. Li. Evolvable View Environment. In Proceedings of SIGMOD’99 Demo Session, pages 553–555, May 1999.Google Scholar
  11. 11.
    X. Zhang, L. Ding, and E.A. Rundensteiner. PSWEEP: Parallel View Maintenance Under Concurrent Data Updates of Distributed Sources. Technical Report WPI-CS-TR-99-14, Worcester Polytechnic Institute, Computer Science Department, May 1999.Google Scholar
  12. 12.
    Y. Zhuge, H. García-Molina, J. Hammer, and J. Widom. View Maintenance in a Warehousing Environment. In Proceedings of SIGMOD, pages 316–327, May 1995.Google Scholar
  13. 13.
    Y. Zhuge, H. García-Molina, and J.L. Wiener. The Strobe Algorithms for Multi-Source Warehouse Consistency. In International Conference on Parallel and Distributed Information Systems, pages 146–157, December 1996.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Xin Zhang
    • 1
  • Lingli Ding
    • 1
  • Elke A. Rundensteiner
    • 1
  1. 1.Department of Computer ScienceWorcester Polytechnic InstituteWorcesterUSA

Personalised recommendations