Abstract
Data warehouse refreshment is often viewed as a problem of maintaining materialized views over operational sources. In this paper, we show that the data warehouse refreshment process is a complex process comprising several tasks, e.g., monitoring, extracting, transforming, integrating and cleaning operational data, deriving new data, building histories and loading the data warehouse. We propose a novel approach for defining and executing the refreshment process based on specifications stored in an object-oriented metadata repository. Our approach considers the multidimensional character of OLAP data and can be used in conjunction with various operational sources and target data warehouses.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Agrawal, D., El Abbadi, A., Singh, A., Yurek, T.: Efficient View Maintenance at Data Warehouses. Proc. of ACM SIGMOD IntI. Conf. of Management of Data, Tucson, Arizona, May 1997R. G.G. Cattell, D. Barry (ed). The Object Database Standard: ODMG 2.0. Morgan Kaufmann Publishers, San Francisco, California, 1997.
Bhowmick, S.S., Madria, S.K., Ng, W.K., Lim, E.-P.: Pi-Web Join in a Web Warehouse. Proc. of the 6th Intl. Conf. on Database Systems for Advanced Applications (DAS-FAA), Hsinchu, Taiwan, April 1999.
Bouzeghoub, M., Fabret, F.: Modeling Data Warehouse Refreshment Process as a Workflow Application. Proc. of the Intl. Workshop on Design and Management of Data Warehouses (DMDW99), Heidelberg, Germany, June 1999.
Cattell, R.G.G., Barry, D. (ed): The Object Database Standard: ODMG 2.0. Morgan Kaufmann Publishers, San Francisco, California, 1997.
Chaudhuri, S., Dayal, U.: An Overview of Data Warehousing and OLAP Technology. ACM SIGMOD Record, 26:1, March 1997.
Clifford, J., Dyreson, C.E., Isakowitz, T., Jensen, C.S., Snodgrass, R.T.: On the Semantics of “NOW” in Databases, ACM Trans. on Database Systems, 22(2):171–214, June 1997.
Critchlow, T.: The DataFoundry Project: Managing Change in a Genome Warehouse. Presentation in: IEEE EMBS Conf. on Information Technology in Biomedicine (ITAB’98), Washington DC, May 1998.
Gupta, A., Mumick, I.S.: Maintenance of materialized views: Problems, techniques, and applications. IEEE Data Engineering Bulletin, 18(2), June 1995.
Hull, R., Zhou, G.: A Framework for Supporting Data Integration Using the Materialized and Virtual Apporaches. Proc. of the ACM SIGMOD Intl. Conf. on Management of Data, Montreal, Quebec, Canada, June 1996.
Huyn, N.: Multiple-View Self-Maintenance in Data Warehousing Environments. Proc. of the 23rd Intl. Conf. on Very Large Data Bases, Athens, Greece, 1997.
Immon, W.H.: Building the Data Warehouse. John Wiley, 1996. Platinum Software Corporation: http://www.platinum.com.
Quass, D., Gupta, A., Mumick, I.S., Widom, J.: Making Views Self-Maintainable for Data Warehousing. Proc. of the 4th Intl. Conf. on Parallel and Distributed Information Systems, (PDIS’ 96), December 1996.
Roussopoulos, N.: Materialized Views and Data Warehouses. SIGMOD Record, 27(1), p21–26, March 1998.
Srivastava, D., Dar, S., Jagadish, H.V., Levy, A.Y.: Answering Queries with Aggregation Using Views. Proc. of the 22th Intl. Conf. on Very Large Data Bases, Bombay, India, 1996.
Staudt, M., Jarke, M.: Incremental Maintenance of Externally Materialized Views. Proc. of the 22th Intl. Conf. on Very Large Data Bases, Bombay, India, September 1996.
Theodoratos, D., Ligoudistianos, S., Sellis, T.: Designing the Global Data Warehouse with SPJ Views. Proc. of the 11th Intl. Conf. on Advanced Information Systems Engineering (CAiSE’99), Heidelberg, Germany, June 1999.
Trillium Software. http://www.trilliumsoft.com.
Vavouras, A., Gatziu, S., Dittrich, K.R.: The SIRIUS Approach for Refreshing Data Warehouses Incrementally. Proc. GI-Conf. Datenbanksysteme in Büro, Technik und Wissenschaft (BTW), Freiburg, Germany, March 1999.
Vavouras, A., Gatziu, S., Dittrich, K.R.: Modeling and Executing the Data Warehouse Refreshment Process. Technical Report 2000.01, Department of Information Technology, January 2000.
Widom, J.:Research Problems in Data Warehousing. Proc. of the 4th Intl. Conf. on Information and Knowledge, Baltimore, 1995.
Wiener, J. Gupta, H., Labio, W., Zhuge, Y., Garcia-Molina, H., Widom, J.: A System Prototype for Warehouse View Maintenace. Proc. of the ACM Workshop on Materialized Views: Techniques and Applications, Montreal, June 1996.
Wu, M-C., Buchmann, A.P.: Research Issues in Data Warehousing. Datenbanksysteme in Büro, Technik und Wissenschaft: GI-Fachtagung, Springer-Verlag, Ulm, 1997.
Yang, J., Karlapalem, K., Li, Q.: Algorithms for Materialized View Design in Data Warehousing Environment. Proc. of the 23rd Intl. Conf. on Very Large Data Bases, Athens, Greece, August 1997.
Yang, J., Widom, J.: Maintaining Temporal Views Over Non-Historical Information Sources For Data Warehousing. Proc. of the 14th Intl. Conf. on Data Engineering, Orlando, Florida, Februar 1998.
Zhang, X., Rundensteiner, E.A.: Data Warehouse Maintenance Under Cuncurrent Schema and Data Updates. Proc. of the 15th Intl. Conf. on Data Engineering, Sydney, Austrialia, March 1999.
Zhuge, Y., Garcia-Molina, H., Hammer, J., Widom, J.: View Maintenance in a Warehousing Environment. Proc. of the ACM SIGMOD Intl. Conf. on Management of Data, San Jose, California, May 1995.
Zhuge, Y., Garcia-Molina, H., Wiener, J.L.: The Strobe Algorithms for Multi-Source Warehouse Consistency. Proc. of the 4th Intl. Conf. on Parallel and Distributed Information Systems, (PDIS’ 96), December 1996.
Zhuge, Y., Wiener, J.L., Garcia-Molina, H.: Multiple View Consistency for Data Warehousing. Proc. of the 13th Intl. Conf. on Data Engineering, Birmingham U.K., April 1997.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vavouras, A., Gatziu, S., Dittrich, K.R. (2000). Data Warehouse Refreshment Using SIRIUS. In: Jung, R., Winter, R. (eds) Data Warehousing 2000. Physica, Heidelberg. https://doi.org/10.1007/978-3-642-57681-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-57681-2_10
Publisher Name: Physica, Heidelberg
Print ISBN: 978-3-642-63326-3
Online ISBN: 978-3-642-57681-2
eBook Packages: Springer Book Archive