Abstract
Real-time data warehouse as an extension of traditional data warehouse, it is effectively shortening the delay of information and providing timely and accurate decision support to decision makers. The ETL processing is the core technology of data warehouse, especially in real-time data warehouse. This paper is analyzing the current mainstream technology for real-time ETL. We propose a way to capture changed data which is based on log analysis and log listening. This method provides an effective solution for the huge amount of data, which greatly improve system performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J. Langseth. Real-Time Data Warehousing: Challenges and Solutions [DB/OL], http://DSSResources.COM (April 06, 2008)
Davis, J.R.: Right-time Business Intelligence: Optimizing the Business Decision Cycle. B-EYE-Netword.com (2006)
Inmon, W.H., Wang, Z.-H.: Data warehouse, The original book 4th edn. Machinery Industry Press, Beijing (2006)
Bin, G., Jianhua, G., et al.: ESB-based real-time ETL systems. Design and Implementation of Computer Applications (2008)
Yu, L., Yang, D.-Q., et al.: Real-time active data warehouse for real-time demand data integration method. Computer Research and Development (2007)
Li, Q.-Z., Zhang, K., Yang, S.-J.: Regulation for the Replacement, a data warehouse initiative to update the way. System Simulation Technology (2003)
Kimball, R., Ross, M.: The Data Warehouse Toolkit. John Wiley & Sons (2002)
Codd, E.F., Codd, S.B., Salley, C.T.: Providing OLAP to User Analysts: An IT Mandate. Codd & Date, Inc. (1993)
Plattner, H.: A Common Database Approach for OLTP and OLAP Using an In-Memory Column Database. In: SIGMOD 2009 (2009)
Thalhammer, T., Schrefl, M., et al.: Active data warehouses: complementing OLAP with analysis rules. Data & Knowledge Engineering 39(3), 241–269 (2001)
Rizzi, S., Abelló, A., Lechtenbörger, J., Trujillo, J.: Research in Data Warehouse Modeling and Design: Dead or Alive? In: ACM DOLAP 2006, pp. 3–10 (2006)
March, S.T., Hevner, A.R.: Integrated decision support systems: A data warehousing perspective. Decision Support Systems 43, 1031–1043 (2007)
Zimmer, D., Unland, R.: On the Semantics of Complex Events in Active Database Management Systems. In: 15th International Conference on Data Engineering (ICDE 1999), p. 392 (1999)
Pardillo, J., Mazón, J.-N., Trujillo, J.: Model-Driven Metadata for OLAP Cubes from the Conceptual Modelling of Data Warehouses. In: Song, I.-Y., Eder, J., Nguyen, T.M. (eds.) DaWaK 2008. LNCS, vol. 5182, pp. 13–22. Springer, Heidelberg (2008)
Santos, R.J., Bernardino, J.: Real-Time Data Warehouse Loading Methodology. In: ACM IDEAS 2008, September 10-12, pp. 49–58 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhou, H., Yang, D., Xu, Y. (2011). An ETL Strategy for Real-Time Data Warehouse. In: Wang, Y., Li, T. (eds) Practical Applications of Intelligent Systems. Advances in Intelligent and Soft Computing, vol 124. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25658-5_41
Download citation
DOI: https://doi.org/10.1007/978-3-642-25658-5_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25657-8
Online ISBN: 978-3-642-25658-5
eBook Packages: EngineeringEngineering (R0)