Abstract
ETL tools are responsible for extracting, transforming and loading data from data sources into a data warehouse. Each ETL tool has its own model for specifying ETL processes. This makes it difficult to interchange ETL designs. Entire ETL workflows must be redesigned in order to migrate them from one tool to another. It has therefore become increasingly important to have a single conceptual model for ETL processes which is interchangeable between tools. Business Process Model and Notation (BPMN) has been widely accepted as a standard for specifying business processes. For this reason, it has been proposed as an efficient conceptual model of ETL processes. In this paper, we present BEXF, an Extensible Markup Language (XML) interchange format for BPMN4ETL, an extended BPMN model for ETL. It is a format powerful enough the express and interchange BPMN4ETL model information across tools that are compliant with BPMN 2.0. This XML interchange format does not only describe the control flow of ETL processes but also the data flow.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akkaoui, Z.E., Zimányi, E.: Defining ETL worfklows using BPMN and BPEL. In: Proceedings of the 12th ACM International Workshop on Data Warehousing and OLAP, pp. 41–48. ACM, Hong Kong (2009)
Akkaoui, Z.E., Zimányi, E., Mazón, J., Trujillo, J.: A model-driven framework for ETL process development. In: Proceedings of the 14th International Workshop on Data Warehousing and OLAP, DOLAP 2011, pp. 45–52. ACM, Glasgow (2011)
Ali, S.M.F., Wrembel, R.: From conceptual design to performance optimization of ETL workflows: current state of research and open problems. VLDB J. 26(6), 777–801 (2017)
Awiti, J., Vaisman, A., Zimányi, E.: From conceptual to logical ETL design using BPMN and relational algebra. In: Proceedings of the 21st ACM International Conference on Big Data Analytics and Knowledge Discovery, DAWAK 2019. Springer, Linz (2019, forthcoming)
Bock, C., Barbau, R., Narayanan, A.: BPMN profile for operational requirements. J. Object Technol. 13(2), 1–35 (2014)
El Akkaoui, Z., Zimányi, E., Mazón, J.N., Trujillo, J.: A BPMN-based design and maintenance framework for ETL processes. Int. J. Data Warehousing Mining 9(3), 46–72 (2013)
Muñoz, L., Mazón, J.-N., Pardillo, J., Trujillo, J.: Modelling ETL processes of data warehouses with UML activity diagrams. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM 2008. LNCS, vol. 5333, pp. 44–53. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88875-8_21
Santos, V., Belo, O.: Using relational algebra on the specification of real world ETL processes. In: Proceedings of the 13th IEEE International Conference on Dependable, Autonomic and Secure Computing, DASC 2015, pp. 861–866. IEEE, Liverpool (2015)
Trujillo, J., Luján-Mora, S.: A UML based approach for modeling ETL processes in data warehouses. In: Song, I.-Y., Liddle, S.W., Ling, T.-W., Scheuermann, P. (eds.) ER 2003. LNCS, vol. 2813, pp. 307–320. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-39648-2_25
Vaisman, A.A., Zimányi, E.: Data Warehouse Systems: Design and Implementation. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-54655-6
Vassiliadis, P., Simitsis, A., Skiadopoulos, S.: Conceptual modeling for ETL processes. In: Proceedings of the 5th ACM International Workshop on Data Warehousing and OLAP, DOLAP 2002, pp. 14–21. ACM, McLean (2002)
Vassiliadis, P., Simitsis, A., Skiadopoulos, S.: Modeling ETL activities as graphs. In: Proceedings of the 4th International Workshop on Design and Management of Data Warehouses, DMDW 2002, pp. 52–61. CEUR-WS.org, Toronto (2002)
Acknowledgements
The work of Judith Awiti is supported by the European Commission through the Erasmus Mundus Joint Doctorate project Information Technologies for Business Intelligence-Doctoral College (IT4BI-DC).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Awiti, J., Zimányi, E. (2019). An XML Interchange Format for ETL Models. In: Welzer, T., et al. New Trends in Databases and Information Systems. ADBIS 2019. Communications in Computer and Information Science, vol 1064. Springer, Cham. https://doi.org/10.1007/978-3-030-30278-8_42
Download citation
DOI: https://doi.org/10.1007/978-3-030-30278-8_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30277-1
Online ISBN: 978-3-030-30278-8
eBook Packages: Computer ScienceComputer Science (R0)