Skip to main content

An XML Interchange Format for ETL Models

  • Conference paper
  • First Online:
New Trends in Databases and Information Systems (ADBIS 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1064))

Included in the following conference series:

Abstract

ETL tools are responsible for extracting, transforming and loading data from data sources into a data warehouse. Each ETL tool has its own model for specifying ETL processes. This makes it difficult to interchange ETL designs. Entire ETL workflows must be redesigned in order to migrate them from one tool to another. It has therefore become increasingly important to have a single conceptual model for ETL processes which is interchangeable between tools. Business Process Model and Notation (BPMN) has been widely accepted as a standard for specifying business processes. For this reason, it has been proposed as an efficient conceptual model of ETL processes. In this paper, we present BEXF, an Extensible Markup Language (XML) interchange format for BPMN4ETL, an extended BPMN model for ETL. It is a format powerful enough the express and interchange BPMN4ETL model information across tools that are compliant with BPMN 2.0. This XML interchange format does not only describe the control flow of ETL processes but also the data flow.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.omg.org/spec/BPMN/2.0/About-BPMN/.

  2. 2.

    https://www.w3.org/TR/2008/REC-xml-20081126/.

  3. 3.

    https://www.omg.org/mda/.

  4. 4.

    https://www.omg.org/spec/MOFM2T/1.0.

References

  1. Akkaoui, Z.E., Zimányi, E.: Defining ETL worfklows using BPMN and BPEL. In: Proceedings of the 12th ACM International Workshop on Data Warehousing and OLAP, pp. 41–48. ACM, Hong Kong (2009)

    Google Scholar 

  2. Akkaoui, Z.E., Zimányi, E., Mazón, J., Trujillo, J.: A model-driven framework for ETL process development. In: Proceedings of the 14th International Workshop on Data Warehousing and OLAP, DOLAP 2011, pp. 45–52. ACM, Glasgow (2011)

    Google Scholar 

  3. Ali, S.M.F., Wrembel, R.: From conceptual design to performance optimization of ETL workflows: current state of research and open problems. VLDB J. 26(6), 777–801 (2017)

    Article  Google Scholar 

  4. Awiti, J., Vaisman, A., Zimányi, E.: From conceptual to logical ETL design using BPMN and relational algebra. In: Proceedings of the 21st ACM International Conference on Big Data Analytics and Knowledge Discovery, DAWAK 2019. Springer, Linz (2019, forthcoming)

    Google Scholar 

  5. Bock, C., Barbau, R., Narayanan, A.: BPMN profile for operational requirements. J. Object Technol. 13(2), 1–35 (2014)

    Article  Google Scholar 

  6. El Akkaoui, Z., Zimányi, E., Mazón, J.N., Trujillo, J.: A BPMN-based design and maintenance framework for ETL processes. Int. J. Data Warehousing Mining 9(3), 46–72 (2013)

    Article  Google Scholar 

  7. Muñoz, L., Mazón, J.-N., Pardillo, J., Trujillo, J.: Modelling ETL processes of data warehouses with UML activity diagrams. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM 2008. LNCS, vol. 5333, pp. 44–53. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88875-8_21

    Chapter  Google Scholar 

  8. Santos, V., Belo, O.: Using relational algebra on the specification of real world ETL processes. In: Proceedings of the 13th IEEE International Conference on Dependable, Autonomic and Secure Computing, DASC 2015, pp. 861–866. IEEE, Liverpool (2015)

    Google Scholar 

  9. Trujillo, J., Luján-Mora, S.: A UML based approach for modeling ETL processes in data warehouses. In: Song, I.-Y., Liddle, S.W., Ling, T.-W., Scheuermann, P. (eds.) ER 2003. LNCS, vol. 2813, pp. 307–320. Springer, Heidelberg (2003). https://doi.org/10.1007/978-3-540-39648-2_25

    Chapter  Google Scholar 

  10. Vaisman, A.A., Zimányi, E.: Data Warehouse Systems: Design and Implementation. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-642-54655-6

    Book  Google Scholar 

  11. Vassiliadis, P., Simitsis, A., Skiadopoulos, S.: Conceptual modeling for ETL processes. In: Proceedings of the 5th ACM International Workshop on Data Warehousing and OLAP, DOLAP 2002, pp. 14–21. ACM, McLean (2002)

    Google Scholar 

  12. Vassiliadis, P., Simitsis, A., Skiadopoulos, S.: Modeling ETL activities as graphs. In: Proceedings of the 4th International Workshop on Design and Management of Data Warehouses, DMDW 2002, pp. 52–61. CEUR-WS.org, Toronto (2002)

    Google Scholar 

Download references

Acknowledgements

The work of Judith Awiti is supported by the European Commission through the Erasmus Mundus Joint Doctorate project Information Technologies for Business Intelligence-Doctoral College (IT4BI-DC).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Judith Awiti .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Awiti, J., Zimányi, E. (2019). An XML Interchange Format for ETL Models. In: Welzer, T., et al. New Trends in Databases and Information Systems. ADBIS 2019. Communications in Computer and Information Science, vol 1064. Springer, Cham. https://doi.org/10.1007/978-3-030-30278-8_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-30278-8_42

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-30277-1

  • Online ISBN: 978-3-030-30278-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics