Skip to main content
SpringerLink
Log in

On Discovering Data Preparation Modules Using Examples

  • Conference paper
  • First Online:
Service-Oriented Computing (ICSOC 2020)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 12571))

Included in the following conference series:

Abstract

A major issue that arises when designing data-analysis pipelines is that of identifying the services (or what we refer to as modules in this paper) that are suitable for performing data preparation steps, which represents \(80\%\) of the modules that compose data analysis workflows. Such modules are ubiquitous and are used to perform, amongst other things, operations such as record retrieval, format transformation, data combination to name a few. To assist scientists in the task of discovering suitable modules, we examine, in this paper, a solution that utilizes semantic annotations describing the inputs and outputs of modules together with data examples that characterize modules’ behavior as ingredients for the discovery of data preparation modules. The discovery strategy that we devised is iterative in that it allows scientists to explore existing modules by providing feedback on data examples.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.biggorilla.org.

  2. 2.

    https://bio.tools.

  3. 3.

    https://galaxyproject.org/tools.

  4. 4.

    www.trifacta.com.

References

  1. Alexe, B., Cate, B.T., Kolaitis, P.G., Tan, W.C.: Characterizing schema mappings via data examples. ACM Trans. Database Syst. 36(4), 23:1–23:48 (2011)

    Article  Google Scholar 

  2. Belhajjame, K.: Annotating the behavior of scientific modules using data examples: a practical approach. In: EDBT, pp. 726–737. OpenProceedings.org (2014)

    Google Scholar 

  3. Ebaid, A., et al.: NADEEF: a generalized data cleaning system. PVLDB 6(12), 1218–1221 (2013)

    Google Scholar 

  4. Goble, C., et al.: BioCatalogue: a curated web service registry for the life science community. In: Microsoft eScience Conference (2008)

    Google Scholar 

  5. Gruber, T.: Ontology. In: Encyclopedia of Database Systems (2009)

    Google Scholar 

  6. Konstantinou, N., et al.: The VADA architecture for cost-effective data wrangling. In: SIGMOD Conference, pp. 1599–1602. ACM (2017)

    Google Scholar 

  7. Kuropka, D., Tröger, P., Staab, S., Weske, M. (eds.): Semantic Service Provisioning. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-78617-7

    Book  Google Scholar 

  8. Stonebraker, M., et al.: Data curation at scale: the data tamer system. In: CIDR (2013). www.cidrdb.org

  9. Studer, R., Grimm, S., Abecker, A. (eds.): Semantic Web Services, Concepts, Technologies, and Applications. Springer, Berlin (2007). https://doi.org/10.1007/3-540-70894-4

    Book  Google Scholar 

  10. van Rijsbergen, C.J.: Information Retrieval. Butterworth, London (1979)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. PSL, Universití Paris-Dauphine, LAMSADE, Paris, France

    Khalid Belhajjame

Authors
  1. Khalid Belhajjame
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Khalid Belhajjame .

Editor information

Editors and Affiliations

  1. Zayed University, Dubai, United Arab Emirates

    Eleanna Kafeza

  2. University of New South Wales, Sydney, NSW, Australia

    Boualem Benatallah

  3. IIT National Research Council C.N.R., Pisa, Italy

    Fabio Martinelli

  4. Zayed University, Dubai, United Arab Emirates

    Hakim Hacid

  5. University of Sydney, Darlington, NSW, Australia

    Athman Bouguettaya

  6. Ernst & Young AI Lab, San Jose, CA, USA

    Hamid Motahari

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Belhajjame, K. (2020). On Discovering Data Preparation Modules Using Examples. In: Kafeza, E., Benatallah, B., Martinelli, F., Hacid, H., Bouguettaya, A., Motahari, H. (eds) Service-Oriented Computing. ICSOC 2020. Lecture Notes in Computer Science(), vol 12571. Springer, Cham. https://doi.org/10.1007/978-3-030-65310-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-65310-1_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-65309-5

  • Online ISBN: 978-3-030-65310-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation