Skip to main content

Dealing with Velocity and Variety in the Acquisition of Heterogeneous Sensor Data

  • Conference paper
  • First Online:
Book cover Knowledge Engineering and Knowledge Management (EKAW 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10180))

Included in the following conference series:

  • 911 Accesses

Abstract

ETL (Extraction-Transform-Load) tools, traditionally developed to operate offline, need to be enhanced to deal with various, fast, big and fresh data and be executed on the edge of the network during the acquisition process. In this dissertation we wish to develop facilities that from one side make easy, scalable and controllable the development of data acquisition plans that can be executed on the edge of the network during loading and transmission. From the other side, we wish to deal with the variety of the data and verify when the developed data acquisition plans adhere to the common semantics adopted in the Domain Ontology. These facilities are included in StreamLoader, a web application tailored for the specification and monitoring of sensor data acquisition plans.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Apparent temperature is a value of temperature adjusted with the level of humidity.

References

  1. Dong, M., Kimata, T., Zettsu, K.: Service-controlled networking: dynamic in-network data fusion for heterogeneous sensor networks. In: IEEE International Symposium on Reliable Distributed Systems Workshops (SRDSW), pp. 94–99 (2014)

    Google Scholar 

  2. Bermudez-Edo, M., et al.: IoT-Lite ontology (2015)

    Google Scholar 

  3. W3C Semantic Sensor Network Group: Semantic sensor network ontology (2005)

    Google Scholar 

  4. Ankit, J., et al.: Learning Storm. Packt Publishing, Birmingham (2014)

    Google Scholar 

  5. Mesiti, M., et al.: StreamLoader: An event-driven ETL system for the on-line processing of heterogeneous sensor data. In: Proceedings of International Conference on Extending Database Technology, pp. 628–631 (2016)

    Google Scholar 

  6. Neumeyer, L., et al.: S4: distributed stream computing platform. In: International Workshop on Data Mining ICDMW, pp. 170–177 (2010)

    Google Scholar 

  7. Kabra, N., et al.: Efficient mid-query re-optimization of sub-optimal query execution plans. SIGMOD Rec. 27(2), 106–117 (1998)

    Article  Google Scholar 

  8. Markl, V., et al.: Robust query processing through progressive optimization. In: Proceedings of International Conferences on Management of Data, SIGMOD, pp. 659–670 (2004)

    Google Scholar 

  9. Sheth, A., et al.: Semantic sensor web. IEEE Internet Comput. 12(4), 78–83 (2008)

    Article  Google Scholar 

  10. Karau, H., et al.: Learning Spark: Lightning-Fast Big Data Analysis. O’Reilly Media, Beijing (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Luca Ferrari .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Ferrari, L. (2017). Dealing with Velocity and Variety in the Acquisition of Heterogeneous Sensor Data. In: Ciancarini, P., et al. Knowledge Engineering and Knowledge Management. EKAW 2016. Lecture Notes in Computer Science(), vol 10180. Springer, Cham. https://doi.org/10.1007/978-3-319-58694-6_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-58694-6_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-58693-9

  • Online ISBN: 978-3-319-58694-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics