Skip to main content

Architecturing Elastic Edge Storage Services for Data-Driven Decision Making

  • Conference paper
  • First Online:
Software Architecture (ECSA 2019)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 11681))

Included in the following conference series:

Abstract

In the IoT era, a massive number of smart sensors produce a variety of data at unprecedented scale. Edge storage has limited capacities posing a crucial challenge for maintaining only the most relevant IoT data for edge analytics. Currently, this problem is addressed mostly considering traditional cloud-based database perspectives, including storage optimization and resource elasticity, while separately investigating data analytics approaches and system operations. For better support of future edge analytics, in this work, we propose a novel, holistic approach for architecturing elastic edge storage services, featuring three aspects, namely, (i) data/system characterization (e.g., metrics, key properties), (ii) system operations (e.g., filtering, sampling), and (iii) data processing utilities (e.g., recovery, prediction). In this regard, we present seven engineering principles for the architecture design of edge data services.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://prometheus.io/.

  2. 2.

    https://www.fluentd.org/.

  3. 3.

    https://fluentbit.io/.

  4. 4.

    https://fogger.io/.

  5. 5.

    https://www.mainflux.com/.

  6. 6.

    https://docs.docker.com.

  7. 7.

    https://www.ansible.com/.

  8. 8.

    https://www.terraform.io/.

  9. 9.

    https://www.vapor.io/kinetic-edge/.

References

  1. Ali, N.A., Abu-Elkheir, M.: Data management for the Internet of Things: green directions. In: 2012 IEEE Globecom Workshops, pp. 386–390. IEEE (2012)

    Google Scholar 

  2. Ali, S., Jarwar, M.A., Chong, I.: Design methodology of microservices to support predictive analytics for IoT applications. Sensors 18(12), 4226 (2018)

    Article  Google Scholar 

  3. Silva Araújo, H., Rodrigues, J.J.P.C., Rabelo, R.A.L., Sousa, N.C., Sobral, J.V.V., et al.: A proposal for IoT dynamic routes selection based on contextual information. Sensors 18(2), 353 (2018)

    Article  Google Scholar 

  4. Blair, G., Bencomo, N., France, R.R.: Models@ run.time. Computer 42(10), 22–27 (2009)

    Article  Google Scholar 

  5. D’Angelo, M.: Decentralized self-adaptive computing at the edge. In: International Conference on Software Engineering for Adaptive and Self-Managing Systems, pp. 144–148. ACM (2018)

    Google Scholar 

  6. Dimitrov, D.V.: Medical Internet of Things and big data in healthcare. Healthc. Inf. Res. 22(3), 156–163 (2016)

    Article  Google Scholar 

  7. He, W., Yan, G., Da Xu, L.: Developing vehicular data cloud services in the IoT environment. IEEE Trans. Ind. Inform. 10(2), 1587–1595 (2014)

    Article  Google Scholar 

  8. Lai, L.L., et al.: Intelligent weather forecast. In: International Conference on Machine Learning and Cybernetics, vol. 7, pp. 4216–4221 (2004)

    Google Scholar 

  9. Lederman, R., Wynter, L.: Real-time traffic estimation using data expansion. Transp. Res. Part B: Methodol. 45(7), 1062–1079 (2011)

    Article  Google Scholar 

  10. Lin, J., Keogh, E., Wei, L., Lonardi, S.: Experiencing sax: a novel symbolic representation of time series. Data Min. Knowl. Disc. 15(2), 107–144 (2007)

    Article  MathSciNet  Google Scholar 

  11. O’Donovan, P., Leahy, K., Bruton, K., O’Sullivan, D.T.: An industrial big data pipeline for data-driven analytics maintenance applications in large-scale smart manufacturing facilities. J. Big Data 2(1), 25 (2015)

    Article  Google Scholar 

  12. Psaras, I., Ascigil, O., Rene, S., Pavlou, G., Afanasyev, A., Zhang, L.: Mobile data repositories at the edge. In: Workshop on Hot Topics in Edge Computing (2018)

    Google Scholar 

  13. Satyanarayanan, M., et al.: Edge analytics in the Internet of Things. IEEE Pervasive Comput. 14(2), 24–31 (2015)

    Article  Google Scholar 

  14. Su, M., Zhang, L., Wu, Y., Chen, K., Li, K.: Systematic data placement optimization in multi-cloud storage for complex requirements. IEEE Trans. Comput. 65(6), 1964–1977 (2016)

    Article  MathSciNet  Google Scholar 

  15. Vogel, B., Gkouskos, D.: An open architecture approach: towards common design principles for an IoT architecture. In: Proceedings of the 11th European Conference on Software Architecture: Companion Proceedings, pp. 85–88. ACM (2017)

    Google Scholar 

Download references

Acknowledgments

The work in this paper has been partially funded through Rucon project (Runtime Control in Multi Clouds), FWF Y 904 START-Programm 2015 and Ivan Lujic’s netidee scholarship by the Internet Foundation Austria.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ivan Lujic .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lujic, I., Truong, HL. (2019). Architecturing Elastic Edge Storage Services for Data-Driven Decision Making. In: Bures, T., Duchien, L., Inverardi, P. (eds) Software Architecture. ECSA 2019. Lecture Notes in Computer Science(), vol 11681. Springer, Cham. https://doi.org/10.1007/978-3-030-29983-5_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-29983-5_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-29982-8

  • Online ISBN: 978-3-030-29983-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics