Dynamic Data Management for Machine Learning in Embedded Systems: A Case Study

  • Hamza OuhaichiEmail author
  • Helena Holmström OlssonEmail author
  • Jan BoschEmail author
Conference paper
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 370)


Dynamic data and continuously evolving sets of records are essential for a wide variety of today’s data management applications. Such applications range from large, social, content-driven Internet applications, to highly focused data processing verticals like data intensive science, telecommunications and intelligence applications. However, the dynamic and multimodal nature of data makes it challenging to transform it into machine-readable and machine-interpretable forms. In this paper, we report on an action research study that we conducted in collaboration with a multinational company in the embedded systems domain. In our study, and in the context of a real-world industrial application of dynamic data management, we provide insights to data science community and research to guide discussions and future research into dynamic data management in embedded systems. Our study identifies the key challenges in the phases of data collection, data storage and data cleaning that can significantly impact the overall performance of the system.


Dynamic data Embedded systems Machine learning Data management Business outcomes 


  1. 1.
    Darema, F.: Dynamic data driven applications systems: a new paradigm for application simulations and measurements. In: Bubak, M., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2004. LNCS, vol. 3038, pp. 662–669. Springer, Heidelberg (2004). Scholar
  2. 2.
    Polyzotis, N., Roy, S., Whang, S.E., Zinkevich, M.: Data lifecycle challenges in production machine learning: a survey. SIGMOD Record 47, 17–28 (2018)CrossRefGoogle Scholar
  3. 3.
    Kennedy, O., Ahmad, Y., Koch, C.: DBToaster: agile views for a dynamic data management system. In: CIDR 2011 - 5th Biennial Conference on Innovative Data Systems Research, Conference Proceedings, pp. 284–295 (2011)Google Scholar
  4. 4.
    Tegen, A., Davidsson, P., Mihailescu, R.C., Persson, J.A.: Collaborative sensing with interactive learning using dynamic intelligent virtual sensors. Sensors (Basel, Switzerland) 19(3), 477 (2019). Scholar
  5. 5.
    Charles, H., Bellarnyz, R., Ericksonz, T., Burnett, M.: Trials and tribulations of developers of intelligent systems: a field study, pp. 162–170 (2016).
  6. 6.
    Polyzotis, N., Roy, S., Whang, S.E., Zinkevich, M.: Data management challenges in production machine learning. pp. 1723–1726 (2017).
  7. 7.
    Arpteg, A., Raj, A., Brinne, B., Crnkovic-Friis, L., Bosch, J.: Data Management Challenges of Deep Learning, pp. 50–59 (2019).
  8. 8.
    Kumar, A., Boehm, M., Yang, J.: Data Management in Machine Learning: Challenges, Techniques, and Systems, pp. 1717–1722 (2017).
  9. 9.
    Delaye, E., Sirasao, A., Dudha, C., Das, S.: Deep learning challenges and solutions with Xilinx FPGAs, pp. 908–913 (2017).
  10. 10.
    Lwakatare, L.E., Raj, A., Bosch, J., Olsson, H., Crnkovic, I.: A Hilltironomy of Software Engineering Challenges for Machine Learning Systems: An Empirical Investigation (2019).
  11. 11.
    Zhou, L., Pan, S., Wang, J., Vasilakos, A.: Machine learning on big data: opportunities and challenges. Neurocomputing 237, 350–361 (2017). Scholar
  12. 12.
    Chu, X., Ilyas, I., Krishnan, S., Wang, J.: Data Cleaning: Overview and Emerging Challenges, pp. 2201–2206 (2016).
  13. 13.
    Krawczyk, B.: Learning from imbalanced data: open challenges and future directions. Progress Artif. Intell. 5, 221–232 (2016)CrossRefGoogle Scholar
  14. 14.
    Ahuja, S., Angra, S.: Machine learning and its Applications: A Review (2017).
  15. 15.
    Hedgebeth, D.: Data-driven decision making for the enterprise: an overview of business intelligence applications. VINE 37(4), 414–420 (2007)CrossRefGoogle Scholar
  16. 16.
    Maxwell, J.A.: Qualitative Research Design: An interactive approach, 2nd edn. SAGE Publications, Thousands Oaks (2005)Google Scholar
  17. 17.
    Berthold, M.R., Borgelt, C., Höppner, F., Klawonn, F.: Guide to Intelligent Data Analysis. TCS. Springer, London (2010). Scholar
  18. 18.
    Broy, M.: Challenges in automotive software engineering. In: Proceedings of the 28th International Conference on Software Engineering (ICSE 2006), ACM, New York, NY, USA, pp. 33–42 (2006)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Malmö UniversityMalmöSweden
  2. 2.Chalmers University of TechnologyGothenburgSweden

Personalised recommendations