The Method of Forming Contents for a NoSQL Storage of Configurable Information System

Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 763)

Abstract

Configurable information systems operate under conditions of uncertainty regarding stored data and sources for filling this data. The change and expansion of functionality raises the problem of data collection and preparation, which, in turn, is connected with the integration of heterogeneous structures both in structure and in format. The technical solution to the problem is the use of ETL-systems that automate the operations of extracting, transforming and loading data into the store by rigidly defined rules. In the issues of data selection, exclusively the data specialist makes definition of rules for drive and transformation, the decision, which is a consequence of the lack of a methodological basis. This, in turn, raises such problems as the excess accuracy and inconsistency of imported data, a narrow specialization of rules (up to uniqueness) with a limited number of analytical models and known requirements for the data mart. The article presents the concept of the method for creating the content of NoSQL-storage of a configurable information system.

Keywords

Configurable information system NoSQL ETL Heterogeneous data sources Integration Storage Content 

Notes

Acknowledgment

The reported study was partially supported by RFBR, research project No.17-07-00105.

References

  1. 1.
    Garcia, J., Goldszmidt, G.: Building SOA composite business services. http://www.ibm.com/developerworks/webservices/library/ws-soa-composite/
  2. 2.
    Kucherov, S., Rogozov, Y., Sviridov, A.: NoSQL approach to data storing in configurable information systems. In: Communications in Computer and Information Science, vol. 584, pp. 120–134 (2016)Google Scholar
  3. 3.
    Kucherov, S., Rogozov, Y., Sviridov, A.: The model of subject-oriented storage of concepts sense for configurable information systems. In: Proceedings of the First International Scientific Conference “Intelligent Information Technologies for Industry” (IITI 2016). Advances in Intelligent Systems and Computing, vol. 450, pp. 317–327 (2016)CrossRefGoogle Scholar
  4. 4.
    Simitisis, A., et al.: Data warehouse refreshment. In: Data Warehouses OlAP Concepts, Architectures, and Solutions, pp. 111–134 (2006)Google Scholar
  5. 5.
    Kimball, R., et al.: The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleaning Conforming, and Delivering Data, 526 p. Wiley, NewYork (2004)Google Scholar
  6. 6.
    Inmon, W.H., Strauss, D., Neushloss, G.: DW 2.0: The Architecture for the Next Generation of Data Warehousing, 400 p., New York (2008)Google Scholar
  7. 7.
    Romero, O., Simitsis, A., Abelló, A.: GEM: requirement-driven generation of ETL and multidimensional conceptual designs. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) LNCS, vol. 6862, pp. 80–95 (2011)CrossRefGoogle Scholar
  8. 8.
    Bansal, S.K.: Towards a semantic extract-transform-load (ETL) framework for big data integration. In: Proceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014, pp. 522–529 (2014)Google Scholar
  9. 9.
    Bansal, S.K., Kagemann, S.: Integrating big data: a semantic extract-transform-load framework. Computer 48(3), 42–50 (2015)CrossRefGoogle Scholar
  10. 10.
    El Akkaoui, Z., et al.: BPMN-based conceptual modeling of ETL processes. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) LNCS, vol. 7448, pp. 1–14 (2012)Google Scholar
  11. 11.
    Kabiri, A., Wadjinny, F., Chiadmi, D.: Towards a framework for conceptual modeling of ETL processes. Communications in Computer and Information Science CCIS, vol. 241 (2011)Google Scholar
  12. 12.
    Schultz, A., et al.: LDIF - linked data integration framework. In: Proceedings of the 11th International Semantic Web Conference, ISWC 2011, vol. 782, pp. 1–6 (2011)Google Scholar
  13. 13.
    Schultz, A., et al.: LDIF - A framework for large-scale linked data integration. In: 21st International World Wide Web Conference (WWW 2012), Dev. Track, Lyon, France, pp. 1–3 (2012)Google Scholar
  14. 14.
    Knap, T., et al.: UnifiedViews: an ETL framework for sustainable RDF data processing. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8798, pp. 379–383 (2014)Google Scholar
  15. 15.
    Knap, T., et al.: UnifiedViews: towards ETL tool for simple yet powerfull RDF data management. In: CEUR Workshop Proceedings, vol. 1343, pp. 111–120 (2015)Google Scholar
  16. 16.
    Oliveira, B., Belo, O.: A domain-specific language for ETL patterns specification in data warehousing systems. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9273 (2015)Google Scholar
  17. 17.
    Rogozov, Y.: Approach to the construction of a systemic concept. In: Advances in Intelligent Systems and Computing, vol. 679, pp. 429–438 (2018)Google Scholar
  18. 18.
    Elleuch, N., Khalfallah, A., Ben, A.S.: Software architecture in model driven architecture. In: 2007 International Symposium on Computational Intelligence and Intelligent Informatics, pp. 219–223 (2007)Google Scholar
  19. 19.
    Kang, K.C., Lee, J., Donohoe, P.: Feature-oriented product line engineering. IEEE Softw. 19(4), 58–65 (2002)CrossRefGoogle Scholar
  20. 20.
    Jifeng, H., Li, X., Liu, Z.: Component-Based Software Engineering. Theor. Asp. Comput. 2005, 70–95 (2005)MATHGoogle Scholar
  21. 21.
    Legner, C., Heutschi, R.: SOA adoption in practice - findings from early SOA implementations. In: ECIS, № 2007, pp. 1643–1654 (2007)Google Scholar
  22. 22.
    Kucherov, S., Rogozov, Y., Sviridov, A., Rasol, M.: Approach to data warehousing in configurable information systems based on action abstraction. In: Communications in Computer and Information Science, vol. 535, pp. 139–148 (2015)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Institute of Computer Technology and Information SecuritySouthern Federal UniversityTaganrogRussian Federation

Personalised recommendations