Skip to main content

Associative Representation and Processing of Databases Using DASNG and AVB+trees for Efficient Data Access

  • Conference paper
  • First Online:
Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2017)

Abstract

Today, we have to cope with a great amount of data – BIG data problems. The main issues concerned about BIG data are sparing representation, time efficiency of data access and processing, as well as data mining and knowledge discovery. When dealing with the big amount of data, time is crucial. The most of time for data processing in the contemporary computer science is lost for a various search operation to access appropriate data. This paper presents how data collected in relational databases can be transformed into the associative neuronal graph structures, and how searching operations can be accelerated thanks to the use of aggregation and association of the stored data. To achieve an extraordinary efficiency in data access, this paper introduces new AVB+trees which together with Deep Associative Semantic Neuronal Graphs which can typically allow for constant time access to the stored data. The presented solution allows representing horizontal and vertical relations between data and stored objects, expanding possibilities of relational databases and replacing various search operations by the specific graph structure. Another contribution is the expansion of the aggregation of the duplicates to all data tables which contain the same attributes. In such a way, the presented associative structures simplify and speed up all searching operations in comparison to the classic solutions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Apiletti, D., Baralis, E., Cerquitelli, T., Garza, P., Pulvirenti, F., Venturini, L.: Frequent itemsets mining for big data: a comparative analysis. Big Data Res. 9, 67–83 (2017)

    Article  Google Scholar 

  2. Agrawal, R., Imielinski, T., Swami, A.: Mining association rules between sets of items in large databases. In: ACM SIGMOND Conference on Management of Data, pp. 207–216 (1993)

    Google Scholar 

  3. Bagui, S., Earp, R.: Database Design Using Entity-Relationship Diagrams, 2nd edn. CRC Press, Boca Raton (2011)

    MATH  Google Scholar 

  4. Chen, P.: Entity-relationship modeling: historical events, future trends, and lessons learned. In: Broy, M., Denert, E. (eds.) Software Pioneers, pp. 296–310. Springer, Heidelberg (2002). https://doi.org/10.1007/978-3-642-59412-0_17

    Chapter  Google Scholar 

  5. Cormen, T., Leiserson, Ch., Rivest, R., Stein, C.: Introduction to Algorithms, 2nd edn, pp. 434–454. MIT Press/McGraw-Hill, Cambridge/New York City (2001)

    MATH  Google Scholar 

  6. Duch, W., Dobosz, K.: Visualization for understanding of neurodynamical systems. Cogn. Neurodyn. 5(2), 145–160 (2011)

    Article  Google Scholar 

  7. Fayyad, U.P.-S.: From data mining to knowledge discovery in databases. In: Advances in Knowledge Discovery and Data Mining, vol. 17, pp. 37–54. MIT Press (1996)

    Google Scholar 

  8. Gerstner, W., Kistler, W.: Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge University Press, New York (2002)

    Book  Google Scholar 

  9. Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)

    MATH  Google Scholar 

  10. Han, J., Kamber, M.: Data Mining: Concepts and Techniques. Morgan Kaufmann, Burlington (2000)

    MATH  Google Scholar 

  11. Haykin, S.O.: Neural Networks and Learning Machines, 3rd edn. Prentice Hall, Upper Saddle River (2009)

    Google Scholar 

  12. Hellerstein, J.M., Stonebraker, M., Hamilton, J.: Architecture of a database system. Found. Trends Databases 1(2), 141–259 (2007)

    Article  Google Scholar 

  13. Horzyk, A.: Artificial Associative Systems and Associative Artificial Intelligence. Academic Publishing House EXIT, Warsaw (2013)

    Google Scholar 

  14. Horzyk, A., Starzyk, J.A., Graham, J.: Integration of semantic and episodic memories. IEEE Trans. Neural Netw. Learn. Syst. 28(12), 3084–3095 (2017). https://doi.org/10.1109/tnnls.2017.2728203

    Article  MathSciNet  Google Scholar 

  15. Horzyk, A.: How does generalization and creativity come into being in neural associative systems and how does it form human-like knowledge? Neurocomputing 144, 238–257 (2014). https://doi.org/10.1016/j.neucom.2014.04.046

    Article  Google Scholar 

  16. Horzyk, A., Starzyk, J.A., Basawaraj: Emergent creativity in declarative memories. In: 2016 IEEE SSCI, pp. 1–8. IEEE Xplore, Curran Associates, Inc., Red Hook (2016). https://doi.org/10.1109/ssci.2016.7850029

  17. Horzyk, A.: Neurons can sort data efficiently. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2017. LNCS (LNAI), vol. 10245, pp. 64–74. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59063-9_6

    Chapter  Google Scholar 

  18. Horzyk, A.: Deep associative semantic neural graphs for knowledge representation and fast data exploration. In: Proceedings of KEOD 2017, pp. 67–79. SCITEPRESS Digital Library (2017)

    Google Scholar 

  19. Horzyk, A., Starzyk, J.A.: Fast neural network adaptation with associative pulsing neurons. In: 2017 IEEE Symposium Series on Computational Intelligence, pp. 339–346. IEEE Xplore (2017). https://doi.org/10.1109/ssci.2017.8285369

  20. Horzyk, A., Starzyk, J.A.: Multi-class and multi-label classification using associative pulsing neural networks. In: 2018 IEEE World Congress on Computational Intelligence. IEEE Xplore (2018, in press)

    Google Scholar 

  21. Jin, X., Wah, B.W., Cheng, X., Wang, Y.: Significance and challenges of big data research. Big Data Res. 2(2), 59–64 (2015)

    Article  Google Scholar 

  22. Kalat, J.W.: Biological Psychology. Wadsworth Publishing, Belmont (2012)

    Google Scholar 

  23. Linoff, G.S., Berry, M.A.: Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management, 3rd edn. Wiley, Hoboken (2011)

    Google Scholar 

  24. Longstaff, A.: BIOS Instant Notes in Neuroscience. Garland Science, New York (2011)

    Google Scholar 

  25. Nuxoll, A., Laird, J.E.: A cognitive model of episodic memory integrated with a general cognitive architecture. In: International Conference on Cognitive Modelling, pp. 220–225 (2004)

    Google Scholar 

  26. Pääkkönen, P., Pakkala, D.: Reference architecture and classification of technologies, products and services for big data systems. Big Data Res. 2(4), 166–186 (2015)

    Article  Google Scholar 

  27. Parisia, G.I., Tanib, J., Webera, C., Wermter, S.: Emergence of multimodal action representations from neural network self-organization. Cogn. Syst. Res. 43, 208–221 (2017)

    Article  Google Scholar 

  28. Piatetsky-Shapiro, G., Frawley, W.J.: Knowledge Discovery in Databases. AAAI/MIT Press, Cambridge (1991)

    Google Scholar 

  29. Sowa, J.F.: Principles of Semantic Networks: Explorations in the Representation of Knowledge. Morgan Kaufmann, San Mateo (1991)

    MATH  Google Scholar 

  30. Starzyk, J.A., Graham, J.: MLECOG - motivated learning embodied cognitive architecture. IEEE Syst. J. PP(99), 1–12 (2015)

    Google Scholar 

  31. UCI Machine Learning Repository. http://archive.ics.uci.edu/ml/datasets/Iris. Accessed 04 Apr 2018

Download references

Acknowledgements

This work was supported by AGH 11.11.120.612 and a grant from the National Science Centre DEC-2016/21/B/ST7/02220.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Adrian Horzyk .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Horzyk, A. (2019). Associative Representation and Processing of Databases Using DASNG and AVB+trees for Efficient Data Access. In: Fred, A., et al. Knowledge Discovery, Knowledge Engineering and Knowledge Management. IC3K 2017. Communications in Computer and Information Science, vol 976. Springer, Cham. https://doi.org/10.1007/978-3-030-15640-4_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-15640-4_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-15639-8

  • Online ISBN: 978-3-030-15640-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics