Abstract
Webservice is a software technology as the representative method of information communication currently used to create a dynamic system environment that is configured to fulfill its users’ needs. Therefore, analyzing log data that occurred at provision is being used as the significant basic data in webservice research. Thanks to development of Cloud computing technology, it has resulted in centralized points from which data is generated and data enlargement. A research is now implemented to create information from collecting, processing and converting flood of data and to obtain the new various items of information. Against this backdrop, it is justified that collection, storage and analysis of web log data in the existing conventional RDBMS system may be inadequate to process the enlarged log data. This research propose a framework which to integrate web log for storage using HBase, a repository of the Cloud computing- based NoSQL. In addition, data validation must be completed in the pre-process when collecting web log. The validated log is stored in the modeling structure in which takes features of web log into account. According to the results, introduction of NoSQL system is found to integrate the enlargement of log data in more efficient manner. By comparisons with the existing RDBMS in terms of data processing performance, it was proved that the NoSQL- based database had a superior performance.
Chapter PDF
Similar content being viewed by others
References
Choi, J., Choi, C., Ko, B., Choi, D., Kim, P.: Detecting Web based DDoS Attack using MapReduce operations in Cloud Computing Environment. Journal of Internet Services and Information Security 3(3/4), 28–37 (2013)
Oliner, A., Ganapathi, A., Xu, W.: Advances and challenges in log analysis. Communications of the ACM 55(2), 55–61 (2012)
Yunhua, G.U., Shu, S., Guansheng, Z.: Application of NoSQL Database in Web Crawling. International Journal of Digital Content Technology and its Applications 5(6) (2011)
Elkotob, M., Andersson, K.: Cross-Layer Design for Improved QoE in Content Distribution Networks. IT CoNvergence PRActice (INPRA) 1(1), 37–52 (2013)
Srinivasan, V., Bulkowski, B.: Citrusleaf: A Real-Time NoSQL DB which Preserves ACID. In: The 37th International Conference on Very Large Data Bases, Proceedings of the VLDB Endowment, vol. 4(12), pp. 1340–1350 (2011)
Yi, X., Wei, G., Dong, F.: A Survey on NoSQL Database. Communication of Modern Technology, 46–50 (2010)
Zhou, W., Han, J., Zhang, Z., Dai, J.: Dynamic Random Access for Hadoop Distributed File System. In: 32nd International Conference on Distributed Computing Systems Workshops, pp. 17–22. IEEE (2012)
George, L.: HBase The Definitive Guide. O‘ReillyMedia (2011)
Bomin, C., Jong-Hwan, K., Sung-Sam, H., Myung-Mook, H.: The Method of Analyzing Firewall Log Data using Map Reduce based on NoSQL. Journal of The Korea Institute of Information Security & Cryptology (JKIISC) 23(4), 667–677 (2013)
Yang, J., Leskovec, J.: Patterns of Temporal Variation in Online Media. In: ACM International Conference on Web Search and Data Mining, pp. 177–186 (2011)
Shvachko, K.V.: HDFS Scalability: The limits to growth. Login 35(2), 6–16 (2010)
Borthakur, D., Sarma, J.S., Gray, J.: Apache Hadoop goes realtime at Facebook. In: SIGMOD, pp. 1071–1080 (2011)
Proffitt, B.: When NoSQL Databases Are Yes Good For You and Your Company (2013)
Agosti, M., Crivellari, F., Nunzio, G.M.: Web log analysis: a review of a decade of studies about information acquisition, inspection and interpretation of user interaction. Data Mining and Knowledge Discovery 24(3), 663–696 (2012)
Choi, C., Choi, J., Ko, B., Oh, K., Kim, P.: A Design of Onto-ACM (Ontology based Access Control Model) in Cloud Computing Environments. Journal of Internet Services and Information Security 2(3/4), 54–64 (2012)
Herrerias, J., Gomez: Log Analysis Towards an Automated Forensic Diagnosis System. IEEE ARES, 15–18 (2010)
Han, S., Han, Y.: Meaning and Prospects of IT Convergence Technology in Korea. IT CoNvergence PRActice (INPRA) 1(1), 2–12 (2013)
Gonzalez-Miranda, S., Alcarria, R., Robles, T., Morales, A., Gonzalez, I., Montcada, E.: An IoT-leveraged information system for future shopping environments. IT CoNvergence PRActice (INPRA) 1(3), 49–65 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 IFIP International Federation for Information Processing
About this paper
Cite this paper
Jeong, H., Choi, J., Choi, C., You, I., Kim, P. (2014). A Design of Web Log Integration Framework Using NoSQL. In: Linawati, Mahendra, M.S., Neuhold, E.J., Tjoa, A.M., You, I. (eds) Information and Communication Technology. ICT-EurAsia 2014. Lecture Notes in Computer Science, vol 8407. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-55032-4_44
Download citation
DOI: https://doi.org/10.1007/978-3-642-55032-4_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-55031-7
Online ISBN: 978-3-642-55032-4
eBook Packages: Computer ScienceComputer Science (R0)