Skip to main content
SpringerLink
Log in

BigData: Issues, Challenges, Technologies and Methods

  • Conference paper
  • First Online:
Proceedings of the International Conference on Data Engineering 2015 (DaEng-2015)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 520))

Abstract

With dramatically increase of emerging applications such as social media, sensors, videos and digital pictures data is become generating from everywhere. Due to characteristic of big data it becomes very difficult to manage, analysis, store, transport, and process the data using the existing traditional techniques. This paper introduces several Big Data, technologies and methods. First, we introduce the Big Data and its problem, important of Big Data, technologies and methods of Big Data management, and analyzed includes the Distributed File System, NOSQL Database, Hadoop/MapReduce. Next, we present the Big Data model; and discuss the Big Data security challenges. Finally, we present the future work and the conclusion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ji, C., Li, Y., Qiu, W., Awada, U., Li, K.: BigData processing in cloud computing environments. In: International Symposium on Pervasive Systems, Algorithms and Networks (2012)

    Google Scholar 

  2. Patel, A.B., Birla, M., Nair, U.: Addressing big data problem using hadoop and map reduce. In: NIRMA University International Conference on Engineering (2012)

    Google Scholar 

  3. Kaisler, S., Armour, F., Espinosa, J.A., Money, W.: Big data: issues and challenges moving forward. In: Hawaii International Conference on System Sciences. https://doi.org/10.1109/hicss.2013.645 (2012)

  4. Ji, C., Li, Y., Qiu, W., Awada, U., Li, K.: Big data processing in cloud computing environments. In: International Symposium on Pervasive Systems, Algorithms and Networks (2012)

    Google Scholar 

  5. UzZaman, N.: Survey on google file system. In: Survey Paper for CSC 456 (Operating Systems), University of Roch (2007)

    Google Scholar 

  6. Ghemawat, S., Gobioff, H., Leung, S.-T.: The google file system, ACM 1-58113-757-5/03/0010. Bolton Landing, New York, USA (2003)

    Google Scholar 

  7. Gudivada, V.N., Rao, D., Raghavan, V.V.: NoSQL systems for big data management. In: IEEE 10th World Congress on Services, 978-1-4799-5069-0/14 (2014)

    Google Scholar 

  8. Zhang, Q., Chen, Z., Lv, A., Zhao, L., Liu, F., Zou, J.: A universal storage architecture for big data in cloud environment. In: IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing, 978-0-7695-5046-6/13 (2013)

    Google Scholar 

  9. Nandimath, J., Patil, A., Banerjee, E., Kakade, P., Vaidya, S.: Big data analysis using apache hadoop. In: IEEE San Francisco, California, USA, 978-1-4799-1050-2/13(2013)

    Google Scholar 

  10. Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters, Google, Inc

    Google Scholar 

  11. Pal, A., Agrawal, P., Jain, K., Agrawal, S.: A performance analysis of mapreduce task with large number of files datasetin big data using hadoop. In: Fourth International Conference on Communication Systems and Network Technologies, 978-1-4799-3070-8/14 (2014)

    Google Scholar 

  12. Kong, W.c., Wu, Q., Li, L., Qiao, F.: Intelligent data analysis and its challenges in big data environment. In: IEEE International Conference on System Science and Engineering (ICSSE), 978-1-4799-4367-8/14 (2014)

    Google Scholar 

  13. Kim, S.-H., Kim, N.-U., Chung, T.-M.: Attribute Relationship Evaluation Methodology for Big Data Security, 978-1-4799-2845-3/13/$31.00, IEEE (2013)

    Google Scholar 

Download references

Acknowledgements

Appreciation conveyed to Ministry of Higher Education Malaysia for project financing under Exploratory Research Grant Scheme RDU120608; and University Malaysia Pahang under UMP Short Term Grant RDU1403163.

Author information

Authors and Affiliations

  1. Faculty of Computer Systems and Software Engineering, University Malaysia Pahang, Gambang, 26300, Kuantan, Pahang, Malaysia

    Khalid Adam, Mohammed Adam Ibrahim Fakharaldien, Jasni Mohamed Zain, Mazlina Abdul Majid & Ahmad Noraziah

Authors
  1. Khalid Adam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed Adam Ibrahim Fakharaldien
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jasni Mohamed Zain
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mazlina Abdul Majid
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ahmad Noraziah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ahmad Noraziah .

Editor information

Editors and Affiliations

  1. School of Information Technology, Deakin University, Geelong, VIC, Australia

    Jemal H. Abawajy

  2. Department of Communication Technology and Network, Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Serdang, Malaysia

    Mohamed Othman

  3. Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, Batu Pahat, Johor, Malaysia

    Rozaida Ghazali

  4. Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, Batu Pahat, Johor, Malaysia

    Mustafa Mat Deris

  5. Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, Batu Pahat, Johor, Malaysia

    Hairulnizam Mahdin

  6. Faculty of Computer Science and Information Technology, University of Malaya, Kuala Lumpur, Malaysia

    Tutut Herawan

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Adam, K., Fakharaldien, M.A.I., Zain, J.M., Majid, M.A., Noraziah, A. (2019). BigData: Issues, Challenges, Technologies and Methods. In: Abawajy, J., Othman, M., Ghazali, R., Deris, M., Mahdin, H., Herawan, T. (eds) Proceedings of the International Conference on Data Engineering 2015 (DaEng-2015) . Lecture Notes in Electrical Engineering, vol 520. Springer, Singapore. https://doi.org/10.1007/978-981-13-1799-6_56

Download citation

Publish with us

Policies and ethics

Search

Navigation