Skip to main content

Research Challenges in Big Data Solutions in Different Applications

  • Chapter
  • First Online:
Social Network Forensics, Cyber Security, and Machine Learning

Part of the book series: SpringerBriefs in Applied Sciences and Technology ((BRIEFSFOMEBI))

Abstract

Data is the most important unit of information. Now a day, data are being generated in a phenomenal speed. Data is being collected from various sources like social media, sensors, machines, etc. To get vital information, it is very important that the data should get processed in very smart and intelligent way. Traditional approach of processing data is not capable of processing the humongous data generated these days. So to overcome the problem of smart processing of data, Big Data analytics came into existence. Many scientists are working to make it more efficient. This technique is using the latest ways to process the data generated from various sources. It’s just not only store and process the data, but keep the integrity of the data also, as some data are very confident for the organizations. If some organization is sharing their data, their primary requirement is the confidentiality and integrity of the data. Big Data analytics take care of the requirement of the organization. It has been proven a very powerful method for processing of data in the area of surveillance, health care, fraud detection, reduction of crime, etc. The purpose of this paper is to discuss the features of Big Data and its applications. In this paper, the state of the art and applications of Big Data will be discussed. We hashed out about the work already done in the area of improving the integrity and usability of data generated by using Big Data analytics techniques. This will also cover the latest solutions offered by the researchers for the challenges in Big Data analytics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Jagadish HV et al (2014) Big data and its technical challenges. Commun ACM 57(7):86–94

    Article  Google Scholar 

  2. Rodríguez-Mazahua L, Rodríguez-Enríquez C-A, Sánchez-Cervantes JL, Cervantes J, García-Alcaraz JL, Alor-Hernández G (2016) A general perspective of big data: applications, tools, challenges and trends. J Supercomputing 72(8):3073–3113

    Article  Google Scholar 

  3. Lomotey RK, Deters R (2014) Towards knowledge discovery in big data. In: Proceeding of the 8th international symposium on service oriented system engineering. IEEE Computer Society, pp 181–191

    Google Scholar 

  4. Candela L, Castelli D, Pagano P (2012) Managing big data through hybrid data infrastructures. ERCIM News 89:37–38

    Google Scholar 

  5. Patel, JA, Sharma P (2014) Big data for better health planning. In: 2014 international conference on advances in engineering and technology research (ICAETR), pp 1–5. IEEE

    Google Scholar 

  6. Veenadhari S, Misra B, Singh CD (2011) Data mining techniques for predicting crop productivity—a review article. In: IJCST 2(1)

    Google Scholar 

  7. Alberto G-S, Juan F-S, Ojeda-Bustamante W (2014) Predictive ability of machine learning methods for massive crop yield prediction Span. J Agric Res 12(2):313–328

    Google Scholar 

  8. Gleaso CP (1982) Large area yield estimation/forecasting using plant process models. Paper presentation at the winter meeting American society of agricultural engineers palmer house, Chicago, Illinois, 14–17

    Google Scholar 

  9. Khan, S, Shakil KA, Alam M (2016) Educational intelligence: applying cloud-based big data analytics to the Indian education sector. In: 2016 2nd international conference on contemporary computing and informatics (IC3I), pp 29–34. IEEE

    Google Scholar 

  10. Smart Cities—Make In India. Makeinindia.com, 2016. [Online]. Available: http://www.makeinindia.com/article/-/v/internet-of-things

  11. Education sector in India, Indian education system, Industry. Ibef.org. N.p., 2016. Web. 8 June 2016

    Google Scholar 

  12. Sin, K, Muthu L (2015) Application of big data in education data mining and learning analytics—a literature review. ICTACT J Soft Comput 5(4)

    Google Scholar 

  13. Blikstein P (2011) Using learning analytics to assess students’ behavior in open-ended programming tasks. In: Proceedings of the 1st international conference on learning analytics and knowledge, pp 110–116. ACM

    Google Scholar 

  14. Brown DE (1998) The regional crime analysis program (RECAP): a framework for mining data to catch criminals. In: 1998 IEEE international conference on systems, man, and cybernetics, 1998, vol 3, pp 2848–2853. IEEE

    Google Scholar 

  15. Xu JJ, Chen H (2005) CrimeNet explorer: a framework for criminal network knowledge discovery. ACM Trans Inf Syst (TOIS) 23(2):201–226

    Article  MathSciNet  Google Scholar 

  16. Sparrow MK (1991) The application of network analysis to criminal intelligence: an assessment of the prospects. Soc Netw 13(3):251–274

    Article  Google Scholar 

  17. Malleson N, Andresen MA (2015) The impact of using social media data in crime rate calculations: shifting hot spots and changing spatial patterns. Cartography Geogr Inf Sci 42(2):112–121

    Article  Google Scholar 

  18. Mena, J (2003) Investigative data mining for security and criminal detection. Butterworth-Heinemann

    Google Scholar 

  19. Kitchin R (2014) The real-time city? Big data and smart urbanism. GeoJournal 79(1):1–14

    Article  Google Scholar 

  20. Fan W, Bifet A (2013) Mining Big Data: current status, and forecast to the future. ACM SIGKDD Explor Newsl 14(2):1–5

    Article  Google Scholar 

  21. Meijer A, Bolívar MPR (2016) Governing the smart city: a review of the literature on smart urban governance. Int Rev Admin Sci 82(2):392–408

    Article  Google Scholar 

  22. Agrawal, D, El Abbadi A, Antony S, Das S (2010) Data management challenges in cloud computing infrastructures. In: International workshop on databases in networked information systems. Springer, Berlin, pp 1–10

    Google Scholar 

  23. Azevedo, DNR, de Oliveira JMP (2009) Application of data mining techniques to storage management and online distribution of satellite images.” In Innovative Applications in Data Mining, pp 1–15. Springer, Berlin, 2009

    Google Scholar 

  24. Buza K, Nagy G, Nanopoulos A (2014) Storage-optimizing clustering algorithms for high-dimensional tick data. Expert Syst Appl 41(9):4148–4157

    Article  Google Scholar 

  25. Lakshman A, Malik P (2010) Cassandra: a decentralized structured storage system. ACM SIGOPS Oper Syst Rev 44(2):35–40

    Article  Google Scholar 

  26. The Apache Software Foundation. Apache HBase. http://hbase.apache.org

  27. Halevi G, Moed H (2012) The evolution of big data as a research and scientific topic: overview of the literature. Res Trends 30:3–6

    Google Scholar 

  28. Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113

    Article  Google Scholar 

  29. Cavoukian A, Chibba M, Williamson G, Ferguson A (2015) The importance of ABAC: attribute-based access control to big data: privacy and context. Privacy and Big Data Institute, Ryerson University, Toronto, Canada

    Google Scholar 

  30. White T (2009) Hadoop: the definite guide, 1st edn. OReilly Media Inc, Sebastopol

    Google Scholar 

  31. McGilvray D (2008) Executing data quality projects: ten steps to quality data and trusted informationTM. Elsevier

    Google Scholar 

  32. Keim, DA et al (2006) Challenges in visual data analysis. In: 10th international conference on information visualisation (IV’06). IEEE

    Google Scholar 

  33. Jaseena KU, David JM (2014) Issues, challenges, and solutions: big data mining. Comput Sci Inf Technol (CS & IT) 131–140

    Google Scholar 

  34. Nasser T, Tariq RS (2014) Big data challenges. J Comput Eng Inf Technol 4:3. 9307(2) https://doi.org/10.4172/2324; Nasser T, Tariq RS (2015) Big data challenges. J Comput Eng Inf Technol 4:3. 9307(2) https://doi.org/10.4172/2324

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bhawna Dhupia .

Rights and permissions

Reprints and permissions

Copyright information

© 2019 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Dhupia, B., Usha Rani, M. (2019). Research Challenges in Big Data Solutions in Different Applications. In: Social Network Forensics, Cyber Security, and Machine Learning. SpringerBriefs in Applied Sciences and Technology(). Springer, Singapore. https://doi.org/10.1007/978-981-13-1456-8_9

Download citation

Publish with us

Policies and ethics