Abstract
Data is the most important unit of information. Now a day, data are being generated in a phenomenal speed. Data is being collected from various sources like social media, sensors, machines, etc. To get vital information, it is very important that the data should get processed in very smart and intelligent way. Traditional approach of processing data is not capable of processing the humongous data generated these days. So to overcome the problem of smart processing of data, Big Data analytics came into existence. Many scientists are working to make it more efficient. This technique is using the latest ways to process the data generated from various sources. It’s just not only store and process the data, but keep the integrity of the data also, as some data are very confident for the organizations. If some organization is sharing their data, their primary requirement is the confidentiality and integrity of the data. Big Data analytics take care of the requirement of the organization. It has been proven a very powerful method for processing of data in the area of surveillance, health care, fraud detection, reduction of crime, etc. The purpose of this paper is to discuss the features of Big Data and its applications. In this paper, the state of the art and applications of Big Data will be discussed. We hashed out about the work already done in the area of improving the integrity and usability of data generated by using Big Data analytics techniques. This will also cover the latest solutions offered by the researchers for the challenges in Big Data analytics.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jagadish HV et al (2014) Big data and its technical challenges. Commun ACM 57(7):86–94
Rodríguez-Mazahua L, Rodríguez-Enríquez C-A, Sánchez-Cervantes JL, Cervantes J, García-Alcaraz JL, Alor-Hernández G (2016) A general perspective of big data: applications, tools, challenges and trends. J Supercomputing 72(8):3073–3113
Lomotey RK, Deters R (2014) Towards knowledge discovery in big data. In: Proceeding of the 8th international symposium on service oriented system engineering. IEEE Computer Society, pp 181–191
Candela L, Castelli D, Pagano P (2012) Managing big data through hybrid data infrastructures. ERCIM News 89:37–38
Patel, JA, Sharma P (2014) Big data for better health planning. In: 2014 international conference on advances in engineering and technology research (ICAETR), pp 1–5. IEEE
Veenadhari S, Misra B, Singh CD (2011) Data mining techniques for predicting crop productivity—a review article. In: IJCST 2(1)
Alberto G-S, Juan F-S, Ojeda-Bustamante W (2014) Predictive ability of machine learning methods for massive crop yield prediction Span. J Agric Res 12(2):313–328
Gleaso CP (1982) Large area yield estimation/forecasting using plant process models. Paper presentation at the winter meeting American society of agricultural engineers palmer house, Chicago, Illinois, 14–17
Khan, S, Shakil KA, Alam M (2016) Educational intelligence: applying cloud-based big data analytics to the Indian education sector. In: 2016 2nd international conference on contemporary computing and informatics (IC3I), pp 29–34. IEEE
Smart Cities—Make In India. Makeinindia.com, 2016. [Online]. Available: http://www.makeinindia.com/article/-/v/internet-of-things
Education sector in India, Indian education system, Industry. Ibef.org. N.p., 2016. Web. 8 June 2016
Sin, K, Muthu L (2015) Application of big data in education data mining and learning analytics—a literature review. ICTACT J Soft Comput 5(4)
Blikstein P (2011) Using learning analytics to assess students’ behavior in open-ended programming tasks. In: Proceedings of the 1st international conference on learning analytics and knowledge, pp 110–116. ACM
Brown DE (1998) The regional crime analysis program (RECAP): a framework for mining data to catch criminals. In: 1998 IEEE international conference on systems, man, and cybernetics, 1998, vol 3, pp 2848–2853. IEEE
Xu JJ, Chen H (2005) CrimeNet explorer: a framework for criminal network knowledge discovery. ACM Trans Inf Syst (TOIS) 23(2):201–226
Sparrow MK (1991) The application of network analysis to criminal intelligence: an assessment of the prospects. Soc Netw 13(3):251–274
Malleson N, Andresen MA (2015) The impact of using social media data in crime rate calculations: shifting hot spots and changing spatial patterns. Cartography Geogr Inf Sci 42(2):112–121
Mena, J (2003) Investigative data mining for security and criminal detection. Butterworth-Heinemann
Kitchin R (2014) The real-time city? Big data and smart urbanism. GeoJournal 79(1):1–14
Fan W, Bifet A (2013) Mining Big Data: current status, and forecast to the future. ACM SIGKDD Explor Newsl 14(2):1–5
Meijer A, Bolívar MPR (2016) Governing the smart city: a review of the literature on smart urban governance. Int Rev Admin Sci 82(2):392–408
Agrawal, D, El Abbadi A, Antony S, Das S (2010) Data management challenges in cloud computing infrastructures. In: International workshop on databases in networked information systems. Springer, Berlin, pp 1–10
Azevedo, DNR, de Oliveira JMP (2009) Application of data mining techniques to storage management and online distribution of satellite images.” In Innovative Applications in Data Mining, pp 1–15. Springer, Berlin, 2009
Buza K, Nagy G, Nanopoulos A (2014) Storage-optimizing clustering algorithms for high-dimensional tick data. Expert Syst Appl 41(9):4148–4157
Lakshman A, Malik P (2010) Cassandra: a decentralized structured storage system. ACM SIGOPS Oper Syst Rev 44(2):35–40
The Apache Software Foundation. Apache HBase. http://hbase.apache.org
Halevi G, Moed H (2012) The evolution of big data as a research and scientific topic: overview of the literature. Res Trends 30:3–6
Dean J, Ghemawat S (2008) MapReduce: simplified data processing on large clusters. Commun ACM 51(1):107–113
Cavoukian A, Chibba M, Williamson G, Ferguson A (2015) The importance of ABAC: attribute-based access control to big data: privacy and context. Privacy and Big Data Institute, Ryerson University, Toronto, Canada
White T (2009) Hadoop: the definite guide, 1st edn. OReilly Media Inc, Sebastopol
McGilvray D (2008) Executing data quality projects: ten steps to quality data and trusted informationTM. Elsevier
Keim, DA et al (2006) Challenges in visual data analysis. In: 10th international conference on information visualisation (IV’06). IEEE
Jaseena KU, David JM (2014) Issues, challenges, and solutions: big data mining. Comput Sci Inf Technol (CS & IT) 131–140
Nasser T, Tariq RS (2014) Big data challenges. J Comput Eng Inf Technol 4:3. 9307(2) https://doi.org/10.4172/2324; Nasser T, Tariq RS (2015) Big data challenges. J Comput Eng Inf Technol 4:3. 9307(2) https://doi.org/10.4172/2324
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2019 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Dhupia, B., Usha Rani, M. (2019). Research Challenges in Big Data Solutions in Different Applications. In: Social Network Forensics, Cyber Security, and Machine Learning. SpringerBriefs in Applied Sciences and Technology(). Springer, Singapore. https://doi.org/10.1007/978-981-13-1456-8_9
Download citation
DOI: https://doi.org/10.1007/978-981-13-1456-8_9
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1455-1
Online ISBN: 978-981-13-1456-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)