Abstract
The main interest of this chapter is to present the reader with the idea and benefits of fusing Big Data and Blockchain technology. As the focus of this book is the inclusive fusion of Big Data, Blockchain, and Cryptocurrency, it is important to briefly introduce Big Data first before we delve into its interactions with Blockchain and Cryptocurrency. We begin by summarizing the significance and evolution of Big Data, in order to provide a solid foundational understanding of the same, prior to delving into its infrastructure and Data Mining—the means of analysing Big Data. Thereafter, we move the discussion into the revolutionary impact of Blockchain on FinTech before we consider the opportunities made possible via the fusion of Big Data and Blockchain technology.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Agrawal, R., Imieliński, T., & Swami, A. (1993). Mining Association Rules between sets of items in large databases. In Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, 26–28 May, Washington, DC (pp. 207–216)
Agrawal, R., & Srikant, R. (1994). Fast algorithms for mining association rules. In Proceedings of the 20th International Conference on Very Large Data Bases, September 12–15, Santiago de Chile, Chile (pp. 487–499)
Alexandre, A. (2019). Report: Bank of China joins new blockchain platform for property buyers. Available at https://cointelegraph.com/news/report-bank-of-china-joins-new-blockchain-platform-for-property-buyers. Accessed 25 July 2019.
Allison, I. (2015). The French Bitcoin revolution: BNP Paribas testing crypto on its currency funds. International Business Times.
Andoni, M., Robu, V., Flynn, D., Abram, S., Geach, D., Jenkins, D., …Peacock, A. (2019). Blockchain technology in the energy sector: A systematic review of challenges and opportunities. Renewable and Sustainable Energy Reviews, 100, 143–174.
Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R., Konwinski, A., …Zaharia, M. (2010). A view of cloud computing. Communications of the ACM, 53(4), 50–58.
Arner, D. W., Barberis, J., & Buckley, R. P. (2015). The evolution of Fintech: A new post-crisis paradigm. UNSW Law Research Paper No. 2016-62.
Asolo, B. (2018). Transaction malleability explained. Available at https://www.mycryptopedia.com/transaction-malleability-explained/. Accessed 25 July 2019.
Assuncao, M. D., Calheiros, R. N., Bianchi, S., Netto, M. A., & Buyya, R. (2015). Big Data computing and clouds: Trends and future directions. Journal of Parallel and Distributed Computing, 79, 3–15.
Bahga, A., & Madisetti, V. K. (2016). Blockchain platform for industrial internet of things. Journal of Software Engineering and Applications, 9(10), 533.
Bank of Canada. (2018, October). Jasper phase 3 – securities settlement using distributed ledger technology.
Bank of Canada, Bank of England, & Monetary Authority of Singapore. (2018, November). Cross-border interbank payments and settlements: Emerging opportunities for digital transformation. KPMG.
Barontini, C., & Holden, H. (2019). Proceeding with Caution – A Survey on Central Bank Digital Currency. Bank for International Settlements. BIS Papers, no. 101.
Beedham, M. (2018). Australian bank used blockchain to ship 17,000 kilos of almonds to Germany. Available at https://thenextweb.com/hardfork/2018/07/30/blockchain-cryptocurrency-banks-tracking/. Accessed 25 July 2019.
Boyd, D., & Crawford, K. (2012). Critical questions for Big Data: Provocations for a cultural, technological, and scholarly phenomenon. Information, Communication & Society, 15(5), 662–679.
Bui, A. (2018). Big Data as a service: IaaS, PaaS and SaaS. Panoply. Available at https://blog.panoply.io/big-data-as-a-service-iaas-paas-and-saas. Accessed 25 July 2019.
Central Bank of Brazil. (2017, August). Distributed ledger technical research in Central Bank of Brazil. Positioning Report.
Chan, K., & Liebowitz, J. (2006). The synergy of social network analysis and knowledge mapping: A case study. International Journal of Management and Decision Making, 7(1), 19–35.
Chen, C. P., & Zhang, C. Y. (2014). Data-intensive applications, challenges, techniques and technologies: A survey on Big Data. Information Sciences, 275, 314–347.
Chen, F., Deng, P., Wan, J., Zhang, D., Vasilakos, A. V., & Rong, X. (2015). Data mining for the internet of things: Literature review and challenges. International Journal of Distributed Sensor Networks, 11(8), 431047.
Chen, H., Chiang, R. H., & Storey, V. C. (2012). Business intelligence and analytics: From Big Data to big impact. MIS Quarterly, 36, 1165–1188.
Chen, M., Mao, S., & Liu, Y. (2014). Big Data: A survey. Mobile Networks and Applications, 19(2), 171–209.
ConsenSys. (2019). A timeline of blockchain development in Australia (So Far). Available at https://media.consensys.net/a-timeline-of-blockchain-development-in-australia-so-far-a6f117a357cd. Accessed 25 July 2019.
Cook, J. (2018a). Is the future of finance in blockchain banking? Available at https://urbancrypto.com/is-the-future-of-finance-in-blockchain-banking/. Accessed 26 July 2019.
Cook, J. (2018b). More countries moving towards Crypto and ICO legislation – Is this the first step to legitimizing Crypto? Available at https://urbancrypto.com/more-countriesmoving-to-ico-legislate/. Accessed 26 July 2019.
Cortes, C., & Vapnik, V. (1995). Support vector networks. Machine Learning, 20(3), 273–297.
Das, S. (2016). French Central Bank conducts an “Interbank Blockchain Experiment”. Available at https://www.ccn.com/french-central-bank-conducts-interbank-blockchain-experiment. Accessed 26 July 2019.
De Mauro, A., Greco, M., & Grimaldi, M. (2015). What is Big Data? A consensual definition and a review of key research topics. In AIP Conference Proceedings (Vol. 1644, No. 1, pp. 97–104). Melville, NY: AIP.
De Mauro, A., Greco, M., & Grimaldi, M. (2016). A formal definition of Big Data based on its essential features. Library Review, 65(3), 122–135.
Demchenko, Y., De Laat, C., & Membrey, P. (2014). Defining architecture components of the Big Data Ecosystem. In 2014 International Conference on Collaboration Technologies and Systems (CTS) (pp. 104–112). Piscataway, NJ: IEEE.
Demirguc-Kunt, A., Klapper, L., Singer, D., Ansar, S., & Hess, J. (2018). The Global Findex Database 2017: Measuring financial inclusion and the fintech revolution. Washington, DC: The World Bank.
Deutsche Bundesbank. (2018). Deutsche Bundesbank and Deutsche Borse successfully complete tests for blockchain prototypes. Available at https://www.bundesbank.de/en/press/press-releases/deutsche-bundesbank-and-deutsche-boerse-successfully-complete-tests-for-blockchain-prototypes-764698. Accessed 26 July 2019.
DOMO (2018). The data never sleeps 6.0 report by DOMO. Available at https://www.domo.com/learn/data-never-sleeps-6. Accessed 26 July 2019.
Draper, N. R., & Smith, H. (2014). Applied regression analysis. New York, NY: Wiley.
DTCC. (2017). DTCC selects IBM, AXONI and R3 to develop DTCC’s distributed ledger solution for derivatives processing. Press Releases by DTCC. Available at http://www.dtcc.com/news/2017/january/09/dtcc-selects-ibm-axoni-and-r3-to-develop-dtccs-distributed-ledger-solution. Accessed 26 July 2019.
ECCB. (2019). ECCB to issue world’s first blockchain-based digital currency. Available at https://www.eccb-centralbank.org/news/view/eccb-to-issue-worldas-first-blockchain-based-digital-currency. Accessed 26 July 2019.
Emani, C. K., Cullot, N., & Nicolle, C. (2015). Understandable Big Data: A survey. Computer Science Review, 17, 70–81.
Fan, W., & Bifet, A. (2013). Mining Big Data: Current status, and forecast to the future. ACM sIGKDD Explorations Newsletter, 14(2), 1–5.
Fard, A. M., & Ester, M. (2009). Collaborative mining in multiple social networks data for criminal group discovery. In Proceedings of the International Conference on Computational Science and Engineering, 29–31 August, Vancouver, BC (pp. 582–587).
Fedak, V. (2018). Blockchain and Big Data: The match made in heavens. Towards Data Science.
Gai, K., Qiu, M., & Sun, X. (2018). A survey on FinTech. Journal of Network and Computer Applications, 103, 262–273.
Gandomi, A., & Haider, M. (2015). Beyond the hype: Big Data concepts, methods, and analytics. International Journal of Information Management, 35(2), 137–144.
Gartner IT Glossary (n.d.). Available at http://www.gartner.com/it-glossary/big-data/. Accessed 27 July 2019.
Griggs, K. N., Ossipova, O., Kohlios, C. P., Baccarini, A. N., Howson, E. A., & Hayajneh, T. (2018). Healthcare blockchain system using smart contracts for secure automated remote patient monitoring. Journal of Medical Systems, 42(7), 130.
Hashem, I. A. T., Yaqoob, I., Anuar, N. B., Mokhtar, S., Gani, A., & Khan, S. U. (2015). The rise of “Big Data” on cloud computing: Review and open research issues. Information Systems, 47, 98–115.
Hassani, H., Gheitanchi, S., & Yeganegi, M. R. (2010). On the application of data mining to official data. Journal of Data Science, 8, 75–89.
Hassani, H., Huang, X., & Ghodsi, M. (2018a). Big Data and causality. Annals of Data Science, 5(2), 133–156.
Hassani, H., Huang, X., & Silva, E. (2018b). Big-Crypto: Big Data, Blockchain and Cryptocurrency. Big Data and Cognitive Computing, 2(4), 34.
Hassani, H., Huang, X., & Silva, E. (2018c). Digitalisation and Big Data mining in banking. Big Data and Cognitive Computing, 2(3), 18.
Hassani, H., Huang, X., Silva, E. S., & Ghodsi, M. (2016). A review of data mining applications in crime. Statistical Analysis and Data Mining: The ASA Data Science Journal, 9(3), 139–154.
Hassani, H., Saporta, G., & Silva, E. S. (2014). Data mining and official statistics: The past, the present and the future. Big Data, 2(1), 34–43.
Hassani, H., & Silva, E. S. (2015). Forecasting with Big Data: A review. Annals of Data Science, 2(1), 5–19.
Hilbert, M., & Lopez, P. (2011). The world’s technological capacity to store, communicate, and compute information. Science, 332, 1200970.
HKMA. (2018, October). The launch of eTradeConnect and the Collaboration with we.trade. Available at https://www.hkma.gov.hk/eng/key-information/press-releases/2018/20181031-4.shtml. Accessed 25 July 2019.
HSBC. (2018). HSBC and ING execute groundbreaking live trade finance transaction on R3’s Corda Blockchain platform. Available at https://www.hsbc.com/news-and-insight/mediaresources/media-releases/2018/hsbc-trade-blockchain-transaction-press-release. Accessed 25 July 2019.
Iansiti, M., & Lakhani, K. R. (2017). The truth about blockchain. Harvard Business Review, 95(1), 118–127.
Intel (2018). A guide to the Internet of Things Infographic. Available at https://www.intel.com/content/www/us/en/internet-of-things/infographics/guide-to-iot.html. Accessed 27 July 2019.
Iskandar, K. (2017). What will blockchain mean for banks? Available via https://www.bookingbug.com/blog/what-blockchain-will-mean-for-banks/. Accessed 12 April 2019.
Jin, X., Wah, B. W., Cheng, X., & Wang, Y. (2015). Significance and challenges of Big Data research. Big Data Research, 2(2), 59–64.
Keller, F. (2018). Blockchain-based Batavia platform set to rewire global trade finance. Available at https://www.ibm.com/blogs/blockchain/2018/04/blockchain-based-bataviaplatform-set-to-rewire-global-trade-finance/. Accessed 25 July 2019.
Kotsiantis, S. B., Zaharakis, I., & Pintelas, P. (2007). Supervised machine learning: A review of classification techniques. Emerging Artificial Intelligence Applications in Computer Engineering, 160, 3–24.
KPMG. (2019, February). The Pulse of Fintech 2018: Biannual global analysis of investment in fintech.
Landset, S., Khoshgoftaar, T. M., Richter, A. N., & Hasanin, T. (2015). A survey of open source tools for machine learning with Big Data in the Hadoop ecosystem. Journal of Big Data, 2(1), 24.
Langley, P., Iba, W., & Thompson, K. (1992). An analysis of Bayesian classifiers. In Proceedings of the 10th National Conference on Artificial Intelligence, 12–16 July, San Jose, California (pp. 223–228).
Leighton, R. (2018). Banking on blockchain: The innovations that have emerged from financial terms. Available at https://www.coininsider.com/banks-using-blockchain-technology/. Accessed 26 July 2019.
Li, X., Jiang, P., Chen, T., Luo, X., & Wen, Q. (2017). A survey on the security of blockchain systems. Future Generation Computer Systems. Available at https://doi.org/10.1016/j.future.2017.08.020. Accessed 25 April 2019.
Linoff, G. S., & Berry, M. J. (2011). Data mining techniques: For marketing, sales, and customer relationship management. Indianapolis, IN: Wiley.
Larose, D. T., & Larose, C. D. (2014). Discovering knowledge in data: An introduction to data mining. Hoboken, NJ: Wiley.
Maayan, G. D. (2018). Big Data as a service solutions: Comparing Iaas, PaaS and Saas. Packt. Available at https://hub.packtpub.com/big-data-as-a-service-bdaas-solutions-comparing-iaas-paas-and-saas/. Accessed 18 April 2019.
MArr, B. (2018). How much data do we create every day? The mind-blowing stats everyone should read. Available at https://www.forbes.com/sites/bernardmarr/2018/05/21/. Accessed 25 July 2019.
McAfee, A., Brynjolfsson, E., Davenport, T. H., Patil, D. J., & Barton, D. (2012). Big Data: The management revolution. Harvard Business Review, 90(10), 60–68.
Mena, J. (2003). Investigative data mining for security and criminal detection. Oxford: Butterworth-Heinemann.
Monetary Authority of Singapore. (2017, November). Project Ubin phase 2 – Re-imagining interbank real-time gross settlement system using distributed ledger technologies.
Narayanan, A., Bonneau, J., Felten, E., Miller, A., & Goldfeder, S. (2016). Bitcoin and cryptocurrency technologies: A comprehensive introduction. Princeton, NJ: Princeton University Press.
Ngai, E. W., Xiu, L., & Chau, D. C. (2009). Application of data mining techniques in customer relationship management: A literature review and classification. Expert Systems with Applications, 36(2), 2592–2602.
Oussous, A., Benjelloun, F. Z., Lahcen, A. A., & Belfkih, S. (2018). Big Data technologies: A survey. Journal of King Saud University-Computer and Information Sciences, 30(4), 431–448.
Pang-Ning, T., Steinbach, M., & Kumar, V. (2014). Introduction to data mining (1st ed.). London, UK: Pearson.
Peyton, A. (2019, January). China Banking Association pushes trade finance on blockchain. Fintech Futures. Available at https://www.bankingtech.com/2019/01/china-banking-association-pushes-trade-finance-on-blockchain/. Accessed 26 July 2019.
Philippon, T. (2016). The fintech opportunity (No. w22476). Cambridge, MA: National Bureau of Economic Research.
Provost, F., & Fawcett, T. (2013). Data science and its relationship to Big Data and data-driven decision making. Big Data, 1(1), 51–59.
Quinlan, J. R. (1986). Induction of decision trees. Machine Learning, 1(1), 81–106.
Richard, M. D., & Lippmann, R. P. (1991). Neural network classifiers estimate Bayesian a posteriori probabilities. Neural Computation, 3(4), 461–483.
Riksbank. (2018, October). E-krona project, report 2. Available at https://www.riksbank.se/en-gb/payments--cash/e-krona/e-krona-reports/e-krona-project-report-2/. Accessed 26 July 2019.
Rud, D. (2018). One of the world’s largest banks issued $300k loan using blockchain. Available at https://www.coininsider.com/banks-using-blockchain-technology/. Accessed 25 July 2019.
SAMA. (2019). A statement on launching “Aber” project, the common digital currency between Saudi Arabian Monetary Authority (SAMA) and United Arab Emirates Central Bank (UAECB). Available at http://www.sama.gov.sa/en-US/News/Pages/news29012019.aspx. Accessed 26 July 2019.
Shi, Y. (2014). Big Data: History, current status, and challenges going forward. Bridge, 44(4), 6–11.
Smith, B. (2018). National Bank of Dubai embraces blockchain for check-issuance systems. Available at https://www.coininsider.com/national-bank-of-dubai-blockchain/. Accessed 25 July 2019.
South African Reserve Bank. (2018, June). Project Khokha – Exploring the use of distributed ledger technology for interbank payments settlement in South Africa. Fintech Report.
Sparrow, M. K. (1991). The application of network analysis to criminal intelligence: An assessment of the prospects. Social Networks, 13(3), 251–274.
Sutherland, B. R. (2019). Blockchain’s first consensus implementation is unsustainable. Joule, 3(4), 917–919.
Telikani, A., & Shahbahrami, A. (2018). Data sanitization in association rule mining: An analytical review. Expert Systems with Applications, 96, 406–426.
Van Vlasselaer, V., Bravo, C., Caelen, O., Eliassi-Rad, T., Akoglu, L., Snoeck, M., & Baesens, B. (2015). APATE: A novel approach for automated credit card transaction fraud detection using network-based extensions. Decision Support Systems, 75, 38–48.
Varian, H. R. (2014). Big Data: New tricks for econometrics. Journal of Economic Perspectives, 28(2), 3–28.
Vranken, H. (2017). Sustainability of Bitcoin and blockchains. Current Opinion in Environmental Sustainability, 28, 1–9.
Wang, M., Jayaraman, P. P., Solaiman, E., Chen, L. Y., Li, Z., Jun, S., …Ranjan, R. (2018). A multi-layered performance analysis for cloud-based topic detection and tracking in Big Data applications. Future Generation Computer Systems, 87, 580–590.
Wasserman, S., & Faust, K. (1995). Social Network Analysis methods and applications. Cambridge, MA: Cambridge University Press.
Williamson, C. (2018). Australia’s biggest stock exchange targets blockchain integration in 2020. Available at https://www.ccn.com/the-australian-securities-exchange-is-replacing-chess-with-distributed-ledger-technology. Accessed 25 July 2019.
Witten, I. H., Frank, E., Hall, M. A., & Pal, C. J. (2016). Data Mining: Practical machine learning tools and techniques. Burlington, VT: Morgan Kaufmann.
World Economic Forum. (2019). Central banks and distributed ledger technology: How are central banks exploring blockchain today? White Paper. 2019 World Economic Forum.
Wu, X., Kumar, V., Quinlan, J. R., Ghosh, J., Yang, Q., Motoda, H., …Zhou, Z. H. (2008). Top 10 algorithms in data mining. Knowledge and Information Systems, 14(1), 1–37.
Wu, X., Zhu, X., Wu, G. Q., & Ding, W. (2014). Data mining with Big Data. IEEE Transactions on Knowledge and Data Engineering, 26(1), 97–107.
Yue, X., Wang, H., Jin, D., Li, M., & Jiang, W. (2016). Healthcare data gateways: Found healthcare intelligence on blockchain with novel privacy risk control. Journal of Medical Systems, 40(10), 218.
Zhang, H. (2004). The optimality of naive Bayes. In Proceedings of the 17th International Florida Artificial Intelligence Research Society Conference, 12–14 May, Miami Beach, Florida (pp. 562–567).
Zhang, Q., Cheng, L., & Boutaba, R. (2010). Cloud computing: State-of-the-art and research challenges. Journal of Internet Services and Applications, 1(1), 7–18.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2019 The Author(s)
About this chapter
Cite this chapter
Hassani, H., Huang, X., Silva, E.S. (2019). Big Data and Blockchain. In: Fusing Big Data, Blockchain and Cryptocurrency. Palgrave Pivot, Cham. https://doi.org/10.1007/978-3-030-31391-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-31391-3_2
Published:
Publisher Name: Palgrave Pivot, Cham
Print ISBN: 978-3-030-31390-6
Online ISBN: 978-3-030-31391-3
eBook Packages: Economics and FinanceEconomics and Finance (R0)