Skip to main content

Big Data and Blockchain

  • Chapter
  • First Online:
Book cover Fusing Big Data, Blockchain and Cryptocurrency

Abstract

The main interest of this chapter is to present the reader with the idea and benefits of fusing Big Data and Blockchain technology. As the focus of this book is the inclusive fusion of Big Data, Blockchain, and Cryptocurrency, it is important to briefly introduce Big Data first before we delve into its interactions with Blockchain and Cryptocurrency. We begin by summarizing the significance and evolution of Big Data, in order to provide a solid foundational understanding of the same, prior to delving into its infrastructure and Data Mining—the means of analysing Big Data. Thereafter, we move the discussion into the revolutionary impact of Blockchain on FinTech before we consider the opportunities made possible via the fusion of Big Data and Blockchain technology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 64.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Agrawal, R., Imieliński, T., & Swami, A. (1993). Mining Association Rules between sets of items in large databases. In Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, 26–28 May, Washington, DC (pp. 207–216)

    Google Scholar 

  • Agrawal, R., & Srikant, R. (1994). Fast algorithms for mining association rules. In Proceedings of the 20th International Conference on Very Large Data Bases, September 12–15, Santiago de Chile, Chile (pp. 487–499)

    Google Scholar 

  • Alexandre, A. (2019). Report: Bank of China joins new blockchain platform for property buyers. Available at https://cointelegraph.com/news/report-bank-of-china-joins-new-blockchain-platform-for-property-buyers. Accessed 25 July 2019.

    Google Scholar 

  • Allison, I. (2015). The French Bitcoin revolution: BNP Paribas testing crypto on its currency funds. International Business Times.

    Google Scholar 

  • Andoni, M., Robu, V., Flynn, D., Abram, S., Geach, D., Jenkins, D., …Peacock, A. (2019). Blockchain technology in the energy sector: A systematic review of challenges and opportunities. Renewable and Sustainable Energy Reviews, 100, 143–174.

    Article  Google Scholar 

  • Armbrust, M., Fox, A., Griffith, R., Joseph, A. D., Katz, R., Konwinski, A., …Zaharia, M. (2010). A view of cloud computing. Communications of the ACM, 53(4), 50–58.

    Article  Google Scholar 

  • Arner, D. W., Barberis, J., & Buckley, R. P. (2015). The evolution of Fintech: A new post-crisis paradigm. UNSW Law Research Paper No. 2016-62.

    Google Scholar 

  • Asolo, B. (2018). Transaction malleability explained. Available at https://www.mycryptopedia.com/transaction-malleability-explained/. Accessed 25 July 2019.

    Google Scholar 

  • Assuncao, M. D., Calheiros, R. N., Bianchi, S., Netto, M. A., & Buyya, R. (2015). Big Data computing and clouds: Trends and future directions. Journal of Parallel and Distributed Computing, 79, 3–15.

    Article  Google Scholar 

  • Bahga, A., & Madisetti, V. K. (2016). Blockchain platform for industrial internet of things. Journal of Software Engineering and Applications, 9(10), 533.

    Article  Google Scholar 

  • Bank of Canada. (2018, October). Jasper phase 3 – securities settlement using distributed ledger technology.

    Google Scholar 

  • Bank of Canada, Bank of England, & Monetary Authority of Singapore. (2018, November). Cross-border interbank payments and settlements: Emerging opportunities for digital transformation. KPMG.

    Google Scholar 

  • Barontini, C., & Holden, H. (2019). Proceeding with Caution – A Survey on Central Bank Digital Currency. Bank for International Settlements. BIS Papers, no. 101.

    Google Scholar 

  • Beedham, M. (2018). Australian bank used blockchain to ship 17,000 kilos of almonds to Germany. Available at https://thenextweb.com/hardfork/2018/07/30/blockchain-cryptocurrency-banks-tracking/. Accessed 25 July 2019.

    Google Scholar 

  • Boyd, D., & Crawford, K. (2012). Critical questions for Big Data: Provocations for a cultural, technological, and scholarly phenomenon. Information, Communication & Society, 15(5), 662–679.

    Article  Google Scholar 

  • Bui, A. (2018). Big Data as a service: IaaS, PaaS and SaaS. Panoply. Available at https://blog.panoply.io/big-data-as-a-service-iaas-paas-and-saas. Accessed 25 July 2019.

  • Central Bank of Brazil. (2017, August). Distributed ledger technical research in Central Bank of Brazil. Positioning Report.

    Google Scholar 

  • Chan, K., & Liebowitz, J. (2006). The synergy of social network analysis and knowledge mapping: A case study. International Journal of Management and Decision Making, 7(1), 19–35.

    Article  Google Scholar 

  • Chen, C. P., & Zhang, C. Y. (2014). Data-intensive applications, challenges, techniques and technologies: A survey on Big Data. Information Sciences, 275, 314–347.

    Article  Google Scholar 

  • Chen, F., Deng, P., Wan, J., Zhang, D., Vasilakos, A. V., & Rong, X. (2015). Data mining for the internet of things: Literature review and challenges. International Journal of Distributed Sensor Networks, 11(8), 431047.

    Article  Google Scholar 

  • Chen, H., Chiang, R. H., & Storey, V. C. (2012). Business intelligence and analytics: From Big Data to big impact. MIS Quarterly, 36, 1165–1188.

    Article  Google Scholar 

  • Chen, M., Mao, S., & Liu, Y. (2014). Big Data: A survey. Mobile Networks and Applications, 19(2), 171–209.

    Article  Google Scholar 

  • ConsenSys. (2019). A timeline of blockchain development in Australia (So Far). Available at https://media.consensys.net/a-timeline-of-blockchain-development-in-australia-so-far-a6f117a357cd. Accessed 25 July 2019.

  • Cook, J. (2018a). Is the future of finance in blockchain banking? Available at https://urbancrypto.com/is-the-future-of-finance-in-blockchain-banking/. Accessed 26 July 2019.

    Google Scholar 

  • Cook, J. (2018b). More countries moving towards Crypto and ICO legislation – Is this the first step to legitimizing Crypto? Available at https://urbancrypto.com/more-countriesmoving-to-ico-legislate/. Accessed 26 July 2019.

    Google Scholar 

  • Cortes, C., & Vapnik, V. (1995). Support vector networks. Machine Learning, 20(3), 273–297.

    Google Scholar 

  • Das, S. (2016). French Central Bank conducts an “Interbank Blockchain Experiment”. Available at https://www.ccn.com/french-central-bank-conducts-interbank-blockchain-experiment. Accessed 26 July 2019.

    Google Scholar 

  • De Mauro, A., Greco, M., & Grimaldi, M. (2015). What is Big Data? A consensual definition and a review of key research topics. In AIP Conference Proceedings (Vol. 1644, No. 1, pp. 97–104). Melville, NY: AIP.

    Google Scholar 

  • De Mauro, A., Greco, M., & Grimaldi, M. (2016). A formal definition of Big Data based on its essential features. Library Review, 65(3), 122–135.

    Article  Google Scholar 

  • Demchenko, Y., De Laat, C., & Membrey, P. (2014). Defining architecture components of the Big Data Ecosystem. In 2014 International Conference on Collaboration Technologies and Systems (CTS) (pp. 104–112). Piscataway, NJ: IEEE.

    Chapter  Google Scholar 

  • Demirguc-Kunt, A., Klapper, L., Singer, D., Ansar, S., & Hess, J. (2018). The Global Findex Database 2017: Measuring financial inclusion and the fintech revolution. Washington, DC: The World Bank.

    Book  Google Scholar 

  • Deutsche Bundesbank. (2018). Deutsche Bundesbank and Deutsche Borse successfully complete tests for blockchain prototypes. Available at https://www.bundesbank.de/en/press/press-releases/deutsche-bundesbank-and-deutsche-boerse-successfully-complete-tests-for-blockchain-prototypes-764698. Accessed 26 July 2019.

    Google Scholar 

  • DOMO (2018). The data never sleeps 6.0 report by DOMO. Available at https://www.domo.com/learn/data-never-sleeps-6. Accessed 26 July 2019.

    Google Scholar 

  • Draper, N. R., & Smith, H. (2014). Applied regression analysis. New York, NY: Wiley.

    Google Scholar 

  • DTCC. (2017). DTCC selects IBM, AXONI and R3 to develop DTCC’s distributed ledger solution for derivatives processing. Press Releases by DTCC. Available at http://www.dtcc.com/news/2017/january/09/dtcc-selects-ibm-axoni-and-r3-to-develop-dtccs-distributed-ledger-solution. Accessed 26 July 2019.

    Google Scholar 

  • ECCB. (2019). ECCB to issue world’s first blockchain-based digital currency. Available at https://www.eccb-centralbank.org/news/view/eccb-to-issue-worldas-first-blockchain-based-digital-currency. Accessed 26 July 2019.

    Google Scholar 

  • Emani, C. K., Cullot, N., & Nicolle, C. (2015). Understandable Big Data: A survey. Computer Science Review, 17, 70–81.

    Article  Google Scholar 

  • Fan, W., & Bifet, A. (2013). Mining Big Data: Current status, and forecast to the future. ACM sIGKDD Explorations Newsletter, 14(2), 1–5.

    Article  Google Scholar 

  • Fard, A. M., & Ester, M. (2009). Collaborative mining in multiple social networks data for criminal group discovery. In Proceedings of the International Conference on Computational Science and Engineering, 29–31 August, Vancouver, BC (pp. 582–587).

    Google Scholar 

  • Fedak, V. (2018). Blockchain and Big Data: The match made in heavens. Towards Data Science.

    Google Scholar 

  • Gai, K., Qiu, M., & Sun, X. (2018). A survey on FinTech. Journal of Network and Computer Applications, 103, 262–273.

    Article  Google Scholar 

  • Gandomi, A., & Haider, M. (2015). Beyond the hype: Big Data concepts, methods, and analytics. International Journal of Information Management, 35(2), 137–144.

    Article  Google Scholar 

  • Gartner IT Glossary (n.d.). Available at http://www.gartner.com/it-glossary/big-data/. Accessed 27 July 2019.

  • Griggs, K. N., Ossipova, O., Kohlios, C. P., Baccarini, A. N., Howson, E. A., & Hayajneh, T. (2018). Healthcare blockchain system using smart contracts for secure automated remote patient monitoring. Journal of Medical Systems, 42(7), 130.

    Article  Google Scholar 

  • Hashem, I. A. T., Yaqoob, I., Anuar, N. B., Mokhtar, S., Gani, A., & Khan, S. U. (2015). The rise of “Big Data” on cloud computing: Review and open research issues. Information Systems, 47, 98–115.

    Article  Google Scholar 

  • Hassani, H., Gheitanchi, S., & Yeganegi, M. R. (2010). On the application of data mining to official data. Journal of Data Science, 8, 75–89.

    Google Scholar 

  • Hassani, H., Huang, X., & Ghodsi, M. (2018a). Big Data and causality. Annals of Data Science, 5(2), 133–156.

    Article  Google Scholar 

  • Hassani, H., Huang, X., & Silva, E. (2018b). Big-Crypto: Big Data, Blockchain and Cryptocurrency. Big Data and Cognitive Computing, 2(4), 34.

    Article  Google Scholar 

  • Hassani, H., Huang, X., & Silva, E. (2018c). Digitalisation and Big Data mining in banking. Big Data and Cognitive Computing, 2(3), 18.

    Article  Google Scholar 

  • Hassani, H., Huang, X., Silva, E. S., & Ghodsi, M. (2016). A review of data mining applications in crime. Statistical Analysis and Data Mining: The ASA Data Science Journal, 9(3), 139–154.

    Article  Google Scholar 

  • Hassani, H., Saporta, G., & Silva, E. S. (2014). Data mining and official statistics: The past, the present and the future. Big Data, 2(1), 34–43.

    Article  Google Scholar 

  • Hassani, H., & Silva, E. S. (2015). Forecasting with Big Data: A review. Annals of Data Science, 2(1), 5–19.

    Article  Google Scholar 

  • Hilbert, M., & Lopez, P. (2011). The world’s technological capacity to store, communicate, and compute information. Science, 332, 1200970.

    Article  Google Scholar 

  • HKMA. (2018, October). The launch of eTradeConnect and the Collaboration with we.trade. Available at https://www.hkma.gov.hk/eng/key-information/press-releases/2018/20181031-4.shtml. Accessed 25 July 2019.

    Google Scholar 

  • HSBC. (2018). HSBC and ING execute groundbreaking live trade finance transaction on R3’s Corda Blockchain platform. Available at https://www.hsbc.com/news-and-insight/mediaresources/media-releases/2018/hsbc-trade-blockchain-transaction-press-release. Accessed 25 July 2019.

    Google Scholar 

  • Iansiti, M., & Lakhani, K. R. (2017). The truth about blockchain. Harvard Business Review, 95(1), 118–127.

    Google Scholar 

  • Intel (2018). A guide to the Internet of Things Infographic. Available at https://www.intel.com/content/www/us/en/internet-of-things/infographics/guide-to-iot.html. Accessed 27 July 2019.

  • Iskandar, K. (2017). What will blockchain mean for banks? Available via https://www.bookingbug.com/blog/what-blockchain-will-mean-for-banks/. Accessed 12 April 2019.

  • Jin, X., Wah, B. W., Cheng, X., & Wang, Y. (2015). Significance and challenges of Big Data research. Big Data Research, 2(2), 59–64.

    Article  Google Scholar 

  • Keller, F. (2018). Blockchain-based Batavia platform set to rewire global trade finance. Available at https://www.ibm.com/blogs/blockchain/2018/04/blockchain-based-bataviaplatform-set-to-rewire-global-trade-finance/. Accessed 25 July 2019.

    Google Scholar 

  • Kotsiantis, S. B., Zaharakis, I., & Pintelas, P. (2007). Supervised machine learning: A review of classification techniques. Emerging Artificial Intelligence Applications in Computer Engineering, 160, 3–24.

    Google Scholar 

  • KPMG. (2019, February). The Pulse of Fintech 2018: Biannual global analysis of investment in fintech.

    Google Scholar 

  • Landset, S., Khoshgoftaar, T. M., Richter, A. N., & Hasanin, T. (2015). A survey of open source tools for machine learning with Big Data in the Hadoop ecosystem. Journal of Big Data, 2(1), 24.

    Article  Google Scholar 

  • Langley, P., Iba, W., & Thompson, K. (1992). An analysis of Bayesian classifiers. In Proceedings of the 10th National Conference on Artificial Intelligence, 12–16 July, San Jose, California (pp. 223–228).

    Google Scholar 

  • Leighton, R. (2018). Banking on blockchain: The innovations that have emerged from financial terms. Available at https://www.coininsider.com/banks-using-blockchain-technology/. Accessed 26 July 2019.

    Google Scholar 

  • Li, X., Jiang, P., Chen, T., Luo, X., & Wen, Q. (2017). A survey on the security of blockchain systems. Future Generation Computer Systems. Available at https://doi.org/10.1016/j.future.2017.08.020. Accessed 25 April 2019.

  • Linoff, G. S., & Berry, M. J. (2011). Data mining techniques: For marketing, sales, and customer relationship management. Indianapolis, IN: Wiley.

    Google Scholar 

  • Larose, D. T., & Larose, C. D. (2014). Discovering knowledge in data: An introduction to data mining. Hoboken, NJ: Wiley.

    Google Scholar 

  • Maayan, G. D. (2018). Big Data as a service solutions: Comparing Iaas, PaaS and Saas. Packt. Available at https://hub.packtpub.com/big-data-as-a-service-bdaas-solutions-comparing-iaas-paas-and-saas/. Accessed 18 April 2019.

  • MArr, B. (2018). How much data do we create every day? The mind-blowing stats everyone should read. Available at https://www.forbes.com/sites/bernardmarr/2018/05/21/. Accessed 25 July 2019.

    Google Scholar 

  • McAfee, A., Brynjolfsson, E., Davenport, T. H., Patil, D. J., & Barton, D. (2012). Big Data: The management revolution. Harvard Business Review, 90(10), 60–68.

    Google Scholar 

  • Mena, J. (2003). Investigative data mining for security and criminal detection. Oxford: Butterworth-Heinemann.

    Google Scholar 

  • Monetary Authority of Singapore. (2017, November). Project Ubin phase 2 – Re-imagining interbank real-time gross settlement system using distributed ledger technologies.

    Google Scholar 

  • Narayanan, A., Bonneau, J., Felten, E., Miller, A., & Goldfeder, S. (2016). Bitcoin and cryptocurrency technologies: A comprehensive introduction. Princeton, NJ: Princeton University Press.

    Google Scholar 

  • Ngai, E. W., Xiu, L., & Chau, D. C. (2009). Application of data mining techniques in customer relationship management: A literature review and classification. Expert Systems with Applications, 36(2), 2592–2602.

    Article  Google Scholar 

  • Oussous, A., Benjelloun, F. Z., Lahcen, A. A., & Belfkih, S. (2018). Big Data technologies: A survey. Journal of King Saud University-Computer and Information Sciences, 30(4), 431–448.

    Article  Google Scholar 

  • Pang-Ning, T., Steinbach, M., & Kumar, V. (2014). Introduction to data mining (1st ed.). London, UK: Pearson.

    Google Scholar 

  • Peyton, A. (2019, January). China Banking Association pushes trade finance on blockchain. Fintech Futures. Available at https://www.bankingtech.com/2019/01/china-banking-association-pushes-trade-finance-on-blockchain/. Accessed 26 July 2019.

  • Philippon, T. (2016). The fintech opportunity (No. w22476). Cambridge, MA: National Bureau of Economic Research.

    Book  Google Scholar 

  • Provost, F., & Fawcett, T. (2013). Data science and its relationship to Big Data and data-driven decision making. Big Data, 1(1), 51–59.

    Article  Google Scholar 

  • Quinlan, J. R. (1986). Induction of decision trees. Machine Learning, 1(1), 81–106.

    Google Scholar 

  • Richard, M. D., & Lippmann, R. P. (1991). Neural network classifiers estimate Bayesian a posteriori probabilities. Neural Computation, 3(4), 461–483.

    Article  Google Scholar 

  • Riksbank. (2018, October). E-krona project, report 2. Available at https://www.riksbank.se/en-gb/payments--cash/e-krona/e-krona-reports/e-krona-project-report-2/. Accessed 26 July 2019.

  • Rud, D. (2018). One of the world’s largest banks issued $300k loan using blockchain. Available at https://www.coininsider.com/banks-using-blockchain-technology/. Accessed 25 July 2019.

    Google Scholar 

  • SAMA. (2019). A statement on launching “Aber” project, the common digital currency between Saudi Arabian Monetary Authority (SAMA) and United Arab Emirates Central Bank (UAECB). Available at http://www.sama.gov.sa/en-US/News/Pages/news29012019.aspx. Accessed 26 July 2019.

    Google Scholar 

  • Shi, Y. (2014). Big Data: History, current status, and challenges going forward. Bridge, 44(4), 6–11.

    Google Scholar 

  • Smith, B. (2018). National Bank of Dubai embraces blockchain for check-issuance systems. Available at https://www.coininsider.com/national-bank-of-dubai-blockchain/. Accessed 25 July 2019.

    Google Scholar 

  • South African Reserve Bank. (2018, June). Project Khokha – Exploring the use of distributed ledger technology for interbank payments settlement in South Africa. Fintech Report.

    Google Scholar 

  • Sparrow, M. K. (1991). The application of network analysis to criminal intelligence: An assessment of the prospects. Social Networks, 13(3), 251–274.

    Article  Google Scholar 

  • Sutherland, B. R. (2019). Blockchain’s first consensus implementation is unsustainable. Joule, 3(4), 917–919.

    Article  Google Scholar 

  • Telikani, A., & Shahbahrami, A. (2018). Data sanitization in association rule mining: An analytical review. Expert Systems with Applications, 96, 406–426.

    Article  Google Scholar 

  • Van Vlasselaer, V., Bravo, C., Caelen, O., Eliassi-Rad, T., Akoglu, L., Snoeck, M., & Baesens, B. (2015). APATE: A novel approach for automated credit card transaction fraud detection using network-based extensions. Decision Support Systems, 75, 38–48.

    Article  Google Scholar 

  • Varian, H. R. (2014). Big Data: New tricks for econometrics. Journal of Economic Perspectives, 28(2), 3–28.

    Article  Google Scholar 

  • Vranken, H. (2017). Sustainability of Bitcoin and blockchains. Current Opinion in Environmental Sustainability, 28, 1–9.

    Article  Google Scholar 

  • Wang, M., Jayaraman, P. P., Solaiman, E., Chen, L. Y., Li, Z., Jun, S., …Ranjan, R. (2018). A multi-layered performance analysis for cloud-based topic detection and tracking in Big Data applications. Future Generation Computer Systems, 87, 580–590.

    Article  Google Scholar 

  • Wasserman, S., & Faust, K. (1995). Social Network Analysis methods and applications. Cambridge, MA: Cambridge University Press.

    Google Scholar 

  • Williamson, C. (2018). Australia’s biggest stock exchange targets blockchain integration in 2020. Available at https://www.ccn.com/the-australian-securities-exchange-is-replacing-chess-with-distributed-ledger-technology. Accessed 25 July 2019.

  • Witten, I. H., Frank, E., Hall, M. A., & Pal, C. J. (2016). Data Mining: Practical machine learning tools and techniques. Burlington, VT: Morgan Kaufmann.

    Google Scholar 

  • World Economic Forum. (2019). Central banks and distributed ledger technology: How are central banks exploring blockchain today? White Paper. 2019 World Economic Forum.

    Google Scholar 

  • Wu, X., Kumar, V., Quinlan, J. R., Ghosh, J., Yang, Q., Motoda, H., …Zhou, Z. H. (2008). Top 10 algorithms in data mining. Knowledge and Information Systems, 14(1), 1–37.

    Article  Google Scholar 

  • Wu, X., Zhu, X., Wu, G. Q., & Ding, W. (2014). Data mining with Big Data. IEEE Transactions on Knowledge and Data Engineering, 26(1), 97–107.

    Article  Google Scholar 

  • Yue, X., Wang, H., Jin, D., Li, M., & Jiang, W. (2016). Healthcare data gateways: Found healthcare intelligence on blockchain with novel privacy risk control. Journal of Medical Systems, 40(10), 218.

    Article  Google Scholar 

  • Zhang, H. (2004). The optimality of naive Bayes. In Proceedings of the 17th International Florida Artificial Intelligence Research Society Conference, 12–14 May, Miami Beach, Florida (pp. 562–567).

    Google Scholar 

  • Zhang, Q., Cheng, L., & Boutaba, R. (2010). Cloud computing: State-of-the-art and research challenges. Journal of Internet Services and Applications, 1(1), 7–18.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hossein Hassani .

Rights and permissions

Reprints and permissions

Copyright information

© 2019 The Author(s)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hassani, H., Huang, X., Silva, E.S. (2019). Big Data and Blockchain. In: Fusing Big Data, Blockchain and Cryptocurrency. Palgrave Pivot, Cham. https://doi.org/10.1007/978-3-030-31391-3_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-31391-3_2

  • Published:

  • Publisher Name: Palgrave Pivot, Cham

  • Print ISBN: 978-3-030-31390-6

  • Online ISBN: 978-3-030-31391-3

  • eBook Packages: Economics and FinanceEconomics and Finance (R0)

Publish with us

Policies and ethics