Advertisement

Traps in Multisource Heterogeneous Big Data Processing

Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 849)

Abstract

The importance of big data values and application efforts has reached a universal consensus in most fields. While because of the model difference of data storage, computing and analysis, the big data processing performance and big data values show greatly uneven in different scenarios. In this paper, we analyze the traps which may greatly impact big data processing results, and give our suggestions to solve these problems for the multisource and heterogeneous characteristics of big data.

Keywords

Fault tolerance Data credibility Data fusion 

References

  1. 1.
    Lazer, D., Kennedy, R., King, G., Vespignani, A.: The parable of Google flu: Traps in big data analysis. Science 343, 1203–1205 (2014)CrossRefGoogle Scholar
  2. 2.
    Storey, V.C., Song, I.I.-Y.: Big data technologies and management: what conceptual modeling can do. Data Knowl. Eng. 108, 50–67 (2017)CrossRefGoogle Scholar
  3. 3.
    Kwon, O., Lee, N., Shin, B.: Data quality management, data usage experience and acquisition intention of big data analytics. Int. J. Inf. Manage. 34, 387–394 (2014)CrossRefGoogle Scholar
  4. 4.
    Basanta-Val, Pablo: An efficient industrial big-data engine. IEEE Trans. Ind. Inf. 14, 1361–1369 (2017)CrossRefGoogle Scholar
  5. 5.
    Rui, H., Lizy, K., Jianfeng, Z.: Benchmarking big data systems: A review. IEEE Trans. Serv. Comput. 11(3), 1–17 (2017)Google Scholar
  6. 6.
    Xing, E.P., Qirong, Ho, Wei, Dai, Kru, Kim Jin, Jinliang, Wei, Seunghak, Lee, et al.: Petuum: A new platform for distributed machine learning on big data. IEEE Trans. Big Data 1(2), 49–67 (2015)CrossRefGoogle Scholar
  7. 7.
    Aishwarya G., Ramnatthan A., et al.: Redundancy does not imply fault tolerance: analysis of distributed storage reactions to single errors and corruptions. In: Proceedings of 15th USENIX Conference on File and Storage Technologies, pp. 149–165 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Taikang Insurance GroupBeijingChina

Personalised recommendations