Advertisement

SQL or NoSQL? Which Is the Best Choice for Storing Big Spatio-Temporal Climate Data?

  • Jie Lian
  • Sheng Miao
  • Michael McGuire
  • Ziying Tang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11158)

Abstract

Management of big spatio-temporal data such as the results from large scale global climate models has long been a challenge because of the sheer vastness of the dataset. Although different data management systems like that incorporate a relational database management system have been proposed and widely used in prior studies, solutions that are particularly designed for big spatio-temporal data management have not been studied well. In this paper, we propose a general data management platform for high-dimensional spatio-temporal datasets like those found in the climate domain, where different database systems can be applied. Through this platform, we compare and evaluate several database systems including SQL database and NoSQL database from various aspects and explore the key impact factors for system performance. Our experimental results indicate advantages and disadvantages of each database system and give insight into the best system to use for big spatio-temporal data applications. Our analysis provides important insights into the understanding of performance of different data management systems, which is very useful for designing high dimensional big data applications.

Keywords

Spatio-temporal database NoSQL Big spatio-temporal data Performance 

References

  1. 1.
  2. 2.
    Apache: Hadoop (2011). http://hadoop.apache.org/
  3. 3.
    MongoDB: Mongodb. http://www.mongodb.org/
  4. 4.
    Cuzzocrea, A., Moussa, R.: A cloud-based framework for supporting effective and efficient OLAP in big data environments. In: IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp. 680–684 (2014)Google Scholar
  5. 5.
    Brezany, P., Yan, Z., Janciak, I., Chen, P., Ye, S.: An elastic OLAP cloud platform. In: IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing, pp. 356–363 (2011)Google Scholar
  6. 6.
    Singh, H., Bawa, S.: A survey of traditional and MapReducebased spatial query processing approaches. ACM SIGMOD Rec. 46(2), 18–29 (2017)CrossRefGoogle Scholar
  7. 7.
    Chiang, G.T., Dove, M.T., Bovolo, C.I., Ewen, J.: Implementing a grid/cloud eScience infrastructure for hydrological sciences. In: Yang, X., Wang, L., Jie, W. (eds.) Guide to e-Science. CCN, pp. 3–28. Springer, London (2011).  https://doi.org/10.1007/978-0-85729-439-5_1CrossRefGoogle Scholar
  8. 8.
    Ameri, P., Grabowski, U., Meyer, J., Streit, A.: On the application and performance of MongoDB for climate satellite data. In: IEEE International Conference on Trust, Security and Privacy in Computing and Communications, pp. 652–659 (2014)Google Scholar
  9. 9.
    Jern, M., Franzen, J.: “GeoAnalytics” - exploring spatio-temporal and multivariate data. In: Tenth International Conference on Information Visualization, pp. 25–31 (2006)Google Scholar
  10. 10.
    Lian, J., Mcguire, M.P., Moore, T.W.: FunnelCloud: a cloud-based system for exploring tornado events. Int. J. Digit. Earth 10, 1–25 (2017)CrossRefGoogle Scholar
  11. 11.
    Baumann, P.: Management of multidimensional discrete data. VLDB J. 3, 401–444 (1994)CrossRefGoogle Scholar
  12. 12.
    Baumann, P., Dehmel, A., Furtado, P., Ritsch, R., Widmann, N.: The multidimensional database system RasDaMan. In: ACM SIGMOD International Conference on Management of Data, pp. 575–577 (1998)CrossRefGoogle Scholar
  13. 13.
    Bimonte, S., Zaamoune, M., Beaune, P.: Conceptual design and implementation of spatial data warehouses integrating regular grids of points. Int. J. Digit. Earth 10, 1–22 (2017)CrossRefGoogle Scholar
  14. 14.
    Tang, W., Feng, W.: Parallel map projection of vector-based big spatial data: coupling cloud computing with graphics processing units. Comput. Environ. Urban Syst. 61(11), 187–197 (2014)Google Scholar
  15. 15.
    Arndt, D.S., et al.: State of the climate in 2011 special supplement to the bulletin of the American meteorological society. Bull. Am. Meteorol. Soc. 93(7), S1–S263 (2012)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Jie Lian
    • 1
  • Sheng Miao
    • 2
  • Michael McGuire
    • 2
  • Ziying Tang
    • 2
  1. 1.Shanghai Normal UniversityShanghaiChina
  2. 2.Towson UniversityTowsonUSA

Personalised recommendations