Advertisement

Criteria to Compare Cloud Computing with Current Database Technology

  • Jean-Daniel Cryans
  • Alain April
  • Alain Abran
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5338)

Abstract

After Google published their first paper on their software infrastruc-ture in October 2003, the open-source community quickly began working on similar free solutions. Yahoo! is now able to process terabytes of data daily using Hadoop, which is a scalable distributed file system and an open-source implementation of Google’s MapReduce. HBase, a distributed database that uses Hadoop, enables the reliable storage of structured data, just like Google’s Bigtable which powers applications like Google Maps and Google Analytics, to name only two. Many companies are tempted to use these technologies, but it is currently difficult to compare today’s systems with systems built on top of HBase. This paper presents this new technology and, a list of proposed comparison elements to existing database technology as well as proposed comparison assessment criteria.

Keywords

Cloud Computing Bigtable HBase Hadoop 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
  2. 2.
    HADOOP.COM. Product page, http://www.hadoop.com
  3. 3.
    HBASE.ORG. Product page, http://www.hbase.org
  4. 4.
    Chang, F., Dean, J., Ghemawat, S., et al.: Bigtable: A Distributed Storage System for Structured Data. In: 7th Symposium on Operating Systems Design and Implementation (OSDI 2006), Seattle, WA, USA, November 6-8, pp. 205–218 (2006)Google Scholar
  5. 5.
    Cordes, K.: YouTube scalability Talk (July 14, 2007), http://kylecordes.com/2007/07/12/youtube-scalability/
  6. 6.
    Ghemawat, S., Gobioff, H., Leung, S.-T.: The Google file system. In: Proc. of the 19th ACM SOSP, December 2003, pp. 29–43 (2003)Google Scholar
  7. 7.
    Dean, J., Ghemawat, S.: MapReduce: Simplified data processing on large clusters. In: Proc. of the 6th OSDI, December 2004, pp. 137–150 (2004)Google Scholar
  8. 8.
    Burrows, M.: The Chubby lock service for loosely coupled distributed systems. In: Proc. of the 7th OSDI (November 2006)Google Scholar
  9. 9.
    YAHOO.COM. Product page, http://research.yahoo.com/node/1849
  10. 10.
    APACHE.ORG. Product page, http://lucene.apache.org/nutch
  11. 11.
    Baldeschwieler, E.: Yahoo! Launches world’s biggest Hadoop production application (February 19, 2008), http://developer.yahoo.com/blogs/hadoop/2008/02/yahoo-worlds-largest-production-hadoop.html
  12. 12.
    Borthakur, D.: The Hadoop Distributed File System: Architecture and Design (May 21, 2008), http://hadoop.apache.org/core/docs/r0.17.0/hdfs_design.html
  13. 13.
    Dean, J., Ghemawat, S.: MapReduce: Simplified data processing on large clusters. Communications of the ACM 51(1) (January 2008)Google Scholar
  14. 14.
    Hood, S.: MapReduce at Rackspace (January 23, 2008), http://blog.racklabs.com/?p=66
  15. 15.
    List of companies using Hadoop (June 6, 2008), http://wiki.apache.org/hadoop/PoweredBy
  16. 16.
    Reed, B.: Zookeeper (March 25, 2008), http://research.yahoo.com/node/2120
  17. 17.
  18. 18.
    Delap, S.: HBase Leads Discuss Hadoop, BigTable and Distributed Databases (April 28, 2008), http://www.infoq.com/news/2008/04/hbase-interview
  19. 19.
    Hoff, T.: How to learn to stop worrying and use lots of disk space to scale (May 21, 2008), http://highscalability.com/how-i-learned-stop-worrying-and-love-using-lot-disk-space-scale
  20. 20.
    FACEBOOK.COM. Product page, http://developers.facebook.com/thrift/
  21. 21.
    HADOOP.CA. Product page, http://www.hadoop.ca
  22. 22.
    Unknown author, Hadoop MapReduce Tutorial (May 21, 2008), http://hadoop.apache.org/core/docs/r0.17.0/mapred_tutorial.html
  23. 23.
    ISO/IEC 9126:1999. Software Engineering – Product quality. Int. Org. for Standardization, ISO 9126 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Jean-Daniel Cryans
    • 1
  • Alain April
    • 1
  • Alain Abran
    • 1
  1. 1.École de Technologie SupérieureMontréalCanada

Personalised recommendations