Skip to main content
SpringerLink
Log in

Rethinking DRAM Caching for LSMs in an NVRAM Environment

  • Conference paper
  • First Online:
Advances in Databases and Information Systems (ADBIS 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10509))

Included in the following conference series:

Abstract

The rise of NVRAM technologies promises to change the way we think about system architectures. In order to fully exploit its advantages, it is required to develop systems specially tailored for NVRAM devices. Not only this imposes great challenges, but also developing full system architectures from scratch is undesirable in many scenarios due to prohibitive development costs. Instead, we analyze in this paper the behavior of an existing log-structured persistent key-value store, namely LevelDB, when run on top of an emulated NVRAM device. We investigate initial opportunities for improvement when adapting a system tailored for HDD/SSDs to run on top of an NVRAM environment. Furthermore, we analyze the behavior of the DRAM caching components of LevelDB and whether more suitable caching policies are required.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Apache Cassandra. http://cassandra.apache.org/. Accessed 17 Feb 2017

  2. Apache HBase. https://hbase.apache.org/. Accessed 17 Feb 2017

  3. Direct Access for files. https://www.kernel.org/doc/Documentation/filesystems/dax.txt. Accessed 17 Feb 2017

  4. LevelDB. http://leveldb.org/. Accessed 17 Feb 2017

  5. NVML. http://pmem.io/nvml/libpmem/. Accessed 17 Feb 2017

  6. Riak. http://basho.com/products/riak-kv/. Accessed 17 Feb 2017

  7. RocksDB. http://rocksdb.org/. Accessed 17 Feb 2017

  8. Bonnet, P.: What’s up with the storage hierarchy? In: 8th Biennial Conference on Innovative Data Systems Research, CIDR 2017 (Online Proceedings) (2017)

    Google Scholar 

  9. Chang, F., Dean, J., Ghemawat, S., Hsieh, W.C., Wallach, D.A., Burrows, M., Chandra, T., Fikes, A., Gruber, R.E.: Bigtable: a distributed storage system for structured data. In: Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation (2006)

    Google Scholar 

  10. Dulloor, S., Kumar, S., Keshavamurthy, A., Lantz, P., Reddy, D., Sankaran, R., Jackson, J.: System software for persistent memory. In: Eurosys Conference (2014)

    Google Scholar 

  11. Dulloor, S.R.: Systems and Applications for Persistent Memory. Ph.D. Thesis (2015). https://smartech.gatech.edu/bitstream/handle/1853/54396/DULLOOR-DISSERTATION-2015.pdf

  12. Johnson, T., Shasha, D.E.: 2Q: a low overhead high performance buffer management replacement algorithm. In: PVLDB (1994)

    Google Scholar 

  13. Li, J., Pavlo, A., Dong, S.: NVMRocks: RocksDB on non-volatile memory systems. http://istc-bigdata.org/index.php/nvmrocks-rocksdb-on-non-volatile-memory-systems. Accessed 17 Feb 2017

  14. O’Neil, P.E., Cheng, E., Gawlick, D., O’Neil, E.J.: The log-structured merge-tree (LSM-Tree). Acta Inf. 33, 351–385 (1996)

    Article  MATH  Google Scholar 

  15. Oukid, I., Booss, D., Lehner, W., Bumbulis, P., Willhalm, T.: SOFORT: a hybrid SCM-DRAM storage engine for fast data recovery. In: International Workshop on Data Management on New Hardware (2014)

    Google Scholar 

  16. Pelley, S., Wenisch, T.F., Gold, B.T., Bridge, B.: Storage management in the NVRAM era. In: PVLDB (2013)

    Google Scholar 

  17. Pugh, W.: Concurrent maintenance of skip lists. Univ. of Maryland Institute for Advanced Computer Studies Report No. UMIACS-TR-90-80 (1990)

    Google Scholar 

  18. SNIA: NVM Programming Model V1.1 (2015). http://www.snia.org/sites/default/files/NVMProgrammingModel_v1.1.pdf

  19. Wilcox, M.: Add support for NV-DIMMs to ext4. https://lwn.net/Articles/613384/. Accessed 17 Feb 2017

  20. Xu, J., Swanson, S.: NOVA a log-structured file system for hybrid volatile/non-volatile main memories. In: Proceedings of the 14th USENIX Conference on File and Storage Technologies (FAST) (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. TU Dresden, Dresden, Germany

    Lucas Lersch, Ismail Oukid & Wolfgang Lehner

  2. SAP SE, Walldorf, Germany

    Lucas Lersch, Ismail Oukid & Ivan Schreter

Authors
  1. Lucas Lersch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ismail Oukid
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ivan Schreter
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wolfgang Lehner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lucas Lersch .

Editor information

Editors and Affiliations

  1. Riga Technical University , Riga, Latvia

    Mārīte Kirikova

  2. Norwegian University of Science and Technology, Trondheim, Norway

    Kjetil Nørvåg

  3. University of Cyprus , Nicosia, Cyprus

    George A. Papadopoulos

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Lersch, L., Oukid, I., Schreter, I., Lehner, W. (2017). Rethinking DRAM Caching for LSMs in an NVRAM Environment. In: Kirikova, M., Nørvåg, K., Papadopoulos, G. (eds) Advances in Databases and Information Systems. ADBIS 2017. Lecture Notes in Computer Science(), vol 10509. Springer, Cham. https://doi.org/10.1007/978-3-319-66917-5_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-66917-5_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-66916-8

  • Online ISBN: 978-3-319-66917-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation