Disaggregating Non-Volatile Memory for Throughput-Oriented Genomics Workloads
Massive exploitation of next-generation sequencing technologies requires dealing with both: huge amounts of data and complex bioinformatics pipelines. Computing architectures have evolved to deal with these problems, enabling approaches that were unfeasible years ago: accelerators and Non-Volatile Memories (NVM) are becoming widely used to enhance the most demanding workloads. However, bioinformatics workloads are usually part of bigger pipelines with different and dynamic needs in terms of resources. The introduction of Software Defined Infrastructures (SDI) for data centers provides roots to dramatically increase the efficiency in the management of infrastructures. SDI enables new ways to structure hardware resources through disaggregation, and provides new hardware composability and sharing mechanisms to deploy workloads in more flexible ways. In this paper we study a state-of-the-art genomics application, SMUFIN, aiming to address the challenges of future HPC facilities.
KeywordsGenomics Disaggregation Composability NVM NVMeOF Characterization Orchestration
This work is partially supported by the European Research Council (ERC) under the EU Horizon 2020 programme (GA 639595), the Spanish Ministry of Economy, Industry and Competitivity (TIN2015-65316-P) and the Generalitat de Catalunya (2014-SGR-1051).
- 1.Cadenelli, N., Polo, J., Carrera, D.: Accelerating k-mer frequency counting with GPU and non-volatile memory. In: Proceedings of the 19th IEEE International Conference on High Performance Computing and Communications (HPCC). IEEE Computer Society, December 2017Google Scholar
- 2.Chen, F., Lee, R., Zhang, X.: Essential roles of exploiting internal parallelism of flash memory based solid state drives in high-speed data processing. In: 2011 IEEE 17th International Symposium on High Performance Computer Architecture, pp. 266–277, February 2011Google Scholar
- 3.Ciciani, B., et al.: Automated workload characterization in cloud-based transactional data grids. In: 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops Ph.D. Forum, pp. 1525–1533, May 2012Google Scholar
- 4.NVMexpress: NVMe over fabrics overview. Tech. rep., NVM express (2017). http://www.nvmexpress.org/wp-content/uploads/nvme_over_fabrics.pdf
- 5.Facebook: Facebook disaggregated rack (2016). http://goo.gl/6h2Ut
- 6.Gao, P.X., et al.: Network requirements for resource disaggregation. In: Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. USENIX Association, Berkely, CA, USA, November 2016Google Scholar
- 7.Guz, Z., Li, H.H., Shayesteh, A., Balakrishnan, V.: NVMe-over-fabrics performance characterization and the path to low-overhead flash disaggregation. In: Proceedings of the 10th ACM International Systems and Storage Conference SYSTOR 2017, pp. 16:1–16:9. ACM, New York (2017)Google Scholar
- 8.Intel: Intel rack scale design. Tech. Rep. 332937–004, Intel Corporation, August 2016. http://www.intel.com/content/dam/www/public/us/en/documents/guides/platform-hardware-design-guide.pdf
- 9.Intel: Rapid storage (2017). http://www.intel.com/content/www/us/en/support/technologies/intel-rapid-storage-technology-intel-rst.html
- 11.Klimovic, A., Litz, H., Kozyrakis, C.: Reflex: remote flash & local flash. In: Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems ASPLOS (2017)Google Scholar
- 17.Sivashankar, S., Ramasamy, S.: Design and implementation of non-volatile memory express. In: 2014 International Conference on Recent Trends in Information Technology, Chennai, India, April 2014Google Scholar
- 18.Weerasinghe, J., Abel, F., Hagleitner, C., Herkersdorf, A.: Disaggregated FPGAs: network performance comparison against bare-metal servers, virtual machines and linux containers. In: Proceedings of the 8th IEEE International Conference on Cloud Computing Technology and Science, December 2016Google Scholar