Skip to main content
SpringerLink
Log in

Improving Service Performance in Cloud Computing with Network Memory Virtualization

  • Conference paper
Recent Advances in Information and Communication Technology

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 265))

Abstract

Resources abstractions have been very critical in securing performance improvement and higher acceptance by the end users in cloud computing. System virtualization, storage virtualization and network virtualization had been realized and has become as a part large systems abstraction in cloud computing. Memory high-availability in network environments is an added advantage in our presentation as an integral part in extending cloud computing multi various services to include network memory virtualization.

In this paper, we describe the virtualization of memory in cluster environment that could be applied universally using RDMA utility to map and access memory across the network. We suggested a combination of using the latency of remote memory and direct remote memory mapping facilities in our implementation. A low-level remote memory allocation and replacement technique is introduced to minimize page faulting and provide option to be more fault tolerance. We proposed a low level memory management technique in a network environment which would be able to support Service Oriented Architecture (SOA) and cloud computing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Acharya, A., Setia, S.: Availability and utility of idle memory in workstation clusters. In: Proceedings of ACM SIGMETRICS Conference on Measuring and Modeling of Computer Systems, pp. 35–46 (1999)

    Google Scholar 

  2. Markatos, E.P., Dramitinos, G.: Implementation and Evaluation of a Remote Memory Pager. Technical Report FORTH/ICS 129 (1995)

    Google Scholar 

  3. Markatos, E.P., Dramitinos, G.: Implementing of reliable remote memory pager. In: Proceedings of the 1996 Usenix Technical Conference, pp. 146–164 (1996)

    Google Scholar 

  4. Dahlin, M., Wang, R., Anderson, T., Patterson, D.: Cooperative Caching: Using Remote Memory to Improve File System Performance. In: Proceedings of the 1st Symposium on Operating System Design and Implementation, pp. 267–280 (1994)

    Google Scholar 

  5. Feely, M.J., Morgan, W.E., Pighin, F.H., Karlin, A.R., Levy, H.M.: Implementing global memory management systems in a Workstation Cluster. In: Proceedings of the 15th ACM Symposium on Operating System Principles, pp. 201–212 (1995)

    Google Scholar 

  6. Feeley, M.J.: Global Memory Management for Workstation Networks. PhD Thesis, University of Washington (1996)

    Google Scholar 

  7. Zhang, X., Qu, Y., Xiao, L.: Improving Distributed Workload Performance by Sharing Both CPU and Memory Resources. In: Proceedings of 20th International Conference on Distributed Computing Systems (ICDCS), pp. 10–13 (2000)

    Google Scholar 

  8. Kousshi, S., Acharya, A., Setia, S.: Dodo: A User-level System for exploiting idle memory in workstation clusters. Technical Report TRCS98-35, Department of Computer Science, University of California, Santa Barbara (1998)

    Google Scholar 

  9. Ioannidis, S., Markatos, E.P., Sevaslidou, J.: On using Network Memory to improve the performance of transaction-based System. Technical Report 190, ICS-FORTH, http://www.ics.forth.gr/proj/avg/paging.html

  10. Amir, Y., Awerbuch, B., Borgstrom, R.S.: A Cost-Benefit Framework for Online Management of a Metacomputing System. In: Proceedings of 1st International Conference on Information and Computational Economy (ICE 1998), pp. 25–28 (1998)

    Google Scholar 

  11. Flouris, M.D., Markatos, E.P.: The Network RamDisk: Using Remote Memory on Heterogeneous NOWs. In: Progress Session of the USENIX 1999 Annual Technical Conference (1999)

    Google Scholar 

  12. Flouris, M.D., Markatos, E.P.: Network RAM. In: Buyya, R. (ed.) High Performance Cluster Computing, pp. 383–508. Prentice Hall, New Jersey (1999)

    Google Scholar 

  13. Markatos, E.P., Dramitinos, G.: Adding Flexibility to a Remote Memory Pager. In: Proceedings of the 4th International Workshop on Object Orientation in Operating Systems

    Google Scholar 

  14. Xiao, L., Zhang, X., Kubricht, S.A.: Incorporating Job Migration and Network RAM to Share Cluster Memory Resources. In: Proceedings of the 9th IEEE International Symposium on High-Performance Distributed Computing (HPDC-9), pp. 71–78 (2000)

    Google Scholar 

  15. Cuenca-Acuna, F.M., Nguyen, T.D.: Cooperative Caching Middleware for Cluster-Based Servers. In: Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, HPDC-10 (2001)

    Google Scholar 

  16. Carrera, E.V., Bianchini, R.: Efficiency vs. Portability in Cluster-Based Network Servers. In: Proceedings of the 8th Symposium on Principle and Practice of Parallel Programming. ACM/SIGPLAN (2001)

    Google Scholar 

  17. Hansen, J.S.: Flexible network attached storage using remote DMA. In: Proceeding of Hot Interconnects 9, pp. 51–55. IEEE (2001)

    Google Scholar 

  18. Hansen, J.S., Lachaize, R.: Using Idle Disks in a Cluster as a High Performance Storage System. Technical Report, SARDES Project, SIRAC Laboratory, Grenoble, France (2002)

    Google Scholar 

  19. Buyya, R., Abramson, D., Giddy, J.: Grid Resource Management, Scheduling and Computational Economy. In: Proceedings of the 2nd International Workshop on Global and Cluster Computing (WGCC 2000), Tsukuba, Tokyo, Japan (2000)

    Google Scholar 

  20. Milenkovic, M., Robison, S.H., Knauerhase, R.C., Barkai, D., Garg, S., Tewari, V., Anderson, T.A., Bowman, M. (Intel): Toward Internet Distributed Computing, pp. 38–46. IEEE Computer Society (2003)

    Google Scholar 

  21. Waldspurger, C.A.: Memory Resource Management in VMware ESX Server. In: Proceedings of the 5th Symposium on Operating Systems Design and Implementation, OSDI 2002, Best paper award (2002)

    Google Scholar 

  22. Birman, K., Chockler, G., Renesse, R.: Towards a cloud computing research agenda. SIGACT News 40(2) (2009)

    Article  Google Scholar 

  23. Vouk, M.A.: Cloud Computing – Issues, Research and Implementations. Journal of Computing and Information Technology (CIT) 16(4), 235–246 (2008)

    Article  Google Scholar 

  24. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R., Konwinski, A., Lee, G., Patterson, D., Rabkin, A., Stoica, I., Zaharia, M.: A view of cloud computing. Communications of the ACM 53(4), 50–58 (2009)

    Article  Google Scholar 

  25. Anderson, E., Neefe, J.M.: An exploration of network ram. Technical Report (CSD98-1000) Dept. of Computer Science, University of California, Berkeley (1994)

    Google Scholar 

  26. Islam, N.S., Rahman, M.W., Jose, J., Rajachandrasekar, R., Wang, H., Subramoni, H., Murthy, C., Panda, D.K.: High performance RDMA-based design of HDFS over InfiniBand. In: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, pp. 1–35. IEEE Computer Society Press (2012)

    Google Scholar 

  27. Chu, R., Xiao, N., Zhuang, Y., Liu, Y., Lu, X.: A Distributed Paging RAM Grid System for Wide-Area Memory Sharing. In: Proceedings of 20th International Parallel and Distributed Processing Symposium, IPDPS, pp. 1–10 (2006)

    Google Scholar 

  28. Gemikonakli, O., Mapp, G., Thakker, D., Ever, E.: Modelling and Performability Analysis of Network Memory Servers. In: Proceeding of the 39th Annual Simulation Symposium, ANSS 2006 (2006)

    Google Scholar 

  29. Balaji, P., Shah, H.V., Panda, D.K.: Sockets vs RDMA interface over 10-Gigabit networks: an in-depth analysis of the memory traffic bottleneck. In: RAIT Workshop 2004 (2004)

    Google Scholar 

  30. Mamidala, A.R., Vishnu, A., Panda, D.K.: Efficient shared memory and RDMA based design for mpi_allgather over InfiniBand. In: Mohr, B., Träff, J.L., Worringen, J., Dongarra, J. (eds.) PVM/MPI 2006. LNCS, vol. 4192, pp. 66–75. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  31. Romanow, A., Bailey, S.: An Overview of RDMA over IP. In: Proceedings of the First International Workshop on Protocols for Fast Long-Distance Networks, PFLDnet 2003 (2003)

    Google Scholar 

  32. Pakin, S.: Receiver-initiated message passing over RDMA Networks. In: IEEE International Symposium on, Parallel and Distributed Processing, IPDPS 2008 (2008)

    Google Scholar 

  33. Perez-Conde, C., Diaz-Villanueva, W.: Emerging Information Tecnologies (II): Virtualization as Support for SOA and Cloud Computing. The European Journal of the Informatics Professional (CEPIS UPGRADE) 11(4), 30–35 (2010), http://cepis.org/upgrade

    Google Scholar 

  34. Hoff, T.: Are CloudBased Memory Architectures the Next Big Thing? Blog-Article (2009), http://highscalability.com/blog/2009/3/16/are-cloud-based-memory-architectures-the-next-big-thing.html

  35. Ghalimi, I.C.: Cloud Computing is Memory Bound. An Intalio White Paper. Intalio, Inc., USA (2010)

    Google Scholar 

  36. Vallee, G., Naughton, T., Engelmann, C., Ong, H., Scott, S.L.: System-level virtualization for high performance computing. In: 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008), Toulouse, France (2008)

    Google Scholar 

  37. Subramoni, H., Lai, P., Kettimuthu, R., Panda, D.K.: High Performance Data Transfer in Grid Environment using GridFTP over Infiniband. In: 2010 10th IEEE/ACM International Conference on Proceeding of Cluster, Cloud and Grid Computing (CCGrid). IEEE (2010)

    Google Scholar 

  38. Woodall, T.S., Shipman, G.M., Bosilca, G., Graham, R.L., Maccabe, A.B.: High performance RDMA protocols in HPC. In: Mohr, B., Träff, J.L., Worringen, J., Dongarra, J. (eds.) PVM/MPI 2006. LNCS, vol. 4192, pp. 76–85. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  39. Yu, W., Rao, S.V.N., Wyckoff, P., Vetter, J.S.: Performance of RDMA-capable storage protocols on wide-area network. In: Proceeding of Petascale Data Storage Workshop, PDSW 2008, 3rd edn. IEEE (2008)

    Google Scholar 

  40. Kissel, E., Swany, M.: Evaluating High Performance Data Transfer with RDMA Based Protocols in Wide Area Networks. In: Proceeding of 14th International Conference on High Performance Computing and Communications (HPCC 2012), Liverpool, UK (2012)

    Google Scholar 

  41. Yufei, R., Li, T., Yu, D., Jin, S., Robertazzi, T.G.: Middleware support for rdma-based data transfer in cloud computing. In: Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW). IEEE (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Science & Technology, Wawasan Open University, George Town, Malaysia

    Chandarasageran Natarajan

Authors
  1. Chandarasageran Natarajan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chandarasageran Natarajan .

Editor information

Editors and Affiliations

  1. Faculty of Information Technology, King Mongkut's University of Technology North Bangkok, Bangkok, Thailand

    Sirapat Boonkrong

  2. Lehrgebiet Kommunikationsnetze, University of Hagen, Hagen, Germany

    Herwig Unger

  3. Faculty of Information Technology, King Mongkut's University of Technology North Bangkok, Bangkok, Thailand

    Phayung Meesad

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Natarajan, C. (2014). Improving Service Performance in Cloud Computing with Network Memory Virtualization. In: Boonkrong, S., Unger, H., Meesad, P. (eds) Recent Advances in Information and Communication Technology. Advances in Intelligent Systems and Computing, vol 265. Springer, Cham. https://doi.org/10.1007/978-3-319-06538-0_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-06538-0_23

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-06537-3

  • Online ISBN: 978-3-319-06538-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation