Advertisement

A Toolkit for Storage QoS Provisioning for Data-Intensive Applications

  • Renata Słota
  • Dariusz Król
  • Kornel Skałkowski
  • Bartosz Kryza
  • Darin Nikołow
  • Michał Orzechowski
  • Jacek Kitowski
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7136)

Abstract

In this paper, we present a toolkit named FiVO/QStorMan for supporting data-intensive applications in distributed environments with storage-related Quality of Service provisioning. Main features of the toolkit are: explicit definition of non-functional requirements regarding storage resources, usage of semantic descriptions of the available storage infrastructure and active monitoring data concerning the infrastructure workload and users operations. In particular, we describe user interfaces of the toolkit along with descriptions of main parts of the toolkit. In addition, the paper describes results of the performed experimental evaluation of the toolkit which confirm the effectiveness of the proposed approach for the storage-related QoS provisioning.

Keywords

storage management SLA QoS requirements Virtual Organization ontology 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. Int. J. High Perform. Comput. Appl. 15(3), 200–222 (2001)CrossRefGoogle Scholar
  2. 2.
    Cummings, J., Finholt, T., Foster, I., Kesselman, C., Lawrence, K.A.: Beyond being there: A blueprint for advancing the design, development, and evaluation of virtual organizations. Technical report, National Science Foundation, http://www.ci.uchicago.edu/events/VirtOrg2008 (as of May 26, 2011)
  3. 3.
    Kryza, B., Dutka, L., Slota, R., Kitowski, J.: Dynamic VO Establishment in Distributed Heterogeneous Business Environments. In: Allen, G., Nabrzyski, J., Seidel, E., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds.) ICCS 2009, Part II. LNCS, vol. 5545, pp. 709–718. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  4. 4.
    Palak, B., Wolniewicz, P., Płóciennik, M., Owsiak, M., Żok, T.: User-Friendly Frameworks for Accessing Computational Resources. In: Bubak, M., Szepieniec, T., Wiatr, K. (eds.) PL-Grid 2011. LNCS, vol. 7136, pp. 191–204. Springer, Heidelberg (2012)Google Scholar
  5. 5.
    Balcerek, B., Szurgot, B., Uchroński, M., Waga, W.: ACARM-ng: Next Generation Correlation Framework. In: Bubak, M., Szepieniec, T., Wiatr, K. (eds.) PL-Grid 2011. LNCS, vol. 7136, pp. 114–127. Springer, Heidelberg (2012)Google Scholar
  6. 6.
    Paszyński, M., Pardo, D., Torres-Verdín, C., Demkowicz, L., Calo, A.: A parallel direct solver for the self-adaptive hp Finite Element Method. Journal of Parallel and Distributed Computing 70(3), 270–281 (2010)CrossRefzbMATHGoogle Scholar
  7. 7.
    Cettei, M., Ligon, W., Ross, R.: Support for parallel out of core applications on Beowulf workstations. In: Proceedings of the Aerospace Conference, vol. 4, pp. 355–365. IEEE (1998)Google Scholar
  8. 8.
    Weikuan, Y., Vetter, J., Canon, R., Jiang, S.: Exploiting Lustre File Joining for Effective Collective IO. In: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pp. 267–274. IEEE Computer Society (2007)Google Scholar
  9. 9.
    Dickens, P., Logan, J.: Y-Lib: A User Level Library to Increase the Performance of MPI-IO in a Lustre File System Environment. In: Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing, HPDC 2009, Garching, Germany, pp. 31–38. ACM (2009)Google Scholar
  10. 10.
    Vijay, V., Anthony, S.: Quality of Service support for Grid Storage Environments. In: Proceedings of GCA, pp. 34–140 (2006)Google Scholar
  11. 11.
    Cheng, C., Wu, J., Liu, P.: QoS-aware, access-efficient, and storage-efficient replica placement in grid environments. Journal of Supercomputing 49(1), 42–63 (2009)CrossRefGoogle Scholar
  12. 12.
    Zhang, X., Xu, Y., Jiang, S.: YouChoose: A Performance Interface Enabling Convenient and Efficient QoS Support for Consolidated Storage Systems. In: Proceedings of MSST, Denver, Colorado (2011)Google Scholar
  13. 13.
    Bosak, B., Komasa, J., Kopta, P., Kurowski, K., Mamoński, M., Piontek, T.: New Capabilities in QosCosGrid Middleware for Advanced Job Management, Advance Reservation and Co-allocation of Computing Resources – Quantum Chemistry Application Use Case. In: PL-Grid 2011. LNCS, vol. 7136, pp. 40–55. Springer, Heidelberg (2012)Google Scholar
  14. 14.
    Bosak, B., Konczak, J., Kurowski, K., Mamoński, M., Piontek, T.: Highly Integrated Environment for Parallel Application Development Using QosCosGrid Middleware. In: Bubak, M., Szepieniec, T., Wiatr, K. (eds.) PL-Grid 2011. LNCS, vol. 7136, pp. 182–190. Springer, Heidelberg (2012)Google Scholar
  15. 15.
    Kryza, B., Slota, R., Majewska, M., Pieczykolan, J., Kitowski, J.: Grid organizational memory-provision of a high-level Grid abstraction layer supported by ontology alignment. Future Generation Computer Systems 23(3), 348–358 (2007)CrossRefGoogle Scholar
  16. 16.
    Mylka, A., Swiderska, A., Kryza, B., Kitowski, J.: Integration of heterogeneous data sources into an ontological knowledge base. Computing and Informatics 31(1) (2011)Google Scholar
  17. 17.
    The OntoStor project (June 20, 2011), http://www.icsr.agh.edu.pl/ontostor/en.html
  18. 18.
    Polak, S., Nikolow, D., Slota, R., Kitowski, J.: Modeling Storage System Performance for Data Management in Cloud Environment using Ontology. In: Pileggi, S. (ed.) Proceeding of IWSI 2011 International Workshop on Semantic Interoperability, in conjuction with ICAART 2011, Rome, Italy, pp. 54–63. SciTePress (2011)Google Scholar
  19. 19.
    The Lustre pool mechanism, http://wiki.lustre.org/index.php/Creating_and_Managing_OST_Pools (as of June 20, 2011)
  20. 20.
    The Lustre system, http://wiki.lustre.org/index.php/Main_Page (as of June 20, 2011)

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Renata Słota
    • 1
    • 2
  • Dariusz Król
    • 1
  • Kornel Skałkowski
    • 1
    • 2
  • Bartosz Kryza
    • 1
  • Darin Nikołow
    • 1
    • 2
  • Michał Orzechowski
    • 2
  • Jacek Kitowski
    • 1
    • 2
  1. 1.ACC Cyfronet AGHAGH University of Science and TechnologyKrakówPoland
  2. 2.Faculty of Electrical Engineering, Automatics, Computer Science and Electronics, Department of Computer ScienceAGH University of Science and TechnologyKrakówPoland

Personalised recommendations