Advertisement

Orlando Tools: Energy Research Application Development Through Convergence of Grid and Cloud Computing

  • Alexander FeoktistovEmail author
  • Sergei Gorsky
  • Ivan Sidorov
  • Roman Kostromin
  • Alexei Edelev
  • Lyudmila Massel
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 965)

Abstract

The paper addresses the relevant problem related to the development of scientific applications (applied software packages) to solve large-scale problems in heterogeneous distributed computing environments that can include various infrastructures (clusters, Grid systems, clouds) and provide their integrated use. We propose a new approach to the development of applications for such environments. It is based on the integration of conceptual and modular programming. The application development is implemented with a special framework named Orlando Tools. In comparison to the known tools, used for the development and execution of distributed applications in the current practice, Orlando Tools provides executing application jobs in the integrated environment of virtual machines that include both the dedicated and non-dedicated resources. The distributed computing efficiency is improved through the multi-agent management. Experiments of solving the large-scale practical problems of energy security research show the effectiveness of the developed application for solving the aforementioned problem in the environment that supports the hybrid computational model including Grid and cloud computing.

Keywords

Scientific application Grid Cloud Energy research 

Notes

Acknowledgements

The work was partially supported by Russian Foundation for Basic Research (RFBR), projects no. 16-07-00931, and Presidium RAS, program no. 27, project “Methods and tools for solving hard-search problems with supercomputers”. Part of the work was supported by the basic research program of the SB RAS, project no. III.17.5.1.

References

  1. 1.
    Toporkov, V., Yemelyanov, D., Toporkova, A.: Anticipation scheduling in grid with stakeholders preferences. Commun. Comput. Inf. Sci. 793, 482–493 (2017)Google Scholar
  2. 2.
    Sokolinsky, L.B., Shamakina, A.V.: Methods of resource management in problem-oriented computing environment. Program. Comput. Soft. 42(1), 17–26 (2016)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Singh, A., Juneja, D., Malhotra, M.: A novel agent based autonomous and service composition framework for cost optimization of resource provisioning in cloud computing. J. King Saud Univ. Comput. Inf. Sci. 29(1), 19–28 (2015)Google Scholar
  4. 4.
    Singh, S., Chana, I.: QoS-aware autonomic resource management in cloud computing: a systematic review. ACM Comput. Surv. 48(3) (2016). Article no. 42Google Scholar
  5. 5.
    Qin, H., Zhu, L.: Subject oriented autonomic cloud data center networks model. J. Data Anal. Inform. Process. 5(3), 87–95 (2017)CrossRefGoogle Scholar
  6. 6.
    Talia, D.: Cloud computing and software agents: towards cloud intelligent services. In: Proceedings of the 12th Workshop on Objects and Agents. CEUR Workshop Proceedings, vol. 741, pp. 2–6 (2011)Google Scholar
  7. 7.
    Madni, S.H.H., Latiff, M.S.A., Coulibaly, Y.: Recent advancements in resource allocation techniques for cloud computing environment: a systematic review. Cluster Comput. 20(3), 2489–2533 (2017)CrossRefGoogle Scholar
  8. 8.
    Farahani, A., Nazemi, E., Cabri, G., Capodieci, N.: Enabling autonomic computing support for the JADE agent platform. Scalable Comput. Pract. Exp. 18(1), 91–103 (2017)Google Scholar
  9. 9.
    Ilin, V.P., Skopin, I.N.: Computational programming technologies. Program. Comput. Soft. 37(4), 210–222 (2011)CrossRefGoogle Scholar
  10. 10.
    Foster, I., Kesselman, C.: Globus: a metacomputing infrastructure toolkit. Int. J. High Perform. Comput. Appl. 11(2), 115–128 (1997)Google Scholar
  11. 11.
    Couvares, P., Kosar, T., Roy, A., Weber, J., Wenger, K.: Workflow management in condor. In: Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M. (eds.) Workflows for e-Science, pp. 357–375. Springer, London (2007).  https://doi.org/10.1007/978-1-84628-757-2_22CrossRefGoogle Scholar
  12. 12.
    Anderson, D.: Boinc: a system for public-resource computing and storage. In: Buyya, R. (ed.) Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, pp. 4–10. IEEE (2004)Google Scholar
  13. 13.
    Voevodin, V.V.: The solution of large problems in distributed computational media. Automat. Remote Control 68(5), 773–786 (2007)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Talia, D.: Workflow systems for science: concepts and tools. ISRN Soft. Eng. 2013 (2013). Article ID 404525Google Scholar
  15. 15.
    Tao, J., Kolodziej, J., Ranjan, R., Jayaraman, P., Buyya, R.: A note on new trends in data-aware scheduling and resource provisioning in modern HPC systems. Future Gener. Comput. Syst. 51(C), 45–46 (2015)CrossRefGoogle Scholar
  16. 16.
    Rings, T., et al.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Comput. 7(3) (2009). Article no. 375Google Scholar
  17. 17.
    Kim, H., el-Khamra, Y., Jha, S., Parashar, M.: Exploring application and infrastructure adaptation on hybrid grid-cloud infrastructure. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, pp. 402–412. ACM (2010)Google Scholar
  18. 18.
    Mateescu, G., Gentzsch, W., Ribbens, C.J.: Hybrid computing – where HPC meets grid and cloud computing. Future Gener. Comput. Syst. 27(5), 440–453 (2011)CrossRefGoogle Scholar
  19. 19.
    Vecchiola, C., Calheiros, R.N., Karunamoorthy, D., Buyya, R.: Deadline-driven provisioning of resources for scientific applications in hybrid clouds with Aneka. Future Gener. Comput. Syst. 28(1), 58–65 (2012)CrossRefGoogle Scholar
  20. 20.
    Goecks, J., Nekrutenko, A., Taylor, J.: Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol. 11(8), 1–13 (2010)CrossRefGoogle Scholar
  21. 21.
    Allen, B., et al.: Globus: a case study in software as a service for scientists. In: Proceedings of the 8th Workshop on Scientific Cloud Computing, pp. 25–32. ACM (2017)Google Scholar
  22. 22.
    Mariotti, M., Gervasi, O., Vella, F., Cuzzocrea, A., Costantini, A.: Strategies and systems towards grids and clouds integration: a DBMS-based solution. Future Gener. Comput. Syst. (2017).  https://doi.org/10.1016/j.future.2017.02.047
  23. 23.
    Feoktistov, A., Sidorov, I., Sergeev, V., Kostromin, R., Bogdanova, V.: Virtualization of heterogeneous HPC-clusters based on OpenStack platform. Bull. S. Ural State Univ. Ser. Comput. Math. Soft. Eng. 6(2), 37–48 (2017)Google Scholar
  24. 24.
    Edelev, A., Zorkaltsev, V., Gorsky, S., Doan, V.B., Nguyen, H.N.: The combinatorial modelling approach to study sustainable energy development of Vietnam. Commun. Comput. Inf. Sci. 793, 207–218 (2017)Google Scholar
  25. 25.
    Jonsson, H., Johansson, J., Johansson, H.: Identifying critical components in technical infrastructure networks. Proc. Inst. Mech. Eng. O J. Risk Reliab. 222(2), 235–243 (2008)Google Scholar
  26. 26.
    Vorobev, S., Edelev, A.: Analysis of the importance of critical objects of the gas industry with the method of determining critical elements in networks of technical infrastructures. In: 10th International Conference on Management of Large-Scale System Development (MLSD). IEEE (2017).  https://doi.org/10.1109/mlsd.2017.8109707
  27. 27.
    Massel, L.V., Kopaygorodsky, A.N., Chernousov, A.V.: IT-infrastructure of research activities realized for the power engineering system researches. In: 10th International Conference on Computer Science and Information Technologies, pp. 106–111. Ufa State Aviation Technical University (2008)Google Scholar
  28. 28.
    Massel, L.V., Arshinsky, V.L., Massel, A.G.: Intelligent computing on the basis of cognitive and event modeling and its application in energy security studies. Int. J. Energy Optim. Eng. 3(1), 83–91 (2014)Google Scholar
  29. 29.
    Irkutsk Supercomputer Center of SB RAS. http://hpc.icc.ru. Accessed 13 Apr 2018

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Alexander Feoktistov
    • 1
    Email author
  • Sergei Gorsky
    • 1
  • Ivan Sidorov
    • 1
  • Roman Kostromin
    • 1
  • Alexei Edelev
    • 2
  • Lyudmila Massel
    • 2
  1. 1.Matrosov Institute for System Dynamics and Control Theory of SB RASIrkutskRussia
  2. 2.Melentiev Energy Systems Institute of SB RASIrkutskRussia

Personalised recommendations