Abstract
The paper addresses the relevant problem related to the development of scientific applications (applied software packages) to solve large-scale problems in heterogeneous distributed computing environments that can include various infrastructures (clusters, Grid systems, clouds) and provide their integrated use. We propose a new approach to the development of applications for such environments. It is based on the integration of conceptual and modular programming. The application development is implemented with a special framework named Orlando Tools. In comparison to the known tools, used for the development and execution of distributed applications in the current practice, Orlando Tools provides executing application jobs in the integrated environment of virtual machines that include both the dedicated and non-dedicated resources. The distributed computing efficiency is improved through the multi-agent management. Experiments of solving the large-scale practical problems of energy security research show the effectiveness of the developed application for solving the aforementioned problem in the environment that supports the hybrid computational model including Grid and cloud computing.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Toporkov, V., Yemelyanov, D., Toporkova, A.: Anticipation scheduling in grid with stakeholders preferences. Commun. Comput. Inf. Sci. 793, 482–493 (2017)
Sokolinsky, L.B., Shamakina, A.V.: Methods of resource management in problem-oriented computing environment. Program. Comput. Soft. 42(1), 17–26 (2016)
Singh, A., Juneja, D., Malhotra, M.: A novel agent based autonomous and service composition framework for cost optimization of resource provisioning in cloud computing. J. King Saud Univ. Comput. Inf. Sci. 29(1), 19–28 (2015)
Singh, S., Chana, I.: QoS-aware autonomic resource management in cloud computing: a systematic review. ACM Comput. Surv. 48(3) (2016). Article no. 42
Qin, H., Zhu, L.: Subject oriented autonomic cloud data center networks model. J. Data Anal. Inform. Process. 5(3), 87–95 (2017)
Talia, D.: Cloud computing and software agents: towards cloud intelligent services. In: Proceedings of the 12th Workshop on Objects and Agents. CEUR Workshop Proceedings, vol. 741, pp. 2–6 (2011)
Madni, S.H.H., Latiff, M.S.A., Coulibaly, Y.: Recent advancements in resource allocation techniques for cloud computing environment: a systematic review. Cluster Comput. 20(3), 2489–2533 (2017)
Farahani, A., Nazemi, E., Cabri, G., Capodieci, N.: Enabling autonomic computing support for the JADE agent platform. Scalable Comput. Pract. Exp. 18(1), 91–103 (2017)
Ilin, V.P., Skopin, I.N.: Computational programming technologies. Program. Comput. Soft. 37(4), 210–222 (2011)
Foster, I., Kesselman, C.: Globus: a metacomputing infrastructure toolkit. Int. J. High Perform. Comput. Appl. 11(2), 115–128 (1997)
Couvares, P., Kosar, T., Roy, A., Weber, J., Wenger, K.: Workflow management in condor. In: Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M. (eds.) Workflows for e-Science, pp. 357–375. Springer, London (2007). https://doi.org/10.1007/978-1-84628-757-2_22
Anderson, D.: Boinc: a system for public-resource computing and storage. In: Buyya, R. (ed.) Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, pp. 4–10. IEEE (2004)
Voevodin, V.V.: The solution of large problems in distributed computational media. Automat. Remote Control 68(5), 773–786 (2007)
Talia, D.: Workflow systems for science: concepts and tools. ISRN Soft. Eng. 2013 (2013). Article ID 404525
Tao, J., Kolodziej, J., Ranjan, R., Jayaraman, P., Buyya, R.: A note on new trends in data-aware scheduling and resource provisioning in modern HPC systems. Future Gener. Comput. Syst. 51(C), 45–46 (2015)
Rings, T., et al.: Grid and cloud computing: opportunities for integration with the next generation network. J. Grid Comput. 7(3) (2009). Article no. 375
Kim, H., el-Khamra, Y., Jha, S., Parashar, M.: Exploring application and infrastructure adaptation on hybrid grid-cloud infrastructure. In: Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, pp. 402–412. ACM (2010)
Mateescu, G., Gentzsch, W., Ribbens, C.J.: Hybrid computing – where HPC meets grid and cloud computing. Future Gener. Comput. Syst. 27(5), 440–453 (2011)
Vecchiola, C., Calheiros, R.N., Karunamoorthy, D., Buyya, R.: Deadline-driven provisioning of resources for scientific applications in hybrid clouds with Aneka. Future Gener. Comput. Syst. 28(1), 58–65 (2012)
Goecks, J., Nekrutenko, A., Taylor, J.: Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol. 11(8), 1–13 (2010)
Allen, B., et al.: Globus: a case study in software as a service for scientists. In: Proceedings of the 8th Workshop on Scientific Cloud Computing, pp. 25–32. ACM (2017)
Mariotti, M., Gervasi, O., Vella, F., Cuzzocrea, A., Costantini, A.: Strategies and systems towards grids and clouds integration: a DBMS-based solution. Future Gener. Comput. Syst. (2017). https://doi.org/10.1016/j.future.2017.02.047
Feoktistov, A., Sidorov, I., Sergeev, V., Kostromin, R., Bogdanova, V.: Virtualization of heterogeneous HPC-clusters based on OpenStack platform. Bull. S. Ural State Univ. Ser. Comput. Math. Soft. Eng. 6(2), 37–48 (2017)
Edelev, A., Zorkaltsev, V., Gorsky, S., Doan, V.B., Nguyen, H.N.: The combinatorial modelling approach to study sustainable energy development of Vietnam. Commun. Comput. Inf. Sci. 793, 207–218 (2017)
Jonsson, H., Johansson, J., Johansson, H.: Identifying critical components in technical infrastructure networks. Proc. Inst. Mech. Eng. O J. Risk Reliab. 222(2), 235–243 (2008)
Vorobev, S., Edelev, A.: Analysis of the importance of critical objects of the gas industry with the method of determining critical elements in networks of technical infrastructures. In: 10th International Conference on Management of Large-Scale System Development (MLSD). IEEE (2017). https://doi.org/10.1109/mlsd.2017.8109707
Massel, L.V., Kopaygorodsky, A.N., Chernousov, A.V.: IT-infrastructure of research activities realized for the power engineering system researches. In: 10th International Conference on Computer Science and Information Technologies, pp. 106–111. Ufa State Aviation Technical University (2008)
Massel, L.V., Arshinsky, V.L., Massel, A.G.: Intelligent computing on the basis of cognitive and event modeling and its application in energy security studies. Int. J. Energy Optim. Eng. 3(1), 83–91 (2014)
Irkutsk Supercomputer Center of SB RAS. http://hpc.icc.ru. Accessed 13 Apr 2018
Acknowledgements
The work was partially supported by Russian Foundation for Basic Research (RFBR), projects no. 16-07-00931, and Presidium RAS, program no. 27, project “Methods and tools for solving hard-search problems with supercomputers”. Part of the work was supported by the basic research program of the SB RAS, project no. III.17.5.1.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Feoktistov, A., Gorsky, S., Sidorov, I., Kostromin, R., Edelev, A., Massel, L. (2019). Orlando Tools: Energy Research Application Development Through Convergence of Grid and Cloud Computing. In: Voevodin, V., Sobolev, S. (eds) Supercomputing. RuSCDays 2018. Communications in Computer and Information Science, vol 965. Springer, Cham. https://doi.org/10.1007/978-3-030-05807-4_25
Download citation
DOI: https://doi.org/10.1007/978-3-030-05807-4_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05806-7
Online ISBN: 978-3-030-05807-4
eBook Packages: Computer ScienceComputer Science (R0)