Abstract
The paper presents an attempt to develop and deploy a functioning MDA (Model-Driven Architecture) model of a distributed scientific application. The main focus is a problem of modeling high performance computing processes in a visual notation and automatic generation of an executable code using the resulting diagrams. The article describes the efforts to create a platform independent model of process execution, transformation it into a platform specific model and, finally, automatic generation an application code. The research novelty includes a platform independent model of the classic hydrodynamics problem, equivalent Hadoop based platform specific model and the testing results that confirm feasibility of the research.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Frankel, D.S.: Model Driven Architecture: Applying MDA to Enterprise Computing. Wiley, New York (2003)
OMG. Unified Modeling Language, Version 2.2. Superstructure (2009)
Lugato, D.: Model-driven engineering for high-performance computing applications. In: Proceedings of the 19th IASTED International Conference on Modeling and Simulations, Quebec City, Quebec, Canada, May 2008
Lugato, D., Bruel, J.M., Ober, I., Venelle, B.: Model-driven engineering for high-performance computing applications, modeling simulation and optimization - focus on applications. In: Cakaj, S. (ed.) (2010)
Palyart, M., Lugato, D., Ober, I., Bruel, J.-M.: MDE4HPC: an approach for using model-driven engineering in high-performance computing. In: Ober, I., Ober, I. (eds.) SDL 2011. LNCS, vol. 7083, pp. 247–261. Springer, Heidelberg (2011)
Palyart, M., Lugato, D., Ober, I., Bruel, J.: A modeling language dedicated to high-performance scientific computing. In: Proceedings of the 1st International Workshop on Model-Driven Engineering for High Performance and CLoud computing, MDHPCL 2012. Article No. 6 (2012)
Palyart, M., Lugato, D., Ober, I., Bruel, J.-M.: Improving scalability and maintenance of software for high-performance scientific computing by combining MDE and frameworks. In: Whittle, J., Clark, T., Kühne, T. (eds.) MODELS 2011. LNCS, vol. 6981, pp. 213–227. Springer, Heidelberg (2011)
Bruel, J.M., Combemale, B., Ober, I., Raynal., H.: MDE in practice for computational science. In: ICCS 2015, pp. 660–669 (2015)
Arkin, E., Tekinerdogan, B.: Domain specific language for deployment of parallel applications on parallel computing platforms. In: Proceedings of the ECSAW 2014. Article No. 16 (2014)
Almorsy, M., Grundy, J., Sadus, R.J., van Straten, W., Barnes, D.G., Kaluza, O.: A suite of domain-specific visual languages for scientific software application modelling. In: VL/HCC, pp. 91–94 (2013)
Miller, M.C., Reus, J.F., Matzke, R.P., Arrighi, W.J., Schoof, L.A., Hitt, R.T., Espen, P.K.: Enabling interoperation of high performance, scientific computing applications: modeling scientific data with the sets and fields (SAF) modeling system. In: Alexandrov, V.N., Dongarra, J.J., Juliano, B.A., Renner, R.S., Tan, C.J.K. (eds.) Computational Science - ICCS 2001. LNCS, vol. 2074, pp. 158–167. Springer, Heidelberg (2001)
Tekinerdogan, B., Arkin, E.: Architecture framework for mapping parallel algorithms to parallel computing platforms. In: Proceedings of the 2nd International Workshop on Model-Driven Engineering for High Performance and CLoud computing, MDHPCL 2013, pp. 53–63 (2013)
Gamatie, A., Le Beux, S., Piel, E., Ben Atitallah, R., Etien, A., Marquet, P., Dekeyser, J.-L.: A model-driven design framework for massively parallel embedded systems. ACM Trans. Embed. Comput. Syst. 10(4), 39 (2011)
Daniluk, A.: Visual modeling for scientific software architecture design. A practical approach. Comput. Phys. Commun. 183, 213 (2012)
Scheidgen, M., Zubow, A.: Map/reduce on EMF models. In: Proceedings of the 1st International Workshop on Model-Driven Engineering for High Performance and CLoud computing, MDHPCL 2012. Article No. 7 (2012)
Shekhar, S., Caglar, F., An, K., Kuroda, T., Gokhale, A., Gokhale, S.: A model-driven approach for price/performance tradeoffs in cloud-based mapreduce application deployment. In: Proceedings of the 2nd International Workshop on Model-Driven Engineering for High Performance and CLoud computing, MDHPCL 2013, pp. 37–43 (2013)
Mansurova, M., Akhmed-Zaki, D., Matkerim, B., Kumalakov, B.: Distributed parallel algorithm for numerical solving of 3D problem of fluid dynamics in anisotropic elastic porous medium using MapReduce and MPI technologies. In: Proceedings of 9th International Joint Conference on Software Technologies ICSOFT 2014, Vienna, Austria, pp. 525–528 (2014)
Matkerim, B., Akhmed-Zaki, D., Barata, M.: Development high performance scientific computing application using model-driven architecture. Appl. Math. Sci. 7(100), 4961–4974 (2013)
Bezivin, J.: Object to Model Paradigm Change with the OMG/MDA Initiative, presentation of Summer School on MDA for Embedded System Development, pp. 16–20, Leon, France (2002)
Acknowledgments
The presented research was funded under Kazakhstan government research grant “Development of models and applications for high performance distributed processing based on MapReduce-Hadoop technology for oil extraction problems”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Akhmed-Zaki, D., Mansurova, M., Matkerim, B., Dadykina, E., Kumalakov, B. (2016). Applying MDA to Generate Hadoop Based Scientific Computing Applications. In: Mazzara, M., Voronkov, A. (eds) Perspectives of System Informatics. PSI 2015. Lecture Notes in Computer Science(), vol 9609. Springer, Cham. https://doi.org/10.1007/978-3-319-41579-6_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-41579-6_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41578-9
Online ISBN: 978-3-319-41579-6
eBook Packages: Computer ScienceComputer Science (R0)