Abstract
This paper presents a process-oriented model-driven approach that supports the conduction of controlled experiments in software engineering. The approach consists of: (i) a domain specific language (DSL) for process specification and statistical design of controlled experiments; (ii) model-driven transformations that allow workflow models generations specific to each experiment participant and according to the experiment statistical design; and (iii) a workflow execution environment that allows the monitoring of participant activities in the experiment, besides gathering participants feedback from the experiment. The paper also presents the results of an exploratory study that analyzes the feasibility of the approach and the expressivity of the DSLs in the modeling of a non-trivial software engineering experiment.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Sjoeberg, D.I.K., Hannay, J.E., Hansen, O., Kampenes, V.B., Karahasanovic, A., Liborg, N.-K., Rekdal, A.C.: A survey of controlled experiments in software engineering. IEEE Transactions on Software Engineering 31(9), 733–753 (2005)
Jedlitschka, A., Ciolkowski, M., Pfahl, D.: Reporting Experiments in Software Engineering. In: Guide to Advanced Empirical Software Engineering. Springer Science+Business Media (2008)
Hochstein, L., Nakamura, T., Shull, F., Zazworka, N., Basili, V., Zelkowitz, M.: An Environment for Conducting Families of Software Engineering Experiments. Advances in Computers 74, 175–200 (2008)
Sjøberg, D., Anda, B., Arisholm, E., Dybå, T., Jørgensen, M., Karahasanovic, A., Koren, E., Vokác, M.: Conducting Realistic Experiments in Software Engineering. In: International Symposium on Empirical Software Engineering (2002)
Travassos, G., Santos, P., Mian, P., Dias Neto, A., Biolchini, J.: An environment to support large scale experimentation in software engineering. In: 13th IEEE International Conference on Engineering of Complex Computer Systems, pp. 193–202 (2008)
Accioly, Borba, P., Bonifácio, R.: Comparing Two Black-box Testing Strategies for Software Product Lines. In: Proceedings of SBCARS, Natal, Brazil (2012)
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M., Regnell, B., Wesslén, A.: Experimentation in Software Engineering: An Introduction. Kluwer Academic Publishers, Boston (2000)
Pfleeger, S.: Experimental design and analysis in software engineering: Part 2: how to set up and experiment. SIGSOFT Softw. Eng. Notes 20, 22–26 (1995)
Lochmann, H., Bräuer, M.: Towards Semantic Integration of Multiple Domain-Specific Languages Using Ontological Foundations. In: ATEM on MoDELS, Nashville (2007)
Freire, M., Aleixo, F., Uira, K., Aranha, E., Coelho, R.: Automatic Deployment and Monitoring of Software Processes: A Model-Driven Approach. In: SEKE 2011, Mi/Fl (2011)
Freire, M., Alencar, D., Aranha, E., Kulesza, U.: Software Process Monitoring using Statistical Process Control Integrated in Workflow Systems. In: SEKE 2012, SF/CA (2012)
Juristo, N., Moreno, A.M.: Basics of Software Engineering Experimentation. Kluwer Academic Publisher, Madrid (2001)
Campos, E., Bezerra, A., Freire, M., Kulesza, U., Aranha, E.: Composição de Linguagens de Modelagem Específicas de Domínio: Um Estudo Exploratório. In: MDSD, pp. 41–48 (2012)
Campos, E., Freire, M., Kulesza, U., Bezerra, A., Aranha, E.: Composition of Domain Specific Modeling Languages: An Exploratory Study. In: MODELSWARD (2013)
Freire, M., Alencar, D., Campos, E., Medeiros, T., Kulesza, U., Aranha, E., Soares, S.: Automated Support for Controlled Experiments in Software Engineering: A Systematic Review. In: SEKE, Boston/USA (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Freire, M. et al. (2013). A Model-Driven Approach to Specifying and Monitoring Controlled Experiments in Software Engineering. In: Heidrich, J., Oivo, M., Jedlitschka, A., Baldassarre, M.T. (eds) Product-Focused Software Process Improvement. PROFES 2013. Lecture Notes in Computer Science, vol 7983. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39259-7_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-39259-7_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39258-0
Online ISBN: 978-3-642-39259-7
eBook Packages: Computer ScienceComputer Science (R0)