Abstract
This paper presents criteria and evaluation methods for evaluating domain-specific modelling (DSM) solutions based on analysing state of the art and experiences of developing and evaluating DSM solutions in research projects. The state-of-the-art analysis returned several requirements regarding the quality of domain-specific modelling languages and tools developed based on them that are classified based on the identified stakeholders. The stakeholders are those who develop and those who use a DSM solution, the intended domain and purposes with developing a DSM solution as defined by domain experts, software engineering concerns, integration with other languages or tools, and the quality of artefacts to be modelled or generated. Both quantitative and qualitative approaches may be applied for evaluating DSM solutions based on the development stage and requirements. There is a clear need for a process that supports evaluating the quality of DSM solutions and this research contributes to the definition of such process.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Goodhue, D.L.: Development and Measurement Validity of a Task Technology Fit Instrument for User Evaluations of Information Systems. Decision Sciences 29(1), 105–138 (1998)
Grossman, M., Aronson, J.E., McCarthy, R.V.: Does UML Make the Grade? Insights from the Software Development Community. Information and Software Technology 47, 383–397 (2005)
Evans, A., Fernández, M.A., Mohagheghi, P.: Experiences of Developing a Network Modelling Tool Using the Eclipse Environment. In: Paige, R.F., Hartman, A., Rensink, A. (eds.) ECMDA-FA 2009. LNCS, vol. 5562, pp. 301–312. Springer, Heidelberg (2009)
Howatt, J.: A Project-Based Approach to Programming Language Evolution (2001), http://academic.luther.edu/~howaja01/v/lang.pdf (visited in August 2007)
Kärnä, J., Tolvanen, J.P., Kelly, S.: Evaluating the Use of Domain-Specific Modeling in Practice. In: 9th OOPSLA Workshop on Domain-Specific Modeling (2009)
Kelly, S., Tolvanen, J.-P.: Domain-Specific Modeling- Enabling Full Code Generation. IEEE Computer Society Publications, Los Alamitos (2008)
Kennedy, K., Koelbel, C., Schreiber, R.: Defining and Measuring the Productivity of Programming Languages. International Journal of High Performance Computing Applications 18(4), 441–448 (2004)
Lindland, O.I., Sindre, G., Sølvberg, A.: Understanding Quality in Conceptual Modelling. IEEE Software 11(2), 42–49 (1994)
Mernik, M., Heering, J., Sloane, A.M.: When and How to Develop Domain-Specific Languages. ACM Computing Surveys 37(4), 316–344 (2005)
Mohagheghi, P., Dehlen, V.: Existing Model Metrics and Relations to Model Quality. In: 2009 ICSE Workshop on Software Quality (WoSQ 2009), pp. 39–45. IEEE CS, Los Alamitos (2009)
Paige, R.F., Ostroff, J.S., Brooke, P.J.: Principles for Modeling Language Design. Information and Software Technology 42, 665–675 (2000)
Patig, S.: Preparing Meta-Analysis of Metamodel Understandability. In: Workshop on Empirical Studies of Model-Driven Engineering (ESMDE 2008), pp. 11–20 (2008)
Rossi, M., Brinkkemper, S.: Complexity Metrics for System Development Methods and Techniques. Information Systems 21(2), 209–227 (1996)
Seffah, A., Donyaee, M., Kline, R.B., Padda, H.K.: Usability Measurement and Metrics: a Consolidated Model. Software Quality Journal 14, 159–178 (2006)
Teeuw, W.B., van den Berg, H.: On the Quality of Conceptual Models (1997), http://osm7.cs.byu.edu/ER97/workshop4/tvdb.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mohagheghi, P., Haugen, Ø. (2010). Evaluating Domain-Specific Modelling Solutions. In: Trujillo, J., et al. Advances in Conceptual Modeling – Applications and Challenges. ER 2010. Lecture Notes in Computer Science, vol 6413. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16385-2_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-16385-2_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16384-5
Online ISBN: 978-3-642-16385-2
eBook Packages: Computer ScienceComputer Science (R0)