Abstract
Investigating and improving the quality of conceptual models has gained tremendous importance in the past years. In general, model understandability is regarded one of the most important model quality goals and criteria. A considerable amount of empirical studies, especially experiments, have been conducted in order to investigate factors influencing the understandability of conceptual models. However, a thorough review and reconstruction of 42 experiments on conceptual model understandability conducted in this research shows that there is a variety of different understandings and conceptualizations of the term model understandability. As a consequence, this term remains ambiguous, research results on model understandability are hardly comparable and partly imprecise, which shows the necessity of clarification what the conceptual modeling community is actually talking about when the term model understandability is used. In order to overcome this shortcoming, our research classifies the different observed dimensions of model understandability in a reference framework. Moreover, implications of the findings are presented and discussed and some guidelines for future model understandability research are given.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Germonprez, M., Hovorka, D., Gal, U.: Secondary Design: A Case of Behavioral Design Science Research. Journal of the AIS 12, 662–683 (2011)
Lindland, O.I., Sindre, G., Sølvberg, A.: Understanding Quality in Conceptual Modeling. IEEE Software 11, 42–49 (1994)
Krogstie, J.: Modelling of the People, by the People, for the People. In: Krogstie, J., Opdahl, A.L., Brinkkemper, S. (eds.) Conceptual Modelling in Information Systems Engineering, pp. 305–318. Springer, Berlin (2007)
Cooper, H., Hedges, L.V.: Research Synthesis As a Scientific Enterprise. In: Cooper, H., Hedges, L.V. (eds.) The Handbook of Research Synthesis, pp. 3–14. Russell Sage Foundation, New York (1994)
Fettke, P., Houy, C., Vella, A.-L., Loos, P.: Towards the Reconstruction and Evaluation of Conceptual Model Quality Discourses – Methodical Framework and Application in the Context of Model Understandability. In: Bider, I., Halpin, T., Krogstie, J., Nurcan, S., Proper, E., Schmidt, R., Soffer, P., Wrycza, S. (eds.) EMMSAD 2012 and BPMDS 2012. LNBIP, vol. 113, pp. 406–421. Springer, Heidelberg (2012)
Wand, Y., Storey, V.C., Weber, R.: Analyzing the Meaning of a Relationship. ACM Trans. Database Systems 24, 494–528 (1999)
Wand, Y., Weber, R.: Research Commentary: Information Systems and Conceptual Modeling - A Research Agenda. Information Systems Research 13, 363–377 (2002)
Moody, D.L.: Cognitive Load Effects on End User Understanding of Conceptual Models: An Experimental Analysis. In: Benczúr, A.A., Demetrovics, J., Gottlob, G. (eds.) ADBIS 2004. LNCS, vol. 3255, pp. 129–143. Springer, Heidelberg (2004)
Moody, D.L., Sindre, G., Brasethvik, T., Sølvberg, A.: Evaluating the Quality of Process Models: Empirical Testing of a Quality Framework. In: Spaccapietra, S., March, S.T., Kambayashi, Y. (eds.) ER 2002. LNCS, vol. 2503, pp. 380–396. Springer, Heidelberg (2002)
Patig, S.: A practical guide to testing the understandability of notations. In: Proceedings of the Fifth Asia-Pacific Conference on Conceptual Modelling (APCCM 2008), Wollongong, Australia (2008)
Lazarsfeld, P.F., Pasanella, A.K., Rosenberg, M. (eds.): Continuities in the Language of Social Research. The Free Press, New York (1972)
Babbie, E.R., Mouton, J.: The Practice of Social Research. Oxford University Press, Cape Town (2001)
Edwards, J.R., Bagozzi, R.P.: On the Nature and Direction of Relationships Between Constructs and Measures. Psychological Methods 5, 155–174 (2000)
Petter, S., Straub, D., Rai, A.: Specifying Formative Constructs in Information Systems Research. MIS Quarterly 31, 623–656 (2007)
Costner, H.L.: Theory, deduction, and the rules of correspondence. American Journal of Sociology 75, 245–263 (1969)
Khatri, V., Vessey, I., Ramesh, V., Clay, P., Park, S.-J.: Understanding conceptual schemas: Exploring the role of application and IS domain knowledge. Information Systems Research 17, 81–99 (2006)
Burton-Jones, A., Meso, P.N.: Conceptualizing Systems for Understanding: An Empirical Test of Decomposition Principles in Object-Oriented Analysis. Information System Research 17, 38–60 (2006)
Reijers, H.A., Mendling, J.: A Study Into the Factors That Influence the Understandability of Business Process Models. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 41, 449–462 (2011)
Shanks, G.: Conceptual Data Modelling. An Empirical Study of Expert and Novice Data Modellers. Australian Journal of Information Systems 4, 63–73 (1997)
Hardgrave, B.C., Dalal, N.P.: Comparing Object-Oriented and Extended-Entity Relationship Data Models. Journal of Database Management 6, 15–21 (1995)
Agarwal, R., De, P., Sinha, A.: Comprehending object and process models: An empirical study. IEEE Trans. Softw. Eng. 25, 541–556 (1999)
Bavota, G., Gravino, C., Oliveto, R., De Lucia, A., Tortora, G., Genero, M., Cruz-Lemus, J.A.: Identifying the Weaknesses of UML Class Diagrams during Data Model Comprehension. In: Whittle, J., Clark, T., Kühne, T. (eds.) MODELS 2011. LNCS, vol. 6981, pp. 168–182. Springer, Heidelberg (2011)
Bodart, F., Patel, A., Sim, M., Weber, R.: Should Optional Properties Be Used in Conceptual Modelling? A Theory and Three Empirical Tests. Information Systems Research 12, 384–405 (2001)
Burton-Jones, A., Weber, R.: Understanding relationships with attributes in entity-relationship diagrams. In: 20th Annual International Conference on Information Systems (ICIS 1999), Charlotte, NC, USA, pp. 214–228 (1999)
Juhn, S., Naumann, J.: he Effectiveness of Data Representation Characteristics on User Validation. In: 6th International Conference on Information Systems, pp. 212–226 (1985)
Palvia, T., Lio, C., To, P.: The Impact of Conceptual Data Models on End User Performance. Journal of Database Management 3, 4–14 (1992)
Shoval, P., Fruerman, I.: OO and EER Schemas: A Comparison of User Comprehension. Journal of Database Management 5, 28–38 (1994)
Hardgrave, B.C., Dalal, N.P.: Comparing Object Oriented and Extended Entity Relationship Models. Journal of Database Management 6, 15–22 (1995)
Kim, Y.-G., March, S.T.: Comparing Data Modelling Formalisms. Communications of the ACM 38, 103–115 (1995)
Shanks, G.: Conceptual Data Modelling: An Empirical Study of Expert and Novice Data Modellers. Australasian Journal of Information Systems 4, 63–73 (1997)
Nordbotten, J.C., Crosby, M.E.: The Effect of Graphic Style on Data Model Interpretation. Information Systems Journal 9, 139–155 (1999)
Moody, D.L.: Complexity Effects on End User Understanding of Data Models: An Experimental Comparison of Large Data Model Representation Methods. In: Wrycza, S. (ed.) 10th European Conference on Information Systems (ECIS 2002), Gdansk, Poland, pp. 482–496 (2002)
Purchase, H.C., Colpoys, L., McGill, M., Carrington, D.: UML collaboration diagram syntax: an empirical study of comprehension. In: First International Workshop on Visualizing Software for Understanding and Analysis (2002)
Parsons, J.: Effects of local versus global schema diagrams on verification and communication in conceptual data modeling. Journal of MIS 19, 155–184 (2003)
Moody, D.L.: Cognitive Load Effects on End User Understanding of Conceptual Models: An Experimental Analysis. In: Benczúr, A.A., Demetrovics, J., Gottlob, G. (eds.) ADBIS 2004. LNCS, vol. 3255, pp. 129–143. Springer, Heidelberg (2004)
Serrano, M., Calero, C., Trujillo, J., Lujan, S., Piattini, M.: Empirical Validation of Metrics for Conceptual Models of Data Warehouses. In: Persson, A., Stirna, J. (eds.) CAiSE 2004. LNCS, vol. 3084, pp. 506–520. Springer, Heidelberg (2004)
Gemino, A., Wand, Y.: Complexity and Clarity in Conceptual Modeling: Comparison of Mandatory and Optional Properties. Data and Knowledge Engineering 55, 301–326 (2005)
Poels, G., Gailly, F., Maes, A., Paemeleire, R.: Object Class or Association Class? Testing the User Effect on Cardinality Interpretation. In: Akoka, J., Liddle, S.W., Song, I.-Y., Bertolotto, M., Comyn-Wattiau, I., van den Heuvel, W.-J., Kolp, M., Trujillo, J., Kop, C., Mayr, H.C. (eds.) ER Workshops 2005. LNCS, vol. 3770, pp. 33–42. Springer, Heidelberg (2005)
Sarshar, K., Loos, P.: Comparing the Control-Flow of EPC and Petri Net from the End-User Perspective. In: van der Aalst, W.M.P., Benatallah, B., Casati, F., Curbera, F. (eds.) BPM 2005. LNCS, vol. 3649, pp. 434–439. Springer, Heidelberg (2005)
Cruz-Lemus, J.A., Genero, M., Morasca, S., Piattini, M.: Using Practitioners for Assessing the Understandability of UML Statechart Diagrams with Composite States. In: Hainaut, J.-L., Rundensteiner, E.A., Kirchberg, M., Bertolotto, M., Brochhausen, M., Chen, Y.-P.P., Cherfi, S.S.-S., Doerr, M., Han, H., Hartmann, S., Parsons, J., Poels, G., Rolland, C., Trujillo, J., Yu, E., Zimányie, E. (eds.) ER Workshops 2007. LNCS, vol. 4802, pp. 213–222. Springer, Heidelberg (2007)
Mendling, J., Reijers, H.A., Cardoso, J.: What Makes Process Models Understandable? In: Alonso, G., Dadam, P., Rosemann, M. (eds.) BPM 2007. LNCS, vol. 4714, pp. 48–63. Springer, Heidelberg (2007)
Recker, J., Dreiling, A.: Does it matter which process modelling language we teach or use? An experimental study on understanding process modelling languages without formal education. In: Toleman, M., Cater-Steel, A., Roberts, D. (eds.) Proceedings of the 18th ACIS 2007, Toowoomba, Australia, pp. 356–366 (2007)
Serrano, M., Trujillo, J., Calero, C., Piattini, M.: Metrics for data warehouse conceptual models understandability. Inf. Softw. Technol. 49, 851–870 (2007)
Burton-Jones, A., Meso, P.N.: The Effects of Decomposition Quality and Multiple Forms of Information on Novices’ Understanding of a Domain from a Conceptual Model. Journal of the AIS 9, 748–802 (2008)
De Lucia, A., Gravino, C., Oliveto, R., Tortora, G.: Data model comprehension an empirical comparison of ER and UML class diagrams. In: IEEE International Conference on Program Comprehension, Amsterdam, pp. 93–102 (2008)
Genero, M., Poels, G., Piattini, M.: Defining and validating metrics for assessing the under-standability of entity-relationship diagrams. Data and Knowledge Engineering 64, 534–557 (2008)
Mendling, J., Strembeck, M.: Influence factors of understanding business process models. In: Abramowicz, W., Fensel, D. (eds.) BIS 2008. LNBIP, vol. 7, pp. 142–153. Springer, Berlin (2008)
Reijers, H.A., Mendling, J.: Modularity in Process Models: Review and Effects. In: Dumas, M., Reichert, M., Shan, M.-C. (eds.) BPM 2008. LNCS, vol. 5240, pp. 20–35. Springer, Heidelberg (2008)
Vanderfeesten, I., Reijers, H.A., Mendling, J., Van Der Aalst, W.M.P., Cardoso, J.: On a Quest for Good Process Models: The Cross-Connectivity Metric. In: Bellahsène, Z., Léonard, M. (eds.) CAiSE 2008. LNCS, vol. 5074, pp. 480–494. Springer, Heidelberg (2008)
Fuller, R.M., Murthy, U., Schafer, B.A.: The effects of data model representation method on task performance. Information & Management 47, 208–218 (2010)
Sánchez-González, L., García, F., Mendling, J., Ruiz, F., Piattini, M.: Prediction of Business Process Model Quality Based on Structural Metrics. In: Parsons, J., Saeki, M., Shoval, P., Woo, C., Wand, Y. (eds.) ER 2010. LNCS, vol. 6412, pp. 458–463. Springer, Heidelberg (2010)
Figl, K., Laue, R.: Cognitive Complexity in Business Process Modeling. In: Mouratidis, H., Rolland, C. (eds.) CAiSE 2011. LNCS, vol. 6741, pp. 452–466. Springer, Heidelberg (2011)
Ottensooser, A., Fekete, A., Reijers, H.A., Mendling, J., Menictas, C.: Making sense of business process descriptions: An experimental comparison of graphical and textual notations. Journal of Systems and Software 85, 596–606 (2012)
Parsons, J.: An Experimental Study of the Effects of Representing Property Precedence on the Comprehension of Conceptual Schemas. Journal of the AIS 12, 441–462 (2011)
Recker, J., Dreiling, A.: The Effects of Content Presentation Format and User Characteristics on Novice Developers Understanding of Process Models. Communications of the AIS 28, 65–84 (2011)
Reijers, H.A., Mendling, J.: A Study Into the Factors That Influence the Understandability of Business Process Models. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 41, 449–462 (2011)
Reijers, H.A., Mendling, J., Dijkman, R.M.: Human and automatic modularizations of process models to enhance their comprehension. Information Systems 36, 881–897 (2011)
Sánchez-González, L., Ruiz, F., García, F., Cardoso, J.: Towards thresholds of control flow complexity measures for BPMN models. In: Proceedings of the ACM Symposium on Applied Computing, SAC 2011, TaiChung, pp. 1445–1450 (2011)
Schalles, C., Creagh, J., Rebstock, M.: Usability of Modelling Languages for Model Interpretation: An Empirical Research Report. In: Bernstein, A., Schwabe, G. (eds.) 10th International Conference on Wirtschaftsinformatik, Zurich, Switzerland, pp. 787–796 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Houy, C., Fettke, P., Loos, P. (2012). Understanding Understandability of Conceptual Models – What Are We Actually Talking about?. In: Atzeni, P., Cheung, D., Ram, S. (eds) Conceptual Modeling. ER 2012. Lecture Notes in Computer Science, vol 7532. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34002-4_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-34002-4_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-34001-7
Online ISBN: 978-3-642-34002-4
eBook Packages: Computer ScienceComputer Science (R0)