Skip to main content
SpringerLink
Log in
Book cover

International Conference on Conceptual Modeling

ER 2003: Conceptual Modeling for Novel Application Domains pp 80–91Cite as

Multiperspective Evaluation of Reference Models – Towards a Framework

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2814))

Abstract

Within the information systems field, reference models have been known for many years. Despite the relevance of reference model quality, little research has been done on their systematic evaluation. Based on an analysis of prior work on reference model quality, we propose a framework for the multiperspective evaluation of reference models. The framework comprises 15 perspectives. Each perspective is discussed with respect to its strengths and limitations. As well, we provide examples of the types of research that have already been undertaken on each perspective.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Frank, U.: Conceptual Modelling as the Core of the Information Systems Discipline – Perspectives and Epistemological Challenges. In: Proceedings of the Fifth Americas Conference on Information Systems (AMCIS 1999), August 13-15, pp. 695–697 (1999)

    Google Scholar 

  2. Mylopoulos, J.: Information Modeling in the Time of the Revolution. Information Systems 23, 127–155 (1998)

    Article  Google Scholar 

  3. Wand, Y., Weber, R.: Research Commentary: Information Systems and Conceptual Modelling – A Research Agenda. Information Systems Research 13, 363–377 (2002)

    Article  Google Scholar 

  4. Scheer, A.-W., Hars, A.: Extending Data Modeling to Cover the Whole Enterprise. Communications of the ACM 35, 166–172 (1992)

    Article  Google Scholar 

  5. Mertins, K., Bernus, P.: Reference Models. In: Bernus, P., Mertins, K., Schmidt, G. (eds.) Handbook on Architectures of Information Systems, pp. 615–617. Springer, Heidelberg (1998)

    Google Scholar 

  6. Mišic, V.B., Zhao, J.L.: Evaluating the Quality of Reference Models. In: Laender, A.H.F., Liddle, S.W., Storey, V.C. (eds.) ER 2000. LNCS, vol. 1920, pp. 484–498. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  7. Scheer, A.-W., Nüttgens, M.: ARIS Architecture and Reference Models for Business Process Management. In: Aalst, W., Desel, J., Oberweis, A. (eds.) Business Process Management – Models, Techniques, and Empirical Studies, pp. 376–389. Springer, Heidelberg (2000)

    Google Scholar 

  8. Scheer, A.-W.: Business Process Engineering – Reference Models for Industrial Companies, 2nd edn. Springer, Berlin (1994)

    Google Scholar 

  9. Schütte, R.: Architectures for Evaluating the Quality of Information Models – A Meta and Object Level Comparison. In: Akoka, J., Bouzeghoub, M., Comyn-Wattiau, I., Métais, E. (eds.) ER 1999. LNCS, vol. 1728, pp. 490–505. Springer, Heidelberg (1999)

    Google Scholar 

  10. Bernus, P., Mertins, K., Schmidt, G.: Handbook on Architectures of Information Systems. Springer, Heidelberg (1998)

    Book  Google Scholar 

  11. Fettke, P., Loos, P.: Classification of reference models – a methodology and its application. Information Systems and e-Business Management 1, 35–53 (2003)

    Article  Google Scholar 

  12. Vessey, I., Ramesh, V., Glass, R.L.: A Unified Classification System for Research in the Computing Disciplines. Available: http://www.bus.indiana.edu/ardennis/wp/tr107-1.doc

  13. Siau, K., Rossi, M.: Evaluating of Information Modeling Methods – A Review. In: Proceedings of the 31th Hawaii International Conference on Systems Science, HICSS 1998 (1998)

    Google Scholar 

  14. Moody, D.L., Shanks, G.G.: Improving the quality of data models: empirical validation of a quality management framework. Information Systems 28, 619–650 (2003)

    Article  MATH  Google Scholar 

  15. Mišic, V. B., Zhao, J. L.: Reference Models for Electronic Commerce (2003), Available http://www.bm.ust.hk/~zhao/HKDC-misiczhao.pdf

  16. Wisse, P.: Metapattern – Context and Time in Information Models. Addison-Wesley, Reading (2001)

    Google Scholar 

  17. Rising, L.: The Pattern Almanac 2000. Addison-Wesley, Reading (2000)

    Google Scholar 

  18. Schütte, R.: Grundsätze ordnungsmäßiger Referenzmodellierung – Konstruktion konfigurations- und anpassungsorientierter Modelle. Gabler, Wiesbaden (1998)

    Google Scholar 

  19. Schuette, R., Rotthowe, T.: The Guidelines of Modeling – An Approach to Enhance the Quality in Information Models. In: Ling, T.-W., Ram, S., Li Lee, M. (eds.) ER 1998. LNCS, vol. 1507, pp. 240–254. Springer, Heidelberg (1998)

    Google Scholar 

  20. Lindland, O.I., Sindre, G., Sølvberg, A.: Understanding Quality in Conceptual Modeling. IEEE Software, 42–49 (1994)

    Google Scholar 

  21. Krogstie, J.: Conceptual Modeling for Computerized Information Systems Support in Organizations. University of Trondheim (1995)

    Google Scholar 

  22. Daneva, M., Scheer, A.-W.: Benchmarking Business Process Models. Institut für Wirtschaftsinformatik, Universität des Saarlandes, Arbeitsbericht 136 Saarbrücken (1996)

    Google Scholar 

  23. Moody, D.L.: Metrics for Evaluating the Quality of Entity Relationship Models. In: Ling, T.-W., Ram, S., Li Lee, M. (eds.) ER 1998. LNCS, vol. 1507, pp. 211–225. Springer, Heidelberg (1998)

    Google Scholar 

  24. Mühlen zur, M.: Evaluation of Workflow Management Systems Using Meta Models. In: Proceedings of the 32th Hawaii International Conference on Systems Science, HICSS 1999 (1999)

    Google Scholar 

  25. Paulk, M.C., Curtis, B., Chrissis, M.B., Weber, C.V.: Capability Maturity Model for Software, Version 1.1. Software Engineering Institute – Carnegie Mellon University, CMU/SEI-93-TR-024 Pittsburgh, Pennsylvania (1993)

    Google Scholar 

  26. Klein, H.K., Lyytinen, K.: Towards a New Understanding of Data Modelling. In: Floyd, C., Züllighoven, H., Budde, R., Keil-Slawik, R. (eds.) Software Development and Reality Construction, pp. 203–219. Springer, Heidelberg (1992)

    Google Scholar 

  27. Hirschheim, R., Klein, H.K., Lyytinen, K.: Information Systems Development and Data Modeling – Conceptual and Philosophical Foundations. Press Syndicate for the University of Cambridge, Cambridge (1995)

    Google Scholar 

  28. Loos, P.: Produktionslogistik in der chemischen Industrie – Betriebstypologische Merkmale und Informationsstrukturen. Gabler, Wiesbaden (1997)

    Google Scholar 

  29. Malone, T.W., Crowston, K., Lee, J., Pentland, B., Dellarocas, C., Wyner, G., Quimby, J., Osborn, C.S., Bernstein, A., Herman, G., Klein, M., O’Donnell, E.: Tools for inventing organizations. Toward a handbook of organizational processes. Management Science 45, 425–443 (1999)

    Google Scholar 

  30. Bunge, M.: Ontology I: The Furniture of the World. D. Reidel, Dordrecht (1977)

    MATH  Google Scholar 

  31. Wand, Y., Monarchi, D.E., Parsons, J., Woo, C.C.: Theoretical foundations for conceptual modelling in information systems development. Decision Support Systems 15, 285–304 (1995)

    Article  Google Scholar 

  32. Fettke, P., Loos, P.: Ontological evaluation of reference models using the Bunge-Wand-Weber-model. In: Americas Conference on Information Systems (2003) (accepted)

    Google Scholar 

  33. Opdahl, A.L., Henderson-Sellers, B.: Ontological Evaluation of the UML Using the Bunge-Wand-Weber Model. Software and Systems Modeling 1, 43–67 (2002)

    Google Scholar 

  34. Bodart, F., Patel, A., Sim, M., Weber, R.: Should Optional Properties Be Used in Conceptual Modelling? A Theory and Three Empirical Tests. Information Systems Research 12, 384–405 (2001)

    Article  Google Scholar 

  35. Milton, S., Kazmierczak, E., Thomas, L.: Ontological Foundations of Data Modeling in Information Systems. In: Proceedings of the Sixth Americas Conference on Information Systems (AMCIS 2000), August 10-13, pp. 1537–1543 (2000)

    Google Scholar 

  36. Siau, K.: Information Modeling and Method Engineering: A Psychological Perspective. Journal of Database Management 10, 44–50 (1999)

    Google Scholar 

  37. Kim, J., Hahn, J., Hahn, H.: How Do We Unterstand a System with (So) Many Diagrams? Cognitive Integration Processes in Diagrammatic Reasoning. Information Systems Research 11, 284–303 (2000)

    Article  Google Scholar 

  38. Maier, R.: Qualität von Datenmodellen. Gabler, Wiesbaden (1996)

    Google Scholar 

  39. Prechelt, L., Unger, B., Tichy, W.F., Brössler, P., Votta, L.G.: A Controlled Experiment in Maintenance Comparing Design Patterns to Simpler Solutions. IEEE Transactions on Software Engineering 27, 1134–1144 (2001)

    Article  Google Scholar 

  40. Burton-Jones, A., Meso, P.: How Good are these UML Diagrams? An Empirical Test of the Wand and Weber Good Decomposition Model. In: Twenty-Third International Conference on Information Systems, pp. 101–114 (2002)

    Google Scholar 

  41. Kim, Y.-G., March, S.T.: Comparing data modeling formalisms. Communications of the ACM 38, 103–115 (1995)

    Article  Google Scholar 

  42. Shanks, G., Tansley, E., Nuredini, J., Tobin, D., Weber, R.: Representing Part-Whole Relationships in Conceptual Modeling: An Empirical Evaluation. In: Twenty-Third International Conference on Information Systems, pp. 89–100 (2002)

    Google Scholar 

  43. Weber, R.: Are Attributes Entities? A Study of Database Designer’s Memory Structures. Information Systems Research 7, 137–162 (1996)

    Article  Google Scholar 

  44. Schwegmann, A.: Objektorientierte Referenzmodellierung – Theoretische Grundlagen und praktische Anwendung. DUV, Wiesbaden (1999)

    Google Scholar 

  45. Buchwalter, J.: Elektronische Ausschreibungen in der Beschaffung – Referenzprozeßmodell und prototypische Realisierung. Eul, Lohmar, Köln (2002)

    Google Scholar 

  46. Becker, J., Kugeler, M., Rosemann, M.: Process Management. Springer, Heidelberg (2003)

    Google Scholar 

  47. Avison, D.E., Lau, F., Myers, M.D., Nielsen, P.A.: Action Research. Communications of the ACM 42, 94–97 (1999)

    Article  Google Scholar 

  48. Moody, D.L., Shanks, G.G.: Improving the Quality of Entity Relationship Models: An Action Research Programme. The Australian Computer Journal 30, 129–138 (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Lehrstuhl für Wirtschaftsinformatik und Betriebswirtschaftslehre, ISYM – Information Systems & Management, Johannes Gutenberg-University Mainz, D-55099, Mainz, Germany

    Peter Fettke & Peter Loos

Authors
  1. Peter Fettke
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Peter Loos
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. CRISM/Infolab, Tilburg University, 5000, Tilburg, LE, The Netherlands

    Manfred A. Jeusfeld

  2. Department of Information Systems and Computation, Technical University of Valencia, Camino de Vera s/n, 46022, Valencia, Spain

    Óscar Pastor

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fettke, P., Loos, P. (2003). Multiperspective Evaluation of Reference Models – Towards a Framework. In: Jeusfeld, M.A., Pastor, Ó. (eds) Conceptual Modeling for Novel Application Domains. ER 2003. Lecture Notes in Computer Science, vol 2814. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39597-3_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-39597-3_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-20257-8

  • Online ISBN: 978-3-540-39597-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation