Abstract
Collaborative modeling uses and produces modeling artifacts whose quality can help us gauge the effectiveness and efficiency of the modeling process. Such artifacts include the modeling language, the modeling procedure, the products and the support tool or medium. To effectively assess the quality of any collaborative modeling process, the (inter-) dependencies of these artifacts and their effect on modeling process quality need to be analyzed. Although a number of research studies have assessed and measured the quality of collaborative processes, no formal (causal) model has been developed to assess the quality of the collaborative modeling process through a combination of modeling artifacts. This paper develops a Collaborative Modeling Process Quality (CMPQ) construct for assessing the quality of collaborative modeling. A modeling session involving 107 students was used to validate and measure the quality constructs in the model.
Chapter PDF
Similar content being viewed by others
Keywords
References
Barjis, J., Kolfschoten, G.L., Verbraeck, A.: Collaborative Enterprise Modeling. In: Proper, E., Harmsen, F., Dietz, J.L.G. (eds.) PRET 2009, LNBIP, pp. 50–62. Springer, Heidelberg (2009)
Stirna, J., Persson, A.: Ten Years Plus with EKD: Reflections from Using an Enterprise Modeling Method in Practice. In: Proper, H.A., Halpin, T.A., Krogstie, J. (eds.) Proceedings of the EMMSAD 2007, held in conjunctiun with CAiSE 2007, pp. 97–106. Tapir Academic Press, Trondheim (2007)
Gjersvik, R., Krogstie, J., Følstad, A.: Participatory Development of Enterprise Process Models. In: Krogstie, J., Halpin, T., Siau, K. (eds.) Information Modeling Methods and Methodologies, pp. 195–215. IGI Global (2005)
Rittgen, P.: Collaborative Modeling of Business Processes-A Comparative Case Study. In: Proceedings of the 24th Annual ACM Symposium on Applied Computing, Waikiki Beach, Honolulu, Hawaii, pp. 225–230. ACM, New York (2009)
Vennix, J.A.M.: Group Model Building: Facilitating Team Learning Using System Dynamics. Wiley, Chichester (1996)
Vreede, G.J., de Briggs, R.O.: Collaboration Engineering: Designing Repeatable Processes for High-Value Collaborative Task. In: Proceedings of the 38th HICSS Conference, IEEE computer Society Press, Los Alamitos (2005)
Sedera, W., Rosemann, M., Doebeli, G.: A Process Modelling Success Model: Insights From A Case Study. In: 11th ECIS Conference, Naples, Italy, pp. 1–11 (2003)
Davison, R.: An Instrument for Measuring Meeting Success: Revalidation and Modification. Information and Management 36, 321–328 (1999)
Briggs, R.O., Reinig, B.A., de Vreede, G.J.: Meeting Satisfaction for Technology Supported Groups: An Empirical Validation of a Goal-Attainment Model. Small Group Research 37 (2006)
Davis, F.D.: Perceived Usefulness, Perceived Ease of Use and User Acceptance of Information Technology. MIS Quarterly 13(3), 319–340 (1989)
Ssebuggwawo, D., Stijn Hoppenbrouwers, S.J.B.A., Proper, H.A.: Evaluating Modeling Sessions Using the Analytic Hierarchy Process. In: Persson, A., Stirna, J. (eds.) PoEM 2009, LNBIP, vol. 39, pp. 69–83. Springer, Heidelberg (2009)
Moody, D., Sindre, G., Brasethvik, T., Sølvberg, A.: Evaluating the Quality of Process Models: Empirical Analysis of a Quality Framework. In: Spaccapietra, S., March, S.T., Kambayashi, Y. (eds.) ER 2002. LNCS, vol. 2503, p. 380. Springer, Heidelberg (2002)
Nysetvold, A.G., Krogstie, J.: Assessing Business Process Modeling Languages Using a Generic Quality Framework. In: Halpin, T., Krogstie, J., Siau, K. (eds.) Proceedings of the EMMSAD 2005 held in conjuction with CAiSE 2005, Porto, Lisboa, pp. 545–556. Idea Group, USA (2005)
Locke, E.A., Latham, G.P.: A Theory of Goal Setting and Task Performance. Prentice Hall, Eaglewood Cliffs (1990)
Briggs, R.O., de Vreede, G.J., Reinig, B.A.: A Theory and Measurement of Meeting Satisfaction. In: Proccedings of the 26th HICCS Conference (HICCS 2003), p. 25c . IEEE Computer Society, Los Alamitos (2003)
Duivenvoorde, G.P.J., Kolfschoten, G.L., Briggs, R.O., de Vreede, G.J.: Towards an Instrument to Measure the Successfulness of Collaborative Effort from the Participant Perspective. In: Proceedings of the 42nd HICCS Conference (HICCS 2009), pp. 1–9. IEEE Computer Society, Los Alamitos (2009)
Paul, S., Seetharaman, P., Ramamurthy, K.: User Satisfaction with System, Decision Process and Outcome in GDSS-Based Meeting: An Experimental Investigation. In: Proceedings of the 37th HICSS Conference (HICSS 2004), pp. 37–46. IEEE Computer Society, Washington (2004)
Dean, D.L., Orwig, R.E., Vogel, D.R.: Facilitation Methods for Collaborative Modeling Tools. Group Decision and Negotiation 9, 109–127 (2000)
Reinig, B.A: Towards Understanding of Satisfaction with the Process and Outcomes of Teamwork. Journal of MIS 19, 65–83 (2003)
Krogstie, J.: A Semiotic Approach to Quality in Requirements Specifications. In: Proceedings of the IFIP TC8 /WG8.1 Working Conference on Organizational Semiotics: Evolving a Science of Information Systems, Montreal, Canada, pp. 231–249. Kluwer B.V., The Netherlands (2001)
Dean, D.L., Orwig, R.E., Vogel, D.R.: Technological Support for Group Process Modeling. Journal of MIS 11(3), 43–64 (1994)
de Vreede, G.J.: Collaborative Business Engineering with Animated Electronic Meetings. Journal of MIS 14(3), 141–164 (1997)
Fjermestad, J., Hiltz, S.R.: A Decsriptive Evaluation of Group Support Systems and Case Field Studies. Journal of MIS 17, 115–159 (2001)
Fjermestad, J., Hiltz, S.R.: An Assessment of Group Support Systems. Experimental Research: Methodology and Results. Journal of MIS 15, 7–149 (1999)
Rittgen, P.: Collaborative Modelling Architecture (COMA), http://www.coma.nu/COMA_Tool.pdf (accessed on: 09/08/2010)
den Hengst, M., Dean, D.L., Kolfschoten, G.L., Chakrapani, A.: Assessing the Quality of Collaborative Processes. In: Proceedings of the 39th Annual HICCS Conference (HICCS 2006), vol. 1, p. 16b . IEEE Computer Society, Los Alamitos (2006)
Green, S.G., Taber, T.D.: The Effect of Three Social Decision Schemes on Decision Group Processes. Organizational Behaviour and Human Performance 25(1), 97–106 (1980)
Straub, D.W.: Validating Instruments in MIS Research. MIS Quarterly 13, 47–169 (1989)
Straub, D., Boudreau, M.-C., Gefen, D.: Validation Guidelines for IS Positivist Research. Communication of the AIS 13, 380–427 (2004)
Lynn, M.: Determination and Quantification of Content Validity. Nursing Research 35(6), 382–385 (1986)
Joliffe, I.T.: Principal Component Analysis, 2nd edn. Springer Series in Statistics. Springer, Heidelberg (2002)
Tabachnick, B.G., Fidell, L.S.: Using Multivariate Statistics, 4th edn. Harper Collins, New York (2001)
Gefen, D., Straub, D., Boudreau, M.-C.: Structural Equation Modeling and Regression Guidelines for Research Practice. Communication of the AIS 4(7), 1–78 (2000)
Cortina, J.M.: What is Coefficient Alpha? An Examination of Theory and Application. Journal of Applied Psychology 78, 98–104 (1993)
Nunnally, J.C.: Psychometric Theory 2nd edn, McGraw-Hill, New York (1978)
Hair, J.F., Tatham, R.L., Anderson, R.E., Black, W.: Multivariate Data Analysis, 5th edn. Prentice-Hall, Upper Saddle River (1998)
Brown, T.A.: Confirmatory Factor Analysis for Applied Research. Guilford Press, New York (2006)
Albright, J.J., Hun, M.P.: Confirmatory Factor Analysis Using Amos, LISREL, Mplus, and SAS/STAT CALIS. Technical Working Paper. The University Information Technology Services (UITS) Center for Statistical and Mathematical Computing, Indiana University, http://www.indiana.edu/all/cfa/cfa.pdf (accessed on: 17/08/2010)
Raykov, T., Marcoulides, G.A.: A First Course in Structural Equation Modeling, 2nd edn. Psychology Group Taylor & Francis Group, New York (2006)
Arbuckle, J.L.: AMOS 18: User’s Guide. SPSS Inc., Chicago (2009)
Tojib, D.R., Sugiant, L., Sendjay, F.: User Satisfaction with Business-to-Employee Portals: Conceptualization and Scale Development. EJIS 17, 649–667 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 IFIP International Federation for Information Processing
About this paper
Cite this paper
Ssebuggwawo, D., Hoppenbrouwers, S., Proper, E. (2010). Assessing Collaborative Modeling Quality Based on Modeling Artifacts. In: van Bommel, P., Hoppenbrouwers, S., Overbeek, S., Proper, E., Barjis, J. (eds) The Practice of Enterprise Modeling. PoEM 2010. Lecture Notes in Business Information Processing, vol 68. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16782-9_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-16782-9_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-16781-2
Online ISBN: 978-3-642-16782-9
eBook Packages: Computer ScienceComputer Science (R0)