Abstract
Artifact flow represents an important aspect of teaching / learning processes, especially in CSCL situations in which complex relationships may be found. However, consistent modeling of CSCL processes with artifact flow may increase the cognitive load and associated effort of the teachers-designers and therefore decrease the efficiency of the design process. The empirical study, reported in this paper and grounded on mixed methods, provides evidence of the effort overload when teachers are involved in designing CSCL situations in a controlled environment. The results of the study illustrate the problem through the subjective perception of the participating teachers, complemented with objective parameters, such as time consumed or errors committed, and objective complexity metrics.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
The original questionnaires used in the study can be accessed at http://goo.gl/gS0Mxp [Q0] and http://goo.gl/vdOZCp [Q3].
References
Ameri, F., Summers, J., Mocko, G., Porter, M.: Engineering design complexity: an investigation of methods and measures. Res. Eng. Des. 19(2–3), 161–179 (2008)
Bordiés, O., Dimitriadis, Y.: Using objective metrics to measure the effort overload in CSCL design processes that support artifact flow. In: 2014 IEEE 14th International Conference on Advanced Learning Technologies (ICALT). IEEE, Athens, Greece (2014)
Bordiés, O., Papasalouros, A., Dimitriadis, Y.: Estimating the gap between informal descriptions and formal models of artifact flows in CSCL. In: de Freitas, S., Rensing, C., Ley, T., Muñoz-Merino, P.J. (eds.) EC-TEL 2014. LNCS, vol. 8719, pp. 554–555. Springer, Heidelberg (2014)
Braha, D., Maimon, O.: The measurement of a design structural and functional complexity. Syst. Man Cybern. Part A: Syst. Humans 28(4), 527–535 (1998)
Cardoso, J.: Process control-flow complexity metric: an empirical validation. In: IEEE International Conference on Services Computing, 2006. SCC 2006, pp. 167–173. SCC 2006. IEEE Computer Society, Washington, DC, USA (2006)
Casey, J., Brosnan, K., Greller, W., Masson, A., MacNeill, A., Murphy, C.: Designing for change: visual design tools to support process change in education. Handbook of Visual Languages in Instructional Design: Theories and Practices, pp. 413–438 (2008)
Conole, G.: Designing for Learning in an Open World. Explorations in the Learning Sciences, Instructional Systems and Performance Technologies, vol. 4. Springer, New York (2012)
Creswell, J.W.: Research Design: Qualitative, Quantitative, and Mixed Methods approaches. Sage publications, Los Angeles (2013)
Derntl, M., Neumann, S., Griffiths, D., Oberhuemer, P.: The conceptual structure of ims learning design does not impede its use for authoring. IEEE Trans. Learn. Technol. 5(1), 74–86 (2012)
Dillenbourg, P., Tchounikine, P.: Flexibility in macro-scripts for computer-supported collaborative learning. J. Comput. Assist. Learn. 23(1), 1–13 (2007)
Dochy, F., Segers, M., Sluijsmans, D.: The use of self-, peer and co-assessment in higher education: a review. Stud. High. Educ. 24(3), 331–350 (1999)
Hernández-Leo, D., Villasclaras-Fernandez, E., Asensio-Perez, J., Dimitriadis, Y., Retalis, S.: CSCL scripting patterns: hierarchical relationships and applicability. In: Sixth International Conference on Advanced Learning Technologies, 2006, pp. 388–392. ICALT 2006. IEEE Computer Society, Washington, DC, USA (2006)
Jung, J.Y., Chin, C.H., Cardoso, J.: An entropy-based uncertainty measure of process models. Inf. Process. Lett. 111(3), 135–141 (2011)
Karakostas, A., Demetriadis, S.: Adaptation patterns as a conceptual tool for designing the adaptive operation of CSCL systems. Educ. Technol. Res. Dev. 59(3), 327–349 (2011)
Karakostas, A., Prieto, L.P., Dimitriadis, Y.: Opportunities and challenges for adaptive collaborative support in distributed learning environments: evaluating the GLUE! suite of tools. In: 2012 IEEE 12th International Conference on Advanced Learning Technologies (ICALT), pp. 446–450. IEEE (2012)
Malone, T.W., Crowston, K.: The interdisciplinary study of coordination. ACM Comput. Surv. 26(1), 87–119 (1994)
McKenney, S., Kali, Y., Markauskaite, L., Voogt, J.: Teacher design knowledge for technology enhanced learning: an ecological framework for investigating assets and needs. Instr. Sci. 43(2), 181–202 (2015)
Mendling, J.: Metrics for Process Models: Empirical Foundations of Verification, Error Prediction, and Guidelines for Correctness. Lectures Notes in Business Information Processing. Springer, Heidelberg (2008)
Mendling, J.: Metrics for business process models. In: Aalst, W., Mylopoulos, J., Rosemann, M., Shaw, M.J., Szyperski, C. (eds.) Metrics for Process Models. Lecture Notes in Business Information Processing, vol. 6, pp. 103–133. Springer, Heidelberg (2009). Chapter 4
Miao, Y., Burgos, D., Griffiths, D., Koper, R.: Representation of coordination mechanisms in IMS learning design to support group-based learning. In: Lockyer, L., Bennet, S., Agostinho, S., Harper, B. (eds.) Handbook of Research on Learning Design and Learning Objects: Issues, Applications and Technologies, pp. 330–351. IDEA group, Hershey (2008)
Muketha, G., Ghani, A., Selamat, M., Atan, R.: A survey of business process complexity metrics. Inf. Technol. J. 9(7), 1336–1344 (2010)
Palomino-Ramírez, L., Bote-Lorenzo, M., Asensio-Pérez, J., de la Fuente-Valentín, L., Dimitriadis, Y.: The data flow problem in learning design: a case study. In: Proceedings of the 2008 8th International Conference on Networked Learning, NLC, pp. 285–292. NLC 2008 (2008)
Prieto, L.P., Tchounikine, P., Asensio-Pérez, J.I., Sobreira, P., Dimitriadis, Y.: Exploring teachers’ perceptions on different CSCL script editing tools. Comput. Educ. 78, 383–396 (2014)
Rodríguez-Triana, M.J., Martínez-Monés, A., Asensio-Pérez, J.I., Dimitriadis, Y.: Towards a script-aware monitoring process of computer-supported collaborative learning scenarios. Int. J. Technol. Enhanced Learn. 5(2), 151–167 (2013)
Sánchez-González, L., García, F., Ruiz, F., Velthuis, M.P.: Measurement in business processes: a systematic review. Bus. Process Manag. J. 16(1), 114–134 (2010)
Sen, C., Ameri, F., Summers, J.D.: An entropic method for sequencing discrete design decisions. J. Mech. Des. 132(10), 1–11 (2010)
Sobreira, P., Tchounikine, P.: A model for flexibly editing CSCL scripts. Int. J. Comput.-Support. Collaborative Learn. 7(4), 567–592 (2012)
Summers, J.D., Shah, J.J.: Mechanical engineering design complexity metrics: size, coupling, and solvability. J. Mech. Des. 132(2), 021004-1–021004-11 (2010)
Suthers, D.: Technology affordances for intersubjective meaning making: a research agenda for CSCL. Int. J. Comput.-Support. Collaborative Learn. 1(3), 315–337 (2006)
Wu, Y., Hernandez, F., Ortega, F., Clarke, P.J., France, R.: Measuring the effort for creating and using domain-specific models. In: Proceedings of the 10th Workshop on Domain-Specific Modeling. pp. 14:1–14:6. DSM 2010. ACM, New York, NY, USA (2010)
Acknowledgments
This research has been partially funded by the Autonomous Government of Castilla and León, Spain (ORDEN EDU/346/2013), the Spanish Ministry of Economy and Competitiveness (Project TIN2011-28308-C03-02) and the European Education, Audiovisual and Culture Executive Agency Project 531262-LLP-2012-ES-KA3-KA3MP. The authors would like to thank the rest of the GSIC/EMIC research team, for their effort and contributions to the ideas expressed in this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Bordiés, O., Dimitriadis, Y. (2015). Measuring the Effort Demanded by CSCL Design Processes Supporting a Consistent Artifact Flow. In: Baloian, N., Zorian, Y., Taslakian, P., Shoukouryan, S. (eds) Collaboration and Technology. CRIWG 2015. Lecture Notes in Computer Science(), vol 9334. Springer, Cham. https://doi.org/10.1007/978-3-319-22747-4_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-22747-4_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22746-7
Online ISBN: 978-3-319-22747-4
eBook Packages: Computer ScienceComputer Science (R0)