Abstract
We use eye tracking to better understand the attentional characteristics specific to successful error detection in conceptual models. This phase of our multi-step research project describes the visual comportments associated with successful semantic and syntactic error identification and diagnosis. We test our predictions, based on prior studies on visual attention in an error detection task, or studies comparing experts and non-experts in diverse tasks, in a controlled experiment where participants are tasked with detecting and diagnosing errors in 75 BPMN® models. The results suggest that successful error diagnostics are linked with shorter total view time and shorter fixation duration, with a significant difference between semantic and syntactic errors. By identifying the visual attention differences and tendencies associated with successful detection tasks and the investigation of semantic and syntactic errors, we highlight the non-polarity of the ‘scale’ of expertise and allow clear recommendations for curriculum development and training methods.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Recker, J.C., Dreiling, A.: Does it matter which process modelling language we teach or use? An experimental study on understanding process modelling languages without formal education. In: Toleman, M., Cater-Steel, A., Roberts, D. (eds.) 18th Australasian Conference on Information Systems, Toowoomba, Australia, pp. 356–366 (2007)
Parsons, J., Cole, L.: What do the pictures mean? Guidelines for experimental evaluation of representation fidelity in diagrammatical conceptual modeling techniques. Data Knowl. Eng. 55(3), 327–342 (2005)
Gemino, A., Wand, Y.: Comparing mandatory and optional properties in conceptual data modeling. In: Proceedings of the Tenth Annual Workshop on Information Technologies and Systems, Brisbane, pp. 97–102 (2000)
Gemino, A., Wand, Y.: Evaluating modeling techniques based on models of learning. Commun. ACM 46(10), 79–84 (2003)
Gegenfurtner, A., Lehtinen, E., Säljö, R.: Expertise differences in the comprehension of visualizations: a meta-analysis of eye-tracking research in professional domains. Educ. Psychol. Rev. 23(4), 523–552 (2011)
Shanks, G.: Conceptual data modelling: an empirical study of expert and novice data modellers. Australas. J. Inf. Syst. 4(2) (1997)
Davis, C.J., Hevner, A.R., Labonte-LeMoyne, É., Léger, P.-M.: Expertise as a mediating factor in conceptual modeling. In: Information Systems and Neuroscience, pp. 85–92. Springer, Berlin (2018)
Moody, D.: The “physics” of notations: toward a scientific basis for constructing visual notations in software engineering. IEEE Trans. Softw. Eng. 35(6), 756–779 (2009)
Van Waes, L., Leijten, M., Quinlan, T.: Reading during sentence composing and error correction: a multilevel analysis of the influences of task complexity. Read. Writ. 23(7), 803–834 (2009)
Henderson, J.M., Hollingworth, A.: The role of fixation position in detecting scene changes across saccades. Psychol. Sci. 10(5), 438–443 (1999)
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. OUP, Oxford (2011)
Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24(6), 631–645 (1999)
Yusuf, S., Kagdi, H., Maletic, J.I.: Assessing the comprehension of UML class diagrams via eye tracking. In: Program Comprehension, 2007. ICPC’07, 15th IEEE International Conference, pp. 113–122 (2007)
Krupinski, E.A.: The importance of perception research in medical imaging. Radiat. Med. 18(6), 329–334 (2000)
Reingold, E.M., Sheridan, H.: Eye movements and visual expertise in chess and medicine. Oxf. Handb. Eye Movements, 528–550 (2011)
Sheridan, H., Reingold, E.M.: Expert vs. novice differences in the detection of relevant information during a chess game: evidence from eye movements. Front Psychol. 5, 941 (2014)
Glaser, R.: Education and thinking: the role of knowledge. Am. Psychol. 39(2), 93 (1984)
Lurigio, A.J., Carroll, J.S.: Probation officers’ schemata of offenders: content, development, and impact on treatment decisions. J. Pers. Soc. Psychol. 48(5), 1112 (1985)
Gemino, A., Wand, Y.: A framework for empirical evaluation of conceptual modeling techniques. Requirements Eng. 9(4), 248–260 (2004)
Birkmeier, D., Kloeckner, S., Overhage, S.: An empirical comparison of the usability of BPMN and UML activity diagrams for business users. In: ECIS, p. 2 (2010)
Bavota, G., Gravino, C., Oliveto, R., De Lucia, A., Tortora, G., Genero, M., Cruz-Lemus, J.A.: Identifying the weaknesses of UML class diagrams during data model comprehension. In: International Conference on Model Driven Engineering Languages and Systems, pp. 168–182. Springer, Berlin (2011)
Just, M.A., Carpenter, P.A.: Eye fixations and cognitive processes. Cogn. Psychol. 8(4), 441–480 (1976)
Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)
Browne, G.J., Pitts, M.G.: Stopping rule use during information search in design problems. Organ. Behav. Hum. Decis. Process. 95(2), 208–224 (2004)
Nickles, K.R., Curley, S.P., Benson, P.G.: Judgment-Based and Reasoning-Based Stopping Rules in Decision Making Under Uncertainty, vol. 7285. University of Minnesota (1995)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Boutin, KD., Léger, PM., Davis, C.J., Hevner, A.R., Labonté-LeMoyne, É. (2019). Attentional Characteristics of Anomaly Detection in Conceptual Modeling. In: Davis, F., Riedl, R., vom Brocke, J., Léger, PM., Randolph, A. (eds) Information Systems and Neuroscience. Lecture Notes in Information Systems and Organisation, vol 29. Springer, Cham. https://doi.org/10.1007/978-3-030-01087-4_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-01087-4_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-01086-7
Online ISBN: 978-3-030-01087-4
eBook Packages: Business and ManagementBusiness and Management (R0)