Skip to main content

Attentional Characteristics of Anomaly Detection in Conceptual Modeling

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Information Systems and Organisation ((LNISO,volume 29))

Abstract

We use eye tracking to better understand the attentional characteristics specific to successful error detection in conceptual models. This phase of our multi-step research project describes the visual comportments associated with successful semantic and syntactic error identification and diagnosis. We test our predictions, based on prior studies on visual attention in an error detection task, or studies comparing experts and non-experts in diverse tasks, in a controlled experiment where participants are tasked with detecting and diagnosing errors in 75 BPMN® models. The results suggest that successful error diagnostics are linked with shorter total view time and shorter fixation duration, with a significant difference between semantic and syntactic errors. By identifying the visual attention differences and tendencies associated with successful detection tasks and the investigation of semantic and syntactic errors, we highlight the non-polarity of the ‘scale’ of expertise and allow clear recommendations for curriculum development and training methods.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Recker, J.C., Dreiling, A.: Does it matter which process modelling language we teach or use? An experimental study on understanding process modelling languages without formal education. In: Toleman, M., Cater-Steel, A., Roberts, D. (eds.) 18th Australasian Conference on Information Systems, Toowoomba, Australia, pp. 356–366 (2007)

    Google Scholar 

  2. Parsons, J., Cole, L.: What do the pictures mean? Guidelines for experimental evaluation of representation fidelity in diagrammatical conceptual modeling techniques. Data Knowl. Eng. 55(3), 327–342 (2005)

    Article  Google Scholar 

  3. Gemino, A., Wand, Y.: Comparing mandatory and optional properties in conceptual data modeling. In: Proceedings of the Tenth Annual Workshop on Information Technologies and Systems, Brisbane, pp. 97–102 (2000)

    Google Scholar 

  4. Gemino, A., Wand, Y.: Evaluating modeling techniques based on models of learning. Commun. ACM 46(10), 79–84 (2003)

    Article  Google Scholar 

  5. Gegenfurtner, A., Lehtinen, E., Säljö, R.: Expertise differences in the comprehension of visualizations: a meta-analysis of eye-tracking research in professional domains. Educ. Psychol. Rev. 23(4), 523–552 (2011)

    Article  Google Scholar 

  6. Shanks, G.: Conceptual data modelling: an empirical study of expert and novice data modellers. Australas. J. Inf. Syst. 4(2) (1997)

    Google Scholar 

  7. Davis, C.J., Hevner, A.R., Labonte-LeMoyne, É., Léger, P.-M.: Expertise as a mediating factor in conceptual modeling. In: Information Systems and Neuroscience, pp. 85–92. Springer, Berlin (2018)

    Chapter  Google Scholar 

  8. Moody, D.: The “physics” of notations: toward a scientific basis for constructing visual notations in software engineering. IEEE Trans. Softw. Eng. 35(6), 756–779 (2009)

    Article  Google Scholar 

  9. Van Waes, L., Leijten, M., Quinlan, T.: Reading during sentence composing and error correction: a multilevel analysis of the influences of task complexity. Read. Writ. 23(7), 803–834 (2009)

    Article  Google Scholar 

  10. Henderson, J.M., Hollingworth, A.: The role of fixation position in detecting scene changes across saccades. Psychol. Sci. 10(5), 438–443 (1999)

    Article  Google Scholar 

  11. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. OUP, Oxford (2011)

    Google Scholar 

  12. Goldberg, J.H., Kotval, X.P.: Computer interface evaluation using eye movements: methods and constructs. Int. J. Ind. Ergon. 24(6), 631–645 (1999)

    Article  Google Scholar 

  13. Yusuf, S., Kagdi, H., Maletic, J.I.: Assessing the comprehension of UML class diagrams via eye tracking. In: Program Comprehension, 2007. ICPC’07, 15th IEEE International Conference, pp. 113–122 (2007)

    Google Scholar 

  14. Krupinski, E.A.: The importance of perception research in medical imaging. Radiat. Med. 18(6), 329–334 (2000)

    Google Scholar 

  15. Reingold, E.M., Sheridan, H.: Eye movements and visual expertise in chess and medicine. Oxf. Handb. Eye Movements, 528–550 (2011)

    Google Scholar 

  16. Sheridan, H., Reingold, E.M.: Expert vs. novice differences in the detection of relevant information during a chess game: evidence from eye movements. Front Psychol. 5, 941 (2014)

    Google Scholar 

  17. Glaser, R.: Education and thinking: the role of knowledge. Am. Psychol. 39(2), 93 (1984)

    Article  Google Scholar 

  18. Lurigio, A.J., Carroll, J.S.: Probation officers’ schemata of offenders: content, development, and impact on treatment decisions. J. Pers. Soc. Psychol. 48(5), 1112 (1985)

    Article  Google Scholar 

  19. Gemino, A., Wand, Y.: A framework for empirical evaluation of conceptual modeling techniques. Requirements Eng. 9(4), 248–260 (2004)

    Article  Google Scholar 

  20. Birkmeier, D., Kloeckner, S., Overhage, S.: An empirical comparison of the usability of BPMN and UML activity diagrams for business users. In: ECIS, p. 2 (2010)

    Google Scholar 

  21. Bavota, G., Gravino, C., Oliveto, R., De Lucia, A., Tortora, G., Genero, M., Cruz-Lemus, J.A.: Identifying the weaknesses of UML class diagrams during data model comprehension. In: International Conference on Model Driven Engineering Languages and Systems, pp. 168–182. Springer, Berlin (2011)

    Google Scholar 

  22. Just, M.A., Carpenter, P.A.: Eye fixations and cognitive processes. Cogn. Psychol. 8(4), 441–480 (1976)

    Article  Google Scholar 

  23. Rayner, K.: Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124(3), 372 (1998)

    Article  Google Scholar 

  24. Browne, G.J., Pitts, M.G.: Stopping rule use during information search in design problems. Organ. Behav. Hum. Decis. Process. 95(2), 208–224 (2004)

    Article  Google Scholar 

  25. Nickles, K.R., Curley, S.P., Benson, P.G.: Judgment-Based and Reasoning-Based Stopping Rules in Decision Making Under Uncertainty, vol. 7285. University of Minnesota (1995)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Karl-David Boutin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Boutin, KD., Léger, PM., Davis, C.J., Hevner, A.R., Labonté-LeMoyne, É. (2019). Attentional Characteristics of Anomaly Detection in Conceptual Modeling. In: Davis, F., Riedl, R., vom Brocke, J., Léger, PM., Randolph, A. (eds) Information Systems and Neuroscience. Lecture Notes in Information Systems and Organisation, vol 29. Springer, Cham. https://doi.org/10.1007/978-3-030-01087-4_7

Download citation

Publish with us

Policies and ethics