Abstract
The operator is frequently considered as the main sources of vulnerability in command and control systems; for example, in a 2006 survey 79% of fatal accidents in aviation were attributed to “human error.” Beyond the case of command and control systems, users’ faults occur not only at use time but also during the design and development of systems. Following Avizienis et al.’s taxonomy for faults, human-made error can be characterized as the operator’s failure to deliver services while interacting with the interactive system. Non human-made errors are called natural faults and may occur during development or set the interactive system as well as its users into an error-state during its use. Focusing on interactive systems specificities, this paper presents a comprehensive description of faults covering both development and operation phases. In correspondence with this taxonomy, we present mechanisms to avoid, remove, tolerate and mitigate faults in order to design and develop what we call “perfect” interactive systems taking into account the organization, the interactive system, the environment and the people operating them. We define an interactive system as perfect when it blends multiple and diverse properties such as usability, security, user experience, dependability, learnability, resilience … We present multiple concrete examples, from aviation and other domains, of faults affecting socio-technical systems and associated fault-tolerant mechanisms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Accot, J., Zhai, S.: Refining Fitts’ law models for bivariate pointing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2003), pp. 193–200. Association for Computing Machinery, New York (2003). https://doi.org/10.1145/642611.642646
Albinsson, P.A., Zhai, S.: High precision touch screen interaction. In: Proceedings of ACM CHI Conference, pp. 105–112 (2003)
Android Material Design guidelines: https://material.io/design/guidelines-overview. Accessed 6 Jul 2021
Kangasrääsiö, A., Athukorala, K., Howes, A., Corander, J., Kaski, S., Oulasvirta, A.: Inferring cognitive models from data using approximate Bayesian computation. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 1295–1306. Association for Computing Machinery, New York (2017).https://doi.org/10.1145/3025453.3025576
Ardito, C., Bernhaupt, R., Palanque, P., Sauer, S.: Handling security, usability, user experience and reliability in user-centered development processes. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11749, pp. 759–762. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29390-1_76
Armour, P.G.: The business of software estimation is not evil. Commun. ACM 57(1), 42–43 (2014)
Avizienis, A., Laprie, J.-C., Randell, B., Landwehr, C.: Basic concepts and taxonomy of dependable and secure computing. IEEE Trans. Dependable Secure Comput. 1(1), 11–33 (2004)
Beaudouin-Lafon, M.: Designing interaction, not interfaces. In: Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2004), pp. 15–22. Association for Computing Machinery, New York (2004). https://doi.org/10.1145/989863.989865
Beirekdar, A., Keita, M., Noirhomme, M., Randolet, F., Vanderdonckt, J., Mariage, C.: Flexible reporting for automated usability and accessibility evaluation of web sites. In: Costabile, M.F., Paternò, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 281–294. Springer, Heidelberg (2005). https://doi.org/10.1007/11555261_25
Benson, B.: Cognitive biases cheat sheet (2016). https://medium.com/better-humans/cognitive-bias-cheat-sheet-55a472476b18. Accessed July 2021
Bernhaupt, R., Navarre, D., Palanque, P., Winckler, M.: Model-based evaluation: a new way to support usability evaluation of multimodal interactive applications. In: Law, E.-C., Hvannberg, E.T., Cockton, G. (eds.) Maturing Usability. HIS, pp. 96–119. Springer, London (2008). https://doi.org/10.1007/978-1-84628-941-5_5
Bernhaupt, R., Palanque, P., Manciet, F., Martinie, C.: User-test results injection into task-based design process for the assessment and improvement of both usability and user experience. In: Bogdan, C., et al. (eds.) HCSE/HESSD -2016. LNCS, vol. 9856, pp. 56–72. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-44902-9_5
Berry, R.: Common user access – a consistent and usable human-computer interface for the SAA environments. IBM Syst. J. 27(3) (1988)
Bias, R.G., Mayhew, D.: Cost-Justifying Usability: An Update for the Internet Age. Morgan Kaufmann Publishers Inc., San Francisco (2005)
Boehm, B., Sullivan, K.: Software economics: a roadmap. In: Proceedings of the Conference on The Future of Software Engineering (ICSE 2000), pp. 319–343 (2000). Association for Computing Machinery, New York. https://doi.org/10.1145/336512.336584
Bouzekri, E., Canny, A., Martinie, C., Palanque, P., Gris, C.: Deep system knowledge required: revisiting UCD contribution in the design of complex command and control systems. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11746, pp. 699–720. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29381-9_42
Bouzekri, E., Martinie, C., Palanque, P., Atwood, K., Gris, C.: Should I add recommendations to my warning system? The RCRAFT framework can answer this and other questions about supporting the assessment of automation designs. In: IFIP TC 13 INTERACT,Conference, LNCS. Springer (2021)
Bowen, J., Stavridou, V.: Formal methods, safety-critical systems and standards. Softw. Eng. J. 8(4), 189–209 (1993)
Bowen, J., Reeves, S.: Generating obligations, assertions and tests from UI models. Proc. ACM Hum. Comput. Interact. 1, 18 (2017). https://doi.org/10.1145/3095807. EICS, Article 5
Buxton, B.: Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco (2007)
Canny, A., Martinie, C., Navarre, D., Palanque, P., Barboni, E., Gris, C.: Engineering model-based software testing of WIMP interactive applications: a process based on formal models and the SQUAMATA tool. Proc. ACM Hum.-Comput. Interact. 5, 30 (2021). https://doi.org/10.1145/3461729. EICS, Article 207
Card, S., Moran, T., Newell, A.: The Psychology of Human-Computer Interaction, pp. I–XIII, 1–469. Erlbaum (1983). ISBN: 0898598591
Card, S.K, Moran, T.P, Newell, A.: The model human processor: an engineering model of human performance. In: Handbook of Perception and Human Performance, Cognitive Processes and Performance, vol. 2, pp. 1–35 (1986)
Cockburn, A., et al.: Turbulent touch: touchscreen input for cockpit flight displays. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 6742–6753. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3025453.3025584
Cockburn, A., et al.: Design and evaluation of braced touch for touchscreen input stabilization. Int. J. Hum.-Comput. Stud. 122, 21–37 (2019). https://doi.org/10.1016/j.ijhcs.2018.08.005. ISSN 1071-5819
Cockburn, A., Quinn, P., Gutwin, C.: Examining the peak-end effects of subjective experience. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI 2015), pp. 357–366. Association for Computing Machinery, New York (2015). https://doi.org/10.1145/2702123.2702139
Creissac Campos, J., Fayollas, C., Harrison, M.D., Martinie, C., Masci, P., Palanque, P.: Supporting the analysis of safety critical user interfaces: an exploration of three formal tools. ACM Trans. Comput.-Hum. Interact. 27(5), 48 (2020). https://doi.org/10.1145/3404199. Article 35
Cronel, M., Dumas, B., Palanque, P., Canny, A.: MIODMIT: a generic architecture for dynamic multimodal interactive systems. In: Bogdan, C., Kuusinen, K., Lárusdóttir, M., Palanque, P., Winckler, M. (eds.) Human-Centered Software Engineering. HCSE 2018. Lecture Notes in Computer Science, vol. 11262. Springer, Cham (2019).https://doi.org/10.1007/978-3-030-05909-5
Diamantaris, M., Marcantoni, F., Ioannidis, S., Polakis, J.: The seven deadly sins of the HTML5 WebAPI: a large-scale study on the risks of mobile sensor-based attacks. ACM Trans. Priv. Secur. 23(4), 31 (2020). https://doi.org/10.1145/3403947. Article 19
Diaper, D., Stanton, N.: The Handbook of Task Analysis for Human-Computer Interaction. Lawrence Erlbaum Associates (2003). ISBN 0-8058-4432-5
Dix, A.: Abstract, generic models of interactive systems. In: BCS HCI Conference, pp. 63–77 (1988)
DO-178C/ED-12C: Software Considerations in Airborne Systems and Equipment Certification, published by RTCA and EUROCAE (2012)
DO-333 Formal Methods Supplement to DO-178C and DO-278A, published by RTCA and EUROCAE, 13 Dec 2011 (2011)
Eisenberg, N., Miller, P.A.: The relation of empathy to prosocial and related behaviors. Psychol. Bull. 101(1), 91 (1987)
Fahssi, R., Martinie, C., Palanque, P.: Enhanced task modelling for systematic identification and explicit representation of human errors. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9299, pp. 192–212. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22723-8_16
Fayollas, C., Fabre, J.C., Palanque, P., Cronel, M., Navarre, D., Deleris, Y.: A software-implemented fault-tolerance approach for control and display systems in avionics. In: 2014 IEEE 20th Pacific Rim International Symposium on Dependable Computing, pp. 21–30 (2014). https://doi.org/10.1109/PRDC.2014.11
Fayollas, C., Martinie, C., Palanque, P., Ait-Ameur, Y.: QBP notation for explicit representation of properties, their refinement and their potential conflicts: application to interactive systems. In: Clemmensen, T., Rajamanickam, V., Dannenmann, P., Petrie, H., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10774, pp. 91–105. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92081-8_9
Feiler, P.H., Gluch, D.P., Hudak, J.J.: The Architecture Analysis & Design Language (AADL): An Introduction (No. CMU/SEI-2006-TN-011). CMU Software Engineering Inst (2006)
Fitt, P.M.: The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47, 381–391 (1954)
Flemisch, F., et al.: Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations. Cogn. Tech. Work 14, 3–18 (2012). https://doi.org/10.1007/s10111-011-0191-6
Gould, I.D., Lewis, C.: Designing for usability: key principles and what designers think. Commun. ACM 28(3), 300–311 (1985)
Hamon, A., Palanque, P., Silva, J.-L., Deleris, Y., Barboni, E.: Formal description of multi-touch interactions. In: Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2013), pp. 207–216. Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2494603.2480311
Hassenzahl, M., Platz, A., Burmester, M., Lehner, K.: Hedonic and ergonomic quality aspects determine a software’s appeal. In: ACM CHI Conference 2000, pp. 201–208. ACM DL (2000)
Hecht, H., Fiorentino, E.: Reliability assessment of spacecraft electronics. In: Annual Reliability and Maintainability Symposium, pp. 341–346. IEEE (1987)
Hollnagel, E.: How resilient is your organisation? An introduction to the resilience analysis grid (RAG). In: Sustainable Transformation: Building a Resilient Organization, Toronto, Canada (2010)
International Standard Organization: “ISO 9241–11.” Ergonomic requirements for office work with visual display terminals (VDT) – Part 11 Guidance on Usability (1996)
ISO 9241-210: Ergonomics of human-system interaction – Part 210: Human-centred design for interactive systems, Geneva
Johnson, P.: Human-computer Interaction: psychology, task analysis and software engineering. McGraw Hill, Maidenhead (1992)
Kupferman, O., Vardi, M.Y.: Model checking of safety properties. Formal Methods Syst. Des. 19, 291–314 (2001). https://doi.org/10.1023/A:1011254632723
Lai-Chong, E., Roto, V., Hassenzahl, M., Vermeeren, A., Kort. J.: Understanding, scoping and defining user experience: a survey approach. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 719–728. ACM, New York (2009)
Lamport, L.: Proving the correctness of multiprocess programs. IEEE Trans. Softw. Eng. 2, 125–143 (1977)
Landwehr, C., Bull, A., McDermott, J., Choi, W.: A taxonomy of computer program security flaws. ACM Comput. Surv. 26(3). Sept. 1994, 211–254 (1994). https://doi.org/10.1145/185403.185412
Laprie, J.-C. et al.: Definition and analysis of hardware and software fault-tolerant architectures. IEEE Comput. 23(7), 39–51 (1990)
Levitt, S.D., Dubner, S.J.: Freakonomics: A Rogue Economist Explores the Hidden Side of Everything. William Morrow, New York (2005)
Manna, Z., Pnueli, A.: A hierarchy of temporal properties. ACM Symp. Principles Distrib. Comput. 1990, 377–410 (1990)
Martinie, C., Navarre, D., Palanque, P., Fayollas, C.: A generic tool-supported framework for coupling task models and interactive applications. In: Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2015), pp. 244–253. ACM (2015). https://doi.org/10.1145/2774225.2774845
Martinie, C., Palanque, P., Navarre, D., Barboni, E.: A development process for usable large scale interactive critical systems: application to satellite ground segments. In: Winckler, M., Forbrig, P., Bernhaupt, R. (eds.) HCSE 2012. LNCS, vol. 7623, pp. 72–93. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34347-6_5
Mustafa, M., Lindemann, L., Magnor, M.: EEG analysis of implicit human visual perception. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 513–516. Association for Computing Machinery, New York (2012). https://doi.org/10.1145/2207676.2207746
Meshkati, N.: Technology transfer to developing countries: a tripartite micro- and macro ergonomic analysis of human-organization-technology interfaces. Int. J. Ind. Ergon. 4, 101–115 (1989)
Navabpour, S., Bonakdarpour, B., Fischmeister, S.: Software debugging and testing using the abstract diagnosis theory. In: Proceedings of the 2011 SIGPLAN/SIGBED conference on Languages, compilers and tools for embedded systems (LCTES 2011), pp. 111–120. Association for Computing Machinery, New York (2011). https://doi.org/10.1145/1967677.1967693
Navarre, D., Palanque, P., Bastide, R., Sy, O.: Structuring interactive systems specifications for executability and prototypability. In: Palanque, P., Paternò, F. (eds.) DSV-IS 2000. LNCS, vol. 1946, pp. 97–119. Springer, Heidelberg (2001). https://doi.org/10.1007/3-540-44675-3_7
Nicolescu, B., Peronnard, P., Velazco, R., Savaria, Y.: Efficiency of transient bit-flips detection by software means: a complete study. In: Proceedings of the 18th IEEE International Symposium on Defect and Fault Tolerance in VLSI Systems (DFT 2003), pp. 377–384. IEEE Computer Society (2003)
Nielsen, J.: Usability Engineering. Morgan Kaufmann Publishers Inc., San Francisco (1994)
Olwal, A., Feiner, S.: Rubbing the fisheye: precise touch-screen interaction with gestures and fisheye views. In: Conference Supplement of UIST 2003, pp. 83–84 (2003)
Palanque, P., Cockburn, A., Désert-Legendre, L., Gutwin, C., Deleris, Y.: Brace touch: a dependable, turbulence-tolerant, multi-touch interaction technique for interactive cockpits. In: Romanovsky, A., Troubitsyna, E., Bitsch, F. (eds.) SAFECOMP 2019. LNCS, vol. 11698, pp. 53–68. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-26601-1_4
Palanque, P., Cockburn, A., Gutwin, C.: A classification of faults covering the human-computer interaction loop. In: Casimiro, A., Ortmeier, F., Bitsch, F., Ferreira, P. (eds.) SAFECOMP 2020. LNCS, vol. 12234, pp. 434–448. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-54549-9_29
Palanque, P., Farenc, C., Bastide, R.: Embedding ergonomic rules as generic requirements in a formal development process of interactive software. In: Proceedings of IFIP TC 13 Conference on Human-Computer Interaction INTERACT 1999, Edinburg, Scotland, 1–4 Sept 1999 (1999)
Pirker, M., Bernhaupt, R.: Measuring user experience in the living room: results from an ethnographically oriented field study indicating major evaluation factors. EuroITV 2011, 79–82 (2011)
Pnueli, A.: Applications of temporal logic to the specification and verification of reactive systems: a survey of current trends. In: de Bakker, J.W., de Roever, W.P., Rozenberg, G. (eds.) Current Trends in Concurrency. Lecture Notes in Computer Science, vol. 224. Springer, Heidelberg (1986). https://doi.org/10.1007/BFb0027047
Pnueli, A.: The temporal logic of programs. In: 18th IEEE Symposium on the Foundations of Computer Science, pp. 46–57 (1977)
Polet, P., Vanderhaegen, F., Wieringa, P.: Theory of safety related violation of system barriers. Cogn. Technol. Work 4(3), 171–179 (2002)
Raber, F., Kosmalla, F., Krueger, A.: Fine-grained privacy setting prediction using a privacy attitude questionnaire and machine learning. In: Bernhaupt, R., Dalvi, G., Joshi, A., K. Balkrishan, D., O’Neill, J., Winckler, M. (eds.) INTERACT 2017. LNCS, vol. 10516, pp. 445–449. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68059-0_48
Reason, J.: Managing the Risks of Organizational Accidents. Ashgate Publishing limited. (1997)
Reason, J.: The Human Contribution: Unsafe Acts, Accidents and Heroic Recoveries. Taylor and Francis, Routeledge (2008)
Reason, J.: Human Error. Cambridge University Press, Cambridge (1990)
Saint-Lot, J., Imbert, J.-P., Dehais, F.: Red alert: a cognitive countermeasure to mitigate attentional tunneling. In: Proceedings of CHI 2020: CHI Conference on Human Factors in Computing Systems (CHI 2020), 25–30 Apr 2020, Honolulu, HI, USA. ACM, New York (2020). https://doi.org/10.1145/3313831.3376709
Schroeder, B., Pinheiro, E., Weber, W.-D.: DRAM errors in the wild: a large-scale field study. In: ACM SIGMETRICS, Seattle, WA, pp. 193–204 (2009)
Shah, P., Berges, M., Hubwieser, P.: Qualitative content analysis of programming errors. In: Proceedings of the 5th International Conference on Information and Education Technology (ICIET 2017), pp. 161–166. ACM (2017). https://doi.org/10.1145/3029387.3029399
Sistla, A.P.: On characterization of safety and liveness properties in temporal logic. In: Proceedings of the Fourth Annual ACM Symposium on Principles of Distributed Computing, pp. 39–48, ACM (1985)
Soukoreff, W., MacKenzie, S.: Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI. IJHCS 61(6), 751–789 (2004)
Tankeu Choitat, A, Fabre, J.-C., Palanque, P., Navarre, D., Deleris, Y.: Self-checking widgets for interactive cockpits. In: Proceedings of the 13th European Workshop on Dependable Computing (EWDC 2011), pp. 43–48. Association for Computing Machinery, New York (2011). https://doi.org/10.1145/1978582.1978592
Tankeu-Choitat, A., Navarre, D., Palanque, P., Deleris, Y., Fabre, J.-C., Fayollas, C.: Self-checking components for dependable interactive cockpits using formal description techniques. In: 2011 IEEE 17th Pacific Rim International Symposium on Dependable Computing, pp. 164–173 (2011). https://doi.org/10.1109/PRDC.2011.28
ter Beek, M.H., Faconti, G.P., Massink, M., Palanque, P.A., Winckler, M.: Resilience of interaction techniques to interrupts: a formal model-based approach . In: Gross, T., et al. (eds.) INTERACT 2009. LNCS, vol. 5726, pp. 494–509. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-03655-2_56
The cognitive biases codex: 175 cognitive biases: https://medium.com/better-humans/cognitive-bias-cheat-sheet-55a472476b18. Accessed 8 Jul 2021
Thoma, V., White, E.P.: In two minds about usability? Rationality and intuition in usability evaluations. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011. LNCS, vol. 6949, pp. 544–547. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23768-3_78
Traverse, P., Lacaze, I., Souyris, J.: Airbus fly-by-wire: a total approach to dependability. In: Proceedings of WCC, pp. 191–212 (2004)
Trewin, S., et al.: Age-specific predictive models of human performance. In: CHI '12 Extended Abstracts on Human Factors in Computing Systems, pp. 2267–2272. ACM (2012). https://doi.org/10.1145/2212776.2223787
Turk, D., France, R., Rumpe, B. Limitations of agile software processes. In: Proceedings of International Conference on eXtreme Programming and Agile Processes in Software Engineering Italy (2002)
Utting, M., Pretschner, A., Legeard, B.: A taxonomy of model-based testing approaches. Softw. Test. Verif. Reliab. 22(5), 297–312 (2012). https://doi.org/10.1002/stvr.456
Vanderdonckt, J.: Development milestones towards a tool for working with guidelines. Interact. Comput. 12(2), 81–118 (1999)
Vicente, K.: Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work.Lawrence Erlbaum Associates (1999)
Wahl, N.J.: Responsibility for unreliable software. In: Proceedings of the Conference on Ethics in the Computer Age (ECA 1994), pp. 175–177. Association for Computing Machinery, New York (1994). https://doi.org/10.1145/199544.199611
Acknowledgements
The author would like to acknowledge support from the ICS team in Toulouse (E. Barboni, D. Navarre and C. Martinie) for working on most of the contributions presented. Special also goes to Yannick Deleris and Christine Gris from Airbus who contributed and funded part of this work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 IFIP International Federation for Information Processing
About this paper
Cite this paper
Palanque, P. (2021). POISE: A Framework for Designing Perfect Interactive Systems with and for Imperfect People. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12932. Springer, Cham. https://doi.org/10.1007/978-3-030-85623-6_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-85623-6_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85622-9
Online ISBN: 978-3-030-85623-6
eBook Packages: Computer ScienceComputer Science (R0)