Skip to main content
SpringerLink
Log in

How to Evaluate the Usability of Smart Devices as Conceivable Work Assistance: A Systematic Review

  • Conference paper
  • First Online:
Advances in Ergonomic Design of Systems, Products and Processes

Abstract

The ongoing digitalization of work and working environments suggests that the application of smart devices as a work assistance will increase. In this context, particularly it is important to consider an ergonomic design, especially the usability of mobile interactive systems before using it in the working environment. Therefore, a specific significance will be attributed to the usability evaluation of smart device applications. Consequently the Federal Institute for Occupational Safety and Health (BAuA) implemented a study by means of a systematic review, which examined how to evaluate the usability of smart devices. The aim of the review was to investigate, if there are specific methods to evaluate the usability of smart devices or how far consisting methods including their criteria from the area of conventional screen work can be adopted. Results indicate that the majority of existing studies used evaluation criteria from the area of conventional screen work or recently developed kits for mobile usability evaluation, which are built on similar criteria. Actually the established methods and criteria are still adequate, but they have to be adjusted to the rapid development of new technologies with respect to new influence factors like innovative interaction concepts, smaller displays or mobile operations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Arksey H, O’Malley L (2005) Scoping studies: towards a methodological framework. Int J Soc Res Methodol 8:19–32

    Article  Google Scholar 

  • Barricelli BR, Devis Y, Abdelnour-Nocera J, Wilson J, Moore J (2013) MANTRA: mobile anticoagulant therapy management. In: 7th International conference on pervasive computing technologies for healthcare, IEEE, Venice, pp 278–281

    Google Scholar 

  • Billi M, Burzagli L, Catarci T, Santucci G, Bertini E, Gabbanini F, Palchetti E (2010) A unified methodology for the evaluation of accessibility and usability of mobile applications. Univers Access Inform Soc 9(4):337–356

    Article  Google Scholar 

  • Conde A, Lopez de Ipina K, Larranaga M, Elorriaga JA, Lopez JM, Irigoyen E, Garay-Vitoria N, Ezeiza A, Rubio J (2010) An intelligent tutoring system oriented to the integration of people with intellectual disabilities. In: Demazeau Y, Dignum F, Corchado JM, Bajo J, Corchuelo R, Corchado E, Fernandez-Riverola F, Julian VJ, Pawlewski P, Campbell A (eds) Trends in practical applications of agents and multiagent systems. Springer, Heidelberg, pp 639–647

    Chapter  Google Scholar 

  • DIN, Deutsches Institut für Normung (1998) Ergonomische Anforderungen für Bürotätigkeiten mit Bildschirmgeräten. Teil 11: Anforderungen an die Gebrauchstauglichkeit. EN ISO 9241-11

    Google Scholar 

  • DIN, Deutsches Institut für Normung (2000) Ergonomische Anforderungen für Bürotätigkeiten mit Bildschirmgeräten. Teil 12: Informationsdarstellung. EN ISO 9241-12

    Google Scholar 

  • DIN, Deutsches Institut für Normung (2008) Ergonomie der Mensch-System-Interaktion. Teil 110: Grundsätze der Dialoggestaltung. EN ISO 9241-110

    Google Scholar 

  • Fetaji M, Fetaji B (2011) Comparing developed MLUAT (mobile learning usability attribute testing) methodology with qualitative user testing method and heuristics evaluation. In: Proceedings of the 12th international conference on computer systems and technologies, ACM, Vienna, pp 516–523

    Google Scholar 

  • Gielkens C, Wetzel R (2012) A framework for usability evaluation of mobile mixed reality games. In: Herrlich M, Malaka R, Masuch M (eds) Proceedings of the 11th international conference on entertainment computing. Springer, Heidelberg, pp 401–404

    Google Scholar 

  • Grauel BM, Terhoeven JN, Wischniewski S, Kluge A (2014) Erfassung akzeptanzrelevanter Merkmale von Datenbrillen mittels Repertory Grid Technik. Zeitschrift für Arbeitswissenschaft 68:250–256

    Article  Google Scholar 

  • Hongu N, Pope BT, Bilgic P, Orr BJ, Suzuki A, Kime AS, Merchant NC, Roe DJ (2015) Usability of a smartphone food picture app for assisting 24-hour dietary recall: a pilot study. Nutr Res Pract 9:207–212

    Article  Google Scholar 

  • Huang CH, Wang CM (2011) Usability analysis in gesture operation of interactive e-books on mobile devices. In: Marcus A (ed) Design, user experience and usability, Pt I, HCII 2011. Springer, Heidelberg, pp 573–582

    Google Scholar 

  • Inostroza R, Rusu C, Roncagliolo S, Jimenez C, Rusu V (2012) Usability heuristics for touchscreen-based mobile devices. In: 9th international conference on information technology: new generations, IEEE, Las Vegas, pp 662–667

    Google Scholar 

  • Ittermann P, Niehaus J, Hirsch-Kreinsen H (2015) Arbeiten in der Industrie 4.0. Trendbestimmungen und arbeitspolitische Handlungsfelder. Hans-Böckler-Stiftung, Düsseldorf

    Google Scholar 

  • Karahoca A, Bayraktar E, Tatoglu E, Karahoca D (2010) Information system design for a hospital emergency department: a usability analysis of software prototypes. J Biomed Informat 43(2):224–232

    Article  Google Scholar 

  • Marcus A, Abramowitz S, Abulkhair MF (2013) Heuristic evaluation of iCalamityGuide application. In: Marcus A (ed) Design, user experience, and usability: web, mobile, and product design, Proceedings of the Second International Conference, DUXU 2013. Springer, Heidelberg, pp 130–139

    Chapter  Google Scholar 

  • Mattioli S, Zanardi F, Baldasseroni A, Schaafsma F, Cooke RMT, Mancini G, Fierro M, Santangelo C, Farioli A, Fucksia S, Curti S, Violante FS, Verbeek J (2010) Search strings for study of putative occupational determinants of disease. Occup Environ Med 67:436–443

    Article  Google Scholar 

  • Nielsen J (1993) Usability engineering. Morgan Kaufmann, San Francisco, CA

    MATH  Google Scholar 

  • Schönfelder R, Schmalstieg D (2008) Augmented reality for industrial building acceptance. In: Lin M, Steed A, Cruz-Neira C (eds) Proceedings of the IEEE virtual reality 2008. IEEE, Reno, pp 83–90

    Chapter  Google Scholar 

  • Schuh G, Potente T, Wesch-Potente C, Weber AR, Prote JP (2014) Collaboration mechanisms to increase productivity in the context of industrie 4.0. In: Windt K (ed) Procedia CIRP 19, 2nd CIRP robust manufacturing conference 2014. Elsevier Procedia, Amsterdam, pp 51–56

    Google Scholar 

  • Shneiderman B, Plaisant C (2005) Designing the user interface: strategies for effective human computer interaction. Addison Wesley, Boston

    Google Scholar 

  • Soomro S, Wan Ahmad WF, Sulaiman S (2013) Evaluation of mobile games using playability heuristics. In: Badioze Zaman HB, Robinson P, Olivier P, Shih TK, Velastin S (eds) Advances in visual informatics, Proceedings of the third international visual informatics conference, IVIC 2013. Springer, Heidelberg, pp 264–274

    Chapter  Google Scholar 

  • Spath D, Ganschar O, Gerlach S, Hämmerle M, Krause T, Schlund S (2013) Produktionsarbeit der Zukunft—Industrie 4.0. Fraunhofer Verlag. Stuttgart

    Google Scholar 

  • Terhoeven J, Grauel B, Wille M, Wischniewski S (2015) Head Mounted Displays als Arbeitshilfen der Zukunft—Gestaltung eines beanspruchungsoptimalen Einsatzes. In: Schenk M (ed) Digitales Engineering zum Planen, Testen und Betreiben technischer Systeme, 18. IFF-Wissenschaftstage, 24–25. Juni 2015. Fraunhofer IFF. Magdeburg, pp 125–129

    Google Scholar 

  • Varsaluoma J (2009) Scenarios in the heuristic evaluation of mobile devices: emphasizing the context of use. In: Kurosu M (ed) HCD 2009. Springer, Heidelberg, pp 332–341

    Google Scholar 

  • Verordnung über Sicherheit und Gesundheitsschutz bei der Verwendung von Arbeitsmitteln (Betriebssicherheitsverordnung—BetrSichV), vom 03. Februar 2015

    Google Scholar 

  • Wahab NA, Osman A, Ismail MH (2010) Engaging children to science subject: a heuristic evaluation of mobile learning prototype. In: Proceedings of the second IEEE international conference on computer engineering and applications, ICCEA 2010. IEEE, Bali Island, pp 513–516

    Google Scholar 

  • Wickens CD, Hollands JG (2000) Engineering psychology and human performance. Prentice Hall, Upper Saddle River, NJ

    Google Scholar 

  • Zaibon SB, Shiratuddin N (2010) Heuristics evaluation strategy for mobile game-based learning. In: Proceedings of the 6th IEEE international conference on wireless, mobile and ubiquitous technologies in education, WMUTE 2010, IEEE, Kaohsiung, pp 127–131

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Federal Institute for Occupational Safety and Health (BAuA), Dortmund, Germany

    Jan Terhoeven & Sascha Wischniewski

Authors
  1. Jan Terhoeven
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sascha Wischniewski
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jan Terhoeven .

Editor information

Editors and Affiliations

  1. RWTH Aachen, Aachen, Nordrhein-Westfalen, Germany

    Christopher Marc Schlick

  2. RWTH Aachen, Aachen, Nordrhein-Westfalen, Germany

    Sönke Duckwitz

  3. RWTH Aachen, Aachen, Nordrhein-Westfalen, Germany

    Frank Flemisch

  4. RWTH Aachen, Aachen, Nordrhein-Westfalen, Germany

    Martin Frenz

  5. RWTH Aachen, Aachen, Nordrhein-Westfalen, Germany

    Sinem Kuz

  6. RWTH Aachen, Aachen, Nordrhein-Westfalen, Germany

    Alexander Mertens

  7. RWTH Aachen, Aachen, Nordrhein-Westfalen, Germany

    Susanne Mütze-Niewöhner

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer-Verlag GmbH Germany

About this paper

Cite this paper

Terhoeven, J., Wischniewski, S. (2017). How to Evaluate the Usability of Smart Devices as Conceivable Work Assistance: A Systematic Review. In: Schlick, C., et al. Advances in Ergonomic Design of Systems, Products and Processes. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-53305-5_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-53305-5_19

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-53304-8

  • Online ISBN: 978-3-662-53305-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation