Skip to main content

On the Use of Handheld Augmented Reality for Inventory Tasks: A Study with Magazine Retailers

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2021 (INTERACT 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12932))

Included in the following conference series:

  • 2368 Accesses

Abstract

In this paper we investigate if handheld augmented reality, in the form of an application running on a mainstream smartphone, can serve as a practical and effective tool for inventory tasks. Taking magazine retail as an example, we have applied a user-centered design process to research, design, implement and evaluate a handheld AR application prototype. We conducted a qualitative user study at magazine retail stores, where staff responsible for magazines were interviewed (\(n=8\)) and their primary magazine handling tasks observed. After an analysis of the study findings, we selected a key task as the basis for the design, implementation and test of an AR app prototype. The task consisted of collecting and registering a list of magazines for return to the distributor. We evaluated the AR app prototype in a user study (\(n=22\)), where participants used it to perform the selected task. They also performed the task using the paper list currently in use, and a second, simplified app prototype, without AR features. Task performance was measured based on time and error rate. The participant’s subjective experience was also captured in the form of a post-task survey and interview. Our findings suggest that handheld AR can prove effective when used for specific, focused tasks, rather than more open-ended ones.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://unity3d.com.

  2. 2.

    https://docs.unity3d.com/Packages/com.unity.xr.arfoundation@3.1/manual.

  3. 3.

    https://developer.apple.com/augmented-reality/.

  4. 4.

    https://developers.google.com/ar.

  5. 5.

    https://humansystems.arc.nasa.gov/groups/tlx/downloads/TLXScale.pdf.

References

  1. Bonetti, F., Pantano, E., Warnaby, G., Quinn, L., Perry, P.: Augmented reality in real stores: empirical evidence from consumers’ interaction with AR in a retail format. In: tom Dieck, M.C., Jung, T. (eds.) Augmented Reality and Virtual Reality. PI, pp. 3–16. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-06246-0_1

    Chapter  Google Scholar 

  2. Chatzopoulos, D., Bermejo, C., Huang, Z., Hui, P.: Mobile augmented reality survey: from where we are to where we go. IEEE Access 5, 6917–6950 (2017). https://doi.org/10.1109/ACCESS.2017.2698164

    Article  Google Scholar 

  3. Chen, D.M., Tsai, S.S., Girod, B., Hsu, C.H., Kim, K.H., Singh, J.P.: Building book inventories using smartphones. In: Proceedings of the 18th ACM International Conference on Multimedia, pp. 651–654 (2010)

    Google Scholar 

  4. Chung, J., Kim, I.J., Schmandt, C.: Guiding light: Navigation assistance system using projection based augmented reality. In: 2011 IEEE International Conference on Consumer Electronics (ICCE), pp. 881–882. IEEE (2011)

    Google Scholar 

  5. Cirulis, A., Ginters, E.: Augmented reality in logistics. Procedia Comput. Sci. 26, 14 – 20 (2013). https://doi.org/10.1016/j.procs.2013.12.003, iCTE in Regional Development, December 2013, Valmiera, Latvia

  6. Dillman, K.R., Mok, T.T.H., Tang, A., Oehlberg, L., Mitchell, A.: A visual interaction cue framework from video game environments for augmented reality. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, ACM, New York (2018). https://doi.org/10.1145/3173574.3173714

  7. Elia, V., Gnoni, M.G., Lanzilotto, A.: Evaluating the application of augmented reality devices in manufacturing from a process point of view: an ahp based model. Expert Syst. Appl. 63, 187–197 (2016)

    Article  Google Scholar 

  8. Fang, W., Zheng, S., Liu, Z.: A scalable and long-term wearable augmented reality system for order picking. In: 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). pp. 4–7. IEEE (2019)

    Google Scholar 

  9. Glockner, H., Jannek, K., Mahn, J., Theis, B.: Augmented reality in logistics. changing the way we see logistics–a dhl perspective. DHL Customer Solutions Innov. 28 (2014)

    Google Scholar 

  10. Guo, A., et al.: A comparison of order picking assisted by head-up display (hud), cart-mounted display (cmd), light, and paper pick list. In: Proceedings of the 2014 ACM International Symposium on Wearable Computers, ISWC 2014, pp. 71–78. ACM, New York (2014). https://doi.org/10.1145/2634317.2634321

  11. Hart, S.G., Staveland, L.E.: Development of nasa-tlx (task load index): results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, Advances in Psychology, vol. 52, pp. 139–183. North-Holland (1988). https://doi.org/10.1016/S0166-4115(08)62386-9

  12. Kourouthanassis, P.E., Boletsis, C., Lekakos, G.: Demystifying the design of mobile augmented reality applications. Multimed. Tools Appl. 74(3), 1045–1066 (2015). https://doi.org/10.1007/s11042-013-1710-7

    Article  Google Scholar 

  13. Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: a class of displays on the reality-virtuality continuum. In: Das, H. (ed.) Telemanipulator and Telepresence Technologies, vol. 2351, pp. 282–292. International Society for Optics and Photonics, SPIE (1995). https://doi.org/10.1117/12.197321

    Chapter  Google Scholar 

  14. Mitts, P., Debarba, H.G.: On the use of handheld augmented reality for inventory tasks: a study with magazine retailers - dataset (2021). https://doi.org/10.5281/zenodo.4926619

  15. Porter, M.E., Heppelmann, J.E.: Why every organization needs an augmented reality strategy. HBR’S 10 MUST, p. 85 (2017)

    Google Scholar 

  16. Reif, R., Günthner, W.A.: Pick-by-vision: augmented reality supported order picking. Vis. Comput. 25(5), 461–467 (2009). https://doi.org/10.1007/s00371-009-0348-y

    Article  Google Scholar 

  17. Reif, R., Günthner, W.A., Schwerdtfeger, B., Klinker, G.: Evaluation of an augmented reality supported picking system under practical conditions. Computer Graphics Forum 29(1), 2–12 (2010)

    Article  Google Scholar 

  18. Robert, K., Zhu, D., Huang, W., Alem, L., Gedeon, T.: Mobilehelper: remote guiding using smart mobile devices, hand gestures and augmented reality. In: SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications, pp. 1–5 (2013)

    Google Scholar 

  19. de Sá, M., Churchill, E.F.: Mobile Augmented Reality: A Design Perspective, pp. 139–164. Springer New York, New York (2013). https://doi.org/10.1007/978-1-4614-4205-9_6

  20. Sauro, J., Dumas, J.S.: Comparison of three one-question, post-task usability questionnaires. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2009, pp. 1599–1608. ACM, New York (2009). https://doi.org/10.1145/1518701.1518946

  21. Schwerdtfeger, B.: Pick-by-vision: Bringing hmd-based augmented reality into the warehouse. Ph.D. thesis, Technische Universität München (2010)

    Google Scholar 

  22. Soulard, O.: Development of an adaptive user interface for mobile indoor navigation. Master’s thesis, Lehrstuhl für Medientechnik, Fachgebiet Verteilte \(\ldots \) (2012)

    Google Scholar 

  23. Teo, T., Lawrence, L., Lee, G.A., Billinghurst, M., Adcock, M.: Mixed reality remote collaboration combining 360 video and 3d reconstruction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–14. ACM, New York (2019). https://doi.org/10.1145/3290605.3300431

  24. Vidal-Balea, A., Blanco-Novoa, O., Fraga-Lamas, P., Vilar-Montesinos, M., Fernández-Caramés, T.M.: Creating collaborative augmented reality experiences for industry 4.0 training and assistance applications: Performance evaluation in the shipyard of the future. Appl. Sci. 10(24), 9073 (2020)

    Google Scholar 

  25. Wang, P., et al.: Ar/mr remote collaboration on physical tasks: a review. Robot. Comput.-Integr. Manuf. 72, 102071 (2021). https://doi.org/10.1016/j.rcim.2020.102071

  26. Wang, W., Wang, F., Song, W., Su, S.: Application of augmented reality (ar) technologies in inhouse logistics. In: E3S Web of Conferences, vol. 145, p. 02018. EDP Sciences (2020)

    Google Scholar 

  27. Winkel, J.J., Datcu, D.D., Buijs, P.P.: Augmented reality could transform last-mile logistics. In: Symposium on Spatial User Interaction, pp. 1–2 (2020)

    Google Scholar 

Download references

Acknowledgments

We wish to thank the store staff and prototype evaluation participants for their time, and the anonymous reviewers for their valuable comments. This research was supported by Bladkompagniet, which provided materials and compensation for the studies and participants. Their team participated in initial planning, field research recruitment, prototype evaluation environment construction and provided feedback. This research was also supported by Charlie Tango, which provided the infrastructure for the prototype evaluation. We wish to thank Ulla Tønner, who provided valuable feedback on the design of the prototype evaluation. Peter Mitts also wishes to thank Tessa, for her support during the development of this project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Henrique Galvan Debarba .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mitts, P., Debarba, H.G. (2021). On the Use of Handheld Augmented Reality for Inventory Tasks: A Study with Magazine Retailers. In: Ardito, C., et al. Human-Computer Interaction – INTERACT 2021. INTERACT 2021. Lecture Notes in Computer Science(), vol 12932. Springer, Cham. https://doi.org/10.1007/978-3-030-85623-6_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-85623-6_33

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-85622-9

  • Online ISBN: 978-3-030-85623-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics