Toward Development Tools for Augmented Reality Applications – A Practitioner Perspective

  • Ethan HadarEmail author
Conference paper
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 332)


Augmented Reality (AR) commoditized development kits by Apple and Google, software products from IBM and PTC, and eyewear from Microsoft, Epson and ODG are driving a new wave of AR-based business use cases. Yet, today’s development tools for desktop or mobile applications do not natively contain aspects of natural interactions in such immersive environments. There is a gap between the need to understand and capture AR-related functional and non-functional requirements, and the state of modeling, testing, and simulation tools that AR developers have at their disposal. Specifically, how does one elicit and specify AR requirements, evaluate users’ experience, simulate and validate business usefulness. In addition, AR developers should assure that interactions with digital overlay are safe for people, and refrain from violating information security and privacy requirements. The paper discusses concerns for the creation of development tools for AR-based application, driven by a Visual Operation Guidance use case, and analyzed according to AR development steps of Object Recognition, Contextual Enrichment and Guidance. Exemplifying non-functional aspects, the paper presents new Safety, Privacy and Information Security concerns, triggered by investigating the nature of AR applications. It is the goal of this paper to inspire research by the academia to formally analyze, design and propose mapping and capturing these concerns in usable tools, that fit developers’ cognitive abilities, in order to expedite the creation of AR-based business processes and solutions.


Augmented Reality Business process innovation Modeling tools Security Privacy Safety 


  1. 1.
    Ask, J.A., Naparstek, L.: Augmented Reality: Emerging Tools To Explore. Forrester, 5 July 2016Google Scholar
  2. 2.
    ARCore. Accessed 18 Feb 2018
  3. 3.
    ARKit. Accessed 19 Feb 2018
  4. 4.
    Chang, G., Morreale, P., Medicherla, P.: Applications of augmented reality systems in education. In: Gibson, D., Dodge, B. (eds.) Proceedings of Society for Information Technology & Teacher Education International Conference, pp. 1380–1385. AACE, Chesapeake (2010)Google Scholar
  5. 5.
    Chang, Y.S., Nuernberger, B., Luan, B., Höllerer, T.: Evaluating gesture-based augmented reality annotation. In: 2017 IEEE Symposium on 3D User Interfaces (3DUI) 18 March 2017, pp. 182–185 (2017)Google Scholar
  6. 6.
    Druga, M.: Pokemon GO: where VR and AR have gone since its inception. IEEE Potentials 37(1), 23–26 (2018)CrossRefGoogle Scholar
  7. 7.
    Dünser, A., Grasset, R., Billinghurst, M.: A survey of evaluation techniques used in augmented reality studies. Human Interface Technology Laboratory New Zealand, 10 December 2008Google Scholar
  8. 8.
  9. 9.
    GDPR. Accessed 18 Feb 2018
  10. 10.
    Hadar, E.: Cognitive augmented and mixed reality a new era of interaction. In: The 5th International Workshop on Cognitive Aspects of Information Systems Engineering (COGNISE), In Conjunction with the 29th International Conference on Advanced Information System Engineering CAiSE 2017, 13 June, Essen, Germany (2017)Google Scholar
  11. 11.
    Hadar, E., Shtok, J., Cohen, B., Tzur, Y., Karlinsky, L.: Hybrid remote expert - an emerging pattern of industrial remote support. In: CAiSE Forum, 29th International Conference on Advanced Information System Engineering, 12–16 June, Essen, Germany (2017)Google Scholar
  12. 12.
  13. 13.
  14. 14.
    IBM AR Research. Accessed 18 Feb 2018
  15. 15.
    Kratz, S., Rohs, M., Guse, D., Müller, J., Bailly, G., Nischt, M.: PalmSpace: continuous around-device gestures vs. multitouch for 3D rotation tasks on mobile devices. In: ACM Proceedings of the International Working Conference on Advanced Visual Interfaces 21 May 2012, pp. 181–188 (2012)Google Scholar
  16. 16.
    Krichenbauer, M., Yamamoto, G., Taketomi, T., Sandor, C., Kato, H.: Augmented reality vs virtual reality for 3D object manipulation. J. IEEE Trans. Visual. Comput. Graph. (2017)Google Scholar
  17. 17.
    Lee, W.H., Lee, H.K.: The usability attributes and evaluation measurements of mobile media AR (augmented reality). Cogent Arts Hum. 3(1), 1241171 (2016)Google Scholar
  18. 18.
    Lukosch, S., Billinghurst, M., Alem, L., et al.: Collaboration in augmented reality. Comput. Support. Coop. Work 24, 515–525 (2015). Scholar
  19. 19.
    McKee, D.W., Clement, S.J., Almutairi, J., Xu, J.: Massive-scale automation in cyber-physical systems: vision & challenges. In: IEEE 13th International Symposium on Autonomous Decentralized System (ISADS), 22 March 2017, pp. 5–11 (2017)Google Scholar
  20. 20.
    Microsoft. Accessed 18 Feb 2018
  21. 21.
  22. 22.
    Poly. Accessed 18 Feb 2018
  23. 23.
    Radu, I., Antle, A.: Embodied learning mechanics and their relationship to usability of handheld augmented reality. In: 2017 IEEE Virtual Reality Workshop on Embodied Learning through Virtual & Augmented Reality (KELVAR), 18 March 2017, pp. 1–5 (2017)Google Scholar
  24. 24.
    Sage, M.: Creating augmented reality experiences for enterprise: good practices, lessons learned, and technological insights. IEEE Consum. Electron. Mag. 6(1), 42–44 (2017)CrossRefGoogle Scholar
  25. 25.
    Samini, A., Lundin Palmerius, K.: Popular performance metrics for evaluation of interaction in virtual and augmented reality. In: 2017 International Conference on Cyberworlds (2017)Google Scholar
  26. 26.
    Swan, J.E., Gabbard, J.L.: Survey of user-based experimentation in augmented reality. In: Proceedings of 1st International Conference on Virtual Reality, 22 July, pp. 1–9 (2015)Google Scholar
  27. 27.
    Tanikawa, T., Uzuka, H., Narumi, T., Hirose, M.: Integrated view-input interaction method for mobile AR. In: 3D User Interfaces (3DUI) IEEE Symposium, 23 March, pp. 187–188 (2015)Google Scholar
  28. 28.
    Van Krevelen, D.W., Poelman, R.: A survey of augmented reality technologies, applications and limitations. Int. J. Virtual Real. 9(2), 1 (2010)Google Scholar
  29. 29.
    Vlaminck, M., Luong, H., Philips, W.: A markerless 3D tracking approach for augmented reality applications. In: IEEE International Conference on 3D Immersion (IC3D) (2017)Google Scholar
  30. 30.
    Vuforia. Accessed 18 Feb 2018
  31. 31.
  32. 32.
    Wikitude. Accessed 18 Feb 2018

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Accenture LabsHerzeliaIsrael
  2. 2.Zefat Academic CollegeZefatIsrael

Personalised recommendations