Multimedia Tools and Applications

, Volume 55, Issue 3, pp 725–746 | Cite as

AR-Room: a rapid prototyping framework for augmented reality applications

  • Jong-Seung ParkEmail author


This paper presents a novel software framework called AR-Room for fast prototyping of a variety of augmented reality applications. AR-Room consists of a lot of deployable components for core augmented reality technologies, modules for hardware abstraction, and an authoring toolkit for the rapid content design. On the AR-Room, application developers are only required to describe their content scenarios together with a configuration of software components. A content scenario is represented by a set of event-action pairs. Four major procedures in an augmented reality application are an image analyzer, an interaction handler, a rendering engine and an image synthesizer. According to the provided scenarios the designated components cooperatively provide real-time analysis and synthesis of input video frames. Several augmented reality applications are implemented on the AR-Room to show how the framework can be efficiently used for the fast prototyping of applications.


Augmented reality Rapid prototyping Software framework 



This work was supported by the University of Incheon Research Grant in 2010.


  1. 1.
    Ababsa F, Mallem M (2004) Robust camera pose estimation using 2d fiducials tracking for real-time augmented reality systems. International Conference on Virtual-Reality Continuum and its Applications in Industry, pp 431–435Google Scholar
  2. 2.
    Abawi DF, Bienwald J, Dörner R (2004) Accuracy in optical tracking with fiducial markers: an accuracy function for ARToolKit. Proc International Symposium on Mixed and Augmented Reality, pp 260–261Google Scholar
  3. 3.
    Aitkin AL (2005) Playing at reality: exploring the potential of the digital game as a medium for science communication. PhD thesis, The Australian National UniversityGoogle Scholar
  4. 4.
    Asutay AV, Indugula AP, Borst CW (2005) Virtual tennis: a hybrid distributed virtual reality environment with fishtank vs. HMD. IEEE International Symposium on Distributed Simulation and Real-Time Applications, pp 213–220Google Scholar
  5. 5.
    Azuma RT (1997) A survey of augmented reality. Presence: Teleoperators and Virtual Environments 6(4):355–385Google Scholar
  6. 6.
    Balcisoy S, Kallmann M, Fua P, Thalmann D (2000) A framework for rapid evaluation of prototypes with augmented reality, Proceedings of the ACM Virtual Reality Software and Technology, pp 61–66Google Scholar
  7. 7.
    Balcisoy S, Torre R, Ponder M, Fua P, Thalmann D (2000) Augmented reality for real and virtual humans. Proceedings of the International Conference on Computer Graphics, pp 303–308Google Scholar
  8. 8.
    Bauer M, Bruegge B, Klinker G, MacWilliams A, Reicher T, Riss S, Sandor C, Wagner M (2001) Design of a component-based augmented reality framework. Proceedings of the Second IEEE/ACM International Symposium on Augmented Reality (ISAR), pp 45–54Google Scholar
  9. 9.
    Blair M (1999) Exploratory programming of distributed augmented environments. PhD Thesis, Columbia UniversityGoogle Scholar
  10. 10.
    Borst CW, Volz RA (2005) Evaluation of a haptic mixed reality system for interactions with a virtual control panel. Presence: Teleoperators and Virtual Environments 14(6):677–696CrossRefGoogle Scholar
  11. 11.
    Bradski G, Kaehler RA (2008) Learning OpenCV: computer vision with the OpenCV Library. O’Reilly, CambridgeGoogle Scholar
  12. 12.
    Broil W, Lindt I, Ohlenburg J, Herbst I, Wittkamper M, Novotny T (2005) An infrastructure for realizing custom-tailored augmented reality user interfaces. IEEE Trans Vis Comput Graph 11(6):722–733CrossRefGoogle Scholar
  13. 13.
    Costanza E, Huang J (2009) Designable visual markers. Proc International Conference on Human Factors in Computing Systems, pp 1879–1888Google Scholar
  14. 14.
    Dementhon D, Davis L (1995) Model-based object pose in 25 lines of code. Int J Comput Vision 15:123–141CrossRefGoogle Scholar
  15. 15.
    Dörner R, Geiger C, Haller M, Paelke V (2002) Authoring mixed reality—a component and framework-based approach. Proceedings of the International Workshop on Entertainment Computing—Special Session on Mixed Reality, pp 405–413Google Scholar
  16. 16.
    Fellner DW, Behr J, Bockholt U (2009) InstantReality—a framework for industrial augmented and virtual reality applications. Proceedings of the 2nd Sino-German Workshop on Virtual Reality & Augmented Reality in Industry, pp. 78–83Google Scholar
  17. 17.
    Fiala M (2005) ARTag, a fiducial marker system using digital techniques. IEEE Conference on Computer Vision and Pattern Recognition, pp. 590–596Google Scholar
  18. 18.
    Freeman RM, Julier SJ, Steed AJ (2007) A method for predicting marker tracking error. Proc International Symposium on Mixed and Augmented Reality, pp. 157–160Google Scholar
  19. 19.
    Gottschalk S, Lin MC, Manocha D (1996) OBBTree: a hierarchical structure for rapid interference detection. Proceedings of the ACM SIGGRAPH Conference, pp 171–180Google Scholar
  20. 20.
    Govil A, You S, Neumann U (2000) A video-based augmented reality golf simulator. ACM Multimedia, pp 489–490Google Scholar
  21. 21.
    Hardenberg C, Brard F (2001) Bare-hand human-computer interaction. Proceedings of Perceptual User Interfaces, pp 113–120Google Scholar
  22. 22.
    Ishii H, Wisneski C, Orbanes J, Chun B, Paradiso J (1999) PingPongPlus: design of an athletic-tangible interface for computer supported cooperative play. Proceedings of Conference on Human Factors in Computing Systems, pp 394–401Google Scholar
  23. 23.
    Jiang B, You S, Neumann U (2000) Camera tracking for augmented reality media. IEEE International Conference on Multimedia and Expo 3:1637–1640Google Scholar
  24. 24.
    Kallmann M, Thalmann D (1998) Modeling objects for interaction tasks. Proceedings of the 9th Eurographics Workshop on Animation and Simulation, pp 73–86Google Scholar
  25. 25.
    Kato H, Billinghurst M (1999) Marker tracking and HMD calibration for a video-based augmented reality conferencing system. International Workshop on Augmented Reality, pp 85–93Google Scholar
  26. 26.
    Kato H, Billinghurst M, Poupyrev I, Imamoto K, Tachibana K (2000) Virtual object manipulation on a table-top AR environment. Proceedings of the International Symposium on Augmented Reality, pp 111–119Google Scholar
  27. 27.
    Lee GA, Nelles C, Billinghurst M, Kim GJ (2004) Immersive authoring of tangible augmented reality applications. Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality, pp 172–181Google Scholar
  28. 28.
    Lenman S, Bretzner L, Thuresson B (2002) Using marking menus to develop command sets for computer vision based hand gesture interfaces. Proceedings of the second Nordic conference on Human-computer interaction, pp 239–242Google Scholar
  29. 29.
    Looser J (2007) AR magic lenses: addressing the challenge of focus and context in augmented reality. PhD Thesis, University of CanterburyGoogle Scholar
  30. 30.
    Lourakis MIA, Argyros AA (2004) Vision-based camera motion recovery for augmented reality. Proceedings of Computer Graphics International, pp 569–576Google Scholar
  31. 31.
    Lourakis M, Argyros A (2005) Camera matchmoving in unprepared, unknown environments. IEEE Conference on Computer Vision and Pattern Recognition 2:1190Google Scholar
  32. 32.
    MacIntyre B, Gandy M, Dow S, Bolter JD (2004) DART: a toolkit for rapid design exploration of augmented reality experiences. Proceedings of the 2004 ACM Symposium on User Interface Software and Technology, pp 197–206Google Scholar
  33. 33.
    Nilsen T, Looser J (2005) Tankwar—tabletop war gaming in augmented reality. Proceedings of 2nd International Workshop on Pervasive Gaming Applications, pp 86–91Google Scholar
  34. 34.
    Owen C, Tang A, Xiao F (2003) ImageTclAR: a blended script and compiled code development system for augmented reality. Proceedings of the International Workshop on Software Technology for Augmented Reality Systems, pp 537–544Google Scholar
  35. 35.
    Park JS, Lee BJ (2008) Vision-based real-time camera matchmoving using a known marker. Opt Eng 47(2):027201CrossRefGoogle Scholar
  36. 36.
    Ponder M (2004) Component-based methodology and development framework for virtual and augmented reality systems, PhD Thesis No 3046, EPFLGoogle Scholar
  37. 37.
    Quek F, Mysliwiec T, Zhao M (1995) Fingermouse: a freehand computer pointing interface. Proc of Int’l Conference on Automatic Face and Gesture Recognition, pp 372–377Google Scholar
  38. 38.
    Sandor C, Klinker G (2005) A rapid prototyping software infrastructure for user interfaces in ubiquitous augmented reality. Pers Ubiquit Comput 9(3):169–18547CrossRefGoogle Scholar
  39. 39.
    Schmalstieg D, Fuhrmann A, Hesina G, Szalavári Z, Encarnação LM, Gervautz M, Purgathofer W (2002) The Studierstube augmented reality project. Presence 11(1):33–54CrossRefGoogle Scholar
  40. 40.
    Seichter H, Looser J, Billinghurst M (2008) ComposAR: an intuitive tool for authoring AR applications. Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp 177–178Google Scholar
  41. 41.
    Uchiyama S, Takemoto K, Satoh K, Yamamoto H, Tamura H (2002) MR platform: a basic body on which mixed reality applications are built. Proceedings of the International Symposium on Mixed and Augmented Reality, pp 246–320Google Scholar
  42. 42.
    Uematsu Y, Saito H (2005) AR registration by merging multiple planar markers at arbitrary positions and poses via projective space. International Conference on Virtual Reality and Telexistence, pp 48–55Google Scholar
  43. 43.
    Woodward C, Honkamaa P, Jappinen J, Pyokkimies E (2004) Camball—augmented virtual table tennis with real rackets. Proc ACE, pp 275–276Google Scholar
  44. 44.
    Yoon JH, Park JS, Kim C (2006) Increasing camera pose estimation accuracy using multiple markers. Proc International Conference on Artificial Reality and Telexistence, pp 239–248Google Scholar
  45. 45.
    Zauner J, Haller M (2004) Authoring of mixed reality applications including multi-marker calibration for mobile devices. Eurographics Symposium on Virtual Environments, pp 87–90Google Scholar
  46. 46.
    Zhang Z, Wu Y, Shan Y, Shafer S (2001) Visual panel: virtual mouse keyboard and 3D controller with an ordinary piece of paper. Workshop on Perceptive User Interfaces, pp 1–8Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringUniversity of IncheonIncheonRepublic of Korea

Personalised recommendations