Skip to main content

Object Manipulation Using Real Hand Gesture for Augmented Reality Interior Design

  • Living reference work entry
  • First Online:
Encyclopedia of Computer Graphics and Games

Synonyms

3D object manipulation; Augmented reality; Gesture recognition; User interaction

Definition

Augmented reality (AR) has the ability to blend the virtual and real objects. It enables users to interact with virtual objects or images with a real object as a medium of interaction. Hence, to provide natural and intuitive user interaction in AR environment, real hands are widely explored as an input. This entry explains the natural user interaction using real hand gesture in AR and explains the ARDeco application development process. The fundamental guide to developing AR application for interior design using real hand gestures with Leap Motion controller to interact with the UI and manipulate the objects with hand gestures, including color swatch and texture change panel for UIs and translation and rotation, scaling, create object, delete object, and clone object.

Introduction

Augmented reality (AR) is a technology that allows computer-generated or digital information that includes...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

References

  • Azuma, R.T.: A survey of augmented reality. Presence Teleop. Virt. 6(4), 355–385 (1997). Maxwell, J.C.: A Treatise on Electricity and Magnetism, 3rd ed., vol. 2. pp. 68–73. Clarendon, Oxford (1892)

    Article  Google Scholar 

  • Azuma, R.T.: Making augmented reality a reality. In: Applied Industrial Optics: Spectroscopy, Imaging and Metrology, pp. JTu1F-1. Optical Society of America (2017). https://bit.ly/2mOErYT

  • Billinghurst, M.: Crossing the chasm. In: International Conference on Augmented Tele-Existence (ICAT 2001), pp. 5–7. ICAT, Tokyo (2001)

    Google Scholar 

  • Billinghurst, M., Clark, A., Lee, G.: A survey of augmented reality. Found. Trends® Human-Comput. Interact. 8(2–3), 73–272 (2015)

    Article  Google Scholar 

  • Buchmann, V., Violich, S., Billinghurst, M., Cockburn, A.: FingARtips: gesture-based direct manipulation in augmented reality. In: Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, pp. 212–221. ACM (2004)

    Google Scholar 

  • Evans, G., Miller, J., Pena, M. I., MacAllister, A., Winer, E.: Evaluating the Microsoft HoloLens through an augmented reality assembly application. In Degraded Environments: Sensing, Processing, and Display 2017 (Vol. 10197, p. 101970V). (2017). International Society for Optics and Photonics

    Google Scholar 

  • Hürst, W., Van Wezel, C.: Gesture-based interaction via finger tracking for mobile augmented reality. Multimed. Tools Appl. 62(1), 233–258 (2013)

    Article  Google Scholar 

  • Irawati, S., Green, S., Billinghurst, M., Duenser, A., Ko, H.: Move the couch where?: developing an augmented reality multimodal interface. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 183–186. IEEE Computer Society (2006)

    Google Scholar 

  • Ismail, A.W., Sunar, M.S.: Multimodal fusion: gesture and speech input in augmented reality environment. In: Computational Intelligence in Information Systems, pp. 245–254. Springer, Cham (2015)

    Chapter  Google Scholar 

  • Ismail, A.W., Billinghurst, M., Sunar, M.S.: Vision-based technique and issues for multimodal interaction in augmented reality. In: Proceedings of the 8th International Symposium on Visual Information Communication and Interaction, pp. 75–82. ACM (2015, August)

    Google Scholar 

  • Kato, H., Billinghurst, M., Poupyrev, I., Imamoto, K., Tachibana, K.: Virtual object manipulation on a table-top AR environment. In: Augmented Reality, 2000. (ISAR 2000). Proceedings. IEEE and ACM International Symposium on, pp. 111–119. IEEE (2000)

    Google Scholar 

  • Lin, J., Schulze, J.P.: Towards naturally grabbing and moving objects in VR. Electron. Imaging. 2016(4), 1–6 (2016)

    Article  Google Scholar 

  • Magic Leap (2018). https://www.magicleap.com/

  • Mann, S., Furness, T., Yuan, Y., Iorio, J., Wang, Z.: All Reality: Virtual, Augmented, Mixed (X), Mediated (X, Y), and Multimediated Reality (2018)

    Google Scholar 

  • Microsoft Hololens (2016). https://www.microsoft.com/en-us/hololens

  • Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: International Gesture Workshop, pp. 409–420. Springer, Berlin, Heidelberg (2003, April)

    Google Scholar 

  • Piumsomboon, T., Altimira, D., Kim, H., Clark, A., Lee, G., Billinghurst, M.: Grasp-Shell vs gesture-speech: a comparison of direct and indirect natural inter-action techniques in augmented reality. In: Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on, pp. 73–82. IEEE (2014, September)

    Google Scholar 

  • Syafiqa, N.S., Ismail, A.W.: AR Home Deco: Virtual Object Manipulation Technique Using Hand Gesture in Augmented Reality, UTM Computing Proceeding, vol 3, pp. 1–6 (2018). https://bit.ly/2nODkrY

  • Szalavári, Z., Schmalstieg, D., Fuhrmann, A., Gervautz, M.: “Studierstube”: an environment for collaboration in augmented reality. Virtual Reality. 3(1), 37–48 (1998)

    Article  Google Scholar 

Download references

Acknowledgments

This work was funded by UTM-GUP Funding Research Grants Scheme (Q.J130000.2528.19H89).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohamad Yahya Fekri Aladin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Aladin, M.Y.F., Ismail, A.W., Yusof, C.S., Safiee, N.S. (2019). Object Manipulation Using Real Hand Gesture for Augmented Reality Interior Design. In: Lee, N. (eds) Encyclopedia of Computer Graphics and Games. Springer, Cham. https://doi.org/10.1007/978-3-319-08234-9_366-1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08234-9_366-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08234-9

  • Online ISBN: 978-3-319-08234-9

  • eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering

Publish with us

Policies and ethics