Finger Recognition as Interaction Media in Augmented Reality for Historical Buildings in Matsum and Kesawan Regions of Medan City

  • Mohammad Fadly SyahputraEmail author
  • Ridho K. Siregar
  • Romi Fadillah Rahmat
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10325)


Cultural heritage refers to the objects or symbolic attributes which resembles the identity of a society inherited from the previous generations, and will be preserved for the future generations. Despite of the importance of the cultural heritage, the interest of modern society for historic building has been decreased, as the cultural heritage is not considered as the main priority of development by the local government. This condition increases the necessity to restore the interest of modern society for historic building by implementing augmented reality. In this research, the finger recognition is utilized as the media of interaction between the 3-D objects and User. The system will identify the structure of human hand and calculate the number of fingers detected from the image obtained from web camera, by using convex hull and convexity defects. The research shows that the distance required to obtain the best performance is 30 to 50 cm with adequate light condition, while the distance required to perform marker detection in augmented reality is between 2.5 to 5 m, with the camera angle of 40°.


Finger recognition Augmented reality Digital heritage preservation Skin color detection 


  1. 1.
    Hartanto, R., Nurtiantoro, M.A.: Perancangan Awal Antarmuka Gesture Tangan Berbasis visual. JNTETI 1(1), 36–43 (2012)Google Scholar
  2. 2.
    Brotos, A.: Interactive augmented reality panel interface for android. Bachelor Thesis, Stanford University (2015)Google Scholar
  3. 3.
    Peng, H.: Application research on face detection technology based on OpenCV in mobile augmented reality (2015)Google Scholar
  4. 4.
    Rios, D., et al.: Hand-gesture recognition using computer-vision techniques. In: 21st International Conference on Computer Graphics, Visualization and Computer Vision (2013)Google Scholar
  5. 5.
    Liang, H., Thalmann, D., Magnenat, N.: AR in Hand: egocentric palm pose tracking and gesture recognition for augmented reality applications. Skripsi, Nanyang Technological University, Singapore (2015)Google Scholar
  6. 6.
    Lee, H., Tateyama, Y., Ogi, T.: Hand gesture recognition using blob detection for immersive projection display system. World Acad. Sci. Eng. Technol. Int. J. Comput. 2, 116–119 (2012)Google Scholar
  7. 7.
    Rahmat, R.F., Chairunnisa, T., Gunawan, D., Sitompul, O.S.: Skin color segmentation using multi-color space threshold. In: 2016 3rd International Conference on Computer and Information Sciences (ICCOINS), Kuala Lumpur, pp. 391–396 (2016)Google Scholar
  8. 8.
    Syahputra, M.F., Permady, J.A., Muchtar, M.A.: Digital reconstruction of Darul Aman palace based on images and implementation into virtual reality environment. In: Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9769, pp. 269–279. Springer, Cham (2016). doi: 10.1007/978-3-319-40651-0_22 Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Mohammad Fadly Syahputra
    • 1
    Email author
  • Ridho K. Siregar
    • 1
  • Romi Fadillah Rahmat
    • 1
  1. 1.Faculty of Computer Science and Information Technology, Department of Information TechnologyUniversity of Sumatera UtaraMedanIndonesia

Personalised recommendations