Random Forest Based Gesture Segmentation from Depth Image

  • Renjun Tang
  • Hang Pan
  • Xianjun ChenEmail author
  • Jinlong Chen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10942)


Gesture image segmentation is a challenge task due to the high degree of freedom of human gestures, large differences in shape and high flexibility, traditional pattern recognition and image processing methods are not effective in gesture detection. The traditional image segmentation based on the detection of skin color and the image of the depth image are limited by the effects of ambient light, skin color difference and image depth variation, resulting in unsatisfactory results. Therefore, we propose a hand gesture depth image segmentation method based on random forest. The method learns the gesture image feature representation of the depth image by supervising learning. Experiments show that the proposed method segments the gesture s’ pixels from the backgrounds area of the depth image. The proposed method potential has widely usages in gesture tracking, gesture recognition and human computer interaction.


Random forest Gesture segmentation Depth image 



This research work is supported by the grant of Guangxi science and technology development project (No: AC16380124), the grant of Guangxi Science Foundation (No: 2017GXNSFAA198226), the grant of Guangxi Key Laboratory of Trusted Software of Guilin University of Electronic Technology (No: KX201513), the grant of Guangxi Colleges and Universities Key Laboratory of Intelligent Processing of Computer Images and Graphics of Guilin University of Electronic Technology (No: GIIP201602), and the grant of Innovation Project of GUET Graduate Education (2018YJCX43).


  1. 1.
    Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., Twombly, X.: Vision-based hand pose estimation: a review. Comput. Vis. Image Underst. 108(1–2), 52–73 (2007)CrossRefGoogle Scholar
  2. 2.
    Bretzner, L., Laptev, I., Lindeberg, T.: Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, 2002, (pp. 423–428). IEEE (2002)Google Scholar
  3. 3.
    Chen, Q., Georganas, N.D., Petriu, E.M.: Real-time vision-based hand gesture recognition using haar-like features. In: Proceedings of the 2007 Instrumentation and Measurement Technology Conference. IMTC 2007, pp. 1–6. IEEE (2007)Google Scholar
  4. 4.
    Bilal, S., Akmeliawati, R., El Salami, M.J., Shafie, A.A.: A hybrid method using haar-like and skin-color algorithm for hand posture detection, recognition and tracking. In: 2010 International Conference on Mechatronics and Automation (ICMA), pp. 934–939. IEEE (2010)Google Scholar
  5. 5.
    Jo, Y.G., Lee, J.Y., Kang, H.: Segmentation tracking and recognition based on foreground-background absolute features, simplified SIFT, and particle filters. In: IEEE Congress on Evolutionary Computation, 2006. CEC 2006, pp. 1279–1284. IEEE (2006)Google Scholar
  6. 6.
    Hong, H., Zhu, X.: A human hand-image detection based on skin-color and circular degree. In: 10th ACIS International Conference on Software Engineering, Artificial Intelligences, Networking and Parallel/Distributed Computing, 2009. SNPD 2009, pp. 373–376. IEEE (2009)Google Scholar
  7. 7.
    Manresa, C., Varona, J., Mas, R., Perales, F.J.: Hand tracking and gesture recognition for human-computer interaction. ELCVIA Electron. Lett. Comput. Vis. Image Anal. 5(3), 96–104 (2005)CrossRefGoogle Scholar
  8. 8.
    Chen, F.S., Fu, C.M., Huang, C.L.: Hand gesture recognition using a real-time tracking method and hidden Markov models. Image Vis. Comput. 21(8), 745–758 (2003)CrossRefGoogle Scholar
  9. 9.
    Velloso, M.L.F., Carneiro, T.A., de Souza, F.J.: Unsupervised change detection using fuzzy entropy principle. In: Proceedings of the 2004 IEEE International Geoscience and Remote Sensing Symposium, 2004. IGARSS 2004, vol. 4, pp. 2550–2553. IEEE (2004)Google Scholar
  10. 10.
    Malassiotis, S., Aifanti, N., Strintzis, M.G.: A gesture recognition system using 3D data. In: Proceedings of the First International Symposium on 3D Data Processing Visualization and Transmission 2002, pp. 190–193. IEEE (2002)Google Scholar
  11. 11.
    Sohn, M.-K., Kim, D.-J., Kim, H.: Hand part classification using single depth images. In: Jawahar, C.V., Shan, S. (eds.) ACCV 2014. LNCS, vol. 9009, pp. 253–261. Springer, Cham (2015). Scholar
  12. 12.
    Tang, M.: Recognizing hand gestures with Microsoft’s Kinect. Department of Electrical Engineering of Stanford University, Palo Alto (2011)Google Scholar
  13. 13.
    Tompson, J., Stein, M., Lecun, Y., Perlin, K.: Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans. Graph. (ToG) 33(5), 169 (2014)CrossRefGoogle Scholar
  14. 14.
    Neverova, N., Wolf, C., Taylor, G.W., Nebout, F.: Hand segmentation with structured convolutional learning. In: Asian Conference on Computer Vision, pp. 687–702. Springer, Cham (2014)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Renjun Tang
    • 1
    • 2
  • Hang Pan
    • 1
  • Xianjun Chen
    • 1
    • 3
    Email author
  • Jinlong Chen
    • 2
  1. 1.Guangxi Key Laboratory of Trusted SoftwareGuilin University of Electronic TechnologyGuilinChina
  2. 2.Key Laboratory of Intelligent Processing of Computer Image and GraphicsGuilin University of Electronic TechnologyGuilinChina
  3. 3.Information Engineering School, Haikou College of EconomicsHaikouChina

Personalised recommendations