Advertisement

The Issues of 3D Hand Gesture and Posture Recognition Using the Kinect

  • Mohamed-Ikbel Boulabiar
  • Gilles Coppin
  • Franck Poirier
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8511)

Abstract

Besides the emergence of many input devices and sensors, they are still unable to provide good and simple recognition of human postures and gestures. The recognition using simple algorithms implemented on top of these devices (like the Kinect) enlarges use cases for these gestures and postures to newer domains and systems. Our methods cuts the needed computation and allow the integration of other algorithms to run in parallel. We present a system able to track the hand in 3D, log its position and surface information during the time, and recognize hand postures and gestures. We present our solution based on simple geometric algorithms, other tried algorithms, and we discuss some concepts raised from our tests.

Keywords

Gesture Posture 3D Kinect Interaction Hand 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Baudel, T., Beaudouin-Lafon, M.: Charade: Remote control of objects using free-hand gestures. Commun. ACM 36(7), 28–35 (1993)CrossRefGoogle Scholar
  2. 2.
    Bérard, F., Ip, J., Benovoy, M., El-Shimy, D., Blum, J.R., Cooperstock, J.R.: Did “minority report” get it wrong? superiority of the mouse over 3d input devices in a 3d placement task. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 400–414. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  3. 3.
    Boulabiar, M.-I., Burger, T., Poirier, F., Coppin, G.: A low-cost natural user interaction based on a camera hand-gestures recognizer. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 214–221. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  4. 4.
    Gustafson, S., Bierwirth, D., Baudisch, P.: Imaginary interfaces: Spatial interaction with empty hands and without visual feedback. In: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology, UIST 2010, pp. 3–12. ACM, New York (2010)Google Scholar
  5. 5.
    Haubner, N., Schwanecke, U., Dörner, R., Lehmann, S., Luderschmidt, J.: Recognition of dynamic hand gestures with time-of-flight cameras. In: Proceedings of ITG/GI Workshop on Self-Integrating Systems for Better Living Environments, vol. 2010, pp. 33–39 (2010)Google Scholar
  6. 6.
    Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., Butz, A.: Interactions in the air: Adding further depth to interactive tabletops. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 139–148. ACM (2009)Google Scholar
  7. 7.
    Ionescu, B., Coquin, D., Lambert, P., Buzuloiu, V.: Dynamic hand gesture recognition using the skeleton of the hand. EURASIP Journal on Applied Signal Processing (2005)Google Scholar
  8. 8.
    Kratz, S., Rohs, M.: A $3 gesture recognizer: Simple gesture recognition for devices equipped with 3D acceleration sensors. In: International Conference on Intelligent User Interfaces, pp. 341–344 (2010)Google Scholar
  9. 9.
    Li, Y.: Protractor: A fast and accurate gesture recognizer. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2010, pp. 2169–2172. ACM, New York (2010)Google Scholar
  10. 10.
    Marquardt, N., Jota, R., Greenberg, S., Jorge, J.A.: The continuous interaction space: Interaction techniques unifying touch and gesture on and above a digital surface. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part III. LNCS, vol. 6948, pp. 461–476. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  11. 11.
    Oikonomidis, I., Kyriazis, N., Argyros, A.A.: Markerless and efficient 26-dof hand pose recovery. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part III. LNCS, vol. 6494, pp. 744–757. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  12. 12.
    Olsen, L., Samavati, F.F., Sousa, M.C.: Fast Stroke Matching by Angle Quantization. In: Proceedings of the ImmersCom (2007)Google Scholar
  13. 13.
    Rubine, D.: Specifying gestures by example. ACM SIGGRAPH Computer Graphics 25(4), 329–337 (1991)CrossRefGoogle Scholar
  14. 14.
    Valkov, D.: Interscopic multi-touch environments. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, pp. 339–342. ACM, New York (2010)Google Scholar
  15. 15.
    Victor, B.: A Brief Rant on the Future of Interaction Design (2011), http://worrydream.com/ABriefRantOnTheFutureOfInteractionDesign/
  16. 16.
    Walter, R., Bailly, G., Müller, J.: Strikeapose: Revealing mid-air gestures on public displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, pp. 841–850. ACM, New York (2013)CrossRefGoogle Scholar
  17. 17.
    Wilson, A., Izadi, S., Hilliges, O., Garcia-Mendoza, A., Kirk, D.: Bringing physics to the surface. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, pp. 67–76. ACM (2008)Google Scholar
  18. 18.
    Wobbrock, J., Wilson, A., Li, Y.: Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, pp. 159–168. ACM (2007)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Mohamed-Ikbel Boulabiar
    • 1
  • Gilles Coppin
    • 1
  • Franck Poirier
    • 2
  1. 1.Lab-STICCTelecom BretagneFrance
  2. 2.Lab-STICCUniversity of Bretagne-SudFrance

Personalised recommendations