Skip to main content

Special topics of gesture recognition applied in intelligent home environments

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1371))

Abstract

This report shows how to realize a gesture recognition system for controlling appliances in home environments. It gives a brief overview on an existing system and clarifies details on ergonomic remote control of devices by gestures with the help of a vision system. The focus is on the motion detection, object normalization and identification, the modelling and the prediction of motion by the Kalman Filter. A main interest was to show through the example ARGUS, how the Kalman Filter should be modelled and initialized for a physical human motion. The initialization problem of the Kalman Filter of a vision based system for human motion tracking differs from initializing for physical systems, where manuals report measurement errors. Most aspects mentioned in this report were implemented in the ARGUS prototype.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Subutai Ahmad. A usable real-time 3D hand tracker. In Proceedings 28th Asilomar Conference on Signals, Systems and Computers, pages 1257–1261. IEEE Computer Society Press, 1995.

    Google Scholar 

  2. Marcus Breig. Entwicklung einer Bewegungsdetektion und-vorhersage für den Einsatz zweier beweglicher Kameras bei menschlichen Bewegungen. Diplomarbeit, University of Dortmund, December 1997.

    Google Scholar 

  3. Ulrich Bröckl-Fox. Untersuchung neuer, gestenbasierter Methoden für die 3D-In-teraktion. PhD thesis, University of Karlsruhe, February 1995. Shaker-Verlag, ISBN 3-8265-0620-0.

    Google Scholar 

  4. Robert G. Brown. Introduction to random signal analysis and Kalman filtering. Wiley, New York [u.a.], 1983.

    Google Scholar 

  5. Mo Dai, Pierre Baylou, and Mohamed Najim. An efficient algorithm for computation of shape moments from run-length codes or chain codes. Pattern Recognition, 25(10):1119–1128, February 1992.

    Article  Google Scholar 

  6. T.J. Darrell and A.P. Pentland. Space-time gestures. In Proc. Conf. on Computer Vision and Pattern Recognition, pages 335–340, New York, NY, June 15–17 1993.

    Google Scholar 

  7. A. Drees, F. Kummert, E. Littmann, S. Posch, H. Ritter, and G. Sagerer. A hybrid system to detect hand orientation in stereo images. In E.S. Gelsema and L.N. Kanal, editors, Pattern Recognition in Practice IV: Multiple Paradigms, Comparative Studies and Hybrid Systems, pages 551–562. Elsevier, Amsterdam, 1994.

    Google Scholar 

  8. Roger M. du Plessis. Poor Man’s Explanation of Kalman Filtering or how I stopped worrying and learned to love Matrix Inversion. Technical report, Autonetics Division, Rockwell International, 3370 Miraloma Avenue, Anaheim, California 92803, June 1967.

    Google Scholar 

  9. H. Freeman. Computer processing of line drawing images. Computing Surveys, 6:57–98, 1974.

    Article  MATH  Google Scholar 

  10. W. T. Freeman and C. Weissman. Television control by hand gestures. In M. Bichsel, editor, Proc. Intl. Workshop on Automatic Face-and Gesture-Recognition, IEEE Computer Society, pages 179–183, Zürich, Switzerland, June 1995. http://www.merl.com/TR/TR94-24.

    Google Scholar 

  11. Markus Kohler. Vision Based Remote Control in Intelligent Home Environments. In B. Girod, H. Niemann, and H.-P. Seidel, editors, 3D Image Analysis and Synthesis’96, pages 147–154, University of Erlangen-Nuremberg/Germany, November 18–19 1996. infix Verlag. ISBN 3-89601-000-X; see also Ein ergonomisches Dialogsystem zur Steuerung von technischen Systemen in Wohnbereichen mittels Gestenerkennung —Abschlußbericht at Dep. f. CG/University of Dortmund.

    Google Scholar 

  12. Markus Kohler. Using the Kalman Filter to track human interactive motion —Modelling and initialization of the Kalman Filter for translational motion —. Technical Report 629, Informatik VII, University of Dortmund, January 1997.

    Google Scholar 

  13. Ch. Maggioni. GestureComputer: New ways of operating a computer. In M. Bichsel, editor, Proc. Intl. Workshop on Automatic Face-and Gesture-Recognition, IEEE Computer Society, pages 166–171, Zürich, Switzerland, June 1995.

    Google Scholar 

  14. Ch. Maggioni and B. Kämmerer. GestureComputer —history, design and applications. In Ed. R. Cippola and A. Pentland, editors, ECCV ’96 Workshop on Computer Vision in Man-Machine Interfaces. Cambridge University Press, to appear in June 1996.

    Google Scholar 

  15. Andrea Meyering and Helge Ritter. Learning to recognize 3d-hand postures from perspective pixel images. Artificial Neural networks, pages 821–824, 1992. Elsevier Science Publishers B.V.

    Google Scholar 

  16. James M. Rehg and Takeo Kanade. DigitEyes: Vision-based human hand tracking. Technical report, School of Computer Science, Carnegie Mellon University, December 1993.

    Google Scholar 

  17. Hans Röttger. Echtzeit-Interaktion auf Basis visueller Bewegungserfassung. Master’s thesis, University of Dortmund, July 1995.

    Google Scholar 

  18. Sven Schröter. Entwicklung von Verfahren zur automatischen Kalibration eines farbbasierten Objekterkennungssystems. Master’s thesis, University of Dortmund, August 1996.

    Google Scholar 

  19. Michael Stark and Markus Kohler. Videobasierte Mensch-Maschine-Interaktion. Informationstechnik und Technische Informatik, 38(3):15–20, June 1996. More Details in english Video Based Gesture Recognition for Human Computer Interaction, TR 593 and Projektgruppe 247: ZYKLOP —Visueller Mensch-Rechner-Dialog —Abschlußbericht (1995) at Dep. f. CG/University of Dortmund.

    Google Scholar 

  20. Peter W.M. Tsang, P.C. Yuen, and F.K. Lam. Recognition of occluded objects. Pattern Recognition, 25(10):1107–1117, 1992.

    Article  Google Scholar 

  21. Junji Yamato, Jun Ohya, and Kenichiro Ishii. Recognizing human action in timesequential images using hidden markov model. IEEE, pages 379–385, 1992. ISBN or ISSN 0-8186-2855-3/92.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Ipke Wachsmuth Martin Fröhlich

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag

About this paper

Cite this paper

Kohler, M. (1998). Special topics of gesture recognition applied in intelligent home environments. In: Wachsmuth, I., Fröhlich, M. (eds) Gesture and Sign Language in Human-Computer Interaction. GW 1997. Lecture Notes in Computer Science, vol 1371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0053007

Download citation

  • DOI: https://doi.org/10.1007/BFb0053007

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64424-8

  • Online ISBN: 978-3-540-69782-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics