Skip to main content
SpringerLink
Log in
Book cover

International Conference on Computer Vision and Graphics

ICCVG 2016: Computer Vision and Graphics pp 233–243Cite as

Minimal Interaction Touchless Text Input with Head Movements and Stereo Vision

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9972))

Abstract

Many modern interfaces for human-computer interaction are based on some kind of visual system and offer touchless and convenient medium for communication for the user. These non-contact interfaces predominantly limit their operations to gesture recognition or a pointer manipulation in a graphical user interface. The problem of typing in most cases is omitted since touchless interfaces are not designed for text entry purposes. There is, however, a great number of people who suffer from some form of disability. They are unable to use standard input devices (mouse and keyboard) or modern touchless interfaces. For those physically challenged people a minimal interaction interface for text entry operated with head movements is proposed in the paper. It is based on processing video streams from a stereo webcam, uses only directional head movements and a dictionary support.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. World Health Organization: The World Bank: World Report on Disability. WHO Press, World Health Organization, Switzerland (2011)

    Google Scholar 

  2. Chattopadhyay, D., Bolchini, D.: Understanding visual feedback in large-display touchless interactions: an exploratory study. Research report, IUPUI Scholar Works, Indiana University (2014)

    Google Scholar 

  3. Johnson, R., O’Hara, K., Sellen, A., Cousins, C., Criminisi, A.: Exploring the potential for touchless interaction in image-guided interventional radiology. In: ACM Conference on Computer-Human Interaction (CHI 2011), pp. 3323–3332 (2011)

    Google Scholar 

  4. Dostal, J., Hinrichs, U., Kristensson, P.O., Quigley, A.: SpiderEyes: designing attention- and proximity-aware collaborative interfaces for wall-sized displays. In: Proceedings of the 19th International Conference on Intelligent User Interfaces, IUI 2014, pp. 143–152, Haifa, Israel (2014)

    Google Scholar 

  5. Sarkar, A.R., Sanyal, G., Majumder, S.: Hand gesture recognition systems: a survey. Int. J. Comput. Appl. 71(15), 25–37 (2013)

    Google Scholar 

  6. Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 37(3), 311–324 (2007)

    Article  Google Scholar 

  7. Rebman, C.M., Aiken, M.W., Cegielski, C.G.: Speech recognition in the human computer interface. Inform. Manage. 40(6), 509–519 (2003)

    Article  Google Scholar 

  8. Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J.M., Brumberg, J.S.: Silent speech interfaces. Speech Commun. 52(4), 270–287 (2010)

    Article  Google Scholar 

  9. Jacob, R.J.K., Karn, K.S.: Eye tracking in human-computer interaction and usability research: ready to deliver the promises. In: The Minds Eye: Cognitive and Applied Aspects of Eye Movement Research. Elsevier Science, Oxford (2003)

    Google Scholar 

  10. Dasher Project (2016). http://www.inference.phy.cam.ac.uk/dasher/

  11. Ibraheem, N.A., Khan, R.Z.: Survey on various gesture recognition technologies and techniques. Int. J. Comput. Appl. 50(7), 38–44 (2012)

    Google Scholar 

  12. Nowosielski, A.: QWERTY- and 8pen- based touchless text input with hand movement. In: Chmielewski, L.J., Kozera, R., Shin, B.-S., Wojciechowski, K. (eds.) ICCVG 2014. LNCS, vol. 8671, pp. 470–477. Springer, Heidelberg (2014). doi:10.1007/978-3-319-11331-9_56

    Google Scholar 

  13. 8pen (2016). http://www.the8pen.com/

  14. Markussen, A., Jakobsen, M.R., Hornbk, K.: Vulture: a mid-air word-gesture keyboard. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI 2014, pp. 1073–1082 (2014)

    Google Scholar 

  15. Wierzchowski, M., Nowosielski, A.: Swipe text input for touchless interfaces. In: Burduk, R., Jackowski, K., Kurzyński, M., Woźniak, M., Żołnierek, A. (eds.) Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015. AISC, vol. 403, pp. 619–629. Springer, Heidelberg (2016). doi:10.1007/978-3-319-26227-7_58

    Chapter  Google Scholar 

  16. QVirtboard (2016). http://qvirtboard.sourceforge.net/

  17. Nowosielski, A., Chodyła, Ł.: Touchless input interface for disabled. In: Burduk, R., Jackowski, K., Kurzynski, M., Wozniak, M., Zolnierek, A. (eds.) CORES 2013. AISC, vol. 226, pp. 701–709. Springer, Heidelberg (2013). doi:10.1007/978-3-319-00969-8_69

    Chapter  Google Scholar 

  18. Gizatdinova, Y., Spakov, O., Surakka, V.: Face typing: vision-based perceptual interface for hands-free text entry with a scrollable virtual keyboard. In: IEEE Workshop on Applications of Computer Vision 2012, Breckenridge, CO, USA, pp. 81–87 (2012)

    Google Scholar 

  19. Morris, T., Chauhan, V.: Facial feature tracking for cursor control. J. Netw. Comput. Appl. 29(2006), 62–80 (2006)

    Article  Google Scholar 

  20. Varona, J., Manresa-Yee, C., Perales, F.J.: Hands-free vision-based interface for computer accessibility. J. Netw. Comput. Appl. 31(4), 357–374 (2008)

    Article  Google Scholar 

  21. Giorio, C., Fascinari, M.: Kinect in Motion Audio and Visual Tracking by Example Starting. Packt Publishing, Birmingham (2013)

    Google Scholar 

  22. Nowosielski, A.: Evaluation of touchless typing techniques with hand movement. In: Burduk, R., Jackowski, K., Kurzyński, M., Woźniak, M., Żołnierek, A. (eds.) Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015. AISC, vol. 403, pp. 441–449. Springer, Heidelberg (2016). doi:10.1007/978-3-319-26227-7_41

    Chapter  Google Scholar 

  23. Placitelli, A.P.: Toward a framework for rapid prototyping of touchless user interfaces. In: 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems, pp. 539–543 (2012)

    Google Scholar 

  24. Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)

    Article  Google Scholar 

  25. Kukharev, G., Nowosielski, A.: Fast and efficient algorithm for face detection in colour images. Mach. Graph. Vis. 13(4), 377–399 (2004)

    Google Scholar 

  26. Kukharev, G., Kumiski, A.: Biometric Techniques Part I. Face Recognition Methods (in Polish). Szczecin University of Technology Press, Szczecin (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Computer Science and Information Technology, West Pomeranian University of Technology, Żołnierska 52, 71-210, Szczecin, Poland

    Adam Nowosielski

Authors
  1. Adam Nowosielski
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adam Nowosielski .

Editor information

Editors and Affiliations

  1. Faculty of Applied Informatics and Math, Warsaw University of Life Sciences , Warsaw, Poland

    Leszek J. Chmielewski

  2. Computer Sci and Software Engineering, University of Western Australia , Perth, Australia

    Amitava Datta

  3. Faculty of Applied Informatics and Math, Warsaw University of Life Sciences SGGW , Warsaw, Poland

    Ryszard Kozera

  4. Institute of Computer Science, Silesian University of Technology , Gliwice, Poland

    Konrad Wojciechowski

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Nowosielski, A. (2016). Minimal Interaction Touchless Text Input with Head Movements and Stereo Vision. In: Chmielewski, L., Datta, A., Kozera, R., Wojciechowski, K. (eds) Computer Vision and Graphics. ICCVG 2016. Lecture Notes in Computer Science(), vol 9972. Springer, Cham. https://doi.org/10.1007/978-3-319-46418-3_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46418-3_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46417-6

  • Online ISBN: 978-3-319-46418-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation