Skip to main content
SpringerLink
Log in

Typing Braille Code in the Air with the Leap Motion Controller

  • Conference paper
  • First Online:
Man-Machine Interactions 5 (ICMMI 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 659))

Included in the following conference series:

Abstract

The paper presents the new concept of typing the Braille Code. Developed method use a Leap Motion controller to recognize fingers responsible for typing proper Braille dots in the air. The recognition of input characters bases on the analysis of coordinates of the hands, fingers, phalanges and hand joints in three-dimensional space, which is observed by the controller. The arrangement of the hands doesn’t affect the accuracy of typed codes. Proposed method is implemented in the form of desktop application for personal computers. The evaluation shows the writing speed (7.4 WPM) and the MSD error rate (13.18%) comparable to Braille virtual keyboards using touchscreen.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Azenkot, S., Wobbrock, J.O., Prasain, S., Ladner, R.E.: Input finger detection for nonvisual touch screen text entry in perkinput. In: ICGI 2012, Toronto, Ontario, Canada, pp. 121–129. Canadian Information Processing Society (2012)

    Google Scholar 

  2. Bachmann, D., Weichert, F., Rinkenauer, G.: Evaluation of the leap motion controller as a new contact-free pointing device. Sensors 15(1), 214–233 (2014)

    Article  Google Scholar 

  3. Copeland, D.: A lighter touch: Perkins school hopes compact Braille machine brings renewed interest. The Boston Globe (2008)

    Google Scholar 

  4. Dianxing, L.: Research on digital exhibition old summer palace somatosensory interaction based on leap motion. In: ICECEE 2015, Jinan, China. Advances in Computer Science Research, pp. 1079–1083. Atlantis Press (2015)

    Google Scholar 

  5. Façanha, A.R., Viana, W., Pequeno, M.C., de Borba Campos, M., Sánchez, J.: Touchscreen mobile phones virtual keyboarding for people with visual disabilities. In: HCI 2014, Heraklion, Crete, Greece, pp. 134–145. Springer (2014)

    Google Scholar 

  6. Fossbytes: Now control your PC with futuristic leap motion. https://fossbytes.com/now-control-pc-futuristic-leap-motion. Accessed Sept 2016

  7. Guerreiro, T., Lagoá, P., Santana, P., Gonçalves, D., Jorge, J.: NavTap and BrailleTap: Non-visual texting interfaces. In: RESNA 2008, Washington, DC, USA. ACM (2008)

    Google Scholar 

  8. Guna, J., Jakus, G., Pogačnik, M., Tomažič, S., Sodnik, J.: An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors 14(2), 3702–3720 (2014)

    Article  Google Scholar 

  9. He, L., Hu, X.Q., Wei, D.: The study of interaction about the online virtual learning community based on leap motion. In: ICCIS 2014, NanChong, China, pp. 1225–1229. IEEE (2014)

    Google Scholar 

  10. Jakus, G., Guna, J., Tomažič, S., Sodnik, J.: Evaluation of leap motion controller with a high precision optical tracking system. In: ICHCI 2014, Heraklion, Crete, Greece, pp. 254–263. Springer (2014)

    Google Scholar 

  11. Mascetti, S., Bernareggi, C., Belotti, M.: TypeInBraille: a Braille-based typing application for touchscreen devices. In: SIGACCESS 2011, Dundee, Scotland, UK, pp. 295–296. ACM (2011)

    Google Scholar 

  12. Mourouzis, A., Arfaras, G., Kilintzis, V., Chouvarda, I., Maglaveras, N.: Touchless text entry for all: initial design considerations and prototypes. In: UAHCI 2015, Los Angeles, CA, USA, pp. 37–49. Springer (2015)

    Google Scholar 

  13. Oliveira, J., Guerreiro, T., Nicolau, H., Jorge, J., Gonçalves, D.: Brailletype: unleashing Braille over touch screen mobile phones. In: Human-Computer Interaction-INTERACT 2011, pp. 100–107 (2011)

    Google Scholar 

  14. Romero, M., Frey, B., Southern, C., Abowd, G.D.: Brailletouch: designing a mobile eyes-free soft keyboard. In: HCIMDS 2011, Stockholm, Sweden, pp. 707–709. ACM (2011)

    Google Scholar 

  15. Soukoreff, R.W., MacKenzie, I.S.: Measuring errors in text entry tasks: an application of the levenshtein string distance statistic. In: CHI 2001, Seattle, WA, USA, pp. 319–320. ACM (2001)

    Google Scholar 

  16. Southern, C., Clawson, J., Frey, B., Abowd, G., Romero, M.: An evaluation of brailletouch: mobile touchscreen text entry for the visually impaired. In: HCIMDS 2012, San Francisco, CA, USA, pp. 317–326. ACM (2012)

    Google Scholar 

  17. Sturman, M.M., Vaillancourt, D.E., Corcos, D.M.: Effects of aging on the regularity of physiological tremor. J. Neurophysiol. 93(6), 3064–3074 (2005)

    Article  Google Scholar 

  18. Tung, J.Y., Lulic, T., Gonzalez, D.A., Tran, J., Dickerson, C.R., Roy, E.A.: Evaluation of a portable markerless finger position capture device: accuracy of the leap motion controller in healthy adults. Physiol. Meas. 36(5), 1025 (2015)

    Article  Google Scholar 

  19. Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the leap motion controller. Sensors 13(5), 6380–6393 (2013)

    Article  Google Scholar 

  20. Zaii, I.A., Pentiuc, S.G., Vatavu, R.D.: On free-hand TV control: experimental results on user-elicited gestures with leap motion. Pers. Ubiquit. Comput. 19(5–6), 821 (2015)

    Google Scholar 

Download references

Acknowledgements

Publication financed by the Institute of Informatics at Silesian University of Technology, statutory research no. 02/020/BK-16/0077.

Author information

Authors and Affiliations

  1. Institute of Informatics, Silesian University of Technology, Akademicka 16, Gliwice, Poland

    Krzysztof Dobosz & Maciej Mazgaj

Authors
  1. Krzysztof Dobosz
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maciej Mazgaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Krzysztof Dobosz .

Editor information

Editors and Affiliations

  1. Institute of Informatics, Silesian University of Technology, Gliwice, Poland

    Aleksandra Gruca

  2. Institute of Informatics, Silesian University of Technology, Gliwice, Poland

    Tadeusz Czachórski

  3. Institute of Informatics, Silesian University of Technology, Gliwice, Poland

    Katarzyna Harezlak

  4. Institute of Informatics, Silesian University of Technology, Gliwice, Poland

    Stanisław Kozielski

  5. Institute of Informatics, Silesian University of Technology, Gliwice, Poland

    Agnieszka Piotrowska

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Dobosz, K., Mazgaj, M. (2018). Typing Braille Code in the Air with the Leap Motion Controller. In: Gruca, A., Czachórski, T., Harezlak, K., Kozielski, S., Piotrowska, A. (eds) Man-Machine Interactions 5. ICMMI 2017. Advances in Intelligent Systems and Computing, vol 659. Springer, Cham. https://doi.org/10.1007/978-3-319-67792-7_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67792-7_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67791-0

  • Online ISBN: 978-3-319-67792-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation