Skip to main content
SpringerLink
Log in

Neuro-cognitively inspired haptic user interfaces

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Haptic systems and devices are a recent addition to multimodal systems. These devices have widespread applications such as surgical simulations, medical and procedural training, scientific visualizations, assistive and rehabilitative devices for individuals who have physical or neurological impediments and assistive devices for individuals who are blind. While the potential of haptics in natural human machine interaction is undisputable, the realization of such means is still a long way ahead. There are considerable research challenges to development of natural haptic interfaces. The study of human tactile abilities is a recent endeavor and many of the available systems still do not incorporate the domain knowledge of psychophysics, biomechanics and neurological elements of haptic perception. Development of smart and effective haptic interfaces and devices requires extensive studies that link perceptual phenomena with measurable parameters and incorporation of such domain knowledge in the engineering of haptic interfaces. This paper presents design, development and usability testing of a neuro-cognitively inspired haptic user interface for individuals who are blind. The proposed system design is inspired by neuro-cognitive basis of haptic perception and incorporates the computational aspects and requirements of multimodal information processing system. Usability testing of the system suggests that a biologically inspired haptic user interfaces may form a powerful paradigm for haptic user interface design.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Chapman CE (1994) Active versus passive touch: factors influencing the transmission of somatosensory signals to primary somatosensory cortex. Canadian Journal Physiological Pharmacology 72:558–570

    Google Scholar 

  2. Corsini D, Pick HL (1969) The effect of texture on tactually perceived length. Perception and Psychophysics 5:352–356

    Google Scholar 

  3. De Boeck J, Erwin C, Tom DW, Chris R, Karin C (2004) “Multisensory interaction metaphors with haptics and proprioception in virtual environments,” presented at NordiCHI ‘04: Proceedings of the third Nordic conference on human–computer interaction, Tampere, Finland

  4. DeVolder AG (1995) Functional reorganization of the human cerebral cortex in case of early sensory deafferentation (blindness or deafness): therapeutic implications. Université Catholique de Louvain, Brussels 217 pp

    Google Scholar 

  5. DeVolder AG, Bol A, Blin J, Robert A, Arno P, Grandin C, Michel C, Veraart C (1997) Brain energy metabolism in early blind subjects: neural activity in the visual cortex. Brain Res 750:235–244

    Article  Google Scholar 

  6. DiCarlo J, Johnson KO, Hsiao SS (1998) Structure of receptive fields in Area 3b of primary somatosensory cortex in the alert monkey. J Neurosci 18:2626–2645

    Google Scholar 

  7. Ernst MO, Banks MS (2002) Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415:429–433

    Article  Google Scholar 

  8. Fritz JP, Barner KE (1997) Design of a haptic data visualization system for people with visual impairments. IEEE Trans Rehabil Eng 7:372–384

    Article  Google Scholar 

  9. Gibson JJ (1966) The senses considered as perceptual systems. Houghton Mifflin Company, Boston

    Google Scholar 

  10. Gliner CR (1969) A developmental investigation of visual and haptic preferences for shape and texture. University of Chicago Press, Chicago

    Google Scholar 

  11. Gordon I, Morrison V (1982) The haptic perception of curvature. Perception and Psychophysics 31:446–450

    Google Scholar 

  12. Hatwell Y (1987) Motor and cognitive functions of the hand. Int J Behav Dev 10:509–526

    Google Scholar 

  13. Hatwell Y, Streri A, Gentaz E (2003) Touching for knowing: cognitive psychology of haptic manual perception. John Benjamins Pub, Amsterdam

    Google Scholar 

  14. Hikosaka O, Tanaka M, Sakamoto M, Iwamura Y (1985) Deficits in manipulative behaviors induced by local injections of muscimol in the first somatosensory cortex of the conscious monkey. Brain Research 325(1–2):375–380

    Article  Google Scholar 

  15. Johansson RS (1996) Sensory control of dexterous manipulation in humans. In: Wing HPAM, Flanagan JR (eds) Hand and brain: the neurophysiology and psychology of hand movements. Academic, San Diego, pp 381–414

    Google Scholar 

  16. Kahol K, Tripathi P, Panchanathan S, Goldberg M (2004) Formalizing cognitive and motor strategy of haptic exploratory movements of individuals who are blind. IEEE International Workshop on Haptic Audio Visual Environments and their Applications, pp 25–30

  17. Kahol K, Tripathi P, Panchanathan S (2005) Haptic user interfaces: design, testing and evaluation of haptic cueing systems to convey shape, weight, material and texture information. Human–Computer Interaction, Las Vegas Nevada

  18. Kahol K, McDaniel TPT, Bratton L, Panchanathan S (2006) Modeling context in haptic perception, visualization and rendering. ACM Transactions on Multimedia Computing, Communications and Applications 2(3):219–240

    Article  Google Scholar 

  19. Kandel ER, Schwartz JH, Jessel TM (2000) The principles of neural science. McGraw-Hill, New York

    Google Scholar 

  20. Lederman SJ, Klatzky RL (1987) Hand movements: a window into haptic object recognition. Cogn Psychol 19:342–368

    Article  Google Scholar 

  21. Lederman SJ, Klatzky RL (1996) Action for perception: manual exploratory movements for haptically processing objects and their features. In: Wing AM, Hagard P, Flanagan JR (eds) Hand and brain: the neurophysiology and psychology of hand movements. Academic, New York

    Google Scholar 

  22. Marr D (1982) Vision. Freeman Publishers, New York

    Google Scholar 

  23. Millar S (1994) Understanding and representing space. Theory and evidence from studies with blind and sighted children. Clarendon Press, Oxford

    Google Scholar 

  24. Mistlin AJ, Perrett DI (1990) Visual and somatosensory processing in the macaque temporal cortex: the role of ‘expectation’. Exp Brain Res 82:437–450

    Article  Google Scholar 

  25. Nedel LP, Freitas CM, Jacob LJ, Pimenta MS (2003) Testing the use of egocentric interactive techniques in immersive virtual environments,” presented at INTERACT

  26. Paillard J (1991) Brain and space. Oxford University Press, New York

    Google Scholar 

  27. Pascual-Leone A, Theoret H, Merabet L (2002) “Tactile processing in the visual cortex,” Abstract of Touch, Blindness and Neurosciences congress

  28. Revesz G (1950) Psychology and art of the blind. Longmans Green, London

    Google Scholar 

  29. Salisbury K, Brock D, Massie T, Swarup N, Zilles C (1995) “Haptic rendering: programming touch interaction with virtual objects,” presented at ACM Symposium on Interactive 3D Graphics, Monterey

  30. Salisbury K, Conti F, Barbagli F (2004) Haptic rendering: introductory concepts 24:24

  31. Schellingerhout R, Smitsman AW, Van Galen GP (1998) Texture information in tactual space perception. Acta Psychol 99:93–114

    Article  Google Scholar 

  32. Stevens SS, Harris JR (1962) The scaling of subjective roughness and smoothness. J Exp Psychol 64:489–494

    Article  Google Scholar 

  33. Streri A (1987) Tactile discrimination of shape and intermodal tranfer in 2- to 3-month old infants. Br J Dev Psychol 5:213–220

    Google Scholar 

  34. Tzovaras D, Nikolakis G, Fergadis G, Malasiotis S, Stavrakis M (2004) Design and implementation of haptic virtual environments for the training of the visually impaired. IEEE Trans Neural Syst Rehabil Eng 12:266–278

    Article  Google Scholar 

  35. Zaki SR, Homa D (1999) Concepts and transformational knowledge. Cogn Psychol 39:69–115

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Cognitive Ubiquitous Computing (CUbiC), Department of Computer Science and Engineering, Fulton College of Engineering, Arizona State University, 85281, Tempe, USA

    Kanav Kahol & Sethuraman Panchanathan

Authors
  1. Kanav Kahol
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sethuraman Panchanathan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kanav Kahol.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kahol, K., Panchanathan, S. Neuro-cognitively inspired haptic user interfaces. Multimed Tools Appl 37, 15–38 (2008). https://doi.org/10.1007/s11042-007-0167-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-007-0167-y

Keywords

Search

Navigation