Skip to main content

Beyond Vision: Extending the Scope of a Sensorimotor Account of Perception

  • Conference paper
Contemporary Sensorimotor Theory

Part of the book series: Studies in Applied Philosophy, Epistemology and Rational Ethics ((SAPERE,volume 15))

Abstract

We examine the scope of some sensorimotor accounts of perception, and their application in developmental robotics. Current interest in sensorimotor theories, and the enactive paradigm, was stimulated by the seminal book The Embodied Mind by Varela, Thompson and Rosch (1991) [32]. However, both in this initial book and subsequently there has been much work on visual perception and less attention to other perceptual modalities. We suggest that the insights gained from an exploration of the visual domain need supplementing, and in some respects qualifying: some significant characteristics of vision do not hold for audition, in particular for the perception of speech. This leads into a discussion of the importance of integrating different perceptual modes, with particular reference to robots and human-robot interaction. We examine the effect of including audition in accounts of perception, and suggest that it makes sense to avoid the unnecessary straight jacket of a model based primarily on vision and touch alone. The sensorimotor approach can be extended to other perceptual modes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Arena, P., Patane, L.: Spatial Temporal Patterns for Action-Oriented Perception in Roving Robots. Springer (2009), doi:10.1007/978-3-88464-4

    Google Scholar 

  2. Baghai-Ravary, L.: Evidence for the strength of the relationaship between automatic speech recognition and phoneme alignment performance. In: ICASSP (International Conference on Acoustics, Speech and Signal Processing) (2010)

    Google Scholar 

  3. Beeman, W.O.: Linguistics and Anthropology. In: Kempson, R., Fernando, T., Asher, N. (eds.) The Philosophy of Linguistics. Elsevier (2012)

    Google Scholar 

  4. Berkeley, G.: Essay towards a New Theory of Vision (1709)

    Google Scholar 

  5. Cangelosi, A., et al.: Integration of action and language knowledge: A roadmap for developmental robotics. IEEE Transactions on Autonomous Mental Development 2(3), 167–194 (2010)

    Article  Google Scholar 

  6. Curtin, S., Hufnagle, D.: Speech perception. In: Bavin, E. (ed.) The Cambridge Handbook of Child Language. CUP (2009)

    Google Scholar 

  7. Greenberg, S.: Speaking in shorthand: A syllable-centric perspective for understanding pronunciation variation. Speech Communication 29, 159–176 (1999)

    Article  Google Scholar 

  8. Hatsopoulos, N.G., Donoghue, J.P.: The science of neural interface systems. Annual Review of Neuroscience 249, 249–266 (2009)

    Article  Google Scholar 

  9. Heidegger, M.: Being and Time. Blackwell (1927), translated by McQuarrie, J., Robinson, G. published (1962)

    Google Scholar 

  10. Hickok, G., Houde, J., Rong, F.: Sensorimotor integration in speech processing: Computational basis and neural organization. Neuron 69(3), 407–422 (2011)

    Article  Google Scholar 

  11. Hume, D.: A Treatise of Human Nature. OUP (1740, 1978), book I, part IV, section II

    Google Scholar 

  12. Husserl, E.: Logical Investigations. Routledge and K Paul (1900), translated by Findlay, J. published (1970)

    Google Scholar 

  13. Hutto, D.: Radically enactive cognition within our grasp. In: Radman, Z. (ed.) The Hand: An Organ of the Mind. MIT Press (2013)

    Google Scholar 

  14. Jacquemot, C., Scott, S.K.: What is the relationship between phonological short term memory and speech processing? Trends in Cognitive Sciences 10(11) (2006)

    Google Scholar 

  15. Kuhl, P.: Early language acquisition: Cracking the speech code. Nature Reviews - Neuroscience 5, 831–843 (2004)

    Article  Google Scholar 

  16. Locke, J.: An Essay Concerning Human Understanding. Thoemmes, published 2003 (1690), book II, chap IX, section 9

    Google Scholar 

  17. Lyon, C., Nehaniv, C.L., Saunders, J.: Interactive Language Learning by Robots: the transition from babbling to word forms. PLoS1 7(6) (2012), doi:10.1371/journal.pone.0038236

    Google Scholar 

  18. Magee, B.: The Great Philosophers. OUP (1987), reprinted (2009)

    Google Scholar 

  19. Merleau-Ponty, M.: Phenomenology of Perception. Routledge, New York (1945), translated by Colin Smith, reprinted (2005)

    Google Scholar 

  20. Merleau-Ponty, M.: Husserl at the Limits of Phenomenology. NW University Press (1959), edited by Lawlor, L., Bergo, B. (2002)

    Google Scholar 

  21. Näätänen, R.: The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm). Psychophysiology 38, 1–21 (2001)

    Article  Google Scholar 

  22. Nehaniv, C.L., Förster, F., Saunders, J., Broz, F., Antonova, E., Kose, H., Lyon, C., Lehmann, H., Sato, Y., Dautenhahn, K.: Interaction and Experience in Enactive Intelligence and Humanoid Robotics. In: IEEE Symposium on Artificial Life (IEEE ALIFE). IEEE Symposium Series on Computational Intelligence, SSCI (2013)

    Google Scholar 

  23. Noë, A.: Action in Perception. MIT (2006)

    Google Scholar 

  24. Noë, A., Thompson, E.: Vision and Mind. MIT (2002)

    Google Scholar 

  25. O’Regan, J.K., Noë, A.: A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences 24, 939–1031 (2001)

    Article  Google Scholar 

  26. Petrini, K., Pollick, F., Dahl, S., McAleer, P., McKay, D., Rocchesso, D., Waadeland, C.H., Love, S., Avanzini, F., Puce, A.: Action expertise reduces brain activity for audiovisual matching actions: An fMRI study with expert drummers. NeuroImage 56, 1480–1492 (2011)

    Article  Google Scholar 

  27. Port, R.: How are words stored in memory? Beyond phones and phonemes. New Ideas in Psychology 25, 143–170 (2007)

    Article  Google Scholar 

  28. Saffran, J., Aslin, R., Newport, E.: Statistical learning by 8-month-old infants. Science 274, 1926–1928 (1996)

    Article  Google Scholar 

  29. Sapir, E.: Le realite psychologique des phonemes. Journal De Psychologie Normale Et Pathologique, 247–265 (1933)

    Google Scholar 

  30. Saunders, J., Nehaniv, C.L., Lyon, C.: The acquisition of word semantics by a humanoid robot via interaction with a human tutor. In: Dautenhahn, K., Saunders, J. (eds.) New Frontiers in Human-Robot Interaction. John Benjamins (2011)

    Google Scholar 

  31. Tikanoff, V., Cangelosi, A., Metta, G.: Integration of speech and action in humanoid robots: iCub simulation experiments. IEEE Transactions on Autonomous Mental Development 3(1) (2011)

    Google Scholar 

  32. Varela, F., Thompson, E., Rosch, E.: The Embodied Mind. MIT Press (1991)

    Google Scholar 

  33. Vernon, D., von Hofsten, C., Fadiga, L.: A Roadmap for Cognitive Development in Humanoid Robots. Springer (2010)

    Google Scholar 

  34. Wang, R., Perreau-Guimaraes, M., Carvalhaes, C., Suppes, P.: Using phase to recognize English phonemes and their distinctive features in the brain. In: Proceedings of the National Academy of Science, vol. 109(50) (2012)

    Google Scholar 

  35. Wolmetz, M., Poeppel, D., Rapp, B.: What does the right hemisphere know about phoneme categories? Journal of Cognitive Neuroscience (2011)

    Google Scholar 

  36. Zeki, S.: Inner Vision: An exploration of Art and the Brain. OUP (1999)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Caroline Lyon .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Lyon, C. (2014). Beyond Vision: Extending the Scope of a Sensorimotor Account of Perception. In: Bishop, J., Martin, A. (eds) Contemporary Sensorimotor Theory. Studies in Applied Philosophy, Epistemology and Rational Ethics, vol 15. Springer, Cham. https://doi.org/10.1007/978-3-319-05107-9_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-05107-9_9

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-05106-2

  • Online ISBN: 978-3-319-05107-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics