Advertisement

Speech through the Ear, the Eye, the Mouth and the Hand

  • Marion Dohen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5398)

Abstract

This chapter aims at describing how speech is multimodal not only in its perception but also in its production. It first focuses on multimodal perception of speech segments and speech prosody. It describes how multimodal perception is linked to speech production and explains why we consider speech perception as a sensory-motor process. It then analyses some aspects of hand-mouth coordination in spoken communication. Input from evolutionary perspectives, ontogenesis and behavioral studies on infants and adults are combined to detail how and why this coordination is crucial in speech.

Keywords

multimodal speech auditory-visual perception sensori-motor prosody hand-mouth coordination speech and language development pointing 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Stetson, R.H.: Motor Phonetics: A Study of Speech Movements in Action, 2nd edn. North-Holland, Amsterdam (1951)Google Scholar
  2. 2.
    Schwartz, J.-L.: La parole multisensorielle: Plaidoyer, problèmes, perspective. In: Actes des XXVes Journées d’Etude sur la Parole JEP 2004, pp. xi–xviii (2004)Google Scholar
  3. 3.
    Sumby, W.H., Pollack, I.: Visual Contribution to Speech Intelligibility in Noise. J. Acoust. Soc. Am. 26(2), 212–215 (1954)CrossRefGoogle Scholar
  4. 4.
    Miller, G.A., Nicely, P.: An Analysis of Perceptual Confusions Among Some English Consonants. J. Acoust. Soc. Am. 27(2), 338–352 (1955)CrossRefGoogle Scholar
  5. 5.
    Neely, K.K.: Effects of Visual Factors on the Intelligibility of Speech. J. Acoust. Soc. Am. 28(6), 1275–1277 (1956)CrossRefGoogle Scholar
  6. 6.
    Erber, N.P.: Interaction of Audition and Vision in the Recognition of Oral Speech Stimuli. J. Speech Hear. Res. 12(2), 423–425 (1969)CrossRefGoogle Scholar
  7. 7.
    Binnie, C.A., Montgomery, A.A., Jackson, P.L.: Auditory and Visual Contributions to the Perception of Consonants. J. Speech Hear. Res. 17(4), 619–630 (1974)CrossRefGoogle Scholar
  8. 8.
    Erber, N.P.: Auditory-Visual Perception of Speech. J. Speech Hear. Dis. 40(4), 481–492 (1975)CrossRefGoogle Scholar
  9. 9.
    Summerfield, A.Q.: Use of Visual Information for Phonetic Perception. Phonetica 36, 314–331 (1979)CrossRefGoogle Scholar
  10. 10.
    MacLeod, A., Summerfield, A.Q.: Quantifying the Contribution of Vision to Speech Perception in Noise. Brit. J. Audiol. 21, 131–141 (1987)CrossRefGoogle Scholar
  11. 11.
    Grant, K.W., Braida, L.D.: Evaluating the Articulation Index for Audiovisual Input. J. Acoust. Soc. Am. 89, 2952–2960 (1991)CrossRefGoogle Scholar
  12. 12.
    Benoît, C., Mohamadi, T., Kandel, S.: Effects of Phonetic Context on Audio-Visual Intelligibility of French. J. Speech Hear. Res. 37, 1195–1203 (1994)CrossRefGoogle Scholar
  13. 13.
    Reisberg, D., McLean, J., Goldfield, A.: Easy to Hear but Hard to Understand: A Lip-reading Advantage with Intact Auditory Stimuli. In: Dodd, B., Campbell, R. (eds.) Hearing by Eye: The Psychology of Lip-reading, pp. 97–114. Lawrence Erlbaum Associates, Hillsdale (1987)Google Scholar
  14. 14.
    Summerfield, Q.: Comprehensive Account of Audio-Visual Speech Perception. In: Dodd, B., Campbell, R. (eds.) Hearing by Eye: The Psychology of Lip-reading, pp. 3–51. Lawrence Erlbaum Associates, Hillsdale (1987)Google Scholar
  15. 15.
    McGurk, H., MacDonald, J.: Hearing Lips and Seeing Voices. Nature 264, 746–748 (1976)CrossRefGoogle Scholar
  16. 16.
    Vihman, M.M., Macken, M.A., Miller, R., Simmons, H., Miller, J.: From Babbling to Speech: A Re-Assessment of the Continuity Issue. Language 61, 397–445 (1985)CrossRefGoogle Scholar
  17. 17.
    Stoel-Gammon, C.: Prelinguistic Vocalizations of Hearing-Impaired and Normally Hearing Subjects: A Comparison of Consonantal Inventories. J. Speech Hear. Dis. 53, 302–315 (1988)CrossRefGoogle Scholar
  18. 18.
    Mulford, R.: First Words of the Blind Child. In: Smith, M.D., Locke, J.L. (eds.) The Emergent Lexicon: The Child’s Development of a Linguistic Vocabulary, pp. 293–338. Academic Press, New York (1988)Google Scholar
  19. 19.
    Boë, L.J., Vallée, N., Schwartz, J.L.: Les tendances des structures phonologiques: le poids de la forme sur la substance. In: Escudier, P., Schwartz, J.L. (eds.) La parole, des modèles cognitifs aux machines communicantes - I. Fondements, pp. 283–323. Hermes, Paris (2000)Google Scholar
  20. 20.
    Kuhl, P.K., Meltzoff, A.N.: The Bimodal Perception of Speech in Infancy. Science 218, 1138–1141 (1982)CrossRefGoogle Scholar
  21. 21.
    Robert-Ribes, J.: Modèles d’intégration audiovisuelle de signaux linguistiques: de la perception humaine à la reconnaissance automatique des voyelles. PhD Thesis, Institut National Polytechnique de Grenoble, France (1995)Google Scholar
  22. 22.
    Schwartz, J.-L., Robert-Ribes, J., Escudier, P.: Ten Years After Summerfield: A Taxonomy of Models for Audiovisual Fusion in Speech Perception. In: Campbell, R., Dodd, B.J., Burnham, D. (eds.) Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-Visual Speech, pp. 85–108. Psychology Press, Hove (1998)Google Scholar
  23. 23.
    Calvert, G.A., Bullmore, E.T., Brammer, M.J., Campbell, R., Williams, S.C.R., McGuire, P.K., Woodruff, P.W.R., Iversen, S.D., David, A.S.: Activation of the Auditory Cortex During Silent Lipreading. Science 276, 593–596 (1997)CrossRefGoogle Scholar
  24. 24.
    Grant, K.W., Seitz, P.-F.: The Use of Visible Speech Cues for Improving Auditory Detection of Spoken Sentences. J. Acoust. Soc. Am. 108(3), 1197–1208 (2000)CrossRefGoogle Scholar
  25. 25.
    Schwartz, J.-L., Berthommier, F., Savariaux, C.: Seeing to Hear Better: Evidence for Early Audio-Visual Interactions in Speech Identification. Cognition 93, B69–B78 (2004)CrossRefGoogle Scholar
  26. 26.
    Tiippana, K., Andersen, T.S., Sams, M.: Visual Attention Modulates Audiovisual Speech Perception. Eur. J. Cog. Psychol. 16(3), 457–472 (2004)CrossRefGoogle Scholar
  27. 27.
    Schwartz, J.-L., Cathiard, M.: Modeling Audio-Visual Speech Perception: Back on Fusion Architectures and Fusion Control. In: Proceedings of Interspeech 2004, pp. 2017–2020 (2004)Google Scholar
  28. 28.
    Sekiyama, K., Tohkura, Y.: Inter-Language Differences in the Influence of Visual Cues in Speech Perception. Journal of Phonetics 21, 427–444 (1993)Google Scholar
  29. 29.
    Rizzolatti, G., Fogassi, L., Gallese, V.: Neurophysiological Mechanisms Underlying the Understanding and Imitation of Action. Nat. Rev. Neurosci. 2(9), 661–670 (2001)CrossRefGoogle Scholar
  30. 30.
    Rizzolatti, G., Craighero, L.: The Mirror-Neuron System. Annu. Rev. Neurosci. 27, 169–192 (2004)CrossRefGoogle Scholar
  31. 31.
    Kohler, E., Keysers, C., Umilta, M.A., Fogassi, L., Gallese, V., Rizzolatti, G.: Hearing Sounds, Understanding Actions: Action Representation in Mirror Neurons. Science 5582(297), 846–848 (2002)CrossRefGoogle Scholar
  32. 32.
    Keysers, C., Kohler, E., Umilta, M.A., Nanetti, L., Fogassi, L., Gallese, V.: Audiovisual Mirror Neurons and Action Recognition. Exp. Brain Res. 153, 628–636 (2003)CrossRefGoogle Scholar
  33. 33.
    Ferrari, P.F., Gallese, V., Rizzolatti, G., Fogassi, L.: Mirror Neurons Responding to the Observation of Ingestive and Communicative Mouth Actions in the Monkey Ventral Premotor Cortex. Eur. J. Neurosci. 17, 1703–1714 (2003)CrossRefGoogle Scholar
  34. 34.
    Gil-da-Costa, R., Martin, A., Lopes, M.A., Munoz, M., Fritz, J.B., Braun, A.R.: Species-Specific Calls Activate Homologs of Broca’s and Wernicke’s Areas in the Macaque. Nature Rev. Neurosci. 9, 1064–1070 (2006)CrossRefGoogle Scholar
  35. 35.
    Taglialatela, J.P., Russell, J.L., Schaeffer, J.A., Hopkins, W.D.: Communicative Signaling Activates ‘Broca’s’ Homolog in Chimpanzees. Curr. Biol. 18, 343–348 (2008)CrossRefGoogle Scholar
  36. 36.
    Rizzolatti, G., Craighero, L.: Language and Mirror Neurons. In: Gaskell, G. (ed.) Oxford Handbook of Psycholinguistics. Oxford University Press, Oxford (2007)Google Scholar
  37. 37.
    Rizzolatti, G., Buccino, G.: The Mirror-Neuron System and its Role in Imitation and Language. In: Dehaene, S., Duhamel, G.R., Hauser, M., Rizzolatti, G. (eds.) From Monkey Brain to Human Brain, pp. 213–234. MIT Press, Cambridge (2005)Google Scholar
  38. 38.
    Hickok, G., Poeppel, D.: Towards a Functional Neuroanatomy of Speech Perception. Trends Cogn. Sci. 4(4), 132–138 (2000)CrossRefGoogle Scholar
  39. 39.
    Scott, S.K., Johnsrude, I.S.: The Neuroanatomical and Functional Organization of Speech Perception. Trends Neurosci 26(2), 100–107 (2003)CrossRefGoogle Scholar
  40. 40.
    Callan, D.E., Jones, J.A., Munhall, K., Kroos, C., Callan, A.M., Vatikiotis-Bateson, E.: Multisensory Integration Sites Identified by Perception of Spatial Wavelet Filtered Visual Speech Gesture Information. J. Cogn. Neurosci. 16(5), 805–816 (2004)CrossRefGoogle Scholar
  41. 41.
    Hickok, G., Poeppel, D.: Dorsal and Ventral Streams: A Framework for Understanding Aspects of the Functional Anatomy of Language. Cognition 92, 67–99 (2004)CrossRefGoogle Scholar
  42. 42.
    Scott, S.K., Wise, R.J.S.: The Functional Neuroanatomy of Prelexical Processing in Speech Perception. Cognition 92(1-2), 13–45 (2004)CrossRefGoogle Scholar
  43. 43.
    Wilson, S.M., Iacoboni, M.: Neural Responses to Non-Native Phonemes Varying in Producibility: Evidence for the Sensorimotor Nature of Speech Perception. NeuroImage 33, 316–325 (2006)CrossRefGoogle Scholar
  44. 44.
    Hickok, G., Poeppel, D.: The Cortical Organization of Speech Processing. Nat. Rev. Neurosci. 8(5), 393–402 (2007)CrossRefGoogle Scholar
  45. 45.
    Skipper, J.L., van Wassenhove, V., Nusbaum, H.C., Small, S.L.: Hearing Lips and Seeing Voices: How Cortical Areas Supporting Speech Production Mediate Audiovisual Speech Perception. Cereb. Cortex 17(10), 2387–2399 (2007)CrossRefGoogle Scholar
  46. 46.
    Fadiga, L., Craighero, L., Buccino, G., Rizzolatti, G.: Speech Listening Specifically Modulates the Excitability of Tongue Muscles: A TMS Study. Eur. J. Neurosci. 15, 399–402 (2002)CrossRefGoogle Scholar
  47. 47.
    Watkins, K.E., Strafella, A.P., Paus, T.: Seeing and Hearing Speech Excites the Motor System Involved in Speech Production. Neuropsychologia 41, 989–994 (2003)CrossRefGoogle Scholar
  48. 48.
    Callan, D.E., Jones, J.A., Munhall, K., Callan, A.M., Kroos, C., Vatikiotis-Bateson, E.: Neural Processes Underlying Perceptual Enhancement by Visual Speech Gestures. NeuroReport 14(17), 2213–2218 (2003)CrossRefGoogle Scholar
  49. 49.
    Skipper, J.I., Nusbaum, H.C., Small, S.L.: Lending a Helping Hand to Hearing: Another Motor Theory of Speech Perception. In: Arbib, M.A. (ed.) Action to Language Via the Mirror Neuron System, pp. 250–285. Cambridge University Press, Cambridge (2006)CrossRefGoogle Scholar
  50. 50.
    Kelso, J.A.S., Vatikiotis-Bateson, E., Saltzman, E., Kay, B.A.: A Qualitative Dynamic Analysis of Reiterant Speech Production: Phase Portraits, Kinematics, and Dynamic Modeling. J. Acoust. Soc. Am. 77(1), 266–280 (1985)CrossRefGoogle Scholar
  51. 51.
    Summers, W.V.: Effects of Stress and Final-Consonant Voicing on Vowel Production: Articulatory and Acoustic Analyses. J. Acout. Soc. Am. 82(3), 847–863 (1987)CrossRefGoogle Scholar
  52. 52.
    Vatikiotis-Bateson, E., Kelso, J.A.S.: Rhythm Type and Articulatory Dynamics in English, French and Japanese. J. Phonetics 21, 231–265 (1993)Google Scholar
  53. 53.
    De Jong, K.: The Supraglottal Articulation of Prominence in English: Linguistic Stress as Localized Hyperarticulation. J. Acoust. Soc. Am. 97(1), 491–504 (1995)CrossRefGoogle Scholar
  54. 54.
    Harrington, J., Fletcher, J., Roberts, C.: Coarticulation and the Accented/Unaccented Distinction: Evidence from Jaw Movement Data. J. Phonetics 23, 305–322 (1995)CrossRefGoogle Scholar
  55. 55.
    Lœvenbruck, H.: An Investigation of Articulatory Correlates of the Accentual Phrase in French. In: Proceedings of the 14th ICPhS, vol. 1, pp. 667–670 (1999)Google Scholar
  56. 56.
    Erickson, D., Maekawa, K., Hashi, M., Dang, J.: Some Articulatory and Acoustic Changes Associated with Emphasis in Spoken English. In: Proceedings of ICSLP 2000, vol. 3, pp. 247–250 (2000)Google Scholar
  57. 57.
    Lœvenbruck, H.: Effets articulatoires de l’emphase contrastive sur la Phrase Accentuelle en français. In: Actes des XXIIIes Journées d’Etude sur la Parole JEP 2000, pp. 165–168 (2000)Google Scholar
  58. 58.
    Erickson, D.: Articulation of Extreme Formant Patterns for Emphasized Vowels. Phonetica 59, 134–149 (2002)CrossRefGoogle Scholar
  59. 59.
    Keating, P., Baroni, M., Mattys, S., Scarborough, R., Alwan, A., Auer, E.T., Bernstein, L.E.: Optical Phonetics and Visual Perception of Lexical and Phrasal Stress in English. In: Proceedings of ICPhS 2003, pp. 2071–2074 (2003)Google Scholar
  60. 60.
    Cho, T.: Prosodic Strengthening and Featural Enhancement: Evidence from Acoustic and Articulatory Realizations of /a,i/ in English. J. Acoust. Soc. Am. 117(6), 3867–3878 (2005)CrossRefGoogle Scholar
  61. 61.
    Beskow, J., Granström, B., House, D.: Visual Correlates to Prominence in Several Expressive Modes. In: Proceedings of Interspeech 2006 – ICSLP, pp. 1272–1275 (2006)Google Scholar
  62. 62.
    Di Cristo, A.: Vers une modélisation de l’accentuation du français (deuxième partie). J. French Lang. Studies 10, 27–44 (2000)CrossRefGoogle Scholar
  63. 63.
    Dahan, D., Bernard, J.-M.: Interspeaker Variability in Emphatic Accent Production in French. Lang. Speech 39(4), 341–374 (1996)Google Scholar
  64. 64.
    Di Cristo, A.: Intonation in French. In: Hirst, D., Di Cristo, A. (eds.) Intonation Systems: A Survey of Twenty Languages, pp. 195–218. Cambridge University Press, Cambridge (1998)Google Scholar
  65. 65.
    Di Cristo, A., Jankowski, L.: Prosodic Organisation and Phrasing after Focus in French. In: Proceedings of ICPhS 1999, pp. 1565–1568 (1999)Google Scholar
  66. 66.
    Rossi, M.: La focalisation. In: L’intonation, le système du français: description et modélisation, Ophrys, Paris, ch. II-6, pp. 116–128 (1999)Google Scholar
  67. 67.
    Jun, S.-A., Fougeron, C.: A Phonological Model of French Intonation. In: Botinis, A. (ed.) Intonation: Analysis, Modelling and Technology, pp. 209–242. Kluwer Academic Publishers, Dordrecht (2000)CrossRefGoogle Scholar
  68. 68.
    Delais-Roussarie, E., Rialland, A., Doetjes, J., Marandin, J.-M.: The Prosody of Post Focus Sequences in French. In: Proceedings of Speech Prosody 2002, pp. 239–242 (2002)Google Scholar
  69. 69.
    Dohen, M., Lœvenbruck, H.: Pre-focal Rephrasing, Focal Enhancement and Post-focal Deaccentuation in French. In: Proceedings of the 8th ICSLP, pp. 1313–1316 (2004)Google Scholar
  70. 70.
    Dohen, M., Lœvenbruck, H., Cathiard, M.-A., Schwartz, J.-L.: Visual Perception of Contrastive Focus in Reiterant French Speech. Speech Comm. 44, 155–172 (2004)CrossRefGoogle Scholar
  71. 71.
    Dohen, M., Lœvenbruck, H.: Audiovisual Production and Perception of Contrastive Focus in French: A Multispeaker Study. In: Proceedings of Interspeech 2005, pp. 2413–2416 (2005)Google Scholar
  72. 72.
    Dohen, M., Lœvenbruck, H., Hill, H.: Visual Correlates of Prosodic Contrastive Focus in French: Description and Inter-Speaker Variabilities. In: Proceedings of Speech Prosody 2006, pp. 221–224 (2006)Google Scholar
  73. 73.
    Thompson, D.M.: On the Detection of Emphasis in Spoken Sentences by Means of Visual, Tactual, and Visual-Tactual Cues. J. Gen. Psychol. 11, 160–172 (1934)CrossRefGoogle Scholar
  74. 74.
    Risberg, A., Agelfors, E.: On the Identification of Intonation Contours by Hearing Impaired Listeners. Speech Transmission Laboratory - Quarterly Progress Report and Status Report 19(2-3), 51–61 (1978)Google Scholar
  75. 75.
    Risberg, A., Lubker, J.: Prosody and Speechreading. Speech Transmission Laboratory Quarterly Progress Report and Status Report 19(4), 1–16 (1978)Google Scholar
  76. 76.
    Bernstein, L.E., Eberhardt, S.P., Demorest, M.E.: Single-Channel Vibrotactile Supplements to Visual Perception of Intonation and Stress. J. Acoust. Soc. Am. 85(1), 397–405 (1989)CrossRefGoogle Scholar
  77. 77.
    Krahmer, E., Swerts, M.: Perceiving Focus. In: Lee, C.-M. (ed.) Topic and Focus: A Cross-Linguistic Perspective, pp. 121–137. Kluwer, Dordrecht (2006)Google Scholar
  78. 78.
    Granström, B., House, D.: Audiovisual Representation of Prosody in Expressive Speech Communication. Speech Comm. 46, 473–484 (2005)CrossRefGoogle Scholar
  79. 79.
    Dohen, M., Lœvenbruck, H.: Interaction of Audition and Vision for the Perception of Prosodic Contrastive Focus. Lang. Speech (in press)Google Scholar
  80. 80.
    Miller, G.A., Nicely, P.: An Analysis of Perceptual Confusions Among Some English Consonants. J. Acoust. Soc. Am. 27(2), 338–352 (1955)CrossRefGoogle Scholar
  81. 81.
    Kendon, A.: Gesticulation and Speech: Two Aspects of the Process of Utterance. In: Key, M.R. (ed.) The Relationship of Verbal and Nonverbal Communication, Mouton, The Hague, pp. 207–227 (1980)Google Scholar
  82. 82.
    McNeill, D.: Hand and Mind. University of Chicago Press, Chicago (1992)Google Scholar
  83. 83.
    Kendon, A.: Gesture. Annu. Rev. Anthropol. 26, 109–128 (1997)CrossRefGoogle Scholar
  84. 84.
    Kita, S. (ed.): Pointing: Where Language, Culture, and Cognition Meet. Lawrence Erlbaum Associates, Hillsdale (2003)Google Scholar
  85. 85.
    MacNeilage, P.F.: The Frame/Content Theory of Evolution of Speech Production. Behav. Brain Sci. 21(4), 499–511 (1998)Google Scholar
  86. 86.
    MacNeilage, P.F., Davis, B.: On the Origin of Internal Structure and Word Forms. Science 288, 527–531 (2000)CrossRefGoogle Scholar
  87. 87.
    Corballis, M.C.: From Mouth to Hand: Gesture, Speech, and the Evolution of Right-Handedness. Behav. Brain Sci. 26(2), 199–260 (2003)Google Scholar
  88. 88.
    Arbib, M.A.: The Evolving Mirror System: A Neural Basis for Language Readiness. In: Christiansen, M., Kirby, S. (eds.) Language Evolution: The States of the Art, pp. 182–200. Oxford University Press, Oxford (2003)CrossRefGoogle Scholar
  89. 89.
    Arbib, M.A.: From Monkey-Like Action Recognition to Human Language: An Evolutionary Framework for Neurolinguistics. Behav. Brain Sci. 28(2), 105–124 (2005)Google Scholar
  90. 90.
    Holden, G.: The Origin of Speech. Science 303, 1316–1319 (2004)CrossRefGoogle Scholar
  91. 91.
    Iverson, J., Thelen, E.: The Hand Leads the Mouth in Ontogenesis Too. Behav. Brain Sci. 26(2), 225–226 (2003)CrossRefGoogle Scholar
  92. 92.
    Iverson, J., Goldin-Meadow, S.: Gesture Paves the Way for Language Development. Psychol. Sci. 16, 368–371 (2005)CrossRefGoogle Scholar
  93. 93.
    Ozcaliskan, S., Goldin-Meadow, S.: Gesture is at the Cutting Edge of Early Language Development. Cognition 96, 101–113 (2005)CrossRefGoogle Scholar
  94. 94.
    Goldin-Meadow, S., Butcher, C.: Pointing Toward Two-Word Speech in Young Children. In: Kita, S. (ed.) Pointing: Where Language, Culture, and Cognition Meet, pp. 85–107. Lawrence Erlbaum Associates, Hillsdale (2003)Google Scholar
  95. 95.
    Iverson, J., Thelen, E.: Hand, Mouth, and Brain: The Dynamic Emergence of Speech and Gesture. J. Conscious. Stud. 6, 19–40 (1999)Google Scholar
  96. 96.
    Iverson, J., Goldin-Meadow, S.: Why People Gesture as They Speak. Nature 396, 228 (1998)CrossRefGoogle Scholar
  97. 97.
    Butterworth, G.: Pointing is the Royal Road to Language for Babies. In: Kita, S. (ed.) Pointing: Where Language, Culture, and Cognition Meet, pp. 9–33. Lawrence Erlbaum Associates, Hillsdale (2003)Google Scholar
  98. 98.
    Pizzuto, E., Capobianco, M., Devescovi, A.: Gestural-Vocal Deixis and Representational Skills in Early Language Development. Interaction Studies 6(2), 223–252 (2005)CrossRefGoogle Scholar
  99. 99.
    Volterra, V., Caselli, M.C., Capirci, O., Pizzuto, E.: Gesture and the Emergence and Development of Language. In: Tomasello, M., Slobin, D. (eds.) Elizabeth Bates: A Festschrift, pp. 3–40. Lawrence Erlbaum Associates, Mahwah (2005)Google Scholar
  100. 100.
    Hollender, D.: Interference Between a Vocal and a Manual Response to the Same Stimulus. In: Stelmach, G., Requin, J. (eds.) Tutorials in Motor Behavior, pp. 421–432. North-Holland, Amsterdam (1980)CrossRefGoogle Scholar
  101. 101.
    Castiello, U., Paulignan, Y., Jeannerod, M.: Temporal Dissociation of Motor Responses and Subjective Awareness. Brain 114(6), 2639–2655 (1991)CrossRefGoogle Scholar
  102. 102.
    Fagot, C., Pashler, H.: Making Two Responses to a Single Object: Implications for the Central Attentional Bottleneck. J. Exp. Psychol. 18, 1058–1079 (1992)Google Scholar
  103. 103.
    Rochet-Capellan, A.: De la substance à la forme: rôle des contraintes motrices orofaciales et brachiomanuelles de la parole dans l’émergence du langage. PhD Thesis, Cognitive Sciences, Institut National Polytechnique de Grenoble, France (2007)Google Scholar
  104. 104.
    Rochet-Capellan, A., Schwartz, J.-L., Laboissière, R., Galván, A.: The Speech Focus Position Effect on Jaw-Finger Coordination in a Pointing Task. J. Speech Lang. Hear. Res (in Press)Google Scholar
  105. 105.
    Levelt, W.J.M., Richardson, G., Heij, W.L.: Pointing and Voicing in Deictic Expressions. J. Mem. Lang. 24, 133–164 (1985)CrossRefGoogle Scholar
  106. 106.
    Feyereisen, P.: The Competition Between Gesture and Speech Production in Dual-Task Paradigms. J. Mem. Lang. 36(1), 13–33 (1997)CrossRefGoogle Scholar
  107. 107.
    Ducey-Kaufmann, V.: Le cadre de la parole et le cadre du signe: un rendez-vous développemental. PhD Thesis, Language Sciences, Stendhal University, Grenoble, France (2007)Google Scholar
  108. 108.
    Ducey-Kaufmann, V., Abry, C., Vilain, C.: When the Speech Frame Meets the Sign Frame in a Developmental Framework. In: Emergence of Language Abilities (2007)Google Scholar
  109. 109.
    Rochet-Capellan, A., Schwartz, J.-L., Laboissière, R., Galván, A.: Two CV Syllables for One Pointing Gesture as an Optimal Ratio for Jaw-Arm Coordination in a Deictic Task: A Preliminary Study. In: Proceedings of EuroCogSci 2007, pp. 608–613 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Marion Dohen
    • 1
  1. 1.Speech and Cognition DepartmentICP, GIPSA-labSaint Martin d’Hères CedexFrance

Personalised recommendations