Skip to main content
SpringerLink
Log in
Book cover

Nonlinear Dynamics in Human Behavior pp 135–150Cite as

Nonlinear Dynamics in Speech Perception

  • Chapter

Part of the book series: Studies in Computational Intelligence ((SCI,volume 328))

Abstract

The history of research on speech perception and speech production is replete with examples of nonlinearities between articulation and acoustics, and between acoustics and perception. These nonlinearities are useful for communication. They allow 1) adequate production of speech sounds and words despite people having different vocal tracts with different resonance capabilities, and 2) adequate word recognition despite variation in the acoustic signal across speakers, emphasis, background noise, etc. Yet context and the listener’s expectancies often strongly influence what is perceived; perception is dynamic, influenced by multiple factors that change slowly or quickly as speech goes on. In this chapter we present a selected history of demonstrations of nonlinearities in speech and attempt to exploit the nonlinearities in order to uncover the dynamics of both perception and production of speech.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Case, P., Tuller, B., Ding, M., Kelso, J.A.S.: Evaluation of a dynamical model of speech perception. Perception & Psychophysics 57, 977–988 (1995)

    Google Scholar 

  • Chistovich, L., Fant, G., de Serpa-Leitao, A., Tjernlund, P.: Mimicking of synthetic vowels. Quarterly Progress and Status Report, Speech Transmission Lab, Royal Institute of Technology, Stockholm, pp. 1–18 (1966)

    Google Scholar 

  • Erlhagen, W., Mukovskiy, A., Bicho, E.: A dynamic model for action understanding and goal-directed imitation. Brain Research 1083, 174–188 (2006)

    Article  Google Scholar 

  • Gescheider, G.: Chapter 1: Psychophysical Measurement of Thresholds: Differential Sensitivity. In: Psychophysics: the fundamentals, 3rd edn. Lawrence Erlbaum Associates, Mahwah (1997)

    Google Scholar 

  • Goldwater, S., Griffiths, T.L., Johnson, M.: A Bayesian framework for word segmentation: Exploring the effects of context. Cognition 112, 21–54 (2009)

    Article  Google Scholar 

  • Grossberg, S.: Resonant neural dynamics of speech perception. Journal of Phonetic 31, 423–445 (2003)

    Article  Google Scholar 

  • Hawkins, S.: Roles and representations of systematic fine phonetic detail in speech understanding. Journal of Phonetics 31, 373–405 (2003)

    Article  Google Scholar 

  • Hawkins, S.: Phonetic variation as communicative system: Perception of the particular and the abstract. In: Fougeron, C., D’Imperio, M., Kühnert, B., Vallée, N. (eds.) Papers in Laboratory Phonology X. Mouton de Gruyter, Berlin (2007)

    Google Scholar 

  • Johnson, K.: Decisions and mechanisms in exemplar-based phonology. UC Berkeley Phonology Lab Annual Report, 289–311 (2005)

    Google Scholar 

  • Kelso, J.A.S.: Dynamic Patterns: The Self-Organization of Brain and Behavior. MIT Press, Cambridge (1995)

    Google Scholar 

  • Kent, R.D.: The imitation of synthesized vowels and some implications for speech memory. Phonetica 28, 1–25 (1973)

    Article  MathSciNet  Google Scholar 

  • Kuhl, P.K.: A new view of language acquisition. Proceedings of the National Academy of Sciences 97, 11850–11857 (2000)

    Article  Google Scholar 

  • Ladefoged, P., Broadbent, D.E.: Information conveyed by vowels. Journal of the Acoustical Society of America 29, 98–104 (1957)

    Article  Google Scholar 

  • Lancia, L., Nguyen, N., Tuller, B.: Nonlinear dynamics of speech categorization: critical slowing down and critical fluctuations. The Journal of the Acoustical Society of America 123, 3077 (2008)

    Article  Google Scholar 

  • Liberman, A.M., Harris, K.S., Hoffman, H.S., Griffith, B.C.: The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology 54, 358–368 (1957)

    Article  Google Scholar 

  • Luce, P., McLennan, C.: Spoken word recognition: The challenge of variation. In: Pisoni, D., Remez, R. (eds.) The Handbook of Speech Perception, pp. 591–609. Blackwell, Malden (2005)

    Google Scholar 

  • McClelland, J.L., Vallabha, G.: Connectionist models of development: Mechanistic dynamical models with emergent dynamical properties. In: Spencer, J.P., Thomas, M.S.C., McClelland, J.L. (eds.) Toward a unified theory of development: Connectionism and dynamic systems theory re-considered (2009)

    Google Scholar 

  • McClelland, J.L., Mirman, D., Holt, L.L.: Are there interactive processes in speech perception? Trends in Cognitive Sciences 10, 363–369 (2006)

    Article  Google Scholar 

  • McLennan, C., Luce, P.: Examining the time course of indexical specificity effects in spoken word recognition. Journal of Experimental Psychology: Learning, Memory and Cognition 31, 306–321 (2005)

    Article  Google Scholar 

  • McMurray, B., Aslin, R.N., Toscano, J.C.: Statistical learning of phonetic categories: Insights from a computational approach. Developmental Science 12, 369–378 (2009)

    Article  Google Scholar 

  • Moore, B.C.J.: An introduction to the psychology of hearing, 5th edn. Emerald Group Publishing (2003)

    Google Scholar 

  • Muchisky, M.M., Bingham, G.P.: Trajectory forms as a source of information about events. Perception & Psychophysics 64, 15–31 (2002)

    Article  Google Scholar 

  • Nguyen, N., Lancia, L., Bergounioux, M., Wauquier-Gravelines, S., Tuller, B.: Role of training and short-term context effects in the identification of /s/ and /st/ in French. In: Hazan, V., Iverson, P. (eds.) ISCA Workshop on Plasticity in Speech Perception (PSP2005), London, UK, pp. A38–A39 (2005)

    Google Scholar 

  • Nguyen, N., Wauquier, S., Tuller, B.: The dynamical approach to speech perception: From fine phonetic detail to abstract phonological categories. In: Pellegrino, F., Marsico, E., Chitoran, I., Coupé, C. (eds.) Approaches to Phonological Complexity, pp. 193–217. Walter de Gruyter, Berlin (2009)

    Google Scholar 

  • Öhman, S.E.G.: Coarticulation in VCV utterances: spectrographic measurements. Journal of the Acoustical Society of America 39, 151–168 (1966)

    Article  Google Scholar 

  • Pierrehumbert, J.: The next toolkit. Journal of Phonetics 34, 516–530 (2006)

    Article  Google Scholar 

  • Pisoni, D.B.: Auditory and phonetic memory codes in the discrimination of consonants and vowels. Perception & Psychophysics 13, 253–260 (1973)

    Google Scholar 

  • Porter, R.J., Lubker, J.F.: Rapid reproduction of vowel-vowel sequences - Evidence for a fast and direct acoustic-motoric linkage in speech. Journal of Speech and Hearing Research 23, 593–602 (1980)

    Google Scholar 

  • Remez, R.E., Rubin, P.E., Pisoni, D.B., Carrell, T.D.: Speech perception without traditional speech cues. Science 212, 947–950 (1981)

    Article  Google Scholar 

  • Repp, B.H., Liberman, A.M.: Phonetic category boundaries are flexible. In: Harnad, S.R. (ed.) Categorical Perception: The Groundwork of Cognition, pp. 89–112. Cambridge Univ. Press, Cambridge (1987)

    Google Scholar 

  • Repp, B.H.: Categorical perception: Issues, methods and findings. In: Lass, N. (ed.) Speech and language. Advances in basic research and practice, vol. 10, pp. 244–335. Academic Press, Orlando (1984)

    Google Scholar 

  • Repp, B.H., Crowder, R.G.: Stimulus order effects in vowel discrimination. Journal of the Acoustical Society of America 88, 2080–2090 (1990)

    Article  Google Scholar 

  • Repp, B.H., Williams, D.R.: Categorical trends in vowel imitation: Preliminary observations from a replication experiment. Speech Communication 4, 105–120 (1985)

    Article  Google Scholar 

  • Repp, B.H., Williams, D.R.: Categorical tendencies in imitating self-produced isolated vowels. Speech Communication 6, 1–14 (1987)

    Article  Google Scholar 

  • Repp, B.H., Healy, A.F., Crowder, R.G.: Categories and context in the perception of isolated steady-state vowels. Journal of Experimental Psychology: Human Perception and Performance 5, 129–145 (1979)

    Article  Google Scholar 

  • Shockley, K., Sabadini, L., Fowler, C.A.: Imitation in shadowing words. Perception & Psychophysics 66, 422–429 (2004)

    Article  Google Scholar 

  • Stevens, K.N.: Acoustic Phonetics. MIT Press, Cambridge (1998)

    Google Scholar 

  • Stevens, S.S.: On the theory of scales of measurement. Science 103, 677–680 (1946)

    Article  Google Scholar 

  • Studdert-Kennedy, M.: Imitation and the emergence of segments. Phonetica 57, 275–283 (2000)

    Article  Google Scholar 

  • Tuller, B., Case, P., Ding, M., Kelso, J.A.S.: The nonlinear dynamics of speech categorization. Journal of Experimental Psychology: Human Perception and Performance 20, 1–14 (1994)

    Article  Google Scholar 

  • Tuller, B., Jantzen, M.G., Jirsa, V.K.: A dynamical approach to speech categorization: Two routes to learning. Invited contribution, New Ideas in Psychology 26, 208–226 (2008)

    Article  Google Scholar 

  • Vallabha, G.K., McClelland, J.L.: Success and failure of new speech category learning in adulthood: Consequences of learned Hebbian attractors in topographic maps. Cognitive, Affective and Behavioral Neuroscience 7, 53–73 (2007)

    Article  Google Scholar 

  • Vallabha, G.K., Tuller, B.: Perceptuomotor biases in vowel imitation. Journal of the Acoustical Society of America 116, 1184–1197 (2004)

    Article  Google Scholar 

  • Warren, R.M.: Perceptual restoration of missing speech sounds. Science 167, 392–393 (1970)

    Article  Google Scholar 

  • Warren, R.M.: Auditory illusions and the perceptual processing of speech. In: Lass, N.J. (ed.) Principles of Experimental Phonetics, pp. 435–466. Mosby, St. Louis (1996)

    Google Scholar 

  • Warren, R.M., Warren, R.P.: Auditory illusions and confusions. Scientific America 223, 30–36 (1970)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Florida Atlantic University, Boca Raton, FL

    Betty Tuller

  2. National Science Foundation, Arlington, VA

    Betty Tuller

  3. Laboratoire Parole et Langage, CNRS, Aix-Marseille Université, 5, Avenue Pasteur, 13100, Aix-en-Provence, France

    Noël Nguyen

  4. Max Planck Institute for Evolutionary Anthropology Leipzig, Germany

    Leonardo Lancia

  5. Florida Atlantic University, Boca Raton, FL

    Gautam K. Vallabha

  6. The MathWorks, Natick, MA, USA

    Gautam K. Vallabha

Authors
  1. Betty Tuller
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Noël Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Leonardo Lancia
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gautam K. Vallabha
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Theoretical Neuroscience Group, Faculté des Sciences du Sport, CNRS & Université de la Méditerranée,UMR 6233 “Movement Science Institute”, 163 av.De Luminy, cedex 09, 13288, Marseille, France

    Raoul Huys  & Viktor K. Jirsa  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Tuller, B., Nguyen, N., Lancia, L., Vallabha, G.K. (2010). Nonlinear Dynamics in Speech Perception. In: Huys, R., Jirsa, V.K. (eds) Nonlinear Dynamics in Human Behavior. Studies in Computational Intelligence, vol 328. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16262-6_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-16262-6_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-16261-9

  • Online ISBN: 978-3-642-16262-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation