Coupling relations underlying the production of speech articulator movements and their invariance to speech rate

Original Article

Abstract

Since the seminal works of Bernstein (The coordination and regulation of movements. Pergamon Press, Oxford, 1967) several authors have supported the idea that, to produce a goal-oriented movement in general, and a movement of the organs responsible for the production of speech sounds in particular, individuals activate a set of coupling relations that coordinate the behavior of the elements of the motor system involved in the production of the target movement or sound. In order to characterize the configurations of the coupling relations underlying speech production articulator movements, we introduce an original method based on recurrence analysis. The method is validated through the analysis of simulated dynamical systems adapted to reproduce the features of speech gesture kinematics and it is applied to the analysis of speech articulator movements recorded in five German speakers during the production of labial and coronal plosive and fricative consonants at variable speech rates. We were able to show that the underlying coupling relations change systematically between labial and coronal consonants, but are not affected by speech rate, despite the presence of qualitative changes observed in the trajectory of the jaw at fast speech rate.

Keywords

Speech articulation Coupling relations Recurrence analysis Motor control Speech rate 

Notes

Acknowledgements

Leonardo Lancia’s work, carried out within the Labex BLRI (ANR-11-LABX-0036) and EFL (ANR-10-LABX-0083), has benefited from support from the French government, managed by the French National Agency for Research (ANR), under the program “Investissements d’Avenir”.

Supplementary material

422_2018_749_MOESM1_ESM.docx (747 kb)
Supplementary material 1 (docx 746 KB)

References

  1. Abbs JH, Gracco VL (1984) Control of complex motor gestures: orofacial muscle responses to load perturbations of lip during speech. J Neurophysiol 51(4):705–723CrossRefPubMedGoogle Scholar
  2. Balasubramaniam R (2013) On the control of unstable objects: the dynamics of human stick balancing. In: Kevin S, Richardson MJ, Riley MA (eds) Progress in motor control. Springer, New York, pp 149–168CrossRefGoogle Scholar
  3. Bernstein N (1967) The coordination and regulation of movements. Pergamon Press, OxfordGoogle Scholar
  4. Browman CP, Goldstein L (1989) Articulatory gestures as phonological units. Phonology 6(02):201–251CrossRefGoogle Scholar
  5. Fitch H, Tuller B, Turvey MT (1982) The Bernstein perspective III. Tuning of coordinative structures with special reference to perception. In: Kelso JAS (ed) Understanding human motor control. Human Kinetics, Champaign, pp 271–287Google Scholar
  6. Folkins JW, Abbs JH (1975) Lip and jaw motor control during speech: responses to resistive loading of the jaw. J Speech Langc Hear Res 18(1):207–220CrossRefGoogle Scholar
  7. Frankel J, King S (2001) ASR–Articulatory speech recognition. Proc Eurospeech 1:599–602Google Scholar
  8. Fuchs S, Perrier P, Hartinger M (2011) A critical evaluation of gestural stiffness estimations in speech production based on a linear second-order model. J Speech Lang Hear Res 54(4):1067–1076CrossRefPubMedGoogle Scholar
  9. Geumann A, Kroos C, Tillmann HG (1999) Are there compensatory effects in natural speech? In: Proceedings of the 14th international congress of phonetic sciences, San Francisco, pp 399–402Google Scholar
  10. Graco VL, Abbs JH (1985) Dynamic control of the perioral system during speech: kinematic analyses of autogenic and nonautogenic sensorimotor processes. J Neurophysiol 54(2):418–432CrossRefGoogle Scholar
  11. Grimme B, Fuchs S, Perrier P, Schöner G (2011) Limb versus speech motor control: a conceptual review. Mot Control 15(1):5–33CrossRefGoogle Scholar
  12. Guenther FH (1994) A neural network model of speech acquisition and motor equivalent speech production. Biol Cybern 72(1):43–53CrossRefPubMedGoogle Scholar
  13. Hoole P (1996) Issues in the acquisition, processing, reduction and parameterization of articulographic data. Forschungsberichte des Instituts für Phonetik und Sprachliche Kommunikation der Universität München 34:158–173Google Scholar
  14. Ishwaran H, Rao JS (2005) Spike and slab variable selection: frequentist and Bayesian strategies. Ann Stat 33:730–773CrossRefGoogle Scholar
  15. Iskarous K, Mooshammer C, Hoole P, Recasens D, Shadle CH, Saltzman E, Whalen DH (2013) The coarticulation/invariance scale: mutual information as a measure of coarticulation resistance, motor synergy, and articulatory invariance. J Acoust Soc Am 134(2):1271–1282CrossRefPubMedPubMedCentralGoogle Scholar
  16. Ito T, Gomi H, Honda M (2004) Dynamical simulation of speech cooperative articulation by muscle linkages. Biol Cybern 91(5):275–282CrossRefPubMedGoogle Scholar
  17. Iwanski JS, Bradley E (1998) Recurrence plots of experimental data: to embed or not to embed? Chaos: an Interdisciplinary. J Nonlinear Sci 8(4):861–871Google Scholar
  18. Jackson PJ, Singampalli VD (2009) Statistical identification of articulation constraints in the production of speech. Speech Commun 51(8):695–710CrossRefGoogle Scholar
  19. Keating PA, Lindblom B, Lubker J, Kreiman J (1994) Variability in jaw height for segments in English and Swedish VCVs. J Phon 22(4):407–422Google Scholar
  20. Kelso JS, Tuller B, Vatikiotis-Bateson E, Fowler CA (1984) Functionally specific articulatory cooperation following jaw perturbations during speech: evidence for coordinative structures. J Exp Psychol Hum Percept Perform 10(6):812CrossRefPubMedGoogle Scholar
  21. Kennel MB, Brown R, Abarbanel HD (1992) Determining embedding dimension for phase-space reconstruction using a geometrical construction. Phys Rev A 45(6):3403CrossRefPubMedGoogle Scholar
  22. Kinsella-Shaw JM, Harrison SJ, Turvey MT (2011) Interleg coordination in quiet standing: influence of age and visual environment on noise and stability. J Mot Behav 43(4):285–294CrossRefPubMedGoogle Scholar
  23. Koenig L, Lucero J, Löfqvist A, Palethorpe S, Tabain M (2003) Studying articulatory variability using functional data analysis. In: Proceedings of the 15th international congress of phonetic sciences, pp 269–272Google Scholar
  24. Krivobokova T, Kneib T, Claeskens G (2012) Simultaneous confidence bands for penalized spline estimators. J Am Stat Assoc 105(490):852–863CrossRefGoogle Scholar
  25. Lancia L, Fuchs S (2011) The labial coronal effect revisited. In: Laprie Y (ed) Proceedings of the 8th international seminar on speech production, Montreal, Canada, pp 187–194Google Scholar
  26. Lancia L, Fuchs S, Tiede M (2014) Cross-recurrence analysis in speech production: an overview and a comparison to other nonlinear methods. J Speech Lang Hear Res 57(3):718–33CrossRefPubMedGoogle Scholar
  27. Lancia L, Voigt D, Krasovitskiy G (2016) Characterization of laryngealization as irregular vocal fold vibration and interaction with prosodic prominence. J Phon 54:80–97CrossRefGoogle Scholar
  28. Latash ML, Scholz JP, Schöner G (2007) Toward a new theory of motor synergies. Mot Control 11(3):276–308CrossRefGoogle Scholar
  29. Lucero JC (2005) Comparison of measures of variability of speech movement trajectories using synthetic records. J Speech Lang Hear Res 48(2):336–344CrossRefPubMedGoogle Scholar
  30. Marwan N, Romano MC, Thiel M, Kurths J (2007) Recurrence plots for the analysis of complex systems. Phys Rep 438(5):237–329CrossRefGoogle Scholar
  31. Marwan N, Kurths J (2002) Nonlinear analysis of bivariate data with cross recurrence plots. Phys Lett A 302(5):299–307CrossRefGoogle Scholar
  32. McFarland DH, Baum SR (1995) Incomplete compensation to articulatory perturbation. J Acoust Soc Am 97(3):1865–1873CrossRefPubMedGoogle Scholar
  33. McFarland DH, Baum SR, Chabot C (1996) Speech compensation to structural modifications of the oral cavity. J Acoust Soc Am 100(2):1093–1104CrossRefPubMedGoogle Scholar
  34. Mooshammer C, Hoole P, Geumann A (2007) Jaw and order. Lang Speech 50(2):145–176CrossRefPubMedGoogle Scholar
  35. Morris JS, Carroll RJ (2006) Wavelet-based functional mixed models. J R Stat Soc Ser B 68(2):179–199CrossRefGoogle Scholar
  36. Olsen MA, Hartung D, Busch C, Larsen R (2011) Convolution approach for feature detection in topological skeletons obtained from vascular patterns. In: 2011 IEEE workshop on computational intelligence in biometrics and identity management (CIBIM), pp 163–167Google Scholar
  37. Papcun G, Hochberg J, Thomas T, Laroche F, Zacks J, Levy S (1992) Inferring articulation and recognizing gestures from acoustics with a neural network trained on x-ray microbeam data. J Acoust Soc Am 92(2):688–700CrossRefPubMedGoogle Scholar
  38. Perkell JS (2012) Movement goals and feedback and feedforward control mechanisms in speech production. J Neurolinguistics 25(5):382–407CrossRefPubMedGoogle Scholar
  39. Ramsay JO (2006) Functional data analysis. Wiley, New YorkCrossRefGoogle Scholar
  40. Rochet-Capellan A, Schwartz JL (2007) An articulatory basis for the labial-to-coronal effect:/pata/seems a more stable articulatory pattern than /tapa/. J Acoust Soc Am 121(6):3740–3754CrossRefPubMedGoogle Scholar
  41. Romano MC, Thiel M, Kurths J, Grebogi C (2007) Estimation of the direction of the coupling by conditional probabilities of recurrence. Phys Rev E 76(3):036211CrossRefGoogle Scholar
  42. Romano MC, Thiel M, Kurths J, Mergenthaler K, Engbert R (2009) Hypothesis test for synchronization: twin surrogates revisited. Chaos: an interdisciplinary. J Nonlinear Sci 19(1):015108Google Scholar
  43. Rulkov NF, Sushchik MM, Tsimring LS, Abarbanel HD (1995) Generalized synchronization of chaos in directionally coupled chaotic systems. Phys Rev E 51(2):980–994CrossRefGoogle Scholar
  44. Saltzman E, Kelso JA (1987) Skilled actions: a task-dynamic approach. Psychol Rev 94(1):84CrossRefPubMedGoogle Scholar
  45. Saltzman EL, Munhall KG (1989) A dynamical approach to gestural patterning in speech production. Ecol Psychol 1(4):333–382CrossRefGoogle Scholar
  46. Schöner G, Martin V, Reimann H, Scholz JP (2008) Motor equivalence and the uncontrolled manifold. In: Proceedings of the international seminar on speech production (ISSP 2008), Strasbourg, France, pp 23–28Google Scholar
  47. Sugihara G, May R, Ye H, Hsieh CH, Deyle E, Fogarty M, Munch S (2012) Detecting causality in complex ecosystems. Science 338(6106):496–500CrossRefPubMedGoogle Scholar
  48. Thiel M, Romano MC, Read PL, Kurths J (2004) Estimation of dynamical invariants without embedding by recurrence plots. Chaos: an Interdisciplinary. J Nonlinear Sci 14(2):234–243Google Scholar
  49. Tourville JA, Guenther FH (2011) The DIVA model: a neural theory of speech acquisition and production. Lang Cogn Process 26(7):952–981CrossRefPubMedGoogle Scholar
  50. Turvey MT (1977) Preliminaries to a theory of action with reference to vision. In Shaw RE, Bransford J (eds) Perceiving, acting and knowing. Lawrence Erlbaum Associates, pp 211–265Google Scholar
  51. Weirich M, Lancia L, Brunner J (2013) Inter-speaker articulatory variability during vowel-consonant-vowel sequences in twins and unrelated speakers. J Acoust Soc Am 134(5):3766–3780CrossRefPubMedGoogle Scholar
  52. Zou Y, Romano MC, Thiel M, Marwan N, Kurths J (2011) Inferring indirect coupling by means of recurrences. Int J Bifurcat Chaos 21(04):1099–1111CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Laboratoire de Phonétique et Phonologie (CNRS, Sorbonne Nouvelle)ParisFrance
  2. 2.German Centre for Integrative Biodiversity Research (iDiv) Halle-Jena-LeipzigLeipzigGermany
  3. 3.Institute of EcologyFriedrich Schiller University JenaJenaGermany

Personalised recommendations