Skip to main content

Temporal Measures of Hand and Speech Coordination During French Cued Speech Production

  • Conference paper
Book cover Gesture in Human-Computer Interaction and Simulation (GW 2005)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3881))

Included in the following conference series:

Abstract

Cued Speech is an efficient method that allows orally educated deaf people to perceive a complete oral message through the visual channel. Using this system, speakers can clarify what they say with the complement of hand cues near the face; similar lip shapes are disambiguated by the addition of a manual cue. In this context, Cued Speech represents a unique system that closely links hand movements and speech since it is based on spoken language. In a previous study, we investigated the temporal organization of French Cued Speech production for a single cueing talker. A specific pattern of coordination was found: the hand anticipates the lips and speech sounds. In the present study, we investigated the cueing behavior of three additional professional cueing talkers. The same pattern of hand cues anticipation was found. Results are discussed with respect to inter-subject variability. A general pattern of coordination is proposed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cornett, R.O.: Cued Speech. American Annals of the Deaf 112, 3–13 (1967)

    Google Scholar 

  2. Cornett, R.O.: Adapting Cued Speech to additional languages. Cued Speech Journal 5, 19–29 (1994)

    Google Scholar 

  3. Nicholls, G., Ling, D.: Cued Speech and the reception of spoken language. Journal of Speech and Hearing Research 25, 262–269 (1982)

    Article  Google Scholar 

  4. Uchanski, R.M., Delhorne, L.A., Dix, A.K., Braida, L.D., Reed, C.M., Durlach, N.I.: Automatic speech recognition to aid the hearing impaired: Prospects for the automatic generation of cued speech. Journal of Rehabilitation Research and Development 31(1), 20–41 (1994)

    Google Scholar 

  5. Leybaert, J., Alegria, J.: The Role of Cued Speech in Language Development of Deaf Children. In: Marschark, M., Spencer, P.E. (eds.) Oxford Handbook of Deaf Studies, Language, and Education, pp. 261–274. Oxford University Press, Oxford (2003)

    Google Scholar 

  6. Bratakos, M.S., Duchnowski, P., Braida, L.D.: Toward the automatic generation of Cued Speech. Cued Speech Journal 6, 1–37 (1998)

    Google Scholar 

  7. Duchnowski, P., Lum, D., Krause, J., Sexton, M., Bratakos, M., Braida, L.D.: Development of speechreading supplements based on automatic speech recognition. IEEE Transactions on Biomedical Engineering 47(4), 487–496 (2000)

    Article  Google Scholar 

  8. Attina, V., Beautemps, D., Cathiard, M.-A., Odisio, M.: A pilot study of temporal organization in Cued Speech production of French syllables: Rules for a Cued Speech synthesizer. Speech Communication 44, 197–214 (2004)

    Article  Google Scholar 

  9. Lallouache, M.T.: Un poste visage-Parole couleur. Acquisition et traitement automatique des contours des lèvres. Doctoral thesis, INP Grenoble (1991)

    Google Scholar 

  10. Abry, C., Boë, L.-J.: “Laws” for lips. Speech Communication 5, 97–104 (1986)

    Article  Google Scholar 

  11. Badin, P., Motoki, K., Miki, N., Ritterhaus, D., Lallouache, M.-T.: Some geometric and acoustic properties of the lip horn. Journal of Acoustical Society of Japan (E) 15(4), 243–253 (1994)

    Article  Google Scholar 

  12. Schmidt, R.A.: Motor control and learning: A behavioural emphasis. Human Kinetics, Champaign (1988)

    Google Scholar 

  13. Perkell, J.S., Matthies, M.L.: Temporal measures of anticipatory labial coarticulation for the vowel /u/: Within- and cross-subject variability. The Journal of Acoustical Society of America 91(5), 2911–2925 (1992)

    Article  Google Scholar 

  14. Butterworth, B.L., Hadar, U.: Gesture, speech, and computational stages: A reply to McNeill. Psychological Review 96(1), 168–174 (1989)

    Article  Google Scholar 

  15. Morrel-Samuels, P., Krauss, R.M.: Word familiarity predicts temporal asynchrony of hand gestures and speech. Journal of Experimental Psychology: Learning, Memory and Cognition 18(3), 615–622 (1992)

    Google Scholar 

  16. Abry, C., Stefanuto, M., Vilain, A., Laboissière, R.: What can the utterance “tan, tan” of Broca’s patient Leborgne tell us about the hypothesis of an emergent “babble-syllable” downloaded by SMA? In: Durand, J., Laks, B. (eds.) Phonetics, Phonology and Cognition, pp. 226–243. Oxford University Press, Oxford (2002)

    Google Scholar 

  17. Cathiard, M.-A., Attina, V., Abry, C., Beautemps, D.: La Langue française Parlée Complétée. (LPC): sa coproduction avec la parole et l’organisation temporelle de sa perception. Revue PArole, num spécial 29–30–31, Handicap langagier et recherches cognitives: apports mutuels (to appear, 2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Attina, V., Cathiard, MA., Beautemps, D. (2006). Temporal Measures of Hand and Speech Coordination During French Cued Speech Production. In: Gibet, S., Courty, N., Kamp, JF. (eds) Gesture in Human-Computer Interaction and Simulation. GW 2005. Lecture Notes in Computer Science(), vol 3881. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11678816_2

Download citation

  • DOI: https://doi.org/10.1007/11678816_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-32624-3

  • Online ISBN: 978-3-540-32625-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics