Semantic processing of adjectives and nouns in American Sign Language: effects of reference ambiguity and word order across development
- 4 Downloads
When processing spoken language sentences, listeners continuously make and revise predictions about the upcoming linguistic signal. In contrast, during comprehension of American Sign Language (ASL), signers must simultaneously attend to the unfolding linguistic signal and the surrounding scene via the visual modality. This may affect how signers activate potential lexical candidates and allocate visual attention as a sentence unfolds. To determine how signers resolve referential ambiguity during real-time comprehension of ASL adjectives and nouns, we presented deaf adults (n = 18, 19–61 years) and deaf children (n = 20, 4–8 years) with videos of ASL sentences in a visual world paradigm. Sentences had either an adjective-noun (e.g., “SEE YELLOW WHAT? FLOWER”) or a noun-adjective (e.g., “SEE FLOWER WHICH? YELLOW”) structure. The degree of ambiguity in the visual scene was manipulated at the adjective and noun levels (e.g., including one or more yellow items and one or more flowers in the visual array). We investigated effects of ambiguity and word order on target looking at early and late points in the sentence. Analysis revealed that adults and children made anticipatory looks to a target when it could be identified early in the sentence. Further, signers looked more to potential lexical candidates than to unrelated competitors in the early window, and more to matched than unrelated competitors in the late window. Children’s gaze patterns largely aligned with those of adults, although they made fewer anticipatory fixations to the target in the early window and were more susceptible to competitors in the late window. Together, these findings suggest that signers allocate referential attention strategically based on the amount and type of ambiguity at different points in the sentence when processing adjectives and nouns in ASL.
KeywordsAmerican Sign Language Eye tracking Semantic processing Visual world Deaf
This work was funded by the National Institute on Deafness and Communication Disorders (NIDCD), grant number R01DC015272. We thank Rachel Mayberry and Arielle Borovsky for valuable input, and Marla Hatrak, Michael Higgins, and Valerie Sharer for help with data collection. We are grateful to all of the individuals who participated in this study.
Compliance with ethical standards
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
- Borovsky, A., Elman, J. L., & Fernald, A. (2012). Knowing a lot for one’s age: Vocabulary skill and not age is associated with anticipatory incremental sentence interpretation in children and adults. Journal of Experimental Child Psychology, 112(4), 417–436. https://doi.org/10.1016/j.jecp.2012.01.005.Google Scholar
- Chen Pichler, D. (2011). Using early ASL word order to shed light on word order variability in sign language. In M. Anderssen, K. Bentzen, & M. Westergaard (Eds.), Variation in the input (pp. 157–177). Dordrecht: Springer.Google Scholar
- Fernald, A., Thorpe, K., & Marchman, V. A. (2010). Blue car, red car: Developing efficiency in online interpretation of adjective–noun phrases. Cognitive Psychology, 60(3), 190–217.Google Scholar
- Hurewitz, F., Brown-Schmidt, S., Thorpe, K., Gleitman, L. R., & Trueswell, J. C. (2000). One frog, two frog, red frog, blue frog: factors affecting children’s syntactic choices in production and comprehension. Journal of Psycholinguistic Research, 29(6), 597–626. https://doi.org/10.1023/A:1026468209238.Google Scholar
- Lieberman, A. M., Borovsky, A., Hatrak, M., & Mayberry, R. I. (2015). Real-time processing of ASL signs: delayed first language acquisition affects organization of the mental Lexicon. Journal of Experimental Psychology. Learning, Memory, and Cognition, 41(4), 1130–1139. https://doi.org/10.1037/xlm0000088.Google Scholar
- Mayberry, R. I., & Squires, B. (2006). Sign language: acquisition. In K. Brown (Ed.), Encyclopedia of language and linguistics (pp. 291–296). Boston: Elsevier.Google Scholar
- Neidle, C., & Nash, J. (2012). The noun phrase. In R. Pfau, M. Steinbach, & B. Woll (Eds.), Sign language: An international handbook (pp. 265–292). Berlin, Boston: De Gruyter Mouton.Google Scholar
- Pavani, F., & Bottari, D. (2012). Visual abilities in individuals with profound deafness a critical review. In M. M. Murray & M. T. Wallace (Eds.), The neural bases of multisensory processes (pp. 423–448). Boca Raton: CRC Press/Taylor & Francis.Google Scholar
- Rubio-Fernandez, P., Mollica, F., & Jara-Ettinger, J. (2018). English and Spanish speakers exploit language structure to increase communicative efficiency. https://psyarxiv.com/gf8qx.
- Rubio-Fernández, P., Wienholz, A., Kirby, S., & Lieberman, A. M. (2019). ASL signers vary adjective position to maximize efficiency: A reference production study. Poster presented at the 32nd Annual CUNY Conference on Human Sentence Processing, Boulder, CO.Google Scholar
- Sandler, W., & Lillo-Martin, D. (2006). Sign language and linguistic universals. Cambrigde: Cambridge University Press.Google Scholar
- Sutton-Spence, R., & Woll, B. (1999). The linguistics of British Sign Language: An introduction. Cambrigde: Cambridge University Press.Google Scholar
- Swisher, M. V. (2000). Learning to converse: How deaf mothers support the development of attention and conversational skills in their young deaf children. In P. Spencer, C. J. Erting, & M. Marschark (Eds.), The deaf child in the family and at school (pp. 21–40). Mahwah: Erlbaum.Google Scholar
- Waxman, R. P., & Spencer, P. E. (1997). What mothers do to support infant visual attention: sensitivities to age and hearing status. Journal of Deaf Studies and Deaf Education, 2(2), 104–114. https://doi.org/10.1093/oxfordjournals.deafed.a014311.Google Scholar
- Weisleder, A., & Fernald, A. (2009). Real-time processing of postnominal adjectives by Latino children learning Spanish as a first language. In Proceedings of the 24th Annual Boston University Conference on Language Development (pp. 611–621).Google Scholar