A failure to replicate rapid syntactic adaptation in comprehension

  • Caoimhe M. Harrington Stack
  • Ariel N. James
  • Duane G. Watson
Article
  • 21 Downloads

Abstract

Language comprehension requires successfully navigating linguistic variability. One hypothesis for how listeners manage variability is that they rapidly update their expectations of likely linguistic events in new contexts. This process, called adaptation, allows listeners to better predict the upcoming linguistic input. In previous work, Fine, Jaeger, Farmer, and Qian (PLoS ONE, 8, e77661, 2013) found evidence for syntactic adaptation. Subjects repeatedly encountered sentences in which a verb was temporarily ambiguous between main verb (MV) and reduced relative clause (RC) interpretations. They found that subjects who had higher levels of exposure to the unexpected RC interpretation of the sentences had an easier time reading the RC sentences but a more difficult time reading the MV sentences. They concluded that syntactic adaptation occurs rapidly in unexpected structures and also results in difficulty with processing the previously expected alternative structures. This article presents two experiments. Experiment 1 was designed as a follow-up to Fine et al.’s study and failed to find evidence of adaptation. A power analysis of Fine et al.’s raw data revealed that a similar study would need double the items and four times the subjects to reach 95% power. In Experiment 2 we designed a close replication of Fine et al.’s experiment using these sample size guidelines. No evidence of rapid syntactic adaptation was found in this experiment. The failure to find evidence of adaptation in both experiments calls into question the robustness of the effect.

Keywords

Sentence processing Syntax Adaptation Replication 

References

  1. Baayen, R. H. (2008). Analyzing linguistic data: A practical introduction to statistics using R. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
  2. Browne, W. J., Lahi, M. G., & Parker, R. M. (2009). A guide to sample size calculations for random effect models via simulation and the MLPowSim software package. Bristol, UK: University of Bristol.Google Scholar
  3. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3–5.  https://doi.org/10.1177/1745691610393980 CrossRefPubMedGoogle Scholar
  4. Buz, E., Tanenhaus, M. K., & Jaeger, T. F. (2016). Dynamically adapted context-specific hyper-articulation: Feedback from interlocutors affects speakers’ subsequent pronunciations. Journal of Memory and Language, 89, 68–86.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Chang, F. (2002). Symbolically speaking: A connectionist model of sentence production. Cognitive Science, 26, 609–651.  https://doi.org/10.1207/s15516709cog2605_3 CrossRefGoogle Scholar
  6. Chang, F., Dell, G. S., & Bock, K. (2006). Becoming syntactic. Psychological Review, 113, 234–272.  https://doi.org/10.1037/0033-295X.113.2.234 CrossRefPubMedGoogle Scholar
  7. Elman, J. L. (1990). Finding structure in time. Cognitive Science, 14, 179–211.CrossRefGoogle Scholar
  8. Farmer, T. A., Fine, A. B., Yan, S., Cheimariou, S., & Jaeger, F. (2014). Error-driven adaptation of higher-level expectations during reading. In P. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.), Proceedings of the 36h Annual Meeting of the Cognitive Science Society (pp. 2181–2186). Austin, TX: Cognitive Science SocietyGoogle Scholar
  9. Ferreira, F., & Clifton, C., Jr. (1986). The independence of syntactic processing. Journal of Memory and Language, 25, 348–368.  https://doi.org/10.1016/0749-596X(86)90006-9 CrossRefGoogle Scholar
  10. Fine, A. B., & Jaeger, T. F. (2011). Language comprehension is sensitive to changes in the reliability of lexical cues. In Proceedings of the 33rd Annual Meeting of the Cognitive Science Society, 33, 925–930.Google Scholar
  11. Fine, A. B., & Jaeger, T. F. (2013). Evidence for implicit learning in syntactic comprehension. Cognitive Science, 37, 578–591.  https://doi.org/10.1111/cogs.12022 CrossRefPubMedGoogle Scholar
  12. Fine, A. B., & Jaeger, T. F. (2016). The role of verb repetition in cumulative structural priming in comprehension. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42, 1362–1376.PubMedGoogle Scholar
  13. Fine, A. B., Jaeger, T. F., Farmer, T. A., & Qian, T. (2013). Rapid expectation adaptation during syntactic comprehension. PLoS ONE, 8, e77661.  https://doi.org/10.1371/journal.pone.0077661 CrossRefPubMedPubMedCentralGoogle Scholar
  14. Fraundorf, S. H., & Jaeger, T. F. (2016). Readers generalize adaptation to newly-encountered dialectal structures to other unfamiliar structures. Journal of Memory and Language, 91, 28–58.CrossRefPubMedPubMedCentralGoogle Scholar
  15. Garnsey, S. M., Pearlmutter, N. J., Myers, E., & Lotocky, M. A. (1997). The contributions of verb bias and plausibility to the comprehension of temporarily ambiguous sentences. Journal of Memory and Language, 37, 58–93.  https://doi.org/10.1006/jmla.1997.2512 CrossRefGoogle Scholar
  16. Gibson, E., Tan, C., Futrell, R., Mahowald, K., Konieczny, L., Hemforth, B., & Fedorenko, E. (2017). Don’t Underestimate the Benefits of Being Misunderstood. Psychological Science, 28, 703–712.CrossRefPubMedGoogle Scholar
  17. Jaeger, T. F., & Snider, N. E. (2008). Implicit learning and syntactic persistence: Surprisal and cumulativity. In B. C. Love, K. McRae, & V.M. Sloutsky (Eds.), Proceedings of the 30th Annual Cognitive Science Society (pp. 1061–1066). Austin, TX: Cognitive Science Society.Google Scholar
  18. Jaeger, T. F., & Snider, N. E. (2013). Alignment as a consequence of expectation adaptation: Syntactic priming is affected by the prime’s prediction error given both prior and recent experience. Cognition, 127, 57–83.  https://doi.org/10.1016/j.cognition.2012.10.013 CrossRefPubMedGoogle Scholar
  19. Kleinschmidt, D. F., Fine, A. B., & Jaeger, T. F. (2012). A belief-updating model of adaptation and cue combination in syntactic comprehension. In N. Miyake, D. Peebles, & R.P. Cooper (Eds.), Proceedings of the 34th Annual Meeting of the Cognitive Science Society (pp. 599–604). Austin, TX: Cognitive Science Society.Google Scholar
  20. Kleinschmidt, D. F., & Jaeger, T. F. (2015). Robust speech perception: Recognize the familiar, generalize to the similar, and adapt to the novel. Psychological Review, 122, 148–203.  https://doi.org/10.1037/a0038695 CrossRefPubMedPubMedCentralGoogle Scholar
  21. Kurumada, C., Brown, M., Bibyk, S., Pontillo, D., & Tanenhaus, M. (2014). Rapid adaptation in online pragmatic interpretation of contrastive prosody. In P. Bello, M. Guarini, M. McShane, & B. Scassellati (Eds.), Proceedings of the 36th Annual Meeting of the Cognitive Science Society (pp. 791–796). Austin, TX: Cognitive Science SocietyGoogle Scholar
  22. Liu, L., & Jaeger, T. F. (2018). Inferring causes during speech perception. Cognition, 174, 55–70.  https://doi.org/10.1016/j.cognition.2018.01.003 CrossRefPubMedGoogle Scholar
  23. Loftus, G. R. (1978). On interpretation of interactions. Memory & Cognition, 6, 312–319.  https://doi.org/10.3758/BF03197461 CrossRefGoogle Scholar
  24. MacDonald, M. C., Just, M. A., & Carpenter, P. A. (1992). Working memory constraints on the processing of syntactic ambiguity. Cognitive Psychology, 24, 56–98.CrossRefPubMedGoogle Scholar
  25. MacDonald, M. C., Pearlmutter, N. J., & Seidenberg, M. S. (1994). The lexical nature of syntactic ambiguity resolution. Psychological Review, 101, 676–703.  https://doi.org/10.1037/0033-295X.101.4.676 CrossRefPubMedGoogle Scholar
  26. Miikkulainen, R., & Dyer, M. G. (1991). Natural language processing with modular PDP networks and distributed lexicon. Cognitive Science, 15, 343–399.CrossRefGoogle Scholar
  27. Myslin, M., & Levy, R. (2016). Comprehension priming as rational expectation for repetition: Evidence from syntactic processing. Cognition, 147, 29–56.CrossRefPubMedGoogle Scholar
  28. Norris, D., McQueen, J. M., & Cutler, A. (2016). Prediction, Bayesian inference and feedback in speech recognition. Language, Cognition and Neuroscience, 31, 4–18.  https://doi.org/10.1080/23273798.2015.1081703 CrossRefPubMedGoogle Scholar
  29. Rayner, K., Carlson, M., & Frazier, L. (1983). The interaction of syntax and semantics during sentence processing: Eye movements in the analysis of semantically biased sentences. Journal of Verbal Learning and Verbal Behavior, 22, 358–374.CrossRefGoogle Scholar
  30. Rohde, D. L. T., & Plaut, D. C. (1999). Language acquisition in the absence of explicit negative evidence: How important is starting small? Cognition, 72, 67–109.  https://doi.org/10.1016/S0010-0277(99)00031-1 CrossRefPubMedGoogle Scholar
  31. Schnoebelen, T., & Kuperman, V. (2010). Using Amazon Mechanical Turk for linguistic research. Psihologija, 43, 441–464.CrossRefGoogle Scholar
  32. Snedeker, J., & Trueswell, J. C. (2004). The developing constraints on parsing decisions: The role of lexical-biases and referential scenes in child and adult sentence processing. Cognitive Psychology, 49, 238–299.CrossRefPubMedGoogle Scholar
  33. Trueswell, J. C., & Tanenhaus, M. K. (1994). Toward a lexicalist framework of constraint-based syntactic ambiguity resolution. In C. Clifton, L. Frazier, & K. Rayner (Eds.), Perspectives on sentence processing (pp. 155–179). Hillsdale, NJ: Erlbaum.Google Scholar
  34. Trueswell, J. C., Tanenhaus, M. K., & Garnsey, S. M. (1994). Semantic influences on parsing: Use of thematic role information in syntactic ambiguity resolution. Journal of Memory and Language, 33, 285–318.  https://doi.org/10.1006/jmla.1994.1014 CrossRefGoogle Scholar
  35. Wells, J. B., Christiansen, M. H., Race, D. S., Acheson, D. J., & MacDonald, M. C. (2009). Experience and sentence processing: Statistical learning and relative clause comprehension. Cognitive Psychology, 58, 250–271.CrossRefPubMedGoogle Scholar
  36. Wittenberg, E., & Levy, R. (2017). If you want a quick kiss, make it count: How choice of syntactic construction affects event construal. Journal of Memory and Language, 94, 254–271.  https://doi.org/10.1016/j.jml.2016.12.001 CrossRefGoogle Scholar
  37. Xiang, M., & Kuperberg, G. (2015). Reversing expectations during discourse comprehension. Language, Cognition and Neuroscience, 30, 648–672.  https://doi.org/10.1080/23273798.2014.995679 CrossRefPubMedGoogle Scholar
  38. Yildirim, I., Degen, J., Tanenhaus, M. K., & Jaeger, T. F. (2013). Linguistic Variability and Adaptation in Quantifier Meanings. In M. Knauff, M. Pauen, N. Sebanz, & I. Wachsmuth (Eds.), Proceedings of the 35th Annual Conference of the Cognitive Science Society (pp. 3835–3840). Austin, TX: Cognitive Science Society.Google Scholar

Copyright information

© Psychonomic Society, Inc. 2018

Authors and Affiliations

  • Caoimhe M. Harrington Stack
    • 1
  • Ariel N. James
    • 2
  • Duane G. Watson
    • 1
  1. 1.Vanderbilt UniversityNashvilleUSA
  2. 2.Macalester CollegeSt. PaulUSA

Personalised recommendations