Skip to main content

Simulated Evolution of Discourse with Coupled Recurrent Networks

  • Conference paper
Progress in Artificial Life (ACAL 2007)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4828))

Included in the following conference series:

Abstract

The origin and evolution of language have been the subjects of numerous debates and hypotheses. Nevertheless, they remain difficult to study in a scientific manner. In this paper, we focus on the string-context mutual segmentation hypothesis proposed by Merker and Okanoya, which is based on experimental findings related to animal songs. As a first step in formally exploring this hypothesis, we model the evolution of agent discourse using coupled recurrent networks (RNNs). This model is a simplified representation of this hypothesis; that is, agents are situated in a single context (e.g., behavioral, social, or environmental) and they mutually learn their utterance strings from the prediction dynamics of their RNNs. Our simulation demonstrates the emergence of shared utterance patterns, which are culturally transmitted from one generation to the next. Furthermore, the distribution of the shared patterns changes over the course of this evolution. These findings demonstrate an important aspect of language evolution: “language shaped by society.”

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Christiansen, M., Allen, J., Seidenberg, M.: Learning to Segment Speech Using Multiple Cues: A Connectionist Model. Language and Cognitive Processes 13, 221–268 (1998)

    Article  Google Scholar 

  2. Elman, J.L.: Language as a Dynamical System, pp. 195–223. MIT Press, Cambridge (1995)

    Google Scholar 

  3. Hashimoto, T., Ikegami, T.: Emergence of net-grammar in communicating agents. Biosystems 38, 1–14 (1996)

    Article  Google Scholar 

  4. Hauser, M.D., Chomsky, N., Fitch, W.T.: The Faculty of Language: What Is It, Who Has It, and How Did It Evolve? Science 298, 1569–1589 (2002)

    Article  Google Scholar 

  5. Kirby, S.: Natural Language from Artificial Life. Artificial Life 8(2), 185–215 (2002)

    Article  Google Scholar 

  6. Merker, B., Okanoya, K.: The Natural History of Human Language: Bridging the Gaps without Magic. In: Emergence of Communication and Language, pp. 403–420. Springer, Heidelberg (2006)

    Google Scholar 

  7. Mithen, S.: The Singing Neanderthals: The Origins of Music, Language, Mind and Body. Weidenfeld & Nicolson (2005)

    Google Scholar 

  8. Munroe, S., Cangelosi, A.: Learning and the Evolution of Language: The Role of Cultural Variation and Learning Costs in the Baldwin Effect. Artificial Life 8(4), 311–339 (2002)

    Article  Google Scholar 

  9. Nowak, M.A., Komarova, N.L., Niyogi, P.: Evolution of Universal Grammar. Science 291, 114–118 (2001)

    Article  MathSciNet  Google Scholar 

  10. Okanoya, K., Merker, B.: Neural Substrates for String-Context Mutual Segmentation: A Path to Human Language. In: Lyon, C., Nehaniv, C.L., Cangelosi, A. (eds.) Emergence of Communication and Language, pp. 421–434. Springer, Heidelberg (2006)

    Google Scholar 

  11. Pollack, J.B.: The Induction of Dynamical Recognizers. Machine Learning 7(2), 227–252 (1991)

    Google Scholar 

  12. Rumelhart, D.E., McClelland, J.L.: Parallel Distributed Processing: Explorations in the Microstructure of Cognition. MIT Press, Cambridge (1993)

    Google Scholar 

  13. Sasahara, K., Ikegami, T.: Evolution of Birdsong Syntax by Interjection Communication. Artificial Life 13(3), 259–277 (2007)

    Article  Google Scholar 

  14. Sasaki, T., Tokoro, M.: Adaptation toward Changing Environments: Why Darwinian in Nature? In: Husbands, P., Harvey, I. (eds.) Fourth European Conference on Artificial Life, MIT Press, Cambridge (1997)

    Google Scholar 

  15. Steels, L.: Self-organizing Vocabularies. In: Langton, C.G., Shimohara, K. (eds.) Artificial Life V, pp. 179–184 (1996)

    Google Scholar 

  16. Taiji, M., Ikegami, T.: Dynamics of internal models in game players. Physica D 134(2), 253–266 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  17. Takahasi, M., Okanoya, K.: (in preparation)

    Google Scholar 

  18. Tonkes, B., Wiles, J.: Methodological Issues in Simulating the Emergence of Language. In: Wray, A. (ed.) The Transition to Language, pp. 226–251. Oxford University Press, Oxford (2002)

    Google Scholar 

  19. Werner, G.M., Dyer, M.: Evolution of communication in artificial organisms. In: Langton, C., Taylor, C., Farmer, D., Rasmussen, S. (eds.) Artificial Life II, pp. 659–687. Addison-Wesley, Reading (1992)

    Google Scholar 

  20. Wray, A.: Dual Processing in Protolanguage: Performance Without Competence. In: Wray, A. (ed.) The Transition to Language, pp. 113–137. Oxford University Press, Oxford (2002)

    Google Scholar 

  21. Zipf, G.K.: Human Behavior and the Principle of Least Effort. Addison-Wesley, Reading (1949)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Marcus Randall Hussein A. Abbass Janet Wiles

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Sasahara, K., Merker, B., Okanoya, K. (2007). Simulated Evolution of Discourse with Coupled Recurrent Networks. In: Randall, M., Abbass, H.A., Wiles, J. (eds) Progress in Artificial Life. ACAL 2007. Lecture Notes in Computer Science(), vol 4828. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76931-6_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-76931-6_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-76930-9

  • Online ISBN: 978-3-540-76931-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics