Skip to main content

Abstract

In general, traditional machine learning algorithms typically employ task-specific methods and only the parameters pre-determined by the human programmer are updated. These methods often fail to respond to the dynamically changing states of the uncontrolled environments. Additionally, such methods may not represent a developmental entity, such as a human mind. In contrast, an open-ended developmental robot system can learn simple behaviors and buildup more complex behaviors by utilizing the previously learned behaviors. In this chapter, we propose a basic framework for visual learning tasks that integrates a perceptual system into a biologically inspired working memory system. A main objective of this research is to provide a general framework for developmental learning and to investigate how well a neuro-computational PFC working memory model performs on a robotic platform in a real-world environment with complex tasks. Experiments conducted show impressive results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Baddeley, A. D., & Hitch, G. J. (1974). Working memory. In G. A. Bower (Ed.), Recent advances in learning and motivation (Vol. 8, pp. 47–90). New York: Academic Press.

    Google Scholar 

  • Bursch, M. A., Skubic, M., Keller, J. M., & Stone, K. E. (2007). A robot in a water maze: Learning a spatial memory task. In Proceedings of the IEEE International Conference on Robotics and Automation (IRCA), Rome, Italy, April 10–14.

    Google Scholar 

  • Goldman-Rakic, P. S. (1996). Regional and cellular fractionation of working memory. Proceedings of the National Academy of Science USA, 93, 13473–13480.

    Article  Google Scholar 

  • Kohonen, T. (1990). The self-organizing map. Proceedings of the IEEE, 78, 1464–1480.

    Article  Google Scholar 

  • Krichmar, J. L., & Edelman, G. M. (2006). Principles underlying the construction of brain-based devices. In T. Kovacs & J. A. R. Marshall (Eds.), Adaptation in artificial and biological systems (pp. 37–42). Bristol, UK: Society for the Study of Artificial Intelligence and the Simulation of Behavior.

    Google Scholar 

  • Krichmar, J. L., Nitz, D. A., Gally, J. A., & Edelman, G. M. (2005). Characterizing functional hippocampal pathways in a brain-based device as it solves a spatial memory task. Proceedings of National Academy Science USA, 102, 2111–2116.

    Article  Google Scholar 

  • Miyake, A., & Shah, P. (Eds.). (1999). Models of working memory: Mechanisms of active maintenance and executive control. Cambridge: Cambridge University Press.

    Google Scholar 

  • O’Reilly, R. C., Braver, T. S., & Cohen, J. D. (1999). A biologically based computational model of working memory. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 375–411).

    Google Scholar 

  • Phillips, J. L., & Noelle, D. C. (2005). A biologically inspired working memory framework for robots. In Proceedings of the 27th Annual Meeting of the Cognitive Science Society, Stresa, Italy, July.

    Google Scholar 

  • Schultz, W. (1998). Predictive reward signal of dopamine neurons. Journal of Neurophysiology, 80, 1–27.

    Article  Google Scholar 

  • Skinner, B. F. (1953). Science and human behavior. New York: Colliler-Macmillian.

    Google Scholar 

  • Sutton, R. S. (1988). Learning to predict by the method of temporal differences. Machine Learning, 3, 9–44.

    Google Scholar 

  • Tugcu, M., Wang, X., Hunter, J. E., Phillips, J., Noelle, D., & Wilkes, D. M. (2007). A computational neuroscience model of working memory with application to robot perceptual learning. In IASTED Computational Intelligence, Canada, July 2–4.

    Google Scholar 

  • Wang, X., & Wilkes, D. M. (2009). An autonomous vision system based sensor-motor coordination using working memory toolkit. In Proceedings of the 2009 International Conference on Artificial Intelligence, Las Vegas, July.

    Google Scholar 

  • Wang, X., Wang, X. L., & Wilkes, D. M. (2008). Visual novel object detection for mobile robots. In Proceedings of the 2008 International Conference on Data Mining, Las Vegas, July 14–17.

    Google Scholar 

  • Watanabe, M., Kodama, T., & Hikosaka, K. (1997). Increase of extracellular dopamine in primate prefrontal cortex during a working memory task. Journal of Neurophysiology, 78, 2795–2798.

    Article  Google Scholar 

  • Weng, J. (2004). Developmental robots: Theory and experiments. International Journal of Humanoid Robotics, 1, 199–236.

    Article  Google Scholar 

  • Weng, J., & Hwang, W. S. (2006). From neural networks to the brain autonomous mental development. IEEE Computational Intelligence Magazine, 1(3), 15–31.

    Google Scholar 

  • Weng, J., & Hwang, W. (2007). Incremental hierarchical discriminant regression. IEEE Transactions on Neural Networks, 18(2), 397–415.

    Google Scholar 

  • Weng, J., McClelland, J., Pentland, A., Sporns, O., Stockman, I., Sur, M., & Thelen, E. (2001). Computational autonomous mental development: A white paper for suggesting a new initiative (Technical Report).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaochun Wang .

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Xi'an Jiaotong University Press

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Wang, X., Wang, X., Wilkes, D.M. (2020). A Developmental Robotic Paradigm for Mobile Robot Navigation in an Indoor Environment. In: Machine Learning-based Natural Scene Recognition for Mobile Robot Localization in An Unknown Environment. Springer, Singapore. https://doi.org/10.1007/978-981-13-9217-7_14

Download citation

Publish with us

Policies and ethics