Skip to main content

Building Agents That Learn by Observing Other Agents Performing a Task: A Sequential Pattern Mining Approach

  • Chapter
  • 983 Accesses

Part of the book series: Studies in Computational Intelligence ((SCI,volume 214))

Abstract

In this paper, we propose to build agents that learn by observing other agents performing a task by extracting frequent temporal patterns from their behavior. We propose a learning mechanism consisting of three phases: (1) recording other agents’ behavior, (2) mining temporal patterns from this data and (3) utilizing the resulting knowledge. We illustrate this approach with a tutoring system for training learners to robotized arm manipulation where we have integrated a tutoring agent that observes humans performing a task to learn it. The agent then exploits this knowledge to provide assistance to learners.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Han, J., Kamber, M.: Data mining: concepts and techniques. Morgan Kaufmann Publ., San Franc. (2000)

    Google Scholar 

  2. Agrawal, R., Srikant, R.: Mining Sequential Patterns. In: Proc. ICDE, pp. 3–14 (1995)

    Google Scholar 

  3. Fournier-Viger, P., Nkambou, R., Mephu Nguifo, E.: A Knowledge Discovery Framework for Learning Task Models from User Interactions in Intelligent Tutoring Systems. In: Proc. MICAI 2008, pp. 765–778 (2008)

    Google Scholar 

  4. Lattner, A.D., Miene, A., Visser, U., Herzog, O.: Sequential Pattern Mining for Situa-tion and Behavior Prediction in Simulated Robotic Soccer. In: Bredenfeld, A., Jacoff, A., Noda, I., Takahashi, Y. (eds.) RoboCup 2005. LNCS, vol. 4020, pp. 118–129. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  5. Kabanza, F., Nkambou, R., Belghith, K.: Path-planning for Autonomous Training on Robot Manipulators in Space. In: Proc. IJCAI 2005 (2005)

    Google Scholar 

  6. Fournier-Viger, P., Nkambou, R., Mayers, A.: Evaluating Spatial Representations and Skills in a Simulator-Based Tutoring System. IEEE Trans. Learning Techn. 1(1), 63–74 (2008)

    Article  Google Scholar 

  7. Pinto, H., et al.: Multi-Dimensional Sequential Pattern Mining. In: Proc. CIKM 2001, pp. 81–88 (2001)

    Google Scholar 

  8. van Lent, M., Laird, J.E.: Learning procedural knowledge through observation. In: Proc. K-CAP 2001, pp. 179–186 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Fournier-Viger, P., Nkambou, R., Mephu Nguifo, E., Faghihi, U. (2009). Building Agents That Learn by Observing Other Agents Performing a Task: A Sequential Pattern Mining Approach. In: Chien, BC., Hong, TP. (eds) Opportunities and Challenges for Next-Generation Applied Intelligence. Studies in Computational Intelligence, vol 214. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92814-0_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-92814-0_43

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-92813-3

  • Online ISBN: 978-3-540-92814-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics