Skip to main content

Reinforcement Q-Learning and Neural Networks to Acquire Negotiation Behaviors

  • Chapter
New Challenges in Applied Intelligence Technologies

Part of the book series: Studies in Computational Intelligence ((SCI,volume 134))

Abstract

Learning in negotiation is fundamental for understanding human behaviors as well as for developing new solution concepts. Elsewhere, negotiation behaviors, in which the characters such as Conciliatory (Con), Neutral (Neu), or Aggressive (Agg) define a ‘psychological’ aspect of the negotiator personality, play an important role. In this paper, first, a brief description of SISINE (Integrated System of Simulation for Negotiation) project, which aims to develop innovative teaching methodology of negotiation skills, is given. Second, a negotiation approach essentially based on the escalation level and negotiator personality is suggested for SISINE. In fact, the escalation level defines gradually different negotiation stages from agreement to interruption. Afterwards, negotiation behaviors acquired by reinforcement Q-learning and Neural Networks (NN) under supervised learning are developed. Then, behavior results which display the suggested approach ability to provide negotiators with a first intelligence level are presented. Finally, a discussion is given to evaluate this first intelligence level.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wooldridge, M.: An Introduction to MultiAgent Systems. John Wiley & Sons, England (2002)

    Google Scholar 

  2. Miglino, O., Di Ferdinando, A., Rega, A., Benincasa, B.: SISINE: Teaching negotiation through a multiplayer online role playing game. In: The 6th European Conference on E-Learning, Copenhague, Danemark, October 04-05 (2007)

    Google Scholar 

  3. Bales, R.F.: Interaction Process Analysis: A Method for the Study of Small Groups. Addisson-Wesley, Cambridge, Massachussetts (1950)

    Google Scholar 

  4. Rubin, J.Z., Brown, B.R.: The Social Psychology of Bargaining and Negotiation. Academic Press, New York (1975)

    Google Scholar 

  5. Pfeifer, R., Scheier, C.: Understanding Intelligence. MIT Press, Cambridge (1999)

    Google Scholar 

  6. Chohra, A.: Embodied cognitive science, intelligent behavior control, machine learning, soft computing, and FPGA integration: towards fast, cooperative and adversarial robot team (RoboCup). Technical GMD Report, No. 136, ISSN 1435-2702, Germany (June 2001)

    Google Scholar 

  7. Zeng, D., Sycara, K.: Benefits of learning in negotiation. In: Proc. of the 14th National Conference on Artificial Intelligence (AAAI 1997), Providence, RI (July 1997)

    Google Scholar 

  8. Watkins, C.J.C.H.: Learning from Delayed Rewards. PhD Thesis, King’s College (1989)

    Google Scholar 

  9. Whitehead, S.D.: Reinforcement Learning for the Adaptive Control of Perception and Action. Technical Report 406, University of Rochester (February 1992)

    Google Scholar 

  10. Sutton, R.S., Barto, A.G.: Reinforcement Learning. MIT Press, Cambridge (1998)

    Google Scholar 

  11. Dietterich, T.G.: Hierarchical reinforcement learning with the MAXQ value function decomposition. Journal of Artificial Intelligence Research 13, 227–303 (2000)

    MATH  MathSciNet  Google Scholar 

  12. Anderson, J.A.: An Introduction to Neural Networks. The MIT Press, England (1995)

    MATH  Google Scholar 

  13. Patterson, D.W.: Artificial Neural Networks: Theory and Applications, Prentice-Hall, Simon & Schuster (Asia) Pte Ltd., Singapore (1996)

    Google Scholar 

  14. Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice-Hall, Englewood Cliffs (1999)

    MATH  Google Scholar 

  15. Sandholm, T.W.: Distributed Rational Decision Making. In: Multiagent Systems: A Modern Introduction to Distributed Artificial Intelligence, pp. 201–258. MIT Press, Cambridge (1999)

    Google Scholar 

  16. Lin, L.-J.: Self-improving reactive agents based on reinforcement learning, planning and teaching. In: Machine Learning, vol. 8, pp. 293–321. Kluwer Academic Publishers, Dordrecht (1992)

    Google Scholar 

  17. Touzet, C.F.: Neural reinforcement learning for behaviour synthesis. Robotics and Autonomous Systems 22, 251–281 (1997)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Ngoc Thanh Nguyen Radoslaw Katarzyniak

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Chohra, A., Madani, K., Kanzari, D. (2008). Reinforcement Q-Learning and Neural Networks to Acquire Negotiation Behaviors. In: Nguyen, N.T., Katarzyniak, R. (eds) New Challenges in Applied Intelligence Technologies. Studies in Computational Intelligence, vol 134. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79355-7_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-79355-7_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-79354-0

  • Online ISBN: 978-3-540-79355-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics