Skip to main content

Automated Agents that Proficiently Negotiate with People: Can We Keep People out of the Evaluation Loop

  • Chapter
  • First Online:
New Trends in Agent-Based Complex Automated Negotiations

Part of the book series: Studies in Computational Intelligence ((SCI,volume 383))

Abstract

Research on automated negotiators has flourished in recent years. Among the important issues considered is how these automated negotiators can proficiently negotiate with people. To validate this, many experimentations with people are required. Nonetheless, conducting experiments with people is timely and costly, making the evaluation of these automated negotiators a very difficult process. Moreover, each revision of the agent’s strategies requires to gather an additional set of people for the experiments. In this paper we investigate the use of Peer Designed Agents (PDAs) – computer agents developed by human subjects – as a method for evaluating automated negotiators. We have examined the negotiation results and its dynamics in extensive simulations with more than 300 human negotiators and more than 50 PDAs in two distinct negotiation environments. Results show that computer agents perform better than PDAs in the same negotiation contexts in which they perform better than people, and that on average, they exhibit the same measure of generosity towards their negotiation partners. Thus, we found that using the method of peer designed negotiators embodies the promise of relieving some of the need for people when evaluating automated negotiators.

This research is based upon work supported in part by the U.S. Army Research Laboratory and the U.S. Army Research Office under grant number W911NF-08-1-0144 and under NSF grant 0705587.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Byde, A., Yearworth, M., Chen, K.-Y., Bartolini, C.: AutONA: A system for automated multiple 1-1 negotiation. In: Proceedings of the 2003 IEEE International Conference on Electronic Commerc (CEC), pp. 59–67 (2003)

    Google Scholar 

  2. Chalamish, M., Sarne, D., Kraus, S.: Programming agents as a means of capturing self-strategy. In: Proceedings of the Seventh International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 1161–1168 (2008)

    Google Scholar 

  3. Fleming, M., Olsen, D., Stathes, H., Boteler, L., Grossberg, P., Pfeifer, J., Schiro, S., Banning, J., Skochelak, S.: Virtual reality skills training for health care professionals in alcohol screening and brief intervention. Journal of the American Board of Family Medicine 22(4), 387–398 (2009)

    Article  Google Scholar 

  4. Gal, Y., Pfeffer, A., Marzo, F., Grosz, B.J.: Learning social preferences in games. In: Proceedinge of the Nineteenth AAAI Conference on Artificial Intelligence, pp. 226–231 (2004)

    Google Scholar 

  5. Grosz, B., Kraus, S., Talman, S., Stossel, B.: The influence of social dependencies on decision-making: Initial investigations with a new game. In: Proceedings of the Third International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 782–789 (2004)

    Google Scholar 

  6. Hindriks, K., Jonker, C., Tykhonov, D.: Analysis of negotiation dynamics. In: Klusch, M., Hindriks, K.V., Papazoglou, M.P., Sterling, L. (eds.) CIA 2007. LNCS (LNAI), vol. 4676, pp. 27–35. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  7. Hindriks, K., Jonker, C., Tykhonov, D.: Negotiation dynamics: Analysis, concession tactics, and outcomes. In: Proceedings of the 2007 IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT), pp. 427–433 (2007)

    Google Scholar 

  8. Jonker, C.M., Robu, V., Treur, J.: An agent architecture for multi-attribute negotiation using incomplete preference information. Autonomous Agents and Multi-Agent Systems 15(2), 221–252 (2007)

    Article  Google Scholar 

  9. Katz, R., Kraus, S.: Efficient agents for cliff edge environments with a large set of decision options. In: Proceedings of the Fifth International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 697–704 (2006)

    Google Scholar 

  10. Kraus, S., Hoz-Weiss, P., Wilkenfeld, J., Andersen, D.R., Pate, A.: Resolving crises through automated bilateral negotiations. Artificial Intelligence 172(1), 1–18 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  11. Kraus, S., Lehmann, D.: Designing and building a negotiating automated agent. Computational Intelligence 11(1), 132–171 (1995)

    Article  Google Scholar 

  12. Lax, D.A., Sebenius, J.K.: Thinking coalitionally: party arithmetic, process opportunism, and strategic sequencing. In: Young, H.P. (ed.) Negotiation Analysis, pp. 153–193. The University of Michigan Press (1992)

    Google Scholar 

  13. Lin, R., Kraus, S.: Can automated agents proficiently negotiate with humans? Communications of the ACM 53(1), 78–88 (2010)

    Article  Google Scholar 

  14. Lin, R., Kraus, S., Wilkenfeld, J., Barry, J.: Negotiating with bounded rational agents in environments with incomplete information using an automated agent. Artificial Intelligence 172(6-7), 823–851 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  15. Offerman, T., Potters, J., Verbon, H.A.A.: Cooperation in an overlapping generations experiment. Games and Economic Behavior 36(2), 264–275 (2001)

    Article  MATH  Google Scholar 

  16. Olsen, D.E.: Interview and interrogation training using a computer-simulated subject. In: Interservice/Industry Training, Simulation and Education Conference (1997)

    Google Scholar 

  17. Osborne, M.J., Rubinstein, A.: A Course In Game Theory. MIT Press, Cambridge (1994)

    MATH  Google Scholar 

  18. Oshrat, Y., Lin, R., Kraus, S.: Facing the challenge of human-agent negotiations via effective general opponent modeling. In: Proceedings of the Eighth International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 377–384 (2009)

    Google Scholar 

  19. Rosenfeld, A., Kraus, S.: Modeling agents through bounded rationality theories. In: Proceedings of the Tewenty-First International Joint Conference on Artificial Intelligence (IJCAI), pp. 264–271 (2009)

    Google Scholar 

  20. Selten, R., Abbink, K., Buchta, J., Sadrieh, A.: How to play (3x3)-games: A strategy method experiment. Games and Economic Behavior 45(1), 19–37 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  21. Selten, R., Mitzkewitz, M., Uhlich, G.R.: Duopoly strategies programmed by experienced players. Econometrica 65(3), 517–556 (1997)

    Article  MathSciNet  MATH  Google Scholar 

  22. TAC Team: A trading agent competition. IEEE Internet Computing 5(2), 43–51 (2001)

    Article  Google Scholar 

  23. Talman, S., Hadad, M., Gal, Y., Kraus, S.: Adapting to agents’ personalities in negotiation. In: Proceedings of the Fourth International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 383–389 (2005)

    Google Scholar 

  24. Traum, D.R., Marsella, S.C., Gratch, J., Lee, J., Hartholt, A.: Multi-party, Multi-Issue, Multi-Strategy Negotiation for Multi-Modal Virtual Agents. In: Prendinger, H., Lester, J.C., Ishizuka, M. (eds.) IVA 2008. LNCS (LNAI), vol. 5208, pp. 117–130. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Raz Lin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Lin, R., Oshrat, Y., Kraus, S. (2012). Automated Agents that Proficiently Negotiate with People: Can We Keep People out of the Evaluation Loop. In: Ito, T., Zhang, M., Robu, V., Fatima, S., Matsuo, T. (eds) New Trends in Agent-Based Complex Automated Negotiations. Studies in Computational Intelligence, vol 383. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24696-8_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24696-8_4

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24695-1

  • Online ISBN: 978-3-642-24696-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics