Simulation Based Selection of Actions for a Humanoid Soccer-Robot
This paper introduces a method for making fast decisions in a highly dynamic situation, based on forward simulation. This approach is inspired by the decision problem within the RoboCup domain. In this environment, selecting the right action is often a challenging task. The outcome of a particular action may depend on a wide variety of environmental factors, such as the robot’s position on the field or the location of obstacles. In addition, the perception is often heterogeneous, uncertain, and incomplete. In this context, we investigate forward simulation as a versatile and extensible yet simple mechanism for inference of decisions. The outcome of each possible action is simulated based on the estimated state of the situation. The simulation of a single action is split into a number of simple deterministic simulations – samples – based on the uncertainties of the estimated state and of the action model. Each of the samples is then evaluated separately, and the evaluations are combined and compared with those of other actions to inform the overall decision. This allows us to effectively combine heterogeneous perceptual data, calculate a stable decision, and reason about its uncertainty. This approach is implemented for the kick selection task in the RoboCup SPL environment and is actively used in competitions. We present analysis of real game data showing significant improvement over our previous methods.
- 2.Bordallo, A., Previtali, F., Nardelli, N., Ramamoorthy, S.: Counterfactual reasoning about intent for interactive navigation in dynamic environments. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2943–2950, September 2015Google Scholar
- 3.Dodds, R., Vallejos, P., Ruiz-del Solar, J.: Probabilistic kick selection in robot soccer. In: IEEE 3rd Latin American Robotics Symposium, LARS 2006, pp. 137–140, October 2006Google Scholar
- 5.Kunze, L., Beetz, M.: Envisioning the qualitative effects of robot manipulation actions using simulation-based projections. Artif. Intell. (2015). http://www.sciencedirect.com/science/article/pii/S0004370214001544
- 6.Winfield, A.F.T., Blum, C., Liu, W.: Towards an ethical robot: internal models, consequences and ethical action selection. In: Mistry, M., Leonardis, A., Witkowski, M., Melhuish, C. (eds.) TAROS 2014. LNCS (LNAI), vol. 8717, pp. 85–96. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10401-0_8CrossRefGoogle Scholar