Abstract
As robots venture into new application domains as autonomous vehicles on the road or as domestic helpers at home, they must recognize human intentions and behaviors in order to operate effectively. This paper investigates a new class of motion planning problems with uncertainty in human intention. We propose a method for constructing a practical model by assuming a finite set of unknown intentions. We first construct a motion model for each intention in the set and then combine these models together into a single Mixed Observability Markov Decision Process (MOMDP), which is a structured variant of the more common Partially Observable Markov Decision Process (POMDP). By leveraging the latest advances in POMDP/MOMDP approximation algorithms, we can construct and solve moderately complex models for interesting robotic tasks. Experiments in simulation and with an autonomous vehicle show that the proposed method outperforms common alternatives because of its ability in recognizing intentions and using the information effectively for decision making.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aoude, G.S., Luders, B.D., Levine, D.S., How, J.P.: Threat-aware path planning in uncertain urban environments. In: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots & Systems (2010)
Bai, H., Hsu, D., Lee, W.S., Ngo, V.A.: Monte Carlo Value Iteration for Continuous-State POMDPs. In: Hsu, D., Isler, V., Latombe, J.-C., Lin, M.C. (eds.) Algorithmic Foundations of Robotics IX. STAR, vol. 68, pp. 175–191. Springer, Heidelberg (2010)
Behrisch, M., Bieker, L., Erdmann, J., Krajzewicz, D.: Sumo – simulation of urban mobility: An overview. In: Proc. Int. Conf. on Advances in System Simulation, pp. 63–68 (2011)
Bennewitz, M., Burgard, W.: Adapting navigation strategies using motion patterns of people. In: Proc. IEEE Int. Conf. on Robotics & Automation (2003)
Chong, Z.J., et al.: Autonomous personal vehicle in crowded campus environments. In: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots & Systems, Workshop on Perception and Navigation for Autonomous Vehicles in Human Environment (2011)
Fern, A., Tadepalli, P.: A computational decision theory for interactive assistants. In: Advances in Neural Information Processing Systems, NIPS (2010)
Fulgenzi, C., Tay, C., Spalanzani, A., Laugier, C.: Probabilistic navigation in dynamic environment using rapidly-exploring random trees and Gaussian processes. In: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots & Systems (2008)
Helbing, D., Buzna, L., Johansson, A., Werner, T.: Self-organized pedestrian crowd dynamics and design solutions: Experiments, simulations and design solutions. Transportation Science 39(1), 1–24 (2005)
Kaelbling, L.P., Littman, M.L., Cassandra, A.R.: Planning and acting in partially observable stochastic domains. Artificial Intelligence 101(1-2), 99–134 (1998)
Kautz, H., Allen, J.F.: Generalized plan recognition. In: Proc. AAAI Conf. on Artificial Intelligence, vol. 19, p. 86 (1986)
Khatib, O.: Real-time obstacle avoidance for manipulators and mobile robots. Int. J. Robotics Research 5(1), 90–98 (1986)
Kurniawati, H., Hsu, D., Lee, W.S.: SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces. In: Proc. Robotics: Science and Systems (2008)
Latombe, J.C.: Robot Motion Planning. Kluwer Academic Publishers, Boston (1991)
Leonard, J., et al.: A perception driven autonomous urban vehicle. J. Field Robotics 25(10), 727–774 (2008)
Ong, S.C.W., Png, S.W., Hsu, D., Lee, W.S.: Planning under uncertainty for robotic tasks with mixed observability. Int. J. Robotics Research 29(8), 1053–1068 (2010)
Papadimitriou, C., Tsisiklis, J.N.: The complexity of Markov decision processes. Mathematics of Operations Research 12(3), 441–450 (1987)
Pineau, J., Gordon, G., Thrun, S.: Point-based value iteration: An anytime algorithm for POMDPs. In: Proc. Int. Jnt. Conf. on Artificial Intelligence, pp. 477–484 (2003)
Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice Hall (2003)
Smallwood, R.D., Sondik, E.J.: The optimal control of partially observable Markov processes over a finite horizon. Operations Research 21, 1071–1088 (1973)
Smith, T., Simmons, R.: Point-based POMDP algorithms: Improved analysis and implementation. In: Proc. Uncertainty in Artificial Intelligence (2005)
Turaga, P., Chellappa, R., Subrahmanian, V.S., Udrea, O.: Machine recognition of human activities: A survey. IEEE Trans. on Circuits & Systems for Video Technology 18(11), 1473–1488 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bandyopadhyay, T., Won, K.S., Frazzoli, E., Hsu, D., Lee, W.S., Rus, D. (2013). Intention-Aware Motion Planning. In: Frazzoli, E., Lozano-Perez, T., Roy, N., Rus, D. (eds) Algorithmic Foundations of Robotics X. Springer Tracts in Advanced Robotics, vol 86. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36279-8_29
Download citation
DOI: https://doi.org/10.1007/978-3-642-36279-8_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36278-1
Online ISBN: 978-3-642-36279-8
eBook Packages: EngineeringEngineering (R0)