Abstract
This paper examines the hypothesis that local weighted variants of k-nearest neighbor algorithms can support dynamic control tasks. We evaluated several k-nearest neighbor (k-NN) algorithms on the simulated learning task of catching a flying ball. Previously, local regression algorithms have been advocated for this class of problems. These algorithms, which are variants of k-NN, base their predictions on a (possibly weighted) regression computed from the k nearest neighbors. While they outperform simpler k-NN algorithms on many tasks, they have trouble on this ball-catching task. We hypothesize that the non-linearities in this task are the cause of this behavior, and that local regression algorithms may need to be modified to work well under similar conditions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aboaf, E., Drucker, S., & Atkeson, C. (1989). Task-level robot learning: Juggling a tennis ball more accurately. In Proceedings of the 1989 IEEE International Conference on Robotics and Automation (pp. 1290–1295 ). Scottsdale, AR: IEEE Press.
Aha, D. W. (1989). Incremental, instance-based learning of independent and graded concept descriptions. In Proceedings of the Sixth International Workshop on Machine Learning (pp. 387–391 ). Ithaca, NY: Morgan Kaufmann.
Aha, D. W. (1991). Case-based learning algorithms. In Proceedings of the DARPA Case-Based Reasoning Workshop (pp. 147–158 ). Washington, D.C.: Morgan Kaufmann.
Aha, D. W., Kibler, D., & Albert, M. K. (1991). Instance-based learning algorithms. Machine Learning, 6, 37–66.
Atkeson, C. (1989). Using local models to control movement. In D. S. Touretsky (Ed.), Advances in Neural Information Processing Systems 2. San Mateo, CA: Morgan Kaufmann.
Bradshaw, G. (1987). Learning about speech sounds: The NEXUS project. In Proceedings of the Fourth International Workshop on Machine Learning (pp. 1–11 ). Irvine, CA: Morgan Kaufmann.
Connell, M. E., & Utgoff, R E. (1987). Learning to control a dynamic physical system. In Proceedings of the Sixth National Conference on Artificial Intelligence (pp. 456–60 ). Seattle, WA: Morgan Kaufmann.
Dasarathy, B. V. (Ed.). (1991). Nearest neighbor(NN) norms: NNpattern classification techniques. Los Alamitos, CA: IEEE Press.
Geng, Z., Fiala, J., Haynes, L. S., Bukowski, R. Santucci, A., & Coleman, N. (1991). Robotic hand-eye coordination. In Proceedings of the Fourth World Conference on Robotics Research (pp. 4–13 to 4–24 ). Pittsburgh, PA: Society of Manufacturing Engineers.
Kelly, J. D., Jr., & Davis, L. (1991). A hybrid genetic algorithm for classification. In Proceedings of the Twelfth International Joint Conference on Artificial Intelligence (pp. 645–650 ). Sydney, Australia: Morgan Kaufmann.
Michie, D., & Chambers, R. (1968). Boxes: An experiment in adaptive control. In E. Dale & D. Michie (Eds.), Machine Intelligence 2. Edinburgh, Scotland: Oliver and Boyd.
Moore, A. W. (1990). Acquisition of dynamic control knowledge for a robotic manipulator. In Proceedings of the Seventh International Conference on Machine Learning (pp. 244–252 ). Austin, TX: Morgan Kaufmann.
Moore, A., & Atkeson, C. (1992). Memory-based function approximators for learning control. Manuscript submitted for publication.
Rizzi, A. A., Whitcomb, L. L., & Koditschek, D. E. (1992). Distributed real-time control of a spatial robot juggler. IEEE Computer, 25(5), 12–24.
Salzberg, S. L. (1991). A nearest hyperrectangle learning method. Machine Learning, 6, 251–276.
Sammut, C. (1990). Is learning rate a good performance criterion for learning? In Proceedings of the Seventh International Conference on Machine Learning (pp. 170–178 ). Austin, TX: Morgan Kaufmann.
Selfridge, O. G., Sutton, R. S., & Barto, A. G. (1985). Training and tracking in robotics. In Proceedings of the Ninth International Joint Conference on Artificial Intelligence (pp. 670 - 672 ). Los Angeles, CA: Morgan Kaufmann.
Stanfill, C., & Waltz, D. (1986). Toward memory-based reasoning. Communications of the Association for Computing Machinery, 29, 1213 - 1228.
Sutton, R. (1990). Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. In Proceedings of the Seventh International Conference on Machine Learning (pp. 216 - 224 ). Austin, TX: Morgan Kaufmann.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1994 Springer-Verlag New York, Inc.
About this paper
Cite this paper
Aha, D.W., Salzberg, S.L. (1994). Learning to Catch: Applying Nearest Neighbor Algorithms to Dynamic Control Tasks. In: Cheeseman, P., Oldford, R.W. (eds) Selecting Models from Data. Lecture Notes in Statistics, vol 89. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-2660-4_33
Download citation
DOI: https://doi.org/10.1007/978-1-4612-2660-4_33
Publisher Name: Springer, New York, NY
Print ISBN: 978-0-387-94281-0
Online ISBN: 978-1-4612-2660-4
eBook Packages: Springer Book Archive