Skip to main content

Learning by Experimentation: Acquiring and Refining Problem-Solving Heuristics

  • Chapter
Machine Learning

Part of the book series: Symbolic Computation ((1064))

Abstract

This chapter concerns learning heuristic problem-solving strategies through experience. In particular, we focus on the issue of learning heuristics to guide a forward-search problem solver, and describe a computer program called lex, which acquires problem-solving heuristics in the domain of symbolic integration. lex acquires and modifies heuristics by iteratively applying the following process: (i) generate a practice problem; (ii) use available heuristics to solve this problem; (iii) analyze the search steps performed in obtaining the solution; and (iv) propose and refine new domain-specific heuristics to improve performance on subsequent problems. We describe the methods currently used by lex, analyze strengths and weaknesses of these methods, and discuss our current research toward more powerful approaches to learning heuristics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Anzai, Y. and Simon, H., “The theory of learning by doing,” Psychological Review, Vol. 36, No. 2, pp. 124–140, 1979.

    Article  Google Scholar 

  • Buchanan, B. G. and Mitchell, T. M., “Model-Directed Learning of Production Rules,” Pattern-Directed Inference Systems, Waterman, D. A. and Hayes-Roth, F. (Eds.), Academic Press, New York, 1978.

    Google Scholar 

  • Davis, R., “Applications of meta level knowledge to the construction and use of large knowledge bases,” Knowledge-based Systems in Artificial Intelligence, Davis, R. and Lenat, D. (Eds.), McGraw-Hill, New York, 1981.

    Google Scholar 

  • Fikes, R. E., Hart, P. E. and Nilsson, N. J., “Learning and executing generalized robot plans,” Artificial Intelligence, Vol. 3, pp. 251–288, 1972.

    Article  Google Scholar 

  • Hayes-Roth, F., Klahr, P. and Mostow, D. J. J., “Knowledge acquisition, knowledge programming, and knowledge refinement”, Technical Report R-2540-NSF, The Rand Corporation, Santa Monica, CA., May 1980.

    Google Scholar 

  • Iba, G. A., “Learning disjunctive concepts from examples,” Master’s thesis, M.I.T., Cambridge, Mass., 1979, (also AI memo 548).

    Google Scholar 

  • Mitchell, T. M., Version Spaces: An approach to concept learning,Ph.D. dissertation, Stanford University, December 1978, (also Stanford CS report STAN-CS-78–711, HPP-79–2).

    Google Scholar 

  • Mitchell, T. M., Utgoff, P. E., Nudel, B. and Banerji, R., “Learning problem-solving heuristics through practice,” Proceedings of the Seventh International Joint Conference on Artificial Intelligence, Vancouver, pp. 127–134, August 1981.

    Google Scholar 

  • Mitchell, T. M., “Generalization as Search,” Artificial Intelligence, Vol. 18, No. 2, pp. 203–226, March 1982.

    Article  MathSciNet  Google Scholar 

  • Mitchell, T. M., “Toward Combining Empirical and Analytic Methods for Learning Heuristics,” Human and Artificial Intelligence, Elithorn, A. and Banerji, R. ( Eds. ), Erlbaum, 1982.

    Google Scholar 

  • Neves, D. M. M., “A computer program that learns algebraic procedures,” Proceedings of the 2nd Conference on Computational Studies of Intelligence, Toronto, 1978.

    Google Scholar 

  • Nilsson, N. Principles of Artificial Intelligence, Tioga, Palo Alto, 1980.

    MATH  Google Scholar 

  • Politakis, P., Weiss, S. and Kulikowski, C., “Designing consistent knowledge bases for expert consultation systems”, Technical Report DCS-TR-100, Department of Computer Science, Rutgers University, 1979, (also 13th Annual Hawaii International Conference on System Sciences).

    Google Scholar 

  • Utgoff, P. E. and Mitchell, T. M., “Acquisition of Appropriate Bias for Inductive Concept Learning,” Proceedings of the 1982 National Conference on Artificial Intelligence,Pittsburgh, August 1982.

    Google Scholar 

  • Vere, S. A., “Inductive learning of relational productions,” Pattern-Directed Inference Systems, Waterman, D. A. and Hayes-Roth, F. (Eds.), Academic Press, New York, 1978.

    Google Scholar 

  • Waterman, D. A., “Generalization learning techniques for automating the learning of heuristics,” Artificial Intelligence, Vol. 1, No. 1 /2, pp. 121–170, 1970.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1983 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Mitchell, T.M., Utgoff, P.E., Banerji, R. (1983). Learning by Experimentation: Acquiring and Refining Problem-Solving Heuristics. In: Michalski, R.S., Carbonell, J.G., Mitchell, T.M. (eds) Machine Learning. Symbolic Computation. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-12405-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-12405-5_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-12407-9

  • Online ISBN: 978-3-662-12405-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics