Skip to main content

Reasoning with Maximum Entropy in Expert Systems

  • Chapter
Maximum Entropy and Bayesian Methods

Part of the book series: Fundamental Theories of Physics ((FTPH,volume 43))

Abstract

One of the major requirements of an expert system designed to be able to reason cogently with both certain and uncertain information is that it should demonstrably perform its reasoning task within a reasonable amount of time. However, various simplification strategies operated by early expert systems, do in the long run, lead to continued and sustained errors of judgement on the part of the reasoning process. So much so, that criticisms can be made against almost all of the present day methods for reasoning with uncertainty (Prade, 1983), (Stephanou and Sage 1987).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Bard, Y.: 1980, ‘Estimation of State Probabilities Using the Maximum Entropy Principle’, IBM Journal of Research and Development 24, 563–569.

    Article  MathSciNet  MATH  Google Scholar 

  • Bard, Y.: 1980a, ‘A Model of Shared DASD and Multipathing’, CACM 23 564–572.

    Article  Google Scholar 

  • Bayes, T.: 1970, ‘An Essay Towards Solving a Problem in the Doctrine of Changes’, Studies in the History of Statistics and Probability 1, E.S. Pearson and M.G. Kendall (eds.), Griffin, London, 134–153.

    Google Scholar 

  • Bernoulli, J.: 1713, Ars Conjectandi, Montmort.

    Google Scholar 

  • Buchanan, B. and E. Shortliffe: 1984, Rule Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project, Addison-Wesley, Reading, MA.

    Google Scholar 

  • Buchanan, B.G., G. Sutherland, and E. Geirgenbaum: 1969, ‘Heuristic DENDRAL: A Program for Generating Explanatory Hypotheses in Organic Chemistry’, Machine Intelligence 5, Elsevier, New York.

    Google Scholar 

  • Bundy, A.: 1986, ‘Correctness Criteria of Some Algorithms for Uncertain Reasoning Using Incidence Calculus’, Journal of Automated Reasoning 2, D. Reidel, Dordrecht, 109–126.

    Google Scholar 

  • Chang, C.L. and R.C.T. Lee: 1973, Symbolic Logic and Mechanical Theorem Proving, Academic Press, New York.

    MATH  Google Scholar 

  • Cheeseman, P.: 1983, ‘A Method for Producing Generalised Bayesian Probability Values for Expert Systems’, IJCAI 1983, Morgan Kaufmann, Los Altos, CA, 198–202.

    Google Scholar 

  • Cooper, G.F.: 1984, NESTOR: A Computer-Based Diagnostic Aid that Integrates Causal and Probabilistic Logic, Ph.D. Dissertation, Department of Computer Science, Stanford University.

    Google Scholar 

  • Cox, R.: 1946, ‘Probability, Frequency and Reasonable Expectation’, American Journal of Physics 14, 1–13.

    Article  MathSciNet  MATH  Google Scholar 

  • De Finetti, B.: 1977, ‘Probabilities of Probabilities: A Real Problem or a Misunderstanding?’, New Developments in the Applications of Bayesian Methods, A. Aykac and C. Brumet (eds.), North Holland, Amsterdam, 1–10.

    Google Scholar 

  • Dromey, R.G.: 1982, How to Solve It by Computer, Prentice-Hall, Inc., London.

    MATH  Google Scholar 

  • Duda, R., P. Hart, and N. Nilsson: 1976, ‘Subjective Bayesian Methods for Rule-Based Inference Systems’, Proceedings of the 1976 National Computer Conference 45, 1075–1082.

    Google Scholar 

  • Duda, R.O., P.E. Hart, N.J. Nilsson, R. Reboh, and J. Sutherland: 1977, ‘Development of a Computer Based Consultant for Mineral Exploration’, Annual Report (Projects 5821 and 6415), SRI International, Menlo Park, California.

    Google Scholar 

  • Feigenbaum, E. and J. Feldman: 1963, Computers and Thought, McGraw-Hill, New York.

    MATH  Google Scholar 

  • Feller, W.: 1968, An Introduction to Probability Theory and Applications 1, Wiley, New York.

    MATH  Google Scholar 

  • Frost, R.A.: 1986, Introduction to Knowledge Base Systems, Collins, London.

    Google Scholar 

  • Gorry, G.A. and G.O. Barnett: 1968a, ‘Experience with a Model of Sequential Diagnosis’, Computers and Biomedical Research 1, 490–507.

    Article  Google Scholar 

  • Gorry, G.A. and G.O. Barnett: 1968b: ‘Sequential Diagnosis by Computer’, Journal of the American Medical Association 205, 849–854.

    Article  Google Scholar 

  • Guggenheimer, H. and R.S. Freedman: 1987, ‘Foundations of Probabilistic Logic’, Proceedings of National Conference on Artificial Intelligence, 939–941.

    Google Scholar 

  • Hopcroft, J.E. and D. Ullman: 1979, Introduction to Automata Theory, Languages, and Computation, Addison-Wesley, Philippines, 177–213.

    MATH  Google Scholar 

  • Hughes, G.E. and M.J. Cresswell: 1968, Introduction to Modal Logic, Methuen, London.

    MATH  Google Scholar 

  • Jaynes, E.T.: 1979, The Maximum Entropy Formalism, R.D. Levine and M. Tribus (eds.), MIT Press, Cambridge, MA, 15–118.

    Google Scholar 

  • Jaynes, E.T.: 1979, ‘Where Do We Stand on the Maximum Entropy Formalism’, Proceedings Maxent Workshop 1, Cambridge.

    Google Scholar 

  • Jaynes, E.T.: 1990, Probability Theory as Logic, P. Fougere (ed.), Holland.

    Google Scholar 

  • Jeffreys, H.: 1939, Theory of Probability, Oxford University Press.

    Google Scholar 

  • Kanal, L.N. and J.F. Lemmer: 1986, Uncertainty in Artificial Intelligence 2, North-Holland, Amsterdam.

    MATH  Google Scholar 

  • Kane, T.B.: 1989, ‘Maximum Entropy in Nilsson’s Probabilistic Logic’, IJCAI 1989, Morgan Kaufmann, California, 442–447.

    Google Scholar 

  • Kane, T.B.: 1990, ‘Enhancing of the Inference Mechanism of Nilsson’s Probabilistic Logic’, International Journal of Intelligent Systems 5(5).

    Google Scholar 

  • Lemmer, J. and S. Barth: 1982, ‘Efficient Minimum Information Updating for Bayesian in Expert Systems’, Proceedings of National Conference on Artificial Intelligence, 424–427.

    Google Scholar 

  • Mendelssohn, K.: 1977, The Quest for Absolute Zero, Taylor and Francis, London.

    Google Scholar 

  • Nilsson, N.: 1986, ‘Probabilistic Logic’, Artificial Intelligence 28(1).

    Google Scholar 

  • Patil, R.S.: 1988, ‘Artificial Intelligence Techniques for Diagnostic Reasoning’, Exploring Artificial Intelligence, Morgan Kaufmann, San Mateo, California, 347–380.

    Google Scholar 

  • Pearl, J.: 1987, ‘Evidential Reasoning Using Stochastic Simulation of Causal Models’, Artificial Intelligence 32, Elsevier Science Publishers, North Holland, 245–257.

    Google Scholar 

  • Pearl, J.: 1988, Probabilistic Reasoning in Intelligent Systems, Morgan Kaufmann.

    Google Scholar 

  • Perez, A. and R. Jirousek: 1985, ‘Constructing an Intentional Expert System (INES)’, Medical Decision Making, Elsevier Scientific Publishers, 307–315.

    Google Scholar 

  • Prade, H.: 1983, ‘A Synthetic View of Approximate Reasoning Techniques’, Proceedings 8th IJCAI, Karlsruhe, West Germany, 130–136.

    Google Scholar 

  • Quinlan, J.R.: 1983, ‘Inferno: A Cautious Approach to Uncertain Inference’, The Computer Journal 26.

    Google Scholar 

  • Savage, L.J.: 1954, The Foundations of Statistics, Wiley, New York.

    MATH  Google Scholar 

  • Savage, L.J.: 1961, ‘The Foundations of Statistics Reconsidered’, Proceedings, 4th Berkeley Symposium on Mathematics and Probability, University of California.

    Google Scholar 

  • Schwartz, M.S., J. Baron, and J.R. Clarke: 1988, ‘A Causal Bayesian Model for the Diagnosis of Appendicitis’, Uncertainty in Artificial Intelligence 2, Lemmer and Kanal (eds.), Elsevier Science, North-Holland, 423–434.

    Google Scholar 

  • Sell, P.S.: 1985, Expert Systems — A Practical Introduction, Macmillan, London.

    Google Scholar 

  • Shafer, G.: 1976, A Mathematical Theory of Evidence, Princeton University Press.

    Google Scholar 

  • Shannon, C.E.: 1948, ‘A Mathematical Theory of Communication’, Bell System Technical Journal 27, 379–623.

    MathSciNet  MATH  Google Scholar 

  • Spiegelhalter, D.: 1986, ‘Probabilistic Reasoning in Predictive Expert Systems’, Uncertainty in Artificial Intelligence, North Holland, Amsterdam, 47–68.

    Google Scholar 

  • Stephanou, H. and A. Sage: 1987, ‘Perspectives on Imperfect Information Processing’, IEEE Transactions on Systems SMC-17, 780–798.

    MathSciNet  Google Scholar 

  • Thompson, T.R.: 1985, ‘Parallel Formulation of Evidential Reasoning Theories’, Proceedings 8th IJCAI, Los Angeles, California, 321–327.

    Google Scholar 

  • White, A.: 1984, ‘Inference Deficiencies in Rule Based Expert Systems’, in Research and Development in Expert Systems, M.A. Bramer (ed.).

    Google Scholar 

  • Zadeh, L.A.: 1965, ‘Fuzzy Sets’, Information and Control 8, 338–353.

    Article  MathSciNet  MATH  Google Scholar 

  • Zadeh, L.A.: 1978, ‘Fuzzy Sets as a Basis for a Theory of Possibility’, Fuzzy Sets and Systems, North Holland, Amsterdam.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1991 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Kane, T.B. (1991). Reasoning with Maximum Entropy in Expert Systems. In: Grandy, W.T., Schick, L.H. (eds) Maximum Entropy and Bayesian Methods. Fundamental Theories of Physics, vol 43. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-3460-6_19

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-3460-6_19

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-5531-4

  • Online ISBN: 978-94-011-3460-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics