Skip to main content
SpringerLink
Log in
Book cover

Artificial Intelligence in Operational Research pp 349–356Cite as

Measuring Success and Failure in the Commercial Application of Expert Systems: ‘Hard’ Measures for ‘Soft’ Systems?

  • Chapter

Abstract

Commercial expert systems are undoubtedly moving from the sphere of research to that of development. This paper investigates how success may be appropriately measured as the system moves from prototype to commercial application. The paper begins by identifying criteria applicable to measuring the success of expert systems and considers the relationship between the criteria of measurement and the class of expert system, this classification being based upon the system’s objectives. Guidelines are offered which may address some of the difficulties in assessing potentially successful applications.

Earlier versions of this paper were presented at the Yorkshire and Humberside OR Group Conference on Successful Applications of Expert Systems, York, February 1987, and at the National OR Conference, Edinburgh, 1987.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Demb (1979) Computer Systems for Human Systems. Pergamon, Oxford.

    Google Scholar 

  2. M. Ginzberg (1974) A Detailed Look at Implementation Research. Sloan Working Paper 753–74, CISR-4, MIT Sloan School of Management, Cambridge, Massachusetts.

    Google Scholar 

  3. D. Shpilberg, E. Lynford and G. H. Schatz (1986) ExperTax, an expert system for corporate tax planning. Expert Systems 3(3) July.

    Google Scholar 

  4. J. McDermott (1983) R1: a rule-based configurer of computer systems. Artificial Intelligence, 19 (1).

    Google Scholar 

  5. R. Smith (1984) On the development of commercial expert systems. AI Magazine, Fall.

    Google Scholar 

  6. A. L. Kidd and M. B. Cooper (1985) Man-machine interface issues in the construction and use of an expert system, Int. J. Man Mach. Studies, 22, 91–102.

    Article  Google Scholar 

  7. R. Phelps (1986) AI: an overview of similarities with OR. J. Opl Res. Soc. 37, 13–20.

    Google Scholar 

  8. R. M. O’Keefe (1985) Expert systems and operational research — mutual benefits. J. Opl. Res. Soc. 36, 125–129.

    Article  Google Scholar 

  9. R. M. O’Keefe, V. Belton and T. Ball (1986) Experiences with using expert systems in OR. J. Opl Res. Soc. 37, 657–668.

    Article  Google Scholar 

  10. P. C. Bell (1986) Visual interactive modelling in operational research: success and opportunities. J. Opl Res. Soc. 36, 975–982.

    Article  Google Scholar 

  11. J. S. Edwards and J. L. Bader (1988) Expert systems for university admissions. J. Opl Res. Soc. 39, 33–40.

    Article  Google Scholar 

  12. T. Bowen and E. Payling (1987) Expert systems for performance review. J. Opl Res. Soc 38, 929–940.

    Article  Google Scholar 

  13. A. Barton (1987) Experiences in expert systems. J. Opl Res. Soc. 38, 965–974.

    Article  Google Scholar 

  14. P. G. W. Keen (1981) Value analysis: justifying decision support systems. MIS Quarterly 5, (1) March.

    Google Scholar 

  15. P. J. Steinbart (1986) The construction of a rule-based expert system as a method for studying materiality judgements. Accounting Review July.

    Google Scholar 

  16. P. Zakierski (1987) AReview of New Technology Evaluation techniques. Unpublished MSc Thesis, University of Southampton.

    Google Scholar 

  17. P. G. W. Keen and M. S. Scott-Morton (1978) Decision Support Systems: An Organisational Perspective. Addison-Wesley, Reading, Massachusetts.

    Google Scholar 

  18. R. H. Sprague and E. D. Carlson (1982) Building Effective Decision Support Systems. Prentice-Hall, Englewood Cliffs, New Jersey.

    Google Scholar 

  19. H. Barki and S. L. Huff (1985) Change, attitude to change, and decision support system success. Information and Management 9, 261–268.

    Article  Google Scholar 

  20. Y. Ijiri (1975) Theory of Accounting Measurement, Studies in Accounting Research no. 10. American Accounting Association.

    Google Scholar 

  21. M. Z. Bell (1985) Why expert systems fail. J. Opl Res. Soc. 36 (7) 613–619.

    Article  Google Scholar 

  22. E. O. Joslin (1965) Applications benchmarks: the key to meaningful computer evaluations. Association for Computing Machinery, Proceedings of the National Conference, vol. 20.

    Google Scholar 

  23. P. M. Q. Lay (1985) Beware of the cost/benefit model for IS project evaluations. Journal of Systems Management 36 (1), June.

    Google Scholar 

  24. M. P. Martin and J. E. Trumbly (1986) Measuring the performance of automated systems. Journal of Systems Management, 37 (2).

    Google Scholar 

  25. N. Ahituv (1980) A systematic approach toward assessing the value of an information system. MIS, Quarterly, December.

    Google Scholar 

  26. J. A. Senn (1978) Information Systems in Management. Wadworth, London.

    Google Scholar 

  27. C. F. Gibson (1975) A methodology for implementation research. In Implementing Operations Research/ Management Science, part II (R. L. Schultz and D. P. Selvin, Eds), pp. 53–73. Elsevier, Amsterdam.

    Google Scholar 

  28. J. Bachant and R. McDermott (1984) RI revised: four years in the trenches. AI Magazine, Fall.

    Google Scholar 

  29. F. M. Scherer (1979) Industrial Market Structure and Economic Performance Rand McNally International, New York.

    Google Scholar 

  30. G. R. Martins (1984) The overselling of expert systems. Datamation, 30 (18) November.

    Google Scholar 

  31. A. Newell (1985) Quoted in D. G. Bobrow and P. J. Hayes, Artificial intelligence — Where are we? Artificial Intelligence No. 25.

    Google Scholar 

  32. J. A. Breuker and B. J. Wielinga (1983) Analysis Techniques for Knowledge-based Systems. Report 1.1 of Esprit Project 12, University of Amsterdam, October.

    Google Scholar 

  33. S. Hayward (1986) A structured development methodology for expert systems. Proceedings of the KBS ’86 Conference. Online Publications, Pinner.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Accounting and Management Science, University of Southampton, UK

    N. A. D. Connell & P. L. Powell

Authors
  1. N. A. D. Connell
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. L. Powell
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Athens University of Economics and Business, Greece

    Georgios I. Doukidis

  2. London School of Economics and Political Science, UK

    Ray J. Paul

Copyright information

© 1992 Operational Research Society Ltd

About this chapter

Cite this chapter

Connell, N.A.D., Powell, P.L. (1992). Measuring Success and Failure in the Commercial Application of Expert Systems: ‘Hard’ Measures for ‘Soft’ Systems?. In: Doukidis, G.I., Paul, R.J. (eds) Artificial Intelligence in Operational Research. Palgrave, London. https://doi.org/10.1007/978-1-349-12362-9_33

Download citation

  • DOI: https://doi.org/10.1007/978-1-349-12362-9_33

  • Publisher Name: Palgrave, London

  • Print ISBN: 978-1-349-12364-3

  • Online ISBN: 978-1-349-12362-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation