Skip to main content

Statistical validation for uncertainty models

  • Conference paper
  • First Online:
Feedback Control, Nonlinear Systems, and Complexity

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 202))

Abstract

Statistical model validation is treated for a class of parametric uncertainty models and also for a more general class of nonparametric uncertainty models. We show that, in many cases of interest, this problem reduces to computing relative weighted volumes of convex sets in R N (where N is the number of uncertain parameters) for parametric uncertainty models, and to computing the limit of a sequence (V k ) āˆž1 of relative weighted volumes of convex sets in R k for nonparametric uncertainty models. We then present and discuss a randomized algorithm based on gas kinetics for probable approximate computation of these volumes. We also review the existing Hit-and-Run family of algorithms for this purpose.

Finally, we introduce the notion of testability to describe uncertainty models that can be statistically validated with arbitrary reliability using input-output data records of sufficient (finite) length. It is then shown that some common nonparametric uncertainty models, such as those involving ā„“1 or H āˆž norms, do not possess this property.

Supported in part by the National Science Foundation under Grant ECS 89-57461, by gifts from Rockwell International, and by the Air Force Office of Scientific Research under a National Defense Science and Engineering Graduate Fellowship.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. D. Applegate and R. Kannan, ā€œSample and Integration of Near Logconcave Functions,ā€ Comp. Science report CMU, 1990.

    Google ScholarĀ 

  2. I. Barany and Z. Furedi, ā€œComputing the Volume Is Difficult,ā€ Proc. of the 18th Annual Symp. on Theory of Computing, pp. 442ā€“447, 1986.

    Google ScholarĀ 

  3. C. J. P. BĆ©lisle, H. E. Romejin, and R. L. Smith, ā€œHit-and-Run Algorithms for Generating Multivariate Distributions,ā€ Mathematics of Operations Research, 18, No. 2, 255ā€“266, 1993.

    Google ScholarĀ 

  4. M. Dahleh and J. B. Pearson, ā€œā„“1-Optimal controllers for MIMO discrete-time Systems,ā€ IEEE Trans. Automatic Control, vol. AC-32, pp. 314ā€“323, 1987.

    Google ScholarĀ 

  5. M. E. Dyer and A. M. Frieze, ā€œOn the Complexity of Computing the Volume of a Polyhedron,ā€ SIAM J. Computing, vol. 17, pp. 967ā€“974, 1988.

    Google ScholarĀ 

  6. B. A. Francis, A Course in H āˆž Control Theory, Spring-Verlag, 1987.

    Google ScholarĀ 

  7. B. K. Ghosh, Sequential Tests of Statistical Hypotheses, Addison-Wesley, Reading, 1970.

    Google ScholarĀ 

  8. G. C. Goodwin, B. Ninness, and M. E. Salgado, ā€œQuantification of Uncertainty in Estimation,ā€ Proc. of the 1990 ACC, pp. 2400ā€“2405, 1990.

    Google ScholarĀ 

  9. G. Gu and P. P. Khargonekar, ā€œLinear and Nonlinear Algorithms for Identification in H āˆž with Error Bounds,ā€ to appear in IEEE TAC, 1994.

    Google ScholarĀ 

  10. A. J. Helmicki, C. A. Jacobson, and C. N. Nett, ā€œIdentification in H āˆž: a Robustly Convergent Nonlinear Algorithm,ā€ Proc. of the 1990 ACC, pp. 386ā€“391, 1990.

    Google ScholarĀ 

  11. M. H. Karwan, ed., Redundancy in Mathematical Programming, Springer-Verlag, New York, 1983.

    Google ScholarĀ 

  12. M. J. Kearns and U. V. Vazirani, Topics in Computational Learning Theory, preprint, 1993.

    Google ScholarĀ 

  13. L. G. Khachiyan, ā€œOn the Complexity of Computing the Volume of a Polytope,ā€ Izvestia Acad. Nauk. SSSR Engr. Cybernetics, vol. 3, pp. 216ā€“217, 1988. (in Russian)

    Google ScholarĀ 

  14. R. L. Kosut, M. Lau and S. Boyd, ā€œIdentification of Systems with Parametric and Non-parametric Uncertainty,ā€ Proc. of the 1990 ACC, pp. 2412ā€“2417, 1990.

    Google ScholarĀ 

  15. J. M. Krause and P. P. Khargonekar, ā€œParameter Identification in the Presence of Non-parametric Dynamic Uncertainty,ā€ Automatica, vol. 26, pp. 113ā€“124, Jan. 1990.

    Google ScholarĀ 

  16. L. Lee and K. Poolla, ā€œStatistical Testability of Uncertainty Models,ā€ Proc. of the 1994 IFAC Symposium on System Identification, Copenhagen, 1994.

    Google ScholarĀ 

  17. L. H. Lee and K. Poolla, ā€œOn Statistical Model Validation,ā€ submitted to ASME Journal of Dynamic Systems, Measurement and Control.

    Google ScholarĀ 

  18. L. H. Lee and K. Poolla, ā€œStatistical Validation and Testability of Uncertainty Models,ā€ in preparation.

    Google ScholarĀ 

  19. E. L. Lehmann, Testing Statistical Hypotheses, Wiley, New York, 1986.

    Google ScholarĀ 

  20. L. Lin, L. Y. Wang and G. Zames, ā€œUncertainty Principles and Identification n-widths for LTI and Slowly Varying Systems,ā€ Proc. of the 1992 ACC, pp. 296ā€“300, 1992.

    Google ScholarĀ 

  21. L. Ljung, System Identification, Theory for the User, Prentice-Hall, Englewood Cliffs, New Jersey, 1987.

    Google ScholarĀ 

  22. L. Ljung and Z-D Yuan, ā€œAsymptotic Properties of Black-box Identification of Transfer Functions,ā€ IEEE TAC, vol. 30, pp. 514ā€“530, June 1985.

    Google ScholarĀ 

  23. P. M. MƤkilƤ and J. R. Partington, ā€œRobust Approximation and Identification in H āˆž,ā€ Proc. of the 1991 ACC, pp. 70ā€“76, 1991.

    Google ScholarĀ 

  24. S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability, Springer-Verlag, New York, 1993.

    Google ScholarĀ 

  25. A. Packard and J.C. Doyle, ā€œThe complex structured singular value,ā€ Automatica, vol. 29, no. 9, pp:71ā€“110, 1993.

    Google ScholarĀ 

  26. J. R. Partington, ā€œRobust Identification and Interpolation in H āˆž,ā€ Int. J. Contr., 54, pp. 1281ā€“1290, 1991.

    Google ScholarĀ 

  27. K. Poolla, P. P. Khargonekar, A. Tikku, J. Krause, and K. M. Nagpal, ā€œA Time-Domain Approach to Model Validation,ā€ IEEE TAC, vol. 39, no. 5, pp. 951ā€“959, 1994.

    Google ScholarĀ 

  28. K. Popper, Conjectures and Refutations, Harper and Row, 1963.

    Google ScholarĀ 

  29. M.G. Safonov, ā€œStability margins of diagonally perturbed multivariable feedback systems,ā€ IEE Proceedings, Part D, vol. 129, no. 6, pp:251ā€“256, 1982.

    Google ScholarĀ 

  30. R. L. Smith, ā€œEfficient Monte Carlo Procedures for Generating Points Uniformly Distributed over Bounded Regions,ā€ Operations Research, 32, No. 6, pp. 1296ā€“1308, 1984.

    Google ScholarĀ 

  31. R. Smith and J. C. Doyle, ā€œTowards a Methodology for Robust Parameter Identification,ā€ Proc. of the 1990 ACC, pp. 2394ā€“2399, 1990.

    Google ScholarĀ 

  32. R. Tempo and G. Wasilkowski, ā€œMaximum Likelihood Estimators and Worst Case Optimal Algorithms for System Identification,ā€ Systems and Control Letters, vol. 10, pp. 265ā€“270, 1988.

    Google ScholarĀ 

  33. D. N. C. Tse, M. A. Dahleh, and J. N. Tsitsiklis, ā€œOptimal Asymptotic Identification under Bounded Disturbancesā€, Proc. of the 1991 ACC, pp. 1786ā€“1787, 1991.

    Google ScholarĀ 

  34. L. G. Valiant, ā€œA Theory of the Learnable,ā€ Communications of the ACM, vol. 27, pp. 1134ā€“1142, 1984.

    Google ScholarĀ 

  35. R. C. Younce and C. E. Rohrs, ā€œIdentification with Non-parametric Uncertainty,ā€ Proc. of the 1990 CDC, pp. 3154ā€“3161, 1990.

    Google ScholarĀ 

  36. G. Zames, ā€œOn the metric complexity of causal linear systems: Īµ-entropy and Īµ-dimension for continuous timeā€ IEEE Trans. on Auto. Contr., vol. AC-24, pp. 222ā€“230, 1979.

    Google ScholarĀ 

  37. T. Zhou and H. Kimura, ā€œTime domain identification for robust control,ā€ Systems and Control Letters, vol. 20, pp. 167ā€“178, 1993.

    Google ScholarĀ 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Bruce Allen Francis Allen Robert Tannenbaum

Additional information

Dedicated to Professor George Zames on the occasion of his sixtieth birthday

Rights and permissions

Reprints and permissions

Copyright information

Ā© 1995 Springer-Verlag London Limited

About this paper

Cite this paper

Lee, L.H., Poolla, K. (1995). Statistical validation for uncertainty models. In: Francis, B.A., Tannenbaum, A.R. (eds) Feedback Control, Nonlinear Systems, and Complexity. Lecture Notes in Control and Information Sciences, vol 202. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0027675

Download citation

  • DOI: https://doi.org/10.1007/BFb0027675

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-19943-4

  • Online ISBN: 978-3-540-39364-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics