Skip to main content

Identifiability, Estimability, and Extended Optimality Criteria

  • Chapter
  • First Online:
Book cover Design of Experiments in Nonlinear Models

Part of the book series: Lecture Notes in Statistics ((LNS,volume 212))

  • 2652 Accesses

Abstract

Among the major difficulties that one may encounter when estimating parameters in a nonlinear model are the nonuniqueness of the estimator, its instability with respect to small perturbations of the observations, and the presence of local optimizers of the estimation criterion. Classically, those issues are ignored at the design stage: the designs of Chap. 5 are based on asymptotic local properties of the estimator; the approaches of Chap. 6 make use of an assumption (\({\rm H}_{\mathcal{S}}\), p. 183) which allows us to avoid these difficulties. The main message of this chapter is that estimability issues can be taken into account at the design stage, through the definition of suitable design criteria. This forms a difficult area, still under development. Several new notions will be introduced, and a series of examples will illustrate the importance of the geometry of the model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Another possibility, not explored here, would be to use a more classical optimality criterion (see Chap. 5) while imposing a constraint on the extended measure of nonlinearity K int, α (X, θ) defined in (7.25).

  2. 2.

    This is true for almost any θ (in the sense of zero Lebesgue measure on compact subsets on ℝ 3); notice that the model is not identifiable for θ 1 = 0.

References

  • Atkinson, A., K. Chaloner, A. Herzberg, and J. Juritz (1993). Optimal experimental designs for properties of a compartmental model. Biometrics 49, 325–337.

    Article  MATH  Google Scholar 

  • Atkinson, A. and D. Cox (1974). Planning experiments for discriminating between models (with discussion). J. Roy. Statist. Soc. B36, 321–348.

    Google Scholar 

  • Bates, D. and D. Watts (1980). Relative curvature measures of nonlinearity. J. Roy. Statist. Soc. B42, 1–25.

    Google Scholar 

  • Chavent, G. (1983). Local stability of the output least square parameter estimation technique. Matematicada Applicada e Computacional 2(1), 3–22.

    MathSciNet  MATH  Google Scholar 

  • Chavent, G. (1987). Identifiability of parameters in the output least square formulation. In E. Walter (Ed.), Identifiability of Parametric Models, Chapter 6, pp. 67–74. Oxford: Pergamon.

    Google Scholar 

  • Chavent, G. (1990). A new sufficient condition for the wellposedness of non-linear least-square problems arising in identification and control. In A. Bensoussan and J. Lions (Eds.), Analysis and Optimization of Systems, Lecture Notes in Control and Inform. Sci., vol. 144, pp. 452–463. Springer.

    Google Scholar 

  • Chavent, G. (1991). New size × curvature conditions for strict quasiconvexity of sets. SIAM J. Control Optim. 29(6), 1348–1372.

    Article  MathSciNet  MATH  Google Scholar 

  • Clyde, M. and K. Chaloner (2002). Constrained design strategies for improving normal approximations in nonlinear regression problems. J. Stat. Plann. Inference 104, 175–196.

    Article  MathSciNet  MATH  Google Scholar 

  • Demidenko, E. (1989). Optimization and Regression. Moscow: Nauka. [In Russian].

    MATH  Google Scholar 

  • Demidenko, E. (2000). Is this the least squares estimate? Biometrika 87(2), 437–452.

    Article  MathSciNet  MATH  Google Scholar 

  • Hill, P. (1978). A review of experimental design procedures for regression model discrimination. Technometrics 20, 15–21.

    Article  MATH  Google Scholar 

  • Kieffer, M. and E. Walter (1998). Interval analysis for guaranteed nonlinear parameter estimation. In A. Atkinson, L. Pronzato, and H. Wynn (Eds.), MODA5 – Advances in Model-Oriented Data Analysis and Experimental Design, Marseilles (France), June 1998, pp. 115–125. Heidelberg: Physica Verlag.

    Chapter  Google Scholar 

  • Koopmans, T. and O. Reiersøl (1950). The identification of structural characteristics. Ann. Math. Statist. 21(2), 163–181.

    Article  Google Scholar 

  • Pázman, A. (1984a). Nonlinear least squares – uniqueness versus ambiguity. Math. Operationsforsch. Statist. Ser. Statist. 15, 323–336.

    MathSciNet  MATH  Google Scholar 

  • Pázman, A. (1993b). Nonlinear Statistical Models. Dordrecht: Kluwer.

    MATH  Google Scholar 

  • Pázman, A., S. Bilenkaya, J. Bystrický, Z. Janout, and F. Lehar (1969). The problem of un-ambiguity of phase-shift analysis I: Description of a powerful discriminating criterion. Czech J. Physics B19, 882–890.

    Google Scholar 

  • Pronzato, L. and E. Walter (2001). Eliminating suboptimal local minimizers in nonlinear parameter estimation. Technometrics 43(4), 434–442.

    Article  MathSciNet  Google Scholar 

  • Ross, G. (1990). Nonlinear estimation. New York: Springer.

    Book  MATH  Google Scholar 

  • Walter, E. (1982). Identifiability of State-Space Models. Berlin: Springer Verlag.

    Book  MATH  Google Scholar 

  • Walter, E. (Ed.) (1987). Identifiability of Parametric Models. Oxford: Pergamon Press.

    MATH  Google Scholar 

  • Walter, E. and L. Pronzato (1995). Identifiabilities and nonlinearities. In A. Fossard and D. Normand-Cyrot (Eds.), Nonlinear Systems. Modeling and Estimation, Chapter 3, pp. 111–143. London: Chapman & Hall.

    Google Scholar 

  • Walter, E. and L. Pronzato (1997). Identification of Parametric Models from Experimental Data. Heidelberg: Springer.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Pronzato, L., Pázman, A. (2013). Identifiability, Estimability, and Extended Optimality Criteria. In: Design of Experiments in Nonlinear Models. Lecture Notes in Statistics, vol 212. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-6363-4_7

Download citation

Publish with us

Policies and ethics