The Identification and Estimation of Nonlinear Stochastic Systems

  • Peter Young


This chapter describes what might be called the system theorist’s approach to understanding dynamics of nonlinear stochastic systems. The method uses so-called state-dependent parameters, and is able to handle non-stationarity, as long as the state-dependent parameters vary slowly compared to the significant dynamics. One of the main points made here is that most realistic systems have time-varying inputs which can be measured; models must take this into account, and indeed modeling often becomes easier rather than harder when this is done. We describe the methods used, based on recursive fixed-interval smoothing, and present applications to some realistic problems.


Random Walk Model Nonlinear Stochastic System White Noise Input Generalize Random Walk Squid Data 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Brown, R.L., Durbin, J. and Evans, J. M. (1975) ‘Techniques for testing the constancy of regression relationships over time’, Jnl. Royal Stat. Soc., Series B, 37, 141–192.MathSciNetMATHGoogle Scholar
  2. Bryson, A. E. and Ho, Y. C. (1969) ‘Applied Optimal Control’, Blaisdell Publishing Company, Waltham (Mass).Google Scholar
  3. Daubechies, I. (1988) ‘Orthonormal bases of compactly supported wavelets’, Communications on Pure Applied Mathematics, 41, 906–966.Google Scholar
  4. Dempster, A. P., Laird, N. M. and Rubin, D. B. (1977) ‘Maximum likelihood from incomplete data via the EM algorithm’, Jnl. Royal Stat. Soc., Series B, 39,1–38.MathSciNetMATHGoogle Scholar
  5. Fawcett, C. (1999) ‘Data-based mechanistic modelling of nonlinear environmental systems’, Ph.D Thesis, Centre for Research on Environmental Systems and Statistics, Lancaster University.Google Scholar
  6. Harvey, A. C. (1981) ‘Time Series Models’, Phillip Allen, Oxford.MATHGoogle Scholar
  7. Harvey, A. C. (1984) ‘A unified view of statistical forecasting procedures’ (with comments), Jnl. of Forecasting, 3, 245–283.CrossRefGoogle Scholar
  8. Harvey, A. C., ‘Forecasting Structural Time Series Models and the Kalman Filter’, Cambridge, Cambridge University Press, 1989.Google Scholar
  9. Harvey, A. C. and Peters, S. (1990) ‘Estimation procedures for Structural Time Series Models’, Journal of Forecasting, 9, 173–204.CrossRefGoogle Scholar
  10. Hastie, T. J. and Tibshirani, R. J. (1996) ‘Generalized Additive Models’, Chapman and Hall, London.Google Scholar
  11. Holst, U., Hssjer, O., Bjrklund, C., Ragnarsson, P., and Edner, H. (1996) ‘Locally weighted least squares kernel regression and statistical evaluation of LIDAR measurements’, Environmetrics, 7, 410–416.CrossRefGoogle Scholar
  12. Jakeman, A. J. and Young, P. C. (1979) ‘Recursive filtering and the inversion of ill-posed causal problems’, ORES Report No. AS/R28/1979, Centre for Resource and Environmental Studies, Australian National University.Google Scholar
  13. Jakeman, A. J. and Young, P. C. (1984) ‘Recursive filtering and the inversion of ill-posed causal problems’, Utilitas Mathematica, 35, 351–376.MathSciNetGoogle Scholar
  14. Kitagawa, G. (1981) ‘A non-stationary time series model and its fitting by a recursive filter’, Jul. of Time Series Anal., 2, 103–116.MathSciNetMATHCrossRefGoogle Scholar
  15. Mees, A. I. (1993) ‘Parsimonious dynamical reconstruction’, International Journal of Bifurcation and Chaos, 3(3), 669–675.MathSciNetMATHCrossRefGoogle Scholar
  16. Mees, A. I. (1991) ‘Dynamical systems and tesselations: detecting determinism in data’, International Journal of Bifurcation and Chaos, 1(4), 777–794.MathSciNetMATHCrossRefGoogle Scholar
  17. Mees, A. I., Aihara, K., Adachi, M., Judd, K., Ikeguchi, T. and Matsumoto, G. (1992) ‘Deterministic prediction and chaos in squid axon response’, Physics Letters A 169, 41–45.CrossRefGoogle Scholar
  18. Ng, C. N. and Young, P. C. (1990) ‘Recursive estimation and forecasting of non-stationary time-series’, Jnl. of Forecasting, 9, 173–204.CrossRefGoogle Scholar
  19. Pedregal, D. J. and Young, P. C. (1996) ‘Modulated cycles, a new approach to modelling seasonal/cyclical behaviour in unobserved component models’, Centre for Research on Environmental Systems and Statistics (CRES), Tech. Note No. TR/145.Google Scholar
  20. Pedregal, D. J. and Young, P. C. (1998) ‘Extensions of trend models in unobserved component models’, Centre for Research on Environmental Systems and Statistics (CRES), Tech. Note No. TR/156.Google Scholar
  21. Schweppe, F. (1965) ‘Evaluation of likelihood function for Gaussian signals’, I.E.E.E. Transactions on Information Theory, 11, 61–70.MathSciNetMATHCrossRefGoogle Scholar
  22. Young, P. C. (1969) ‘Applying parameter estimation to dynamic systems: Part 1, Theory’, Control Engineering, 16, 10, 119–125; ‘Part li Applications’, 16, 11, 118–124.Google Scholar
  23. Young, P. C. (1970) ‘An instrumental variable method for real-time Identification of a noisy process’, Automatica, 6, 271–287.CrossRefGoogle Scholar
  24. Young, P. C. (1978) ‘A general theory of modeling for badly defined dynamic systems’, in G.C. Vansteenkiste (ed.), Modeling, Identification and Control in Environmental Systems, North Holland, Amsterdam, 103–135.Google Scholar
  25. Young, P. C. (1983) ‘The validity and credibility of models for badly defined systems’, in M.B. Beck and G. Van Straten (eds.), Uncertainty and Forecasting of Water Quality, Springer Verlag, Berlin, 69–100.CrossRefGoogle Scholar
  26. Young, P. C. (1984) ‘Recursive Estimation and Time-Series Analysis’, Springer-Verlag, Berlin.CrossRefGoogle Scholar
  27. Young, P.C. (1985) ‘The instrumental variable method: a practical approach to identification and system parameter estimation’, in H.A. Barker and P.C. Young (eds.), Identification and System Parameter Estimation, Pergamon Press, Oxford, 1–16Google Scholar
  28. Young, P. C. (1988) ‘Recursive extrapolation, interpolation and smoothing of non-stationary time series’, in Chen, C.F. (ed.), Identification and System Parameter Estimation, Pergamon Press, Oxford, 33–44.Google Scholar
  29. Young, P.C. (1992) ‘Parallel processes in hydrology and water quality: a unified time series approach’, Jnl. Inst. of Water and Env. Man., 6, 598–612,.CrossRefGoogle Scholar
  30. Young, P. C. (1993a) ‘Time variable and state dependent modelling of nonstationary and nonlinear time series’, in SubbaRao, T. (ed.), Developments in Time Series Analysis, Chapman and Hall, London, 374–413.Google Scholar
  31. Young, P. C. (1993b) ‘Concise Encyclopedia of Environmental Systems’, Oxford: Pergamon Press.Google Scholar
  32. Young, P. C. (1994) ‘Time-variable parameter and trend estimation in non-stationary economic time series’, Journal of Forecasting, 13, 179–210.CrossRefGoogle Scholar
  33. Young, P.C. (1996) ‘A general approach to identification, estimation and control for a class of nonlinear dynamic systems’, in M. L Friswell and J. E. Mottershead (eds.) Identification in Engineering Systems, University of Wales, Swansea, 436–445.Google Scholar
  34. Young, P. C. (1998a) ‘Data-based mechanistic modelling of environmental, ecological, economic and engineering systems’, Environmental Modelling and Software, 13, 105–122.CrossRefGoogle Scholar
  35. Young, P. C. (1998b) ‘Data-based mechanistic modelling of engineering systems’, Journal of Vibration and Control, 4, 5–28.CrossRefGoogle Scholar
  36. Young, P. C. (1999a) ‘Nonstationary time series analysis and forecasting’, Progress in Environmental Science, 1, 3–48.Google Scholar
  37. Young, P. C. (1999b) ‘Data-based mechanistic modelling, generalised sensitivity and dominant mode analysis’, Computer Physics Communications, 115, 1–17.Google Scholar
  38. Young, P. C. (1999c) ‘Data-based mechanistic modelling and validation of rainfall-flow processes’, in M. G. Anderson (ed.), Model Validation in Hydrological Science, J. Wiley, Chichester, in press.Google Scholar
  39. Young, P. C. (1999d) ‘Stochastic, dynamic modelling and signal processing: time variable and state dependent parameter estimation’, in W. J. Fitzgerald, A. Walden, R. Smith and P. C. Young (eds.), Nonstationary and Nonlinear Signal Processing, Cambridge University Press, Cambridge, in press.Google Scholar
  40. Young, P. C. and Beven, K.J. (1994) ‘Data-based mechanistic modelling and the rainfall-flow nonlinearity’, Environmetrics, 5, 335–363.CrossRefGoogle Scholar
  41. Young, P. C. and Lees, M. J. (1993) ‘The Active Mixing Volume (AMV): a new concept in modelling environmental systems’, Chapter 1 in V. Barnett and K.F. Turkman (eds.), Statistics for the Environment. J. Wiley, Chichester, 3–44.Google Scholar
  42. Young, P. C. and Minchin, P. (1991) ‘Environmetric time-series analysis: modelling natural systems from experimental time-series data’, Int. Jnl. Biol. Macromol., 13, 190–201.CrossRefGoogle Scholar
  43. Young, P. C. and Ng, C. N. (1989) ‘Variance intervention’, Journal of Forecasting, 8, 399–416.CrossRefGoogle Scholar
  44. Young, P. C. and Pedregal, D. J. (1996) ‘Recursive fixed interval smoothing and the evaluation of LIDAR measurements’, Environmetrics, 7, 417–427.CrossRefGoogle Scholar
  45. Young, P. C. and Pedregal, D. J. (1997) ‘Data-based mechanistic modelling’, in Heij, C., Hanzon, B. and Paggman, K. (eds.), System Dynamics in Economic and Financial Models, J. Wiley, Chichester, 169–213.Google Scholar
  46. Young, P. C. and Pedregal, D. J. (1998) ‘Recursive and en-bloc approaches to signal extraction’, Journal of Applied Statistics, 26, 103–128.MathSciNetCrossRefGoogle Scholar
  47. Young, P. C. and Pedregal, D. J. (1999) ‘Macro-economic relativity: government spending, private investment and unemployment in the USA 1948–1998’, Structural Change and Economic Dynamics, 10, 359–380.CrossRefGoogle Scholar
  48. Young, P.C. and Runkle, D. E. (1989) ‘Recursive estimation and modelling of non-stationary and nonlinear time series’, Adaptive Systems in Control and Signal Processing, Vol. 1, IFAC/Inst. Measurement and Control, London, 49–64.Google Scholar
  49. Young, P.C., Schreider, S. Yu., and Jakeman, A.J. (1997) ‘A streamflow forecasting algorithm and results for the Upper Murray Basin’, Proc. MODSIM 97 Congress on Modelling and Simulation, Hobart, Tasmania.Google Scholar
  50. Young, P.C., Jakeman, A.J. and Post, D. (1998) ‘Recent advances in the data-based modelling and analysis of hydrological systems’, Water Science and Technology, 36, 99–116.CrossRefGoogle Scholar
  51. Young, P. C., Lane, K., Ng, C. N. and Parker, D. (1991) ‘Recursive forecasting, smoothing and seasonal adjustment of non-stationary environmental data’, Journal of Forecasting, 10, 57–89.CrossRefGoogle Scholar
  52. Young, P. C., Ng, C. N. and Armitage, P. (1989) ‘A systems approach to economic forecasting and seasonal adjustment’, International Journal on Computers and Mathematics with Applications, 18, 481–501.MATHCrossRefGoogle Scholar
  53. Young, P. C., Pedregal, D. J. and Tych, W. (1999) ‘Dynamic harmonic regression’, Journal of Forecasting, 18, 369–394.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2001

Authors and Affiliations

  • Peter Young

There are no affiliations available

Personalised recommendations