Abstract
We give a general overview of the state of the art in subspace system identification methods. We have restricted ourselves to the most important ideas and developments since the methods appeared in the late eighties. First the basics of linear subspace identification are summarized. Different algorithms one finds in literature (such as N4SID IV-4SID MOESP CVA) are discussed and put into a unifying framework. Further a comparison between subspace identification and prediction error methods is made on the basis of computational complexity and precision of the methods by applying them on 10 industrial datasets. Also the issue of statistical consistency of subspace identification methods is briefly discussed. Some extensions of linear subspace methods to other classes of systems such as continuous-time systems bilinear systems time-periodic systems etc. are given. Current software developments and trends in the field of system identification are also discussed including a general public domain database called DAISY containing numerous datasets that can be used to validate system identification algorithms.
F.W.O. Vlaanderen
Institute for Science and Technology, Flanders
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ainsleigh P.L.Observations on oblique projectors and pseudoinverses.IEEE Transactions on Signal Processing, vol. 45, no. 7, July 1997, pp. 1886–1888.
Akaike H.Markovian representation of stochastic processes by canonical variables.Siam J. Control, vol. 13, no. 1, pp. 162–173, 1975.
Aling H., Milletti U., Kosut R.L., Mesaros M.P., Van Overschee P., De Moor B.An interactive system identification module for Xmath.Proc. of the American Control Conference, June 2–4, San Francisco, CA, USA, pp. 3071–3075, 1993.
Aling H., Kosut R., Van Overschee P., De Moor B., Boyd S.Xmath Interactive System Identification Module Part 1.Integrated Systems Inc., Santa Clara, CA, USA, 1993.
Anderson E., Bai Z., Bischof C., Demmel J., Dongarra J., Du Croz J., Greenbaum A., Hammaling S., McKenney A., Ostrouchov S., Sorensen D.LAPACK Users’ Guide Second Edition.Siam, 1995.
Aström K., Eykhoff P.System identification - A survey.Automatica, vol. 7, pp. 123–167, 1971.
Bastogne T., Gamier H., Sibille P., Mensler M.PMF-based subspace method for continuous-time model identification; Deterministic study.SYSID ‘87, 11th IFAC Symposium on System IdentificationEds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 4, p. 1665–1670, Kitakyushu, Japan, July 8–11, 1997.
Bauer D., Deistler M., Scherrer W.The analysis of the asymptotic variance of subspace algorithms.SYSID ‘87, 11th IFAC Symposium on System IdentificationEds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 3, p. 1087–1091, Kitakyushu, Japan, July 8–11, 1997.
Box G.E., Jenkins G.M.Time series analysis forecasting and control.Revised edition, Holden-Day series in time series analysis and digital processing, Holden-Day, Oakland, CA, 1976.
Cho Y.M., Xu G., Kailath T.Fast Recursive Identification of State Space Models via Exploitation of Displacement Structure.Automatica, Special Issue on Statistical Signal Processing and Control, vol. 30, no. 1, pp. 45–59, 1994.
Cho Y.M., Xu G., Kailath T.Fast Identification of State Space Models via Exploitation of Displacement Structure.IEEE Transactions on Automatic Control, vol. AC-39, no. 10, 1994.
Christodoulou M.A., Mertzios B.G.Realization of singular systems via Markov parameters, Int. Journal Control, 42, No. 6, pp. 1433–1441, 1985.
Chui N.L.C., Maciejowski J.M.Realization of stable models with subspace methods.Automatica, vol. 32, no. 11, pp. 1587–1595, 1996.
De Cock K., De Moor B.Identification of the first order parameters of a circulant modulated Poisson process, Internal Report 97–104 Department of Electrical Engineering, Katholieke Universiteit Leuven, Belgium, 1997.
Desai U. B.Realization of bilinear stochastic systems, IEEE Transactions on Automatic Control, vol. AC-31, no. 2, pp. 189–192, 1986.
Deistler M., Peternell K., Scherrer W.Consistency and Relative Efficiency of Subspace Methods.Proc. of SYSID ‘84, vol. 2, 4–6 July, Copenhagen, Denmark, pp. 157–163, 1994.
Deistler M., Peternell K., Scherrer W.Consistency and relative efficiency of subspace methods, Automatica, vol. 31, pp. 1865–1875, 1995.
De Moor B., Vandewalle J., Ageometrical strategy for the identification of state space models of linear multivariable systems with singular value decomposition.Proc. of the 3rd International Symposium on Applications of Multivariable System Techniques, April 13–15, Plymouth, UK, pp. 59–69, 1987.
De Moor B.Mathematical concepts and techniques for modeling of static and dynamic systems.PhD thesis, Department of Electrical Engineering, Katholieke Universiteit Leuven, Belgium, 1988.
De Moor B.Numerical algorithms for state space subspace system identification.Academia Analecta, Klasse der Wetenschappen, Koninklijke Akademie voor Wetenschappen, Jaargang 55, no. 5, België, 1994.
De Moor B., Van Overschee P.Graphical User Interface Software for System Identification, Award winning paper of theSiemens Award 1994.ESAT-SISTA Report 94–06I, Department of Electrical Engineering, Katholieke Universiteit Leuven, 1994.
De Moor B., Van Overschee P.Numerical Algorithms for Subspace State Space System Identification.Springer, Trends in Control. A European Perspective. Ed. A. Isidori, European Control Conference, Italy, pp. 385–422, 1995.
De Moor B., De Gersem P., De Schutter B., Favoreel W.DAISY: A database for identification of systems, Journal A, Special Issue on CACSD (Computer Aided Control Systems Design), vol. 38, no. 3, pp. 4–5, September 1997.
España M., Landau I.D.Reduced order models of distillation columns, Automatica, vol. 14, pp. 345–357, 1978.
Eykhoff P.System identification.Wiley, London, 1974.
Faurre P.Stochastic realization algorithms.System Identification: Advances and case studies (Eds.) Mehra R., Lainiotis D., Academic Press, 1976.
Favoreel W., De Moor B., Van Overschee P.Subspace identification of bilinear systems subject to white inputs, Internal Report 96–53, Department of Electrical Engineering, Katholieke Universiteit Leuven, Belgium, Accepted for publication in the IEEE Transactions on Automatic Control, 1996.
Favoreel W., De Moor B., Overschee P.A bilinear extension of subspace identification for systems subject to white inputs, in Proc. of the American Control Conference (ACC’97), Alburquerque, NM, pp. 607–611, June 1997.
Favoreel W., De Moor B., Van Overschee P.Subspace identification of balanced deterministic bilinear systems subject to white inputs, in Proc. of the European Control Conference (ECC’97), Brussels, Belgium, July 1997.
Gustafsson I., Ljung L., Söderström T.Identification of Processes in Closed-Loop - Identifiability and Accuracy Aspects.Automatica, vol. 13, pp. 59–75, 1977.
Gustafsson T.System identification using subspace-based instrumental variable methods.SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 3, p. 1119–1124, Kitakyushu, Japan, July 8–11, 1997.
Haverkamp B., Verhaegen M., Chou C., Johansson R.Continuous-time subspace model identification method using Laguerre filtering. SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 3, p. 1143–1148, Kitakyushu, Japan, July 8–11, 1997.
Hench J.J.Identification of linear periodic state space models.Int. J. Control, vol. 62, no. 2, pp. 289–302, 1995.
Hakvoort R.Approximate Identification in the controller design problem.Master Thesis, Delft University of Technology, The Netherlands, Measurement and Control Theory Section, Mech, Eng., A-538, 1990.
Ho B.L., Kalman R.E.Efficient construction of linear state variable models from input/output functions.Regelungstechnik, vol. 14, pp. 545–548,1966.
Jansson M., Wahlberg B.On consistency of subspace based system identification methods.Proc. 13th IFAC World Congress, San Francisco, CA, 1996, pp. 181–186.
Jansson M., Wahlberg B.A linear regression approach to state-space subspace system identification, Signal Processing, Special Issue on Subspace Methods, Part II: System Identification, vol. 52, pp. 103–129, 1996.
Jansson M., Wahlberg B.Counterexample to general consistency of subspace system identification.SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 4, p. 1677–1682, Kitakyushu, Japan, July 8–11, 1997.
Khatri C.G., Rao C.R.Solutions to some function equations and their applications to characterization of probability distributions, The Indian J. Stat., vol. 30, pp. 167–180, 1968.
Kailath T.Linear Systems.Prentice Hall, Englewood Cliffs, NJ, 1980.
Kung S.Y.A new identification method and model reduction algorithm via singular value decomposition.12th Asilomar Conf. on Circuits, Systems and Comp., pp. 705–714, Asilomar, CA, USA, 1978.
Larimore W.E.System identification reduced order filtering and modeling via canonical variate analysis.Proc. of the American Control Conference, San Francisco, CA, USA, pp. 445–451, 1983.
Larimore W.E.Canonical variate analysis in identification filtering and adaptive control.Proc. 29th Conference on Decision and Control, Hawaii, USA, pp. 596–604, 1990.
Larimore W.E.ADAPTX Automated System Identification Software Users Manual, Adaptics, Inc., 40 Fairchild Drive, Reading, MA 01867, USA.
Larimore W.E.Optimal Order Selection and Efficiency of Canonical Variate Analysis System Identification.Proc. of the World Congress of the International Federation of Automatic Control, IFAC, vol. I, pp. 151–156, San Francisco, CA, USA, 1996.
Leontieff W.Essays in Economics, M.E. Sharp, New York, 1977.
Lewis F.L., Marszalek W., Mertzios B.G.Walsh function analysis of 2-D generalized continuous systems, IEEE Trans. Automat. Control 35, No. 10, pp. 1140–1144, 1990.
Lewis F.L., Asurvey of linear singular systems, Circuits, Syst., Signal Processing, 5, No. 1, pp. 3–36, 1986.
Liu K., Skelton R.E., Identification and Control of NASA’s ACES Structure. Proceedings American Control Conference, Boston, MA, USA, pp. 3000–3006, 1991.
Liu K.Identification of Multi-Input and Multi-Output Systems by Observability Range Space Extraction.Proc. 31st Conference on Decision and Control, Tucson, AZ, USA, pp. 915–920, 1992.
Liu K., Jacques R.N., Miller D.W.Frequency Domain Structural System Identification by Observability Range Space Extraction. Proc. of the American Control Conference, Baltimore, MD, vol. 1, pp. 107–111, 1994.
Ljung L.System identification - Theory for the User.Prentice Hall, Englewood Cliffs, NJ, 1987.
Ljung L. ASimple Start- Up Procedure for Canonical Form State Space Identification Based on Subspace Approximation.30th IEEE Conference on Decision and Control, Brighton, UK, pp. 1333–1336, 1991.
Ljung L.System Identification Toolbox For Use withMATLAB. The Mathworks Inc., MA, USA, 1991.
Ljung L., McKelvey T.Subspace Identification from Closed Loop Data.Signal Processing, Special Issue on Subspace Methods, Part II: System Identification, vol. 52, No. 2, pp. 209–216, 1996. (See also Internal Report LiTH-ISY-R-1752, Department of electrical engineering, Linköping University, Sweden, 1995 for the MATLAB code).
Ljung L.Developments for the system identification toolbox forMAT-LAB. SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 2, pp. 969–973, Kitakyushu, Japan, July 8–11, 1997.
Ljung L., McKelvey T.Interpretation of subspace methods: Consistency analysis.SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 3, pp. 1125–1129, Kitakyushu, Japan, July 8–11, 1997.
Lo K., Yoon E.S., Yeo Y.K., Song H.K.Application of a bilinear long-range predictive control method in a distillation process, IFAC Dynamics and Control of Chemical Reactors (DYCORD+’92), MD, USA, pp. 249–254, 1992.
McKelvey T.On State-Space Models in System Identification, Thesis no. 447, Department of Electrical Engineering, Linköping University, Sweden, 1994.
McKelvey T.An Efficient Frequency Domain State-Space Identification Algorithm.Proc. 33rd IEEE Conference on Decision and Control, Lake Buena Vista, FL, USA, 14–16 December, pp. 3359–3364, 1994.
McKelvey T.SSID - AMATLABToolbox for Multivariable State-Space Model Identification.Dept. of EE, Linköping University, Linköping, Sweden, 1994.
Mohler R.R.Nonlinear systems: V.2 Applications to bilinear systems, Englewood Cliffs, NJ: Prentice-Hall, 1991.
Moonen M., De Moor B., Vandenberghe L., Vandewalle J.On and offline identification of linear state space models.International Journal of Control, vol. 49, no. 1, pp. 219–232, 1989.
Moonen M., De Moor B., Vandewalle J.SVD-based subspace methods for multivariable continuous time system identification.Identification of continuous-time systems, Methodology and Computer Implementation; G.P. Rao, N.K. Sinha (Eds.), Kluwer Academic Publications, pp. 473–488, 1991.
Moonen M., De Moor B., Ramos J., Tan S.A subspace identification algorithm for descriptor systems. Systems & Control Letters, vol. 19, pp. 47–52, 1992.
Moore B.C.Principal component analysis in linear systems: Controllability Observability and Model Reduction.IEEE Transactions on Automatic Control, vol. AC-26, no. 1, pp. 17–32, 1981.
Masafumi Okada, Hiroaki Fukushima, Toshiharu Sugie.Joint design of model-subspace based state space identification and control.SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 3, pp. 1155–1160, Kitakyushu, Japan, July 8–11, 1997.
Ottersten B., Viberg M.A Subspace Based Instrumental Variable Method for State Space System Identification. Proc. of SYSID ‘84, vol. 2, 4–6 July, Copenhagen, Denmark, pp.139–144, 1994.
Picci G.Statistical properties of certain subspace identification algorithms.SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 3, pp. 1093–1099, Kitakyushu, Japan, July 8–11, 1997.
Söderström T., Stoica P.System Identification.Prentice Hall International Series in Systems and Control Engineering, Prentice Hall, New York, 1989.
Schoukens J., Pintelon R., Guillaume P.Identification of linear systems: a practical guideline to accurate modeling.Pergamon Press, London, UK, 1991.
Sorelius J., Söderström T., Stoica P., Cedervall M.Order estimation method for subspace-based system identification.SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 3, pp. 1131–1136, Kitakyushu, Japan, July 8–11, 1997.
Van den Hof P.Closed-loop issues in system identification.SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi&Setsuo Sagara, vol. 4, pp. 1651–1664, Kitakyushu, Japan, July 8–11, 1997.
Van Der Veen A., Deprettere E.F., Swindlehurst A.L.Subspace-Based Signal Analysis Using Singular Value Decompositions.Proceedings of the IEEE, vol. 81, no. 9, pp. 1277–1308, 1993.
Van Overschee P., De Moor B.Subspace algorithms for the stochastic identification problem.Automatica, vol. 29, no. 3, 1993, pp. 649–660.
Van Overschee P., De Moor B., Aling H., Kosut R., Boyd S.Xmath Interactive System Identification Module Part 2.Integrated Systems Inc., Santa Clara, CA, USA, 1994.
Van Overschee P., De Moor B.N4SID: Subspace Algorithms for the Identification of Combined Deterministic-Stochastic Systems.Automatica, Special Issue on Statistical Signal Processing and Control, vol. 30, no. 1, pp. 75–93, 1994.
Van Overschee P., De Moor B., Boyd S., Aling H., Kosut R.A fully interactive system identification module for Xmath (ISID), Proc. of SYSID ‘84, vol. 4, Copenhagen, Denmark, pp. 1, 1994.
Van Overschee P., De Moor B.A unifying theorem for three subspace system identification algorithms, Automatica, Special Issue on Trends in System Identification, vol. 31, no. 12, December 1995, pp. 1853–1864.
Van Overschee P., De Moor B.Choice of State Space Basis in Combined Deterministic-Stochastic Subspace Identification.Automatica, vol. 31, no. 12, pp. 1877–1883, 1995.
Van Overschee P., De Moor B.Continuous-time frequency domain subspace system identification, Signal Processing, Special Issue on Subspace methods, part II: System identification, vol. 52, 1996, pp. 179–194.
Van Overschee P., De Moor B.Closed loop subspace system identification, Katholieke Universiteit Leuven, Electrical Engineering Department, Internal Report 1996–52I.
Van Overschee P., De Moor B., Dehandschutter W., Swevers J., Asubspace algorithm for the identification of discrete time frequency domain power spectra, in Proc. of the 11th IFAC Symposium on System Identification (SYSID’97 SICE), Fukuoka, Japan, Jul. 1997, pp. 1149–1154.
Van Overschee P., De Moor B.Subspace identification for linear systems; Theory Implementation Applications.Kluwer Academic Publishers, Dordrecht, Spring 1996, 250 pp. (with MATLAB floppy included), (ISBN: 0–7923–9717–7).19
Verhaegen M., Dewilde P.Subspace model identification Part I: The output-error state space model identification class of algorithms.Int. J. Control, vol. 56, 1187–1210, 1992;Part II: Analysis of the elementary output-error state space model identification algorithm, vol. 56, no. 5, pp. 1211–1241;Part III: Analysis of the ordinary output error state space model identification algorithm, vol. 58, no. 3, pp. 555–586, 1993.
Verhaegen M.Application of a Subspace Model Identification Technique to Identify LTI Systems Operating in Closed-Loop.Automatica, vol. 29, no. 4, pp. 1027–1040, 1993.
Verhaegen M.Identification of the deterministic part of MIMO state space models given in innovations form from input-output data, Automatica (Special Issue on Statistical Signal Processing and Control), vol. 30, no. 1, pp. 61–74, 1994
Verriest E.I., Kullstam J.A.Realization of discrete-time periodic systems from input-output data.Int. Report, Georgia Tech, Lorraine, 1994, submitted for publication.
Viberg M., Ottersten B., Wahlberg B., Ljung L.Performance of Subspace Based State Space System Identification Methods.Proc. of the 12th IFAC World Congress, Sydney, Australia, 18–23 July, vol. 7, pp. 369–372, 1993.
Viberg M.Subspace Methods in System Identification.Proc. of SYSID ‘84, vol. 1, 4–6 July, Copenhagen, Denmark, pp. 1–12, 1994.
Viberg M.Subspace-based methods for the identification of linear time-invariant systems.Automatica, 31, (12), pp. 1835–1852, 1995.
Viberg M., Wahlberg B., Ottersten B.Analysis of state space system identification methods based on instrumental variables and subspace fitting.Automatica, vol. 33, no. 9, pp. 1603–1616, 1997.
Willems J.From time series to linear systems.Automatica, Part I: Finite Dimensional Linear Time Invariant Systems, vol. 22, no. 5, pp. 561–580, 1986, Part II: Exact Modeling, vol. 22, no. 6, pp. 675694, 1986, Part III: Approximate modeling, vol. 23, no. 1, pp. 87–115, 1987.
Xiaode Y., Verhaegen M.An algorithm of subspace model identification for descriptor systems, ECC 95, European Control Conference, vol. 1, pp. 417–422.
Zeiger H., McEwen A.Approximate linear realizations of given dimension via Ho’s algorithm.IEEE Transactions on Automatic Control, vol. 19, pp. 153, 1974.
Zi-Jiang Yang, Setsuo Sagara, Kiyoshi Wada., Subspace model identification for continuous-time systems. SYSID ‘87, 11th IFAC Symposium on System Identification, Eds: Yoshikazu Sawaragi & Setsuo Sagara, vol. 4, pp.1671–1676, Kitakyushu, Japan, July 8–11, 1997.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer Science+Business Media New York
About this chapter
Cite this chapter
De Moor, B., Van Overschee, P., Favoreel, W. (1999). Algorithms for Subspace State-Space System Identification: An Overview. In: Datta, B.N. (eds) Applied and Computational Control, Signals, and Circuits. Birkhäuser, Boston, MA. https://doi.org/10.1007/978-1-4612-0571-5_6
Download citation
DOI: https://doi.org/10.1007/978-1-4612-0571-5_6
Publisher Name: Birkhäuser, Boston, MA
Print ISBN: 978-1-4612-6822-2
Online ISBN: 978-1-4612-0571-5
eBook Packages: Springer Book Archive