Model selection approaches for non-linear system identification: a review

Hong, X. ORCID: https://orcid.org/0000-0002-6832-2298, Mitchell, R. J., Chen, S., Harris, C. J., Li, K. and Irwin, G. W. (2008) Model selection approaches for non-linear system identification: a review. International Journal of Systems Science, 39 (10). pp. 925-946. ISSN 0020-7721 doi: 10.1080/00207720802083018

Abstract/Summary

The identification of non-linear systems using only observed finite datasets has become a mature research area over the last two decades. A class of linear-in-the-parameter models with universal approximation capabilities have been intensively studied and widely used due to the availability of many linear-learning algorithms and their inherent convergence conditions. This article presents a systematic overview of basic research on model selection approaches for linear-in-the-parameter models. One of the fundamental problems in non-linear system identification is to find the minimal model with the best model generalisation performance from observational data only. The important concepts in achieving good model generalisation used in various non-linear system-identification algorithms are first reviewed, including Bayesian parameter regularisation and models selective criteria based on the cross validation and experimental design. A significant advance in machine learning has been the development of the support vector machine as a means for identifying kernel models based on the structural risk minimisation principle. The developments on the convex optimisation-based model construction algorithms including the support vector regression algorithms are outlined. Input selection algorithms and on-line system identification algorithms are also included in this review. Finally, some industrial applications of non-linear models are discussed.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/15286
Item Type	Article
Refereed	Yes
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Uncontrolled Keywords	adaptive learning, cross validation, model selection, model, generalisation, system identification, control engineering, ORTHOGONAL LEAST-SQUARES, SUPPORT VECTOR MACHINES, BASIS FUNCTION, NETWORKS, OPTIMALITY EXPERIMENTAL-DESIGN, ARTIFICIAL NEURAL-NETWORK, ADAPTIVE-CONTROL, VARIABLE SELECTION, MUTUAL INFORMATION, SUBSPACE, IDENTIFICATION, LEARNING ALGORITHMS
Download/View statistics	View download statistics for this item