A neurofuzzy network knowledge extraction and extended gram-Schmidt algorithm for model subspace decomposition

Hong, X. ORCID: https://orcid.org/0000-0002-6832-2298 and Harris, C. J. (2003) A neurofuzzy network knowledge extraction and extended gram-Schmidt algorithm for model subspace decomposition. IEEE Transactions on Fuzzy Systems, 11 (4). pp. 528-541. ISSN 1063-6706 doi: 10.1109/tfuzz.2003.814842

Abstract/Summary

This paper introduces a new neurofuzzy model construction and parameter estimation algorithm from observed finite data sets, based on a Takagi and Sugeno (T-S) inference mechanism and a new extended Gram-Schmidt orthogonal decomposition algorithm, for the modeling of a priori unknown dynamical systems in the form of a set of fuzzy rules. The first contribution of the paper is the introduction of a one to one mapping between a fuzzy rule-base and a model matrix feature subspace using the T-S inference mechanism. This link enables the numerical properties associated with a rule-based matrix subspace, the relationships amongst these matrix subspaces, and the correlation between the output vector and a rule-base matrix subspace, to be investigated and extracted as rule-based knowledge to enhance model transparency. The matrix subspace spanned by a fuzzy rule is initially derived as the input regression matrix multiplied by a weighting matrix that consists of the corresponding fuzzy membership functions over the training data set. Model transparency is explored by the derivation of an equivalence between an A-optimality experimental design criterion of the weighting matrix and the average model output sensitivity to the fuzzy rule, so that rule-bases can be effectively measured by their identifiability via the A-optimality experimental design criterion. The A-optimality experimental design criterion of the weighting matrices of fuzzy rules is used to construct an initial model rule-base. An extended Gram-Schmidt algorithm is then developed to estimate the parameter vector for each rule. This new algorithm decomposes the model rule-bases via an orthogonal subspace decomposition approach, so as to enhance model transparency with the capability of interpreting the derived rule-base energy level. This new approach is computationally simpler than the conventional Gram-Schmidt algorithm for resolving high dimensional regression problems, whereby it is computationally desirable to decompose complex models into a few submodels rather than a single model with large number of input variables and the associated curse of dimensionality problem. Numerical examples are included to demonstrate the effectiveness of the proposed new algorithm.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/15279
Item Type	Article
Refereed	Yes
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Uncontrolled Keywords	least squares, mixtures of experts, neurofuzzy networks, orthogonal, decomposition, subspace, ORTHOGONAL LEAST-SQUARES, CONSTRUCTION, SYSTEMS, IDENTIFICATION, REDUCTION, DESIGN
Download/View statistics	View download statistics for this item