Nonlinear logistic regression model based on simplex basis function

Hong, X. ORCID: https://orcid.org/0000-0002-6832-2298, Wei, H. ORCID: https://orcid.org/0000-0002-9664-5748 and Gao, J. (2020) Nonlinear logistic regression model based on simplex basis function. In: 2020 International Joint Conference on Neural Networks (IJCNN), 19-24 July 2020, Glasgow, United Kingdom (virtual). doi: 10.1109/IJCNN48605.2020.9207064

Abstract/Summary

In this paper a novel nonlinear logistic regression model based on a simplex basis function neural network is introduced that outputs probability of categorical variables in response to multiple predictors. It is shown that since a linear combination of the simplex basis functions can be represented as a piecewise linear model, the proposed nonlinear logistic regression model retains the main advantage of linear logistic regression model, that is, allowing probabilistic interpretation of the data sets from an identified model. The associated estimation problem is treated based on the principle of maximum likelihood by alternating over two algorithms; the iteratively reweighted least squares algorithm for linear parameters, while the simplex basis functions are fixed; then nonlinear parameters in each simplex basis function are adapted in turn based on gradient descent of the negative likelihood. The proposed algorithm is then extended to estimation of nonlinear multinomial logistic model. Numerical experiments are initially carried out to illustrate the advantage of nonlinear logistic regression model versus its linear counterpart in terms of approximation capability. Then we apply the proposed method for a difficult computer vision example of land-cover real data set.

Item Type	Conference or Workshop Item (Paper)
URI	https://reading-clone.eprints-hosting.org/id/eprint/93983
Item Type	Conference or Workshop Item
Refereed	Yes
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Download/View statistics	View download statistics for this item