Probability density function estimation using orthogonal forward regression

Chen, S., Hong, X. ORCID: https://orcid.org/0000-0002-6832-2298 and Harris, C.J. (2007) Probability density function estimation using orthogonal forward regression. In: International Joint Conference on Neural Networks (IJCNN 2007), Orlando, USA. doi: 10.1109/IJCNN.2007.4371350

Abstract/Summary

Using the classical Parzen window estimate as the target function, the kernel density estimation is formulated as a regression problem and the orthogonal forward regression technique is adopted to construct sparse kernel density estimates. The proposed algorithm incrementally minimises a leave-one-out test error score to select a sparse kernel model, and a local regularisation method is incorporated into the density construction process to further enforce sparsity. The kernel weights are finally updated using the multiplicative nonnegative quadratic programming algorithm, which has the ability to reduce the model size further. Except for the kernel width, the proposed algorithm has no other parameters that need tuning, and the user is not required to specify any additional criterion to terminate the density construction procedure. Two examples are used to demonstrate the ability of this regression-based approach to effectively construct a sparse kernel density estimate with comparable accuracy to that of the full-sample optimised Parzen window density estimate.

Item Type	Conference or Workshop Item (Paper)
URI	https://reading-clone.eprints-hosting.org/id/eprint/14628
Item Type	Conference or Workshop Item
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Uncontrolled Keywords	LEAST-SQUARES, LOCAL REGULARIZATION, IDENTIFICATION
Publisher	IEEE
Download/View statistics	View download statistics for this item