Simultaneous optimization of neural network weights and active nodes using metaheuristics

Ojha, V. K. ORCID: https://orcid.org/0000-0002-9256-1192, Abraham, A. and Snasel, V. (2014) Simultaneous optimization of neural network weights and active nodes using metaheuristics. In: 14th International Conference on Hybrid Intelligent Systems, 14-16 Dec 2014, Kuwait, pp. 248-253. doi: 10.1109/HIS.2014.7086207

Abstract/Summary

Optimization of neural network (NN) significantly influenced by the transfer function used in its active nodes. It has been observed that the homogeneity in the activation nodes does not provide the best solution. Therefore, the customizable transfer functions whose underlying parameters are subjected to optimization were used to provide heterogeneity to NN. For the experimental purpose, a meta-heuristic framework using a combined genotype representation of connection weights and transfer function parameter was used. The performance of adaptive Logistic, Tangent-hyperbolic, Gaussian and Beta functions were analyzed. In present research work, concise comparisons between different transfer function and between the NN optimization algorithms are presented. The comprehensive analysis of the results obtained over the benchmark dataset suggests that the Artificial Bee Colony with adaptive transfer function provides the best results in terms of classification accuracy over the particle swarm optimization and differential evolution.

Item Type	Conference or Workshop Item (Paper)
URI	https://reading-clone.eprints-hosting.org/id/eprint/93568
Item Type	Conference or Workshop Item
Refereed	Yes
Divisions	Interdisciplinary Research Centres (IDRCs) > Centre for the Mathematics of Planet Earth (CMPE) Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Download/View statistics	View download statistics for this item