Assessing ranking and effectiveness of evolutionary algorithm hyperparameters using global sensitivity analysis methodologies

Ojha, V. ORCID: https://orcid.org/0000-0002-9256-1192, Timmis, J. and Nicosia, G. (2022) Assessing ranking and effectiveness of evolutionary algorithm hyperparameters using global sensitivity analysis methodologies. Swarm and Evolutionary Computation, 74. 101130. ISSN 2210-6502 doi: 10.1016/j.swevo.2022.101130

Abstract/Summary

We present a comprehensive global sensitivity analysis of two single-objective and two multi-objective state-of-the-art global optimization evolutionary algorithms as an algorithm configuration problem. That is, we investigate the quality of influence hyperparameters have on the performance of algorithms in terms of their direct effect and interaction effect with other hyperparameters. Using three sensitivity analysis methods, Morris LHS, Morris, and Sobol, to systematically analyze tunable hyperparameters of covariance matrix adaptation evolutionary strategy, differential evolution, non-dominated sorting genetic algorithm III, and multi-objective evolutionary algorithm based on decomposition, the framework reveals the behaviors of hyperparameters to sampling methods and performance metrics. That is, it answers questions like what hyperparameters influence patterns, how they interact, how much they interact, and how much their direct influence is. Consequently, the ranking of hyperparameters suggests their order of tuning, and the pattern of influence reveals the stability of the algorithms.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/106167
Item Type	Article
Refereed	Yes
Divisions	Interdisciplinary Research Centres (IDRCs) > Centre for the Mathematics of Planet Earth (CMPE) Science > School of Mathematical, Physical and Computational Sciences > Department of Computer Science
Publisher	Elsevier
Download/View statistics	View download statistics for this item