A note on performance profiles for benchmarking software

Gould, N. and Scott, J. ORCID: https://orcid.org/0000-0003-2130-1091 (2016) A note on performance profiles for benchmarking software. ACM Transactions on Mathematical Software (TOMS), 43 (2). 15. ISSN 0098-3500 doi: 10.1145/2950048

Abstract/Summary

In recent years, performance profiles have become a popular and widely used tool for benchmarking and evaluating the performance of several solvers when run on a large test set. Here we use data from a real application as well as a simple artificial example to illustrate that caution should be exercised when trying to interpret performance profiles to assess the relative performance of the solvers.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/74694
Identification Number/DOI	10.1145/2950048
Refereed	Yes
Divisions	Science > School of Mathematical, Physical and Computational Sciences > Department of Mathematics and Statistics
Publisher	ACM
Download/View statistics	View download statistics for this item