lq-CMA-ES 2019-gecco-surr vs CMA-ES 2019-gecco-surr

Overview page

Empirical cumulative distribution functions (ECDFs) per function group

All functions in 5-D

Separable functions in 5-D

Misc. moderate functions in 5-D

Ill-conditioned functions in 5-D

Multi-modal functions in 5-D

Weak structure functions in 5-D

All functions in 20-D

Separable functions in 20-D

Misc. moderate functions in 20-D

Ill-conditioned functions in 20-D

Multi-modal functions in 20-D

Weak structure functions in 20-D

Empirical cumulative distributions (ECDF) of run lengths and speed-up ratios in 5-D (left) and 20-D (right). Left sub-columns: ECDF of the number of function evaluations divided by dimension D (FEvals/D) to reach a target value f_opt+∆f with ∆f =10^k, where k is given by the first value in the legend, for algorithmA (°) and algorithmB (♦) . Light beige lines show the ECDF of FEvals for target value ∆f =10⁻⁸ of all algorithms benchmarked during BBOB-2009. Right sub-columns: ECDF of FEval ratios of algorithmA divided by algorithmB for target function values 10^k with k given in the legend; all trial pairs for each function. Pairs where both trials failed are disregarded, pairs where one trial failed are visible in the limits being > 0 or < 1. The legend also indicates, after the colon, the number of functions that were solved in at least one trial (algorithmA first).