Overview page

Table showing the aRT in number of function evaluations divided by the best aRT measured during BBOB-2009

Last dimension | Dimension = 2 | Next dimension

Δ fopt
f1, 2-D
1e1
2.0
1e0
6.0
1e-1
6.0
1e-2
6.0
1e-3
6.0
1e-5
6.0
1e-7
6.0
#succ
15/15
NEWUOA ros noiseless 2.5 (0.6)0.94 (0.2)0.94 (0)1.0 (0)★21.0 (0)★21.0 (0.2)★21.0 (0)★215/15
BFGS ros noiseless 3.0 (0.8)1.1 (0.1)1.2 (0)1.2 (0)1.2 (0)1.2 (0)1.2 (0)15/15
MCS huyer noiseless 0.90 (0.4)1.4 (0.1)2.0 (1)2.6 (1)2.6 (1)2.6 (1)2.6 (1)15/15
NELDERDOERR doerr noiseless 0.93 (0.4)1.4 (0.5)2.7 (0.7)4.1 (0.5)5.3 (0.4)7.6 (0.4)10 (0.6)15/15
SLSQP-11 -207 2.1 (2)1.1 (0.2)1.2 (0)1.2 (0)1.2 (0)1.2 (0)1.2 (0)15/15
BFGS-P-StPt 3.2 (2)1.7 (0)1.7 (0)1.7 (0)1.7 (0)1.7 (0)2.1 (0.3)15/15

Δ fopt
f2, 2-D
1e1
16
1e0
19
1e-1
25
1e-2
25
1e-3
26
1e-5
28
1e-7
29
#succ
15/15
NEWUOA ros noiseless 2.3 (1)8.8 (4)12 (5)15 (9)19 (7)26 (9)34 (12)15/15
BFGS ros noiseless 2.6 (2)4.0 (2)3.7 (0.7)4.0 (0.8)4.0 (1)4.1 (1)4.3 (1)15/15
MCS huyer noiseless 1.4 (0.6)1.8 (0.3)1.7 (1)2.6 (0.3)3.1 (0.7)3.7 (0.7)24 (33)15/15
NELDERDOERR doerr noiseless 1.7 (0.4)1.9 (0.3)1.7 (0.1)2.0 (0.1)2.1 (0.1)2.5 (0.2)3.0 (0.2)15/15
SLSQP-11 -207 1.4 (0.6)1.4 (0.6)1.2 (0.4)1.4 (0.6)★21.5 (0.3)★31.6 (0.2)★31.8 (0.5)★315/15
BFGS-P-StPt 4.1 (1)3.7 (1)3.1 (1)3.2 (1)3.4 (1)3.4 (1)3.8 (1)15/15

Δ fopt
f3, 2-D
1e1
15
1e0
271
1e-1
445
1e-2
446
1e-3
450
1e-5
454
1e-7
464
#succ
15/15
NEWUOA ros noiseless 4.7 (9)1.5 (2)4.2 (2)4.2 (2)4.2 (2)4.1 (2)4.1 (11)14/15
BFGS ros noiseless 14 (10)3.1 (4)10 (8)10 (6)10 (12)10 (12)10 (20)10/15
MCS huyer noiseless 1.5 (0.5)1.1 (0.7)1.5 (0.6)1.6 (0.6)1.6 (0.5)2.6 (3)2.6 (3)15/15
NELDERDOERR doerr noiseless 0.98 (0.5)1.00 (0.3)1.7 (2)1.8 (2)1.8 (2)1.8 (2)1.8 (1)15/15
SLSQP-11 -207 3.9 (8)2.6 (2)10 (9)10 (7)10 (5)10 (7)10 (9)15/15
BFGS-P-StPt 15 (9)10 (6)45 (87)45 (91)45 (58)44 (56)43 (72)5/15

Δ fopt
f4, 2-D
1e1
22
1e0
344
1e-1
459
1e-2
496
1e-3
523
1e-5
544
1e-7
566
#succ
15/15
NEWUOA ros noiseless 5.0 (5)4.5 (5)18 (19)16 (24)16 (34)15 (20)14 (9)10/15
BFGS ros noiseless 11 (19)5.7 (5)12 (6)11 (6)11 (4)10 (13)10 (10)9/15
MCS huyer noiseless 2.0 (1)1.00 (0.8)2.9 (2)2.7 (2)2.7 (2)2.7 (1)2.6 (1)15/15
NELDERDOERR doerr noiseless 1.9 (3)1.4 (0.3)3.5 (2)3.2 (2)3.1 (2)3.0 (3)3.0 (2)15/15
SLSQP-11 -207 4.4 (6)3.1 (3)10 (7)9.4 (16)9.0 (16)8.6 (4)8.3 (6)15/15
BFGS-P-StPt 7.7 (10)13 (13)41 (48)38 (53)36 (43)35 (48)34 (57)6/15

Δ fopt
f5, 2-D
1e1
4.0
1e0
4.0
1e-1
4.0
1e-2
4.0
1e-3
4.0
1e-5
4.0
1e-7
4.0
#succ
15/15
NEWUOA ros noiseless 1 (0.2)1.6 (0.4)1.7 (0.2)1.7 (0.2)1.7 (0.2)1.7 (0.2)1.7 (0.2)15/15
BFGS ros noiseless 1.4 (0.4)3.1 (0.8)3.1 (0.6)3.1 (0)3.1 (0)3.1 (0)3.1 (0.8)15/15
MCS huyer noiseless 1.1 (0.1)1.1 (0.1)★21.1 (0.1)★21.1 (0.1)★21.1 (0.1)★21.1 (0.1)★21.1 (0.1)★215/15
NELDERDOERR doerr noiseless 1.1 (0.4)2.1 (0.9)2.1 (0.9)2.1 (0.9)2.1 (1)2.1 (0.9)2.1 (0.9)15/15
SLSQP-11 -207 1.5 (0)3.5 (0)3.5 (0)3.5 (0)3.5 (0)3.5 (0)3.5 (0)15/15
BFGS-P-StPt 1.5 (0)3.5 (0)3.5 (0)3.5 (0)3.5 (0)3.5 (0)3.5 (0)15/15

Δ fopt
f6, 2-D
1e1
13
1e0
23
1e-1
41
1e-2
54
1e-3
67
1e-5
95
1e-7
124
#succ
15/15
NEWUOA ros noiseless 4.3 (4)4.6 (4)3.9 (2)4.4 (2)4.7 (2)4.9 (2)4.9 (2)15/15
BFGS ros noiseless 4.1 (4)3.3 (2)2.7 (1.0)2.3 (0.8)2.0 (0.5)1.7 (0.6)1.6 (0.5)15/15
MCS huyer noiseless 51 (61)29 (58)19 (35)42 (49)102 (306)102 (254)117 (112)12/15
NELDERDOERR doerr noiseless 1.2 (0.9)1.3 (0.4)1 (0.3)1.00 (0.2)1 (0.1)1.00 (0.1)1.0 (0.1)15/15
SLSQP-11 -207 5.2 (4)4.1 (3)2.6 (3)2.2 (2)2.1 (1)1.8 (0.9)2.0 (1)15/15
BFGS-P-StPt 6.6 (3)5.8 (4)4.6 (2)3.7 (1)3.2 (1)2.7 (0.5)2.5 (0.5)15/15

Δ fopt
f7, 2-D
1e1
3.0
1e0
21
1e-1
60
1e-2
193
1e-3
217
1e-5
217
1e-7
241
#succ
15/15
NEWUOA ros noiseless 2.7 (2)9.5 (13)9.4 (8)6.0 (9)14 (9)14 (24)12 (22)13/15
BFGS ros noiseless 11 (11)19 (36)34 (31)3000/15
MCS huyer noiseless 1.1 (0.8)4.2 (5)4.5 (2)2.2 (1)6.5 (9)6.5 (9)6.0 (5)15/15
NELDERDOERR doerr noiseless 2.8 (2)1.0 (0.9)8.6 (10)5.4 (7)5.2 (6)5.2 (3)5.4 (8)15/15
SLSQP-11 -207 17 (24)24 (26)89 (90)241 (356)571 (633)571 (805)514 (198)4/15
BFGS-P-StPt 11 (22)18 (12)5000/15

Δ fopt
f8, 2-D
1e1
5.0
1e0
12
1e-1
37
1e-2
46
1e-3
86
1e-5
94
1e-7
112
#succ
15/15
NEWUOA ros noiseless 4.6 (3)7.0 (5)3.5 (2)3.2 (1)1.9 (0.6)1.8 (0.9)1.6 (0.6)15/15
BFGS ros noiseless 4.5 (3)5.1 (3)2.4 (2)2.2 (1)1.3 (0.7)1.3 (0.4)1.1 (0.4)15/15
MCS huyer noiseless 1.1 (0.9)1 (0.6)0.99 (0.4)1.0 (0.7)1.0 (0.8)1 (0.1)1 (0.6)15/15
NELDERDOERR doerr noiseless 4.9 (4)6.2 (4)2.9 (2)2.8 (1)1.6 (0.4)1.6 (0.6)1.5 (0.4)15/15
SLSQP-11 -207 3.2 (2)3.2 (3)2.0 (1)2.1 (2)1.2 (0.6)1.2 (0.4)1.1 (0.5)15/15
BFGS-P-StPt 4.3 (7)5.4 (6)2.4 (3)2.5 (2)1.5 (0.7)1.5 (0.9)1.3 (0.8)15/15

Δ fopt
f9, 2-D
1e1
1
1e0
18
1e-1
30
1e-2
44
1e-3
68
1e-5
81
1e-7
92
#succ
15/15
NEWUOA ros noiseless 24 (26)3.6 (4)3.3 (3)2.7 (2)1.9 (1)1.8 (0.7)1.7 (0.7)15/15
BFGS ros noiseless 16 (15)2.4 (2)2.3 (1)1.9 (0.5)1.3 (0.5)1.2 (0.5)1.1 (0.5)15/15
MCS huyer noiseless 1 (0)0.99 (0.4)1 (0.3)1.00 (0.4)0.99 (0.4)1.0 (0.4)1.0 (0.5)15/15
NELDERDOERR doerr noiseless 11 (8)2.2 (1)2.6 (0.8)2.1 (0.6)1.5 (0.7)1.4 (0.7)1.4 (0.4)15/15
SLSQP-11 -207 1 (0)0.50 (0)★20.63 (0)0.98 (0)0.78 (0)0.80 (0)0.75 (0)15/15
BFGS-P-StPt 1 (0)1 (0)1 (0)1.4 (0)1.1 (0)1.1 (0)1.0 (0)15/15

Δ fopt
f10, 2-D
1e1
30
1e0
46
1e-1
54
1e-2
61
1e-3
68
1e-5
82
1e-7
98
#succ
15/15
NEWUOA ros noiseless 3.1 (2)4.2 (2)6.5 (4)7.3 (5)8.5 (4)10 (6)11 (5)15/15
BFGS ros noiseless 0.99 (0.6)1.3 (0.7)1.4 (0.2)1.4 (0.2)1.4 (0.3)6.3 (14)24 (27)10/15
MCS huyer noiseless 1.7 (1)8.6 (17)47 (56)131 (376)525 (606)1296 (1416)3721 (5488)1/15
NELDERDOERR doerr noiseless 1.2 (0.4)0.99 (0.2)1.00 (0.3)1.00 (0.1)1.0 (0.2)1.00 (0.2)1.00 (0.1)15/15
SLSQP-11 -207 0.82 (0.3)0.65 (0.3)0.61 (0.2)0.59 (0.2)0.57 (0.2)38 (256)166 (218)8/15
BFGS-P-StPt 1.9 (0.8)1.4 (0.6)1.2 (0.7)1.1 (0.6)1.1 (0.6)0.96 (0.3)0.87 (0.4)15/15

Δ fopt
f11, 2-D
1e1
35
1e0
45
1e-1
50
1e-2
62
1e-3
67
1e-5
81
1e-7
97
#succ
15/15
NEWUOA ros noiseless 1.6 (0.7)3.2 (2)5.6 (2)6.0 (4)7.0 (2)8.5 (4)11 (7)15/15
BFGS ros noiseless 1.2 (0.9)1.6 (1)2.0 (0.5)1.7 (0.3)1.9 (0.2)5.7 (4)36 (35)10/15
MCS huyer noiseless 87 (73)124 (192)168 (181)295 (185)926 (881)2052 (2150)5e40/15
NELDERDOERR doerr noiseless 1.0 (0.3)1 (0.3)1.0 (0.3)0.99 (0.2)1.0 (0.2)1.0 (0.2)1.0 (0.1)15/15
SLSQP-11 -207 0.67 (0.1)0.61 (0.1)0.63 (0.2)★20.59 (0.1)★30.63 (0.2)★383 (169)288 (425)8/15
BFGS-P-StPt 2.6 (1)2.1 (0.9)2.1 (0.8)1.7 (0.6)1.7 (0.5)1.5 (0.5)1.3 (0.4)15/15

Δ fopt
f12, 2-D
1e1
35
1e0
46
1e-1
75
1e-2
94
1e-3
105
1e-5
153
1e-7
195
#succ
15/15
NEWUOA ros noiseless 1.9 (0.5)2.9 (10)2.3 (6)2.1 (2)2.0 (3)1.6 (2)1.4 (2)15/15
BFGS ros noiseless 1.2 (2)3.2 (3)3.1 (4)2.9 (4)2.8 (3)2.4 (2)4.2 (7)15/15
MCS huyer noiseless 60 (74)49 (61)32 (67)26 (54)24 (48)39 (25)30 (36)15/15
NELDERDOERR doerr noiseless 1.1 (0.5)1.6 (2)1.6 (3)1.7 (2)1.7 (1)1.4 (1.0)1.3 (2)15/15
SLSQP-11 -207 1.1 (0.4)1.0 (0.6)0.64 (0.3)0.52 (0.3)0.48 (0.2)0.37 (0.2)1.5 (1)15/15
BFGS-P-StPt 11 (14)11 (15)8.3 (11)7.2 (7)6.7 (9)5.1 (6)4.4 (6)15/15

Δ fopt
f13, 2-D
1e1
23
1e0
35
1e-1
46
1e-2
60
1e-3
71
1e-5
95
1e-7
122
#succ
15/15
NEWUOA ros noiseless 6.2 (1)10 (20)22 (34)25 (37)72 (33)91 (137)147 (80)5/15
BFGS ros noiseless 6.7 (5)15 (14)45 (44)74 (43)164 (136)580 (493)1e40/15
MCS huyer noiseless 23 (15)20 (11)167 (162)958 (792)2152 (2465)5e40/15
NELDERDOERR doerr noiseless 1.1 (1)1.1 (0.1)1.1 (0.3)1.0 (0.3)1.0 (0.3)1.1 (0.2)1.0 (0.1)15/15
SLSQP-11 -207 0.90 (0.2)0.79 (0.2)0.82 (0.2)0.76 (0.1)★20.75 (0.1)★30.87 (0.4)56 (173)9/15
BFGS-P-StPt 7.5 (8)20 (30)16 (28)25 (41)24 (36)23 (25)1994 (1621)8/15

Δ fopt
f14, 2-D
1e1
1
1e0
7.0
1e-1
16
1e-2
24
1e-3
38
1e-5
67
1e-7
90
#succ
15/15
NEWUOA ros noiseless 5.1 (4)2.5 (0.8)1.6 (0.6)1.5 (0.5)1.6 (0.4)2.1 (0.4)5.4 (7)6/15
BFGS ros noiseless 3.0 (4)2.9 (2)1.8 (1)1.7 (1)1.4 (0.5)1.0 (0.4)6.0 (6)15/15
MCS huyer noiseless 1.4 (1)1.1 (0.5)1.4 (0.6)1.7 (0.4)2.8 (2)23 (25)8186 (4171)0/15
NELDERDOERR doerr noiseless 1.8 (2)1.4 (0.6)1.3 (0.3)1.3 (0.2)1.1 (0.2)1.0 (0.1)1.0 (0.1)★215/15
SLSQP-11 -207 3.8 (3)1.6 (1)1.3 (0.4)1.4 (0.3)1.1 (0.4)0.97 (0.3)3.5 (2)14/15
BFGS-P-StPt 2.8 (2)1.5 (2)1.2 (0.8)1.4 (0.2)1.4 (0.7)1.2 (0.3)1.5 (0.2)15/15

Δ fopt
f15, 2-D
1e1
37
1e0
291
1e-1
1033
1e-2
1066
1e-3
1113
1e-5
1231
1e-7
1412
#succ
15/15
NEWUOA ros noiseless 4.1 (4)3.4 (3)3.3 (3)3.2 (3)3.0 (3)2.7 (2)2.4 (3)15/15
BFGS ros noiseless 4.2 (3)4.6 (5)7.9 (12)7.7 (3)7.3 (5)6.6 (4)5.8 (6)7/15
MCS huyer noiseless 2.1 (3)3.5 (7)1.4 (2)1.4 (1)1.3 (2)1.2 (0.4)1.1 (1)15/15
NELDERDOERR doerr noiseless 1.1 (1)1.3 (1)1.4 (1)1.3 (1)1.3 (1)1.2 (0.7)1.0 (1)15/15
SLSQP-11 -207 2.9 (5)2.7 (6)2.4 (2)2.4 (2)2.3 (1)2.1 (0.9)1.8 (1)15/15
BFGS-P-StPt 8.4 (11)4.9 (2)10 (9)10 (13)9.2 (5)8.3 (8)7.3 (8)9/15

Δ fopt
f16, 2-D
1e1
9.0
1e0
50
1e-1
174
1e-2
326
1e-3
358
1e-5
409
1e-7
538
#succ
15/15
NEWUOA ros noiseless 9.1 (10)10 (6)6.8 (9)6.9 (3)22 (32)44 (45)77 (103)4/15
BFGS ros noiseless 41 (45)147 (304)173 (168)269 (417)1e40/15
MCS huyer noiseless 5.2 (6)6.7 (8)2.7 (3)4.3 (5)6.8 (8)29 (40)115 (94)6/15
NELDERDOERR doerr noiseless 1.7 (1)3.5 (5)1.8 (2)1.1 (0.8)1.1 (0.9)1.0 (0.7)★21.00 (1)★415/15
SLSQP-11 -207 430 (53)513 (945)457 (738)599 (386)1850 (1851)4e40/15
BFGS-P-StPt 195 (220)925 (896)1562 (2216)6e40/15

Δ fopt
f17, 2-D
1e1
3.0
1e0
61
1e-1
133
1e-2
275
1e-3
396
1e-5
1086
1e-7
1657
#succ
15/15
NEWUOA ros noiseless 6.8 (8)6.8 (7)18 (18)33 (29)115 (98)1e40/15
BFGS ros noiseless 13 (14)16 (11)90 (63)37860/15
MCS huyer noiseless 1.1 (1)4.3 (3)4.8 (3)5.4 (5)9.2 (9)142 (110)125 (182)0/15
NELDERDOERR doerr noiseless 1.2 (1)1.5 (4)3.3 (5)3.0 (3)3.1 (4)5.9 (5)4.0 (8)14/15
SLSQP-11 -207 11 (16)14 (2)72 (88)2121 (2573)4e40/15
BFGS-P-StPt 21 (95)87 (128)265 (341)1e40/15

Δ fopt
f18, 2-D
1e1
19
1e0
134
1e-1
666
1e-2
1249
1e-3
1708
1e-5
2438
1e-7
2858
#succ
15/15
NEWUOA ros noiseless 5.6 (11)12 (14)14 (15)62 (66)1e40/15
BFGS ros noiseless 14 (24)29 (26)108 (165)48990/15
MCS huyer noiseless 1.3 (1.0)2.8 (5)1.7 (2)8.4 (8)135 (96)5e40/15
NELDERDOERR doerr noiseless 1.2 (2)3.1 (3)2.4 (3)4.3 (8)5.8 (8)25 (38)21 (27)6/15
SLSQP-11 -207 10 (11)59 (90)103 (50)501 (415)366 (349)4e40/15
BFGS-P-StPt 59 (89)97 (111)2e40/15

Δ fopt
f19, 2-D
1e1
1
1e0
1
1e-1
26
1e-2
216
1e-3
227
1e-5
252
1e-7
276
#succ
15/15
NEWUOA ros noiseless 6.2 (4)126 (254)16 (19)27 (22)26 (20)24 (13)22 (9)13/15
BFGS ros noiseless 37 (85)311 (308)62 (57)30 (27)29 (30)26 (29)24 (42)11/15
MCS huyer noiseless 1 (0)1 (0)1.0 (0.3)1 (1)★21 (1)★31.0 (1)★21.00 (1.0)★215/15
NELDERDOERR doerr noiseless 4.6 (4)52 (126)11 (12)8.1 (12)7.8 (13)7.1 (11)6.5 (6)15/15
SLSQP-11 -207 1 (0)1 (0)0.54 (0)4e40/15
BFGS-P-StPt 1 (0)1 (0)0.57 (0.0)203 (313)193 (181)174 (221)1466 (1649)0/15

Δ fopt
f20, 2-D
1e1
4.0
1e0
61
1e-1
365
1e-2
366
1e-3
366
1e-5
370
1e-7
375
#succ
15/15
NEWUOA ros noiseless 1.9 (0.8)6.9 (6)5.9 (4)5.9 (6)5.9 (7)5.8 (8)5.8 (8)15/15
BFGS ros noiseless 1.9 (1)6.0 (7)2.7 (3)2.7 (2)2.7 (4)2.7 (2)2.6 (2)15/15
MCS huyer noiseless 5.3 (2)2.2 (2)1.00 (1)1.0 (1)1.0 (0.5)1.0 (1)1.0 (1)15/15
NELDERDOERR doerr noiseless 1.4 (1)3.9 (5)2.8 (2)2.8 (2)2.9 (4)2.9 (3)2.9 (2)15/15
SLSQP-11 -207 2.5 (0)4.7 (4)21 (28)21 (35)21 (36)21 (26)21 (28)15/15
BFGS-P-StPt 4.5 (0)10 (6)3.2 (2)3.2 (4)3.2 (3)3.2 (3)3.2 (5)15/15

Δ fopt
f21, 2-D
1e1
2.0
1e0
51
1e-1
174
1e-2
276
1e-3
290
1e-5
324
1e-7
330
#succ
15/15
NEWUOA ros noiseless 2.9 (2)3.8 (3)4.0 (3)2.5 (1)2.4 (2)2.2 (1)2.3 (2)15/15
BFGS ros noiseless 2.2 (2)4.8 (5)3.1 (2)2.0 (3)1.9 (1)1.7 (2)1.8 (2)15/15
MCS huyer noiseless 1.3 (0.8)22 (2)14 (16)8.8 (10)8.4 (5)7.6 (9)7.5 (9)15/15
NELDERDOERR doerr noiseless 1.2 (0.6)2.6 (4)2.6 (4)1.7 (3)1.6 (2)1.5 (1)1.5 (1)15/15
SLSQP-11 -207 2.5 (2)3.2 (3)1.3 (1)0.88 (0.8)0.86 (0.8)0.83 (0.7)0.89 (0.7)15/15
BFGS-P-StPt 4.8 (5)6.8 (5)2.8 (5)1.8 (2)1.7 (3)1.6 (3)12 (18)8/15

Δ fopt
f22, 2-D
1e1
5.0
1e0
27
1e-1
168
1e-2
218
1e-3
249
1e-5
289
1e-7
306
#succ
15/15
NEWUOA ros noiseless 2.0 (2)6.3 (16)1.2 (3)1.00 (2)1.0 (1)1.0 (0.6)1.1 (0.3)15/15
BFGS ros noiseless 5.4 (10)5.0 (3)1.5 (3)1.2 (0.6)1.1 (2)1 (2)1.00 (2)15/15
MCS huyer noiseless 2.4 (2)40 (93)7.4 (8)6.0 (11)5.3 (6)4.8 (5)5.2 (5)15/15
NELDERDOERR doerr noiseless 1.3 (0.7)8.0 (8)1.8 (2)1.4 (2)1.2 (1)1.1 (1)1.1 (1)15/15
SLSQP-11 -207 2.1 (2)4.2 (8)1.5 (1)1.2 (0.7)1.1 (0.8)1.0 (0.4)1.0 (1)15/15
BFGS-P-StPt 4.2 (1)11 (21)3.4 (2)2.7 (3)2.4 (2)2.6 (5)10 (10)10/15

Δ fopt
f23, 2-D
1e1
8.0
1e0
193
1e-1
234
1e-2
263
1e-3
299
1e-5
348
1e-7
379
#succ
15/15
NEWUOA ros noiseless 7.6 (15)3.2 (3)32 (50)89 (66)130 (143)500 (876)459 (705)0/15
BFGS ros noiseless 4.7 (7)4.9 (5)28 (32)121 (130)477 (703)410 (523)97440/15
MCS huyer noiseless 3.3 (1)2.8 (3)6.3 (3)23 (11)213 (160)1012 (1250)1902 (1785)1/15
NELDERDOERR doerr noiseless 4.6 (10)1.00 (0.6)1.00 (0.8)1.00 (1)★21.0 (1)★31.00 (0.8)★31.0 (0.8)★415/15
SLSQP-11 -207 9.2 (5)10 (12)16 (24)23 (39)31 (26)111 (107)4e40/15
BFGS-P-StPt 53 (92)43 (24)117 (151)197 (125)582 (347)7e40/15

Δ fopt
f24, 2-D
1e1
18
1e0
857
1e-1
8515
1e-2
23399
1e-3
24113
1e-5
24721
1e-7
24721
#succ
5/15
NEWUOA ros noiseless 3.2 (4)2.8 (4)1.9 (2)2.0 (4)1.9 (4)1.9 (2)1.9 (1)3/15
BFGS ros noiseless 3.4 (5)5.1 (4)2.9 (4)53130/15
MCS huyer noiseless 2.6 (3)5.7 (3)1.6 (0.8)2.7 (3)2.7 (3)2.6 (3)2.6 (2)8/15
NELDERDOERR doerr noiseless 1.6 (3)1.9 (3)1.5 (2)3.2 (6)3.1 (2)3.0 (4)3.0 (4)6/15
SLSQP-11 -207 4.2 (4)1.7 (1)1.5 (1)3.4 (3)3.3 (2)3.3 (3)3.3 (3)6/15
BFGS-P-StPt 8.8 (10)13 (19)5.9 (6)96680/15

Previous dimension | Dimension = 3 | Next dimension

Δ fopt
f1, 3-D
1e1
4.0
1e0
8.0
1e-1
8.0
1e-2
8.0
1e-3
8.0
1e-5
8.0
1e-7
8.0
#succ
15/15
NEWUOA ros noiseless 1.6 (0.8)1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)15/15
BFGS ros noiseless 2.1 (0.2)1.1 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)15/15
MCS huyer noiseless 0.90 (0.6)1.6 (1)2.0 (0.5)2.4 (1.0)2.4 (1.0)2.4 (0.9)2.4 (1.0)15/15
NELDERDOERR doerr noiseless 1.8 (0.9)2.4 (0.5)3.9 (0.7)5.4 (0.8)6.9 (0.6)10 (0.9)14 (1)15/15
SLSQP-11 -207 1.6 (0.4)1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)15/15
BFGS-P-StPt 2.5 (0.7)1.5 (0)1.5 (0)1.5 (0)1.5 (0)1.5 (0)1.9 (0.3)15/15

Δ fopt
f2, 3-D
1e1
38
1e0
42
1e-1
43
1e-2
44
1e-3
45
1e-5
47
1e-7
48
#succ
15/15
NEWUOA ros noiseless 3.4 (6)14 (13)26 (22)33 (45)42 (38)56 (38)72 (44)15/15
BFGS ros noiseless 3.1 (2)3.9 (2)4.7 (0.8)4.9 (1)4.9 (1)5.1 (2)5.2 (1)15/15
MCS huyer noiseless 1.8 (1)1.9 (1)2.3 (2)3.7 (2)4.4 (1)5.2 (1)6.9 (2)15/15
NELDERDOERR doerr noiseless 2.3 (1)2.8 (2)3.2 (1)3.6 (0.9)3.7 (1)4.2 (2)4.6 (1)15/15
SLSQP-11 -207 0.98 (0.1)1.1 (0.2)1.2 (0.1)★21.3 (0.3)★21.4 (0.4)1.6 (0.6)★21.8 (0.5)★215/15
BFGS-P-StPt 2.4 (1)2.4 (1.0)2.6 (1)2.7 (1)2.8 (0.8)2.9 (0.7)3.0 (0.9)15/15

Δ fopt
f3, 3-D
1e1
38
1e0
822
1e-1
830
1e-2
835
1e-3
842
1e-5
847
1e-7
853
#succ
15/15
NEWUOA ros noiseless 5.7 (6)5.0 (9)55 (96)54 (26)54 (85)54 (47)53 (51)4/15
BFGS ros noiseless 41 (21)25 (20)155 (166)154 (134)153 (117)152 (80)151 (155)1/15
MCS huyer noiseless 6.7 (0.4)1.2 (3)10 (20)11 (2)11 (20)12 (19)12 (10)15/15
NELDERDOERR doerr noiseless 3.0 (3)1.5 (1)8.4 (8)8.3 (8)8.3 (11)8.3 (9)8.3 (6)15/15
SLSQP-11 -207 15 (22)6.8 (7)47 (50)47 (59)47 (39)46 (33)46 (31)12/15
BFGS-P-StPt 78 (28)43 (77)1e40/15

Δ fopt
f4, 3-D
1e1
40
1e0
808
1e-1
866
1e-2
921
1e-3
952
1e-5
1015
1e-7
1044
#succ
15/15
NEWUOA ros noiseless 25 (10)21 (29)302 (216)284 (454)275 (437)258 (346)251 (268)1/15
BFGS ros noiseless 48 (34)54 (106)98360/15
MCS huyer noiseless 6.0 (1)10 (3)67 (70)63 (74)61 (64)57 (59)56 (70)6/15
NELDERDOERR doerr noiseless 4.6 (4)7.8 (6)43 (42)40 (47)39 (40)37 (59)36 (46)12/15
SLSQP-11 -207 21 (19)39 (90)328 (403)309 (478)299 (428)280 (282)272 (361)3/15
BFGS-P-StPt 93 (66)87 (125)1e40/15

Δ fopt
f5, 3-D
1e1
7.0
1e0
7.0
1e-1
7.0
1e-2
7.0
1e-3
7.0
1e-5
7.0
1e-7
7.0
#succ
15/15
NEWUOA ros noiseless 1.1 (0)1.3 (0.1)1.4 (0.3)1.4 (0.3)1.4 (0.3)1.4 (0.3)1.4 (0.2)15/15
BFGS ros noiseless 1.5 (0.3)2.3 (0.6)2.4 (0.6)2.4 (0.7)2.4 (0.4)2.4 (0.7)2.4 (0.7)15/15
MCS huyer noiseless 0.94 (0.1)0.94 (0.1)★40.94 (0.1)★40.94 (0.1)★40.94 (0.1)★40.94 (0.1)★40.94 (0.0)★415/15
NELDERDOERR doerr noiseless 1.3 (0.8)2.3 (1)2.3 (1)2.3 (0.7)2.3 (1)2.3 (0.9)2.3 (0.9)15/15
SLSQP-11 -207 1 (0)3.1 (0)3.1 (0)3.1 (0)3.1 (0)3.1 (0)3.1 (0)15/15
BFGS-P-StPt 1 (0)3.1 (0)3.1 (0)3.1 (0)3.1 (0)3.1 (0)3.1 (0)15/15

Δ fopt
f6, 3-D
1e1
34
1e0
56
1e-1
90
1e-2
117
1e-3
149
1e-5
215
1e-7
265
#succ
15/15
NEWUOA ros noiseless 2.1 (1)3.4 (6)3.8 (6)4.0 (3)4.1 (3)4.1 (4)4.8 (2)15/15
BFGS ros noiseless 3.5 (3)3.4 (1)2.9 (1)2.4 (0.9)2.0 (0.6)1.9 (1)3.1 (3)15/15
MCS huyer noiseless 3.0 (4)164 (225)118 (98)141 (182)144 (338)153 (158)213 (126)2/15
NELDERDOERR doerr noiseless 0.99 (0.5)1 (0.2)1.0 (0.3)1.00 (0.5)★21.0 (0.3)★21.00 (0.2)★31.00 (0.1)★315/15
SLSQP-11 -207 4.4 (3)3.3 (2)2.6 (2)2.4 (0.8)2.3 (1)2.0 (1.0)2.4 (0.6)15/15
BFGS-P-StPt 4.0 (4)5.0 (2)4.1 (1)4.4 (1.0)3.7 (0.3)3.4 (0.7)4.6 (0.9)15/15

Δ fopt
f7, 3-D
1e1
11
1e0
65
1e-1
342
1e-2
464
1e-3
482
1e-5
482
1e-7
535
#succ
15/15
NEWUOA ros noiseless 12 (62)12 (2)10 (5)14 (19)39 (44)39 (22)35 (86)9/15
BFGS ros noiseless 17 (9)86 (95)4000/15
MCS huyer noiseless 1.0 (0.5)5.7 (6)2.4 (2)4.2 (2)4.1 (2)4.1 (3)8.8 (6)15/15
NELDERDOERR doerr noiseless 7.8 (0.6)4.2 (5)4.3 (6)4.2 (3)8.8 (6)8.8 (5)8.8 (21)15/15
SLSQP-11 -207 16 (18)190 (289)324 (488)1846 (1960)1777 (1761)1777 (1729)1601 (1983)1/15
BFGS-P-StPt 31 (31)136 (252)6000/15

Δ fopt
f8, 3-D
1e1
27
1e0
45
1e-1
152
1e-2
179
1e-3
188
1e-5
198
1e-7
208
#succ
15/15
NEWUOA ros noiseless 1.4 (1)2.8 (3)1.2 (0.5)1.1 (0.4)1.2 (0.6)1.2 (0.5)1.2 (0.6)15/15
BFGS ros noiseless 1.4 (0.8)2.7 (2)1.1 (0.5)1.0 (0.3)1.0 (0.4)1.0 (0.3)1.0 (0.3)15/15
MCS huyer noiseless 1.0 (0.5)1.00 (0.7)7.1 (9)6.2 (7)6.1 (14)5.9 (13)5.7 (6)15/15
NELDERDOERR doerr noiseless 1.6 (0.6)4.0 (3)1.5 (0.9)1.4 (0.6)1.4 (0.8)1.5 (0.7)1.5 (0.7)15/15
SLSQP-11 -207 1.3 (0.4)2.2 (1)0.95 (0.5)0.94 (0.7)0.96 (0.4)0.96 (0.6)0.95 (0.4)15/15
BFGS-P-StPt 1.7 (0.6)2.3 (1)0.86 (0.5)0.88 (0.5)0.91 (0.4)0.93 (0.4)0.92 (0.4)15/15

Δ fopt
f9, 3-D
1e1
21
1e0
65
1e-1
127
1e-2
149
1e-3
159
1e-5
169
1e-7
178
#succ
15/15
NEWUOA ros noiseless 1.7 (0.8)1.7 (1.0)1.2 (0.6)1.2 (0.7)1.2 (0.5)1.3 (0.9)1.3 (0.5)15/15
BFGS ros noiseless 1.5 (0.9)1.5 (1)1.1 (0.4)1.1 (0.4)1.1 (0.4)1.1 (0.3)1.0 (0.3)15/15
MCS huyer noiseless 0.99 (0.3)1.0 (1)1.0 (0.7)1.1 (0.6)1.1 (0.3)1.2 (0.5)1.2 (0.5)15/15
NELDERDOERR doerr noiseless 1.5 (0.7)1.4 (0.8)1.1 (0.9)1.1 (0.6)1.1 (0.4)1.2 (0.3)1.3 (0.5)15/15
SLSQP-11 -207 0.48 (0)★20.15 (0)★40.44 (0)★20.48 (0)★20.55 (0)0.57 (0)0.57 (0)★415/15
BFGS-P-StPt 1.0 (0)0.34 (0)0.57 (1e-2)0.68 (0)0.70 (0)0.72 (0.0)0.74 (0.0)15/15

Δ fopt
f10, 3-D
1e1
114
1e0
152
1e-1
168
1e-2
180
1e-3
194
1e-5
218
1e-7
242
#succ
15/15
NEWUOA ros noiseless 2.8 (2)5.2 (3)8.3 (5)10 (4)12 (5)14 (8)16 (7)15/15
BFGS ros noiseless 1.0 (0.5)1.2 (0.5)1.2 (0.3)1.2 (0.2)1.4 (0.2)5.9 (4)76 (144)3/15
MCS huyer noiseless 67 (97)168 (61)824 (1393)4119 (4241)3822 (4580)5e40/15
NELDERDOERR doerr noiseless 1.1 (0.7)1.1 (0.6)1.1 (0.2)1.1 (0.4)1.1 (0.3)1.0 (0.2)1.0 (0.2)15/15
SLSQP-11 -207 0.33 (0.1)★30.29 (0.1)★40.30 (0.1)★40.31 (0.0)★30.32 (0.0)★30.41 (0.1)★2108 (278)9/15
BFGS-P-StPt 0.95 (0.1)0.76 (0.3)0.76 (0.2)0.73 (0.2)0.72 (0.3)0.73 (0.1)0.78 (0.2)15/15

Δ fopt
f11, 3-D
1e1
67
1e0
105
1e-1
227
1e-2
263
1e-3
277
1e-5
302
1e-7
327
#succ
15/15
NEWUOA ros noiseless 3.1 (2)3.4 (2)2.5 (1)2.6 (1)3.2 (1)4.0 (1)5.1 (1)15/15
BFGS ros noiseless 1.0 (0.6)1.0 (0.3)1.0 (0.9)1.4 (0.9)3.7 (5)41 (83)2e40/15
MCS huyer noiseless 49 (40)83 (90)101 (87)512 (593)5e40/15
NELDERDOERR doerr noiseless 2.3 (2)2.0 (0.6)1.1 (0.3)1 (0.2)1.0 (0.2)1 (0.2)1.0 (0.2)15/15
SLSQP-11 -207 0.44 (0.1)0.34 (0.1)★40.19 (0.0)★40.19 (0.1)★30.21 (0.0)★233 (149)169 (444)5/15
BFGS-P-StPt 1.3 (0.6)0.89 (0.5)0.44 (0.2)0.41 (0.2)0.41 (0.2)0.41 (0.1)0.66 (0.6)15/15

Δ fopt
f12, 3-D
1e1
65
1e0
168
1e-1
338
1e-2
401
1e-3
445
1e-5
696
1e-7
790
#succ
15/15
NEWUOA ros noiseless 2.0 (2)1.6 (2)1.2 (1)1.2 (1)1.3 (1)1.1 (0.9)1.2 (0.9)15/15
BFGS ros noiseless 1.7 (2)1.4 (1)1.00 (0.8)1.00 (0.7)1.00 (0.4)2.3 (2)43 (68)9/15
MCS huyer noiseless 1.00 (0.8)1.00 (1)1.2 (1)1.2 (1)2.7 (3)4.5 (7)18 (6)9/15
NELDERDOERR doerr noiseless 1.7 (1)1.6 (2)1.3 (1.0)1.2 (0.9)1.3 (0.7)1.00 (0.7)1.0 (0.7)15/15
SLSQP-11 -207 2.3 (3)1.5 (0.5)1.0 (1)1.0 (1)1.0 (0.9)1.2 (1)4.6 (11)9/15
BFGS-P-StPt 6.4 (4)4.1 (1)2.7 (0.1)2.5 (0.5)2.4 (0.5)1.8 (0.1)2.1 (0.8)15/15

Δ fopt
f13, 3-D
1e1
49
1e0
85
1e-1
108
1e-2
136
1e-3
215
1e-5
281
1e-7
365
#succ
15/15
NEWUOA ros noiseless 4.6 (1)9.0 (11)43 (58)62 (98)200 (163)2e40/15
BFGS ros noiseless 1.1 (0.4)1 (0.3)1.0 (0.2)1.00 (0.2)2.1 (2)409 (677)3e40/15
MCS huyer noiseless 14 (23)127 (121)374 (373)367 (342)711 (546)5e40/15
NELDERDOERR doerr noiseless 1.0 (0.4)1.1 (0.3)1.2 (0.8)1.3 (0.8)1.2 (0.4)1.2 (0.6)1.1 (0.7)★315/15
SLSQP-11 -207 0.89 (0.1)0.77 (0.1)0.79 (0.1)0.77 (0.1)★241 (88)287 (552)9e40/15
BFGS-P-StPt 1.3 (0.4)1.0 (0.1)1.1 (0.1)1.1 (0.1)0.80 (0.1)1.1 (0.1)539 (1047)11/15

Δ fopt
f14, 3-D
1e1
2.0
1e0
17
1e-1
28
1e-2
43
1e-3
71
1e-5
110
1e-7
194
#succ
15/15
NEWUOA ros noiseless 4.5 (2)1.1 (0.5)1.0 (0.4)1.0 (0.4)1.2 (0.1)3.1 (0.9)17 (10)9/15
BFGS ros noiseless 4.1 (2)1.5 (1)1.5 (1.0)1.3 (0.8)1.1 (0.2)1.0 (0.3)29 (27)4/15
MCS huyer noiseless 2.7 (4)12 (1)11 (11)7.9 (13)5.7 (8)50 (44)5e40/15
NELDERDOERR doerr noiseless 2.9 (2)1.1 (0.7)1.4 (0.3)1.8 (0.7)1.5 (0.4)1.6 (0.3)1.2 (0.3)15/15
SLSQP-11 -207 2.6 (2)0.90 (0.3)0.83 (0.4)0.85 (0.3)0.74 (0.3)0.75 (0.2)38 (97)11/15
BFGS-P-StPt 2.7 (3)0.94 (0.3)1.2 (0.4)1.3 (0.3)1.1 (0.2)1.2 (0.1)4.6 (3)15/15

Δ fopt
f15, 3-D
1e1
121
1e0
1372
1e-1
6285
1e-2
8282
1e-3
8429
1e-5
8787
1e-7
9041
#succ
15/15
NEWUOA ros noiseless 3.5 (8)3.4 (1)4.5 (4)3.4 (4)3.3 (2)3.2 (3)3.1 (3)6/15
BFGS ros noiseless 7.3 (6)17 (32)22 (15)17 (28)16 (18)16 (22)15 (22)1/15
MCS huyer noiseless 1.8 (3)1 (0.2)1.8 (3)1.4 (2)1.3 (1)1.6 (2)1.5 (2)15/15
NELDERDOERR doerr noiseless 1.4 (5)1.0 (2)2.5 (5)1.9 (8)1.9 (4)1.8 (3)1.8 (2)13/15
SLSQP-11 -207 5.0 (13)6.4 (6)9.2 (9)7.0 (9)6.8 (5)6.6 (5)6.4 (14)10/15
BFGS-P-StPt 21 (32)81 (116)2e40/15

Δ fopt
f16, 3-D
1e1
41
1e0
319
1e-1
582
1e-2
789
1e-3
1864
1e-5
3204
1e-7
3361
#succ
15/15
NEWUOA ros noiseless 4.4 (6)6.6 (6)12 (11)58 (58)149 (136)2e40/15
BFGS ros noiseless 71 (37)154 (164)2e40/15
MCS huyer noiseless 4.1 (8)2.1 (4)11 (11)33 (55)127 (182)5e40/15
NELDERDOERR doerr noiseless 1.2 (2)2.8 (4)3.4 (4)3.9 (3)★33.2 (3)★32.6 (1)★46.3 (6)14/15
SLSQP-11 -207 66 (134)367 (329)1750 (2064)7e40/15
BFGS-P-StPt 283 (231)668 (576)2347 (1986)9e40/15

Δ fopt
f17, 3-D
1e1
4.0
1e0
78
1e-1
282
1e-2
491
1e-3
1134
1e-5
2347
1e-7
3469
#succ
15/15
NEWUOA ros noiseless 2.4 (0.5)9.1 (9)19 (20)143 (146)2e40/15
BFGS ros noiseless 43 (77)45 (30)73360/15
MCS huyer noiseless 0.90 (0.8)2.6 (2)5.6 (5)16 (14)181 (144)5e40/15
NELDERDOERR doerr noiseless 1.7 (0.6)3.8 (2)8.5 (11)36 (82)69 (82)5e40/15
SLSQP-11 -207 2.1 (7)46 (51)6e40/15
BFGS-P-StPt 31 (18)156 (148)2e40/15

Δ fopt
f18, 3-D
1e1
40
1e0
145
1e-1
1289
1e-2
3084
1e-3
3523
1e-5
4738
1e-7
5527
#succ
15/15
NEWUOA ros noiseless 7.3 (7)17 (16)34 (48)2e40/15
BFGS ros noiseless 33 (49)84880/15
MCS huyer noiseless 4.0 (5)2.9 (1)20 (13)5e40/15
NELDERDOERR doerr noiseless 1.9 (1)5.4 (6)7.0 (8)16 (21)72 (55)169 (144)6e40/15
SLSQP-11 -207 18 (14)582 (595)6e40/15
BFGS-P-StPt 104 (240)2e40/15

Δ fopt
f19, 3-D
1e1
1
1e0
1
1e-1
109
1e-2
6764
1e-3
7367
1e-5
7399
1e-7
7441
#succ
15/15
NEWUOA ros noiseless 20 (6)1275 (4029)280 (170)25 (16)54 (55)54 (53)53 (47)4/15
BFGS ros noiseless 113 (134)872 (590)162 (197)33 (50)1e40/15
MCS huyer noiseless 1 (0)1 (0)11 (25)1.0 (0.4)1.0 (0.5)1 (0.4)1.00 (0.4)15/15
NELDERDOERR doerr noiseless 7.6 (6)146 (172)20 (7)5.4 (9)11 (11)11 (10)11 (25)7/15
SLSQP-11 -207 1 (0)1 (0)0.14 (0)★49e40/15
BFGS-P-StPt 1 (0)1 (0)0.20 (0.1)60 (57)6e40/15

Δ fopt
f20, 3-D
1e1
8.0
1e0
385
1e-1
2291
1e-2
2398
1e-3
2481
1e-5
2573
1e-7
2776
#succ
15/15
NEWUOA ros noiseless 1.4 (0.2)1.1 (2)3.9 (5)3.7 (8)3.6 (3)3.4 (7)3.2 (7)12/15
BFGS ros noiseless 1.9 (1)1.7 (1)5.5 (6)5.3 (8)5.1 (5)4.9 (4)4.6 (3)8/15
MCS huyer noiseless 2.4 (2)3.2 (0.8)3.5 (0.5)3.4 (2)3.2 (2)3.1 (0.5)2.9 (1)15/15
NELDERDOERR doerr noiseless 1.8 (1)3.6 (5)10 (7)10 (8)10 (7)9.4 (23)8.7 (15)13/15
SLSQP-11 -207 1.4 (0)4.1 (6)11 (11)10 (11)10 (12)10 (6)8.9 (8)14/15
BFGS-P-StPt 15 (0)3.4 (2)3.0 (3)2.9 (4)2.8 (5)2.7 (4)2.5 (2)14/15

Δ fopt
f21, 3-D
1e1
6.0
1e0
184
1e-1
425
1e-2
439
1e-3
458
1e-5
469
1e-7
482
#succ
14/15
NEWUOA ros noiseless 1.6 (0.8)2.7 (1)3.5 (5)3.5 (5)3.4 (3)3.4 (3)3.4 (3)15/15
BFGS ros noiseless 2.1 (1)3.3 (3)3.5 (4)3.4 (2)3.3 (3)3.3 (2)3.2 (3)14/15
MCS huyer noiseless 6.2 (1)2.1 (2)4.4 (4)4.3 (7)4.1 (7)4.1 (4)4.2 (4)15/15
NELDERDOERR doerr noiseless 2.0 (1)2.8 (5)2.9 (4)2.8 (3)2.7 (3)2.7 (3)2.6 (2)15/15
SLSQP-11 -207 2.7 (3)1.8 (2)1.7 (3)1.6 (1)1.6 (2)1.6 (1)2.3 (4)15/15
BFGS-P-StPt 6.6 (8)2.8 (3)5.2 (4)5.1 (5)4.9 (4)5.3 (8)16 (23)6/15

Δ fopt
f22, 3-D
1e1
18
1e0
170
1e-1
354
1e-2
362
1e-3
384
1e-5
401
1e-7
414
#succ
15/15
NEWUOA ros noiseless 2.8 (4)2.5 (4)5.8 (2)5.8 (44)5.6 (13)5.5 (2)5.7 (12)14/15
BFGS ros noiseless 3.3 (3)2.6 (2)2.1 (2)2.1 (3)2.0 (1)2.0 (2)2.0 (2)15/15
MCS huyer noiseless 3.3 (4)1.6 (3)1.2 (2)1.2 (1)4.6 (9)4.5 (8)4.6 (1)15/15
NELDERDOERR doerr noiseless 4.1 (3)2.0 (2)2.2 (4)2.2 (1)2.1 (5)2.0 (1)2.0 (1)15/15
SLSQP-11 -207 2.2 (2)2.4 (0.9)2.1 (2)2.1 (2)2.0 (2)2.0 (0.5)2.1 (2)15/15
BFGS-P-StPt 2.6 (1)3.5 (3)3.7 (4)3.6 (3)3.4 (3)5.1 (5)16 (34)2/15

Δ fopt
f23, 3-D
1e1
3.0
1e0
407
1e-1
906
1e-2
1215
1e-3
2214
1e-5
2293
1e-7
2393
#succ
15/15
NEWUOA ros noiseless 10 (5)2.7 (3)24 (49)109 (85)2e40/15
BFGS ros noiseless 15 (12)8.7 (12)112 (191)1e40/15
MCS huyer noiseless 0.87 (0.3)2.7 (2)12 (9)39 (26)326 (255)5e40/15
NELDERDOERR doerr noiseless 5.8 (5)1.00 (1)1.0 (0.9)★21.0 (1)★31.1 (2)★21.4 (3)★31.4 (1)★415/15
SLSQP-11 -207 21 (30)6.6 (5)21 (24)22 (16)15 (17)83 (74)6e40/15
BFGS-P-StPt 126 (93)75 (72)754 (1710)9e40/15

Δ fopt
f24, 3-D
1e1
97
1e0
10391
1e-1
1.0e5
1e-2
3.6e5
1e-3
3.6e5
1e-5
3.6e5
1e-7
3.6e5
#succ
2/15
NEWUOA ros noiseless 2.5 (1)1.0 (0.8)2e40/15
BFGS ros noiseless 9.3 (7)86000/15
MCS huyer noiseless 17 (19)2.0 (1)1.0 (1)1 (1)1 (0.9)1 (1)1 (0.8)2/15
NELDERDOERR doerr noiseless 2.3 (3)1.5 (1)3.9 (7)2.4 (2)2.4 (2)2.4 (1)2.4 (4)1/15
SLSQP-11 -207 8.2 (7)3.2 (6)8.4 (12)6e40/15
BFGS-P-StPt 11 (8)25 (24)2e40/15

Previous dimension | Dimension = 5 | Next dimension

Δ fopt
f1, 5-D
1e1
11
1e0
12
1e-1
12
1e-2
12
1e-3
12
1e-5
12
1e-7
12
#succ
15/15
NEWUOA ros noiseless 1.1 (0)1.0 (0.1)1.0 (0.1)1.0 (0)1.0 (0)1.0 (0.1)1.0 (0.1)15/15
BFGS ros noiseless 1.2 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)15/15
MCS huyer noiseless 1 (0.1)1.9 (2)2.5 (2)2.6 (2)2.6 (2)2.6 (2)2.6 (2)15/15
NELDERDOERR doerr noiseless 1.5 (1)3.5 (1)5.6 (1)7.6 (2)10 (2)14 (3)18 (3)15/15
SLSQP-11 -207 0.91 (0)0.83 (0)★40.83 (0)★40.83 (0)★40.83 (0)★40.83 (0)★40.83 (0)★415/15
BFGS-P-StPt 1.5 (0)1.3 (0)1.3 (0)1.3 (0)1.3 (0)1.3 (0)1.4 (0.3)15/15

Δ fopt
f2, 5-D
1e1
83
1e0
87
1e-1
88
1e-2
89
1e-3
90
1e-5
92
1e-7
94
#succ
15/15
NEWUOA ros noiseless 5.7 (4)22 (16)46 (32)60 (32)85 (28)129 (68)166 (51)15/15
BFGS ros noiseless 3.9 (3)5.7 (3)6.3 (2)6.5 (2)6.6 (2)6.9 (1)7.1 (2)15/15
MCS huyer noiseless 1.1 (0.7)1.6 (1)2.2 (1)3.3 (0.3)4.7 (0.8)6.5 (1)29 (28)14/15
NELDERDOERR doerr noiseless 4.9 (3)8.2 (6)9.0 (5)9.3 (6)10 (5)10 (7)10 (7)15/15
SLSQP-11 -207 1.1 (0.1)1.2 (0.5)1.3 (0.5)1.4 (0.4)★21.5 (0.6)★21.8 (0.7)★31.9 (0.3)★215/15
BFGS-P-StPt 2.5 (1)2.5 (1)2.6 (1)2.8 (1)2.9 (1)3.2 (0.9)3.4 (1)15/15

Δ fopt
f3, 5-D
1e1
716
1e0
1622
1e-1
1637
1e-2
1642
1e-3
1646
1e-5
1650
1e-7
1654
#succ
15/15
NEWUOA ros noiseless 6.1 (9)229 (218)3e40/15
BFGS ros noiseless 107 (149)2e40/15
MCS huyer noiseless 1.2 (1)24 (40)216 (285)215 (248)215 (92)214 (199)214 (284)2/15
NELDERDOERR doerr noiseless 1.5 (2)33 (48)268 (380)268 (302)267 (283)266 (286)266 (498)3/15
SLSQP-11 -207 17 (15)879 (624)1e50/15
BFGS-P-StPt 97 (160)3e40/15

Δ fopt
f4, 5-D
1e1
809
1e0
1633
1e-1
1688
1e-2
1758
1e-3
1817
1e-5
1886
1e-7
1903
#succ
15/15
NEWUOA ros noiseless 27 (18)305 (269)3e40/15
BFGS ros noiseless 169 (128)2e40/15
MCS huyer noiseless 4.1 (6)5e40/15
NELDERDOERR doerr noiseless 7.1 (6)898 (1163)870 (563)835 (796)808 (702)779 (756)772 (985)1/15
SLSQP-11 -207 59 (26)1e50/15
BFGS-P-StPt 3e40/15

Δ fopt
f5, 5-D
1e1
10
1e0
10
1e-1
10
1e-2
10
1e-3
10
1e-5
10
1e-7
10
#succ
15/15
NEWUOA ros noiseless 1.3 (0.1)1.5 (0.3)1.5 (0.2)1.5 (0.3)1.5 (0.2)1.5 (0.2)1.5 (0.3)15/15
BFGS ros noiseless 1.9 (0.3)3.0 (0.9)3.1 (0.6)3.1 (1)3.1 (0.6)3.1 (0.9)3.1 (0.5)15/15
MCS huyer noiseless 1 (0)★21 (0)★41 (0)★41 (0)★41 (0)★41 (0)★41 (0)★415/15
NELDERDOERR doerr noiseless 1.9 (0.7)2.4 (0.9)2.5 (0.8)2.5 (0.8)2.5 (0.6)2.5 (0.9)2.5 (0.8)15/15
SLSQP-11 -207 1.6 (0)2.3 (0)3.0 (0)3.0 (0)3.0 (0)3.0 (0)3.0 (0)15/15
BFGS-P-StPt 1.6 (0)2.3 (0)3.0 (0)3.0 (0)3.0 (0)3.0 (0)3.0 (0)15/15

Δ fopt
f6, 5-D
1e1
114
1e0
214
1e-1
281
1e-2
404
1e-3
580
1e-5
1038
1e-7
1332
#succ
15/15
NEWUOA ros noiseless 1.7 (1)2.4 (1)3.6 (2)3.6 (1)3.3 (1)2.7 (1)2.9 (1)15/15
BFGS ros noiseless 3.0 (2)3.3 (1)3.4 (1)3.0 (1)2.5 (0.9)2.0 (0.6)7.8 (4)15/15
MCS huyer noiseless 2.7 (4)47 (193)41 (95)61 (54)71 (111)46 (88)54 (75)4/15
NELDERDOERR doerr noiseless 5.1 (7)5.6 (7)5.6 (9)4.9 (4)5.3 (5)5.6 (5)8.5 (8)14/15
SLSQP-11 -207 2.9 (1)2.1 (1)2.2 (1)1.7 (0.9)1.4 (0.5)0.99 (0.8)2.2 (3)15/15
BFGS-P-StPt 3.7 (2)2.5 (1)2.9 (2)2.5 (0.7)2.1 (0.8)1.6 (0.4)6.8 (10)15/15

Δ fopt
f7, 5-D
1e1
24
1e0
324
1e-1
1171
1e-2
1451
1e-3
1572
1e-5
1572
1e-7
1597
#succ
15/15
NEWUOA ros noiseless 10 (19)13 (17)60 (76)3e40/15
BFGS ros noiseless 6000/15
MCS huyer noiseless 2.8 (4)5.9 (4)13 (12)141 (302)5e40/15
NELDERDOERR doerr noiseless 1.3 (0.5)7.5 (7)15 (17)39 (27)71 (44)71 (85)71 (75)9/15
SLSQP-11 -207 286 (368)1064 (1325)1e50/15
BFGS-P-StPt 220 (643)8000/15

Δ fopt
f8, 5-D
1e1
73
1e0
273
1e-1
336
1e-2
372
1e-3
391
1e-5
410
1e-7
422
#succ
15/15
NEWUOA ros noiseless 1.0 (1.0)1.1 (0.5)1.2 (0.9)1.2 (1)1.2 (0.8)1.2 (0.7)1.2 (0.3)15/15
BFGS ros noiseless 2.1 (0.9)1.8 (2)1.6 (2)1.5 (2)1.5 (0.6)1.5 (2)1.5 (1)15/15
MCS huyer noiseless 1.5 (0.9)1.0 (1)1.0 (0.7)1.0 (0.8)1.1 (0.9)1.1 (0.6)1.1 (0.6)15/15
NELDERDOERR doerr noiseless 2.1 (3)2.4 (2)2.4 (1)2.3 (2)2.3 (1)2.4 (1)2.4 (1)15/15
SLSQP-11 -207 1.3 (0.5)1.1 (0.7)1.0 (0.7)1.0 (0.6)1.0 (0.5)1.0 (0.6)1.0 (0.7)15/15
BFGS-P-StPt 1.9 (0.3)1.0 (0.4)1.1 (0.2)1.1 (0.3)1.1 (0.1)1.1 (0.2)1.1 (0.2)15/15

Δ fopt
f9, 5-D
1e1
35
1e0
127
1e-1
214
1e-2
263
1e-3
300
1e-5
335
1e-7
369
#succ
15/15
NEWUOA ros noiseless 1.8 (0.5)3.6 (2)2.5 (3)2.1 (1)1.9 (2)1.9 (0.9)1.7 (0.9)15/15
BFGS ros noiseless 3.6 (2)3.0 (1)2.0 (1)1.8 (1)1.6 (0.9)1.5 (0.8)1.4 (0.5)15/15
MCS huyer noiseless 0.99 (0.5)1 (0.2)1 (0.2)1.0 (0.2)1.0 (0.0)1.0 (0.2)1 (0.1)15/15
NELDERDOERR doerr noiseless 2.3 (4)3.1 (2)2.5 (0.3)2.3 (0.7)2.1 (0.8)2.1 (1.0)2.0 (0.4)15/15
SLSQP-11 -207 0.63 (0)0.46 (0)★40.54 (0)★40.55 (0)★40.53 (0)★40.51 (0)★40.50 (0)★415/15
BFGS-P-StPt 1.1 (0)0.73 (0)0.63 (0)0.61 (0.0)0.62 (0.0)0.60 (0.0)0.57 (9e-3)15/15

Δ fopt
f10, 5-D
1e1
349
1e0
500
1e-1
574
1e-2
607
1e-3
626
1e-5
829
1e-7
880
#succ
15/15
NEWUOA ros noiseless 3.1 (6)5.5 (3)8.1 (5)11 (7)14 (7)16 (7)21 (9)15/15
BFGS ros noiseless 1.0 (0.6)1.00 (0.2)1.0 (0.4)1 (0.4)1.00 (0.3)1.1 (0.5)23 (42)5/15
MCS huyer noiseless 277 (359)5e40/15
NELDERDOERR doerr noiseless 1.2 (0.9)1.3 (0.5)1.2 (0.5)1.2 (0.3)1.2 (0.6)1.0 (0.2)1.00 (0.2)15/15
SLSQP-11 -207 0.25 (0.0)★30.20 (0.0)★30.19 (0.0)★30.19 (0.0)★30.20 (0.1)★30.22 (0.1)★323 (41)10/15
BFGS-P-StPt 0.67 (0.3)0.48 (0.2)0.44 (0.2)0.46 (0.1)0.51 (0.2)0.46 (0.1)0.46 (0.1)15/15

Δ fopt
f11, 5-D
1e1
143
1e0
202
1e-1
763
1e-2
977
1e-3
1177
1e-5
1467
1e-7
1673
#succ
15/15
NEWUOA ros noiseless 3.5 (1)4.7 (1)1.8 (0.6)1.7 (0.3)1.8 (0.6)2.0 (0.3)2.2 (0.4)15/15
BFGS ros noiseless 1.00 (0.2)1.00 (0.5)1.1 (0.9)1.9 (2)8.2 (12)199 (99)4e40/15
MCS huyer noiseless 82 (106)461 (337)5e40/15
NELDERDOERR doerr noiseless 4.5 (5)4.7 (3)1.5 (0.8)1.4 (0.8)1.2 (0.5)1.1 (0.2)1.2 (0.7)15/15
SLSQP-11 -207 0.28 (0.1)0.27 (0.1)0.08 (0.0)0.07 (0.0)0.07 (0.0)7.2 (18)195 (263)0/15
BFGS-P-StPt 0.90 (0.9)0.73 (0.3)0.21 (0.1)0.18 (0.1)0.18 (0.2)0.17 (0.2)0.17 (0.1)★315/15

Δ fopt
f12, 5-D
1e1
108
1e0
268
1e-1
371
1e-2
413
1e-3
461
1e-5
1303
1e-7
1494
#succ
15/15
NEWUOA ros noiseless 3.5 (3)2.6 (2)2.5 (2)2.5 (2)2.6 (2)1.1 (0.7)1.1 (0.7)15/15
BFGS ros noiseless 1.1 (0.8)1.00 (0.6)1.00 (0.7)1 (0.8)1.0 (0.6)2.0 (4)49 (76)5/15
MCS huyer noiseless 1.0 (0.2)18 (56)17 (13)15 (21)22 (11)26 (36)56 (84)6/15
NELDERDOERR doerr noiseless 4.4 (4)2.9 (4)2.7 (0.7)2.7 (3)2.7 (2)1.1 (1)1.2 (0.9)15/15
SLSQP-11 -207 2.8 (3)1.7 (2)1.5 (1)1.5 (2)1.5 (1)0.88 (2)4.2 (9)11/15
BFGS-P-StPt 7.9 (6)4.8 (2)4.2 (2)4.1 (2)3.9 (1)1.6 (0.3)1.5 (0.5)15/15

Δ fopt
f13, 5-D
1e1
132
1e0
195
1e-1
250
1e-2
319
1e-3
1310
1e-5
1752
1e-7
2255
#succ
15/15
NEWUOA ros noiseless 3.2 (3)9.3 (6)35 (40)55 (51)54 (76)335 (460)4e40/15
BFGS ros noiseless 1.0 (0.2)1.00 (0.1)1.00 (0.0)1.0 (0.1)4.8 (0.7)136 (174)5e40/15
MCS huyer noiseless 41 (19)214 (352)462 (415)2259 (2743)550 (439)5e40/15
NELDERDOERR doerr noiseless 2.4 (4)2.4 (4)5.2 (5)6.1 (9)1.9 (1)3.9 (3)5.0 (10)★215/15
SLSQP-11 -207 0.76 (0.1)0.74 (0.1)0.76 (0.0)0.73 (0.0)★435 (45)437 (285)1e50/15
BFGS-P-StPt 0.95 (0.1)0.86 (0.1)0.85 (0.1)0.85 (0.0)0.24 (0.0)0.86 (0.6)863 (1194)2/15

Δ fopt
f14, 5-D
1e1
10
1e0
41
1e-1
58
1e-2
90
1e-3
139
1e-5
251
1e-7
476
#succ
15/15
NEWUOA ros noiseless 1.6 (0.6)1.00 (0.3)1.0 (0.2)1 (0.2)1.2 (0.3)5.5 (2)2523 (1587)0/15
BFGS ros noiseless 2.2 (1)1.7 (1)1.8 (0.9)1.5 (0.6)1.3 (0.6)1.0 (0.3)350 (449)0/15
MCS huyer noiseless 1.4 (2)2.8 (3)2.7 (2)2.5 (2)2.8 (0.8)225 (166)5e40/15
NELDERDOERR doerr noiseless 1.0 (0.9)1.1 (0.7)1.4 (0.3)1.6 (0.5)1.7 (0.6)1.6 (0.3)1.3 (0.3)15/15
SLSQP-11 -207 0.89 (0.8)0.58 (0.2)0.74 (0.2)0.77 (0.1)0.70 (0.2)0.59 (0.1)★2512 (1170)3/15
BFGS-P-StPt 1 (0.8)0.60 (0.3)0.86 (0.3)0.97 (0.1)0.88 (0.1)0.81 (0.1)2.2 (2)14/15

Δ fopt
f15, 5-D
1e1
511
1e0
9310
1e-1
19369
1e-2
19743
1e-3
20073
1e-5
20769
1e-7
21359
#succ
14/15
NEWUOA ros noiseless 5.8 (4)41 (45)3e40/15
BFGS ros noiseless 87 (61)2e40/15
MCS huyer noiseless 4.0 (3)25 (15)38 (28)38 (55)37 (38)36 (40)5e40/15
NELDERDOERR doerr noiseless 4.5 (5)20 (18)73 (104)72 (112)71 (76)69 (72)67 (86)1/15
SLSQP-11 -207 30 (43)153 (182)1e50/15
BFGS-P-StPt 153 (159)3e40/15

Δ fopt
f16, 5-D
1e1
120
1e0
612
1e-1
2662
1e-2
10163
1e-3
10449
1e-5
11644
1e-7
12095
#succ
15/15
NEWUOA ros noiseless 2.1 (7)29 (25)4e40/15
BFGS ros noiseless 153 (147)960 (2737)4e40/15
MCS huyer noiseless 1.9 (2)18 (26)131 (303)5e40/15
NELDERDOERR doerr noiseless 1.6 (2)4.8 (6)10 (4)★26.3 (10)13 (16)59 (62)119 (107)0/15
SLSQP-11 -207 250 (321)1e50/15
BFGS-P-StPt 716 (1184)2e50/15

Δ fopt
f17, 5-D
1e1
5.0
1e0
215
1e-1
899
1e-2
2861
1e-3
3669
1e-5
6351
1e-7
7934
#succ
15/15
NEWUOA ros noiseless 2.4 (1)40 (10)618 (609)3e40/15
BFGS ros noiseless 125 (204)645 (1289)2e40/15
MCS huyer noiseless 2.0 (2)24 (24)63 (140)5e40/15
NELDERDOERR doerr noiseless 2.0 (2)10 (19)48 (38)1e50/15
SLSQP-11 -207 31 (27)300 (418)1e50/15
BFGS-P-StPt 55 (98)2610 (2763)3e40/15

Δ fopt
f18, 5-D
1e1
103
1e0
378
1e-1
3968
1e-2
8451
1e-3
9280
1e-5
10905
1e-7
12469
#succ
15/15
NEWUOA ros noiseless 32 (76)1350 (1798)9e40/15
BFGS ros noiseless 57 (106)2e40/15
MCS huyer noiseless 19 (25)154 (408)5e40/15
NELDERDOERR doerr noiseless 4.3 (7)28 (37)43 (34)1e50/15
SLSQP-11 -207 46 (64)1e50/15
BFGS-P-StPt 75 (94)4e40/15

Δ fopt
f19, 5-D
1e1
1
1e0
1
1e-1
242
1e-2
1.0e5
1e-3
1.2e5
1e-5
1.2e5
1e-7
1.2e5
#succ
15/15
NEWUOA ros noiseless 14 (2)2.7e4 (1e4)1417 (1367)5e50/15
BFGS ros noiseless 1655 (2856)2.2e4 (1e4)1781 (2503)3e40/15
MCS huyer noiseless 1 (0)1 (0)1.0 (0.4)5e40/15
NELDERDOERR doerr noiseless 12 (8)340 (228)107 (153)14 (21)1e50/15
SLSQP-11 -207 1 (0)1 (0)0.12 (0)1e50/15
BFGS-P-StPt 1 (0)1 (0)0.14 (0.0)1e50/15

Δ fopt
f20, 5-D
1e1
16
1e0
851
1e-1
38111
1e-2
51362
1e-3
54470
1e-5
54861
1e-7
55313
#succ
14/15
NEWUOA ros noiseless 1 (0.2)3.3 (3)3e40/15
BFGS ros noiseless 1.8 (0.5)2.5 (2)10 (13)7.6 (7)7.2 (14)7.1 (5)7.1 (11)1/15
MCS huyer noiseless 2.7 (1)1.00 (1.0)9.1 (8)6.8 (9)6.4 (11)6.4 (8)6.3 (14)2/15
NELDERDOERR doerr noiseless 2.2 (2)8.5 (5)37 (47)28 (22)26 (19)26 (19)26 (24)1/15
SLSQP-11 -207 0.81 (0)2.3 (2)1e50/15
BFGS-P-StPt 7.7 (1)3.3 (3)1.5 (3)1.1 (1.0)1.1 (0.6)1.1 (2)1.1 (1)7/15

Δ fopt
f21, 5-D
1e1
41
1e0
1157
1e-1
1674
1e-2
1692
1e-3
1705
1e-5
1729
1e-7
1757
#succ
14/15
NEWUOA ros noiseless 1.1 (0.2)2.2 (4)1.8 (4)1.8 (3)1.8 (2)1.8 (1)1.9 (0.7)15/15
BFGS ros noiseless 3.8 (4)1.4 (2)1.9 (2)1.9 (2)1.9 (3)1.9 (3)2.0 (3)15/15
MCS huyer noiseless 1.0 (0.9)3.9 (8)5.1 (5)5.1 (10)5.0 (5)5.0 (3)5.0 (6)14/15
NELDERDOERR doerr noiseless 2.9 (6)1.5 (1)1.2 (1)1.2 (0.2)1.2 (0.4)1.2 (1.0)1.2 (1)15/15
SLSQP-11 -207 1.3 (2)0.81 (0.7)1.3 (0.6)1.2 (2)1.2 (2)1.3 (2)1.4 (3)15/15
BFGS-P-StPt 4.4 (9)1.6 (1)2.1 (5)2.1 (1.0)2.1 (0.8)2.7 (3)16 (16)3/15

Δ fopt
f22, 5-D
1e1
71
1e0
386
1e-1
938
1e-2
980
1e-3
1008
1e-5
1040
1e-7
1068
#succ
14/15
NEWUOA ros noiseless 2.1 (3)2.1 (4)2.0 (3)2.0 (4)2.1 (1)2.3 (4)2.4 (4)15/15
BFGS ros noiseless 3.1 (3)2.9 (4)2.1 (3)2.1 (1)2.0 (2)2.0 (2)2.6 (1)14/15
MCS huyer noiseless 1.0 (0.5)1.1 (1)12 (11)11 (13)11 (15)11 (9)15 (10)14/15
NELDERDOERR doerr noiseless 2.5 (7)2.5 (2)2.1 (2)2.0 (4)2.0 (1.0)2.0 (3)2.1 (1)15/15
SLSQP-11 -207 1.8 (1)1.1 (0.7)1.8 (4)1.7 (1)1.7 (4)1.7 (1)2.0 (1)14/15
BFGS-P-StPt 3.7 (4)2.6 (2)3.0 (3)2.9 (2)2.8 (3)6.9 (8)189 (163)1/15

Δ fopt
f23, 5-D
1e1
3.0
1e0
518
1e-1
14249
1e-2
27890
1e-3
31654
1e-5
33030
1e-7
34256
#succ
15/15
NEWUOA ros noiseless 6.2 (3)2.4 (2)7.1 (5)3e40/15
BFGS ros noiseless 11 (8)31 (26)2e40/15
MCS huyer noiseless 3.4 (3)2.4 (2)51 (78)5e40/15
NELDERDOERR doerr noiseless 1.5 (0.8)1.00 (1)1.0 (0.4)★23.6 (5)15 (15)1e50/15
SLSQP-11 -207 27 (74)13 (12)17 (26)25 (31)1e50/15
BFGS-P-StPt 126 (369)284 (327)2e50/15

Δ fopt
f24, 5-D
1e1
1622
1e0
2.2e5
1e-1
6.4e6
1e-2
9.6e6
1e-3
9.6e6
1e-5
1.3e7
1e-7
1.3e7
#succ
3/15
NEWUOA ros noiseless 2.9 (2)2.1 (2)3e40/15
BFGS ros noiseless 69 (96)2e40/15
MCS huyer noiseless 7.0 (8)3.5 (4)5e40/15
NELDERDOERR doerr noiseless 1.0 (1)1.4 (0.9)1e50/15
SLSQP-11 -207 6.4 (7)1e50/15
BFGS-P-StPt 53 (50)3e40/15

Previous dimension | Dimension = 10 | Next dimension

Δ fopt
f1, 10-D
1e1
22
1e0
23
1e-1
23
1e-2
23
1e-3
23
1e-5
23
1e-7
23
#succ
15/15
NEWUOA ros noiseless 1 (0)0.99 (0.0)0.99 (0.0)1.0 (0.1)1.0 (0.0)1.0 (0.0)1.0 (0.1)15/15
BFGS ros noiseless 1.0 (0)1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)15/15
MCS huyer noiseless 1.2 (0.3)2.0 (2)2.0 (1.0)2.2 (2)2.9 (0.9)2.9 (2)2.9 (2)15/15
NELDERDOERR doerr noiseless 2.4 (2)5.2 (2)8.1 (3)11 (4)14 (4)21 (5)32 (8)15/15
SLSQP-11 -207 0.68 (0)★40.65 (0)★40.65 (0)★40.65 (0)★40.65 (0)★40.65 (0)★40.65 (0)★415/15
BFGS-P-StPt 1.2 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)1.7 (0.5)13/15

Δ fopt
f2, 10-D
1e1
187
1e0
190
1e-1
191
1e-2
191
1e-3
193
1e-5
194
1e-7
195
#succ
15/15
NEWUOA ros noiseless 13 (7)37 (23)74 (46)104 (47)147 (72)219 (96)301 (59)15/15
BFGS ros noiseless 10 (4)12 (3)14 (2)14 (2)14 (2)15 (2)15 (2)15/15
MCS huyer noiseless 3.1 (1.0)4.6 (2)6.5 (2)7.6 (3)10 (4)11 (2)107 (103)2/15
NELDERDOERR doerr noiseless 22 (12)52 (28)83 (45)102 (109)119 (146)128 (109)203 (340)14/15
SLSQP-11 -207 1.6 (0.4)★31.6 (0.5)★31.7 (0.5)★31.9 (0.5)★32.0 (0.4)★32.3 (0.6)★32.6 (0.8)★315/15
BFGS-P-StPt 2.6 (0.1)2.8 (1)3.0 (1)3.3 (0.9)3.6 (2)4.0 (2)4.3 (2)15/15

Δ fopt
f3, 10-D
1e1
1739
1e0
3600
1e-1
3609
1e-2
3636
1e-3
3642
1e-5
3646
1e-7
3651
#succ
15/15
NEWUOA ros noiseless 6e40/15
BFGS ros noiseless 5e40/15
MCS huyer noiseless 11 (13)★34e40/15
NELDERDOERR doerr noiseless 179 (213)2e50/15
SLSQP-11 -207 2e50/15
BFGS-P-StPt 8e40/15

Δ fopt
f4, 10-D
1e1
2234
1e0
3626
1e-1
3660
1e-2
3695
1e-3
3707
1e-5
3744
1e-7
28767
#succ
12/15
NEWUOA ros noiseless 7e40/15
BFGS ros noiseless 5e40/15
MCS huyer noiseless 27 (18)★44e40/15
NELDERDOERR doerr noiseless 2e50/15
SLSQP-11 -207 2e50/15
BFGS-P-StPt 9e40/15

Δ fopt
f5, 10-D
1e1
20
1e0
20
1e-1
20
1e-2
20
1e-3
20
1e-5
20
1e-7
20
#succ
15/15
NEWUOA ros noiseless 1.2 (0.1)1.4 (0.1)1.4 (0.2)1.4 (0.2)1.4 (0.2)1.4 (0.2)1.4 (0.2)15/15
BFGS ros noiseless 2.2 (0.3)2.8 (0.3)2.9 (0.6)2.9 (0.6)2.9 (0.6)2.9 (0.4)2.9 (0.4)15/15
MCS huyer noiseless 1.0 (0.0)★41.0 (0.0)★41.0 (0.0)★41.0 (0.0)★41.0 (0.0)★41.0 (0.0)★41.0 (0.0)★415/15
NELDERDOERR doerr noiseless 3.1 (1)4.1 (1.0)4.2 (1)4.2 (1)4.2 (1)4.2 (1)4.2 (1)15/15
SLSQP-11 -207 1.3 (0)2.5 (0)2.5 (0)2.5 (0)2.5 (0)2.5 (0)2.5 (0)15/15
BFGS-P-StPt 1.3 (0)2.5 (0)2.5 (0)2.5 (0)2.5 (0)2.5 (0)2.5 (0)15/15

Δ fopt
f6, 10-D
1e1
412
1e0
623
1e-1
826
1e-2
1039
1e-3
1292
1e-5
1841
1e-7
2370
#succ
15/15
NEWUOA ros noiseless 2.0 (2)3.2 (3)4.0 (4)4.9 (6)5.5 (8)5.9 (8)6.2 (5)15/15
BFGS ros noiseless 3.7 (1)4.2 (1)4.5 (1)4.6 (1)4.5 (2)4.5 (2)66 (47)0/15
MCS huyer noiseless 18 (17)174 (87)169 (195)280 (127)4e40/15
NELDERDOERR doerr noiseless 3.7 (4)10 (5)15 (5)18 (7)25 (21)256 (237)2e50/15
SLSQP-11 -207 2.3 (0.7)2.0 (1)2.1 (0.4)2.3 (0.3)2.3 (0.6)2.4 (0.5)8.4 (4)4/15
BFGS-P-StPt 4.1 (2)3.7 (2)4.3 (2)4.5 (1)4.7 (1)4.8 (1)95 (134)8/15

Δ fopt
f7, 10-D
1e1
172
1e0
1611
1e-1
4195
1e-2
5099
1e-3
5141
1e-5
5141
1e-7
5389
#succ
15/15
NEWUOA ros noiseless 27 (39)1041 (602)1e50/15
BFGS ros noiseless 11000/15
MCS huyer noiseless 53 (59)4e40/15
NELDERDOERR doerr noiseless 59 (100)404 (384)2e50/15
SLSQP-11 -207 2e50/15
BFGS-P-StPt 13000/15

Δ fopt
f8, 10-D
1e1
326
1e0
921
1e-1
1114
1e-2
1217
1e-3
1267
1e-5
1315
1e-7
1343
#succ
15/15
NEWUOA ros noiseless 1.0 (0.5)1.5 (1)1.3 (2)1.3 (1)1.3 (1)1.3 (0.5)1.3 (0.8)15/15
BFGS ros noiseless 1.7 (0.5)1.5 (0.5)1.3 (0.5)1.3 (0.4)1.3 (0.8)1.2 (0.4)1.2 (0.5)15/15
MCS huyer noiseless 1.0 (0.5)1.4 (2)1.3 (2)1.3 (1)1.3 (0.9)1.3 (1)1.3 (1)15/15
NELDERDOERR doerr noiseless 1.3 (0.2)2.2 (2)2.7 (2)2.9 (1)3.1 (0.3)3.3 (0.8)3.6 (0.8)15/15
SLSQP-11 -207 1.4 (0.7)1.1 (0.3)0.97 (0.4)0.94 (0.3)0.93 (0.4)0.92 (0.4)0.91 (0.4)15/15
BFGS-P-StPt 1.9 (0.6)2.1 (2)1.8 (1)1.7 (1)1.7 (1)1.7 (2)1.6 (1.0)15/15

Δ fopt
f9, 10-D
1e1
200
1e0
648
1e-1
857
1e-2
993
1e-3
1065
1e-5
1138
1e-7
1185
#succ
15/15
NEWUOA ros noiseless 1.7 (0.5)1.7 (1)1.4 (0.8)1.3 (0.5)1.2 (0.7)1.2 (0.4)1.2 (0.4)15/15
BFGS ros noiseless 2.1 (1)1.9 (1.0)1.6 (0.6)1.4 (0.4)1.4 (0.4)1.3 (0.5)1.3 (0.2)15/15
MCS huyer noiseless 1.0 (0.1)1.0 (0.4)1.0 (0.3)1.0 (0.2)1.0 (0.3)1 (0.2)1.0 (0.2)15/15
NELDERDOERR doerr noiseless 2.7 (7)7.1 (7)6.5 (5)6.1 (4)6.0 (4)6.0 (3)6.0 (3)15/15
SLSQP-11 -207 0.82 (0)0.39 (0)★40.39 (0)★40.39 (0)★40.39 (0)★40.39 (0)★40.39 (0)★415/15
BFGS-P-StPt 1.3 (0)0.54 (0)0.52 (0)0.52 (0)0.51 (6e-3)0.51 (8e-3)0.51 (8e-3)15/15

Δ fopt
f10, 10-D
1e1
1835
1e0
2172
1e-1
2455
1e-2
2728
1e-3
2802
1e-5
4543
1e-7
4739
#succ
15/15
NEWUOA ros noiseless 2.1 (2)3.8 (3)6.0 (5)7.4 (2)10 (5)9.2 (4)12 (4)15/15
BFGS ros noiseless 1.0 (0.4)1.00 (0.4)1.00 (0.2)1.0 (0.2)1.0 (0.6)1.3 (0.5)924 (939)0/15
MCS huyer noiseless 4e40/15
NELDERDOERR doerr noiseless 9.5 (4)25 (17)34 (39)57 (49)335 (652)2e50/15
SLSQP-11 -207 0.16 (0.1)★40.15 (0.0)★40.14 (0.1)★40.14 (0.0)★40.15 (0.1)★40.10 (0.0)★45.3 (20)9/15
BFGS-P-StPt 0.35 (0.0)0.32 (0.0)0.30 (0.1)0.29 (0.0)0.31 (0.0)0.21 (0.0)0.22 (0.0)15/15

Δ fopt
f11, 10-D
1e1
266
1e0
1041
1e-1
2602
1e-2
2954
1e-3
3338
1e-5
4092
1e-7
4843
#succ
15/15
NEWUOA ros noiseless 11 (2)5.5 (1)3.1 (0.8)3.4 (0.8)4.0 (0.6)4.3 (0.7)4.6 (0.8)15/15
BFGS ros noiseless 1.0 (0.2)1.00 (0.5)1.7 (0.9)6.0 (9)56 (17)8e40/15
MCS huyer noiseless 4e40/15
NELDERDOERR doerr noiseless 13 (2)7.8 (5)5.4 (3)10 (17)17 (17)93 (50)2e50/15
SLSQP-11 -207 0.25 (0.1)★40.09 (0.0)★40.04 (0.0)★40.04 (0.0)★40.05 (8e-3)★40.62 (4)85 (81)0/15
BFGS-P-StPt 1.5 (2)0.45 (0.5)0.20 (0.2)0.19 (0.2)0.18 (0.1)0.17 (0.2)0.35 (0.6)★212/15

Δ fopt
f12, 10-D
1e1
515
1e0
896
1e-1
1240
1e-2
1390
1e-3
1569
1e-5
3660
1e-7
5154
#succ
15/15
NEWUOA ros noiseless 1.9 (1)2.0 (2)2.1 (2)2.3 (2)2.3 (1)1.2 (0.7)1.0 (0.4)15/15
BFGS ros noiseless 1.3 (0.6)1.4 (0.7)1.4 (0.4)1.3 (0.4)1.3 (0.4)2.6 (0.4)23 (13)9/15
MCS huyer noiseless 3.2 (3)3.9 (4)7.0 (19)11 (11)13 (7)76 (39)113 (190)1/15
NELDERDOERR doerr noiseless 3.0 (0.3)6.1 (10)7.2 (5)7.6 (5)7.7 (4)4.3 (4)6.5 (7)15/15
SLSQP-11 -207 1.9 (1)1.6 (1)1.4 (0.6)1.3 (0.7)1.3 (0.7)1.2 (2)4.2 (3)10/15
BFGS-P-StPt 3.5 (2)2.8 (1)2.4 (0.7)2.3 (0.3)2.1 (0.0)1.1 (0.4)1.0 (0.5)15/15

Δ fopt
f13, 10-D
1e1
387
1e0
596
1e-1
797
1e-2
1014
1e-3
4587
1e-5
6208
1e-7
7779
#succ
15/15
NEWUOA ros noiseless 2.0 (2)9.0 (12)20 (27)42 (38)29 (18)8e40/15
BFGS ros noiseless 1.00 (0.2)1.0 (0.1)1.00 (0.1)1.00 (0.1)86 (91)1e50/15
MCS huyer noiseless 37 (60)44 (35)59 (104)283 (710)4e40/15
NELDERDOERR doerr noiseless 7.2 (12)16 (19)40 (26)76 (66)64 (67)479 (564)2e50/15
SLSQP-11 -207 0.65 (0.0)0.64 (0.0)★20.62 (0.0)★40.61 (0.0)★452 (75)266 (254)3e50/15
BFGS-P-StPt 0.82 (0.1)0.79 (0.1)0.73 (0.0)0.71 (0.0)0.18 (3e-3)102 (131)4039 (2617)0/15

Δ fopt
f14, 10-D
1e1
37
1e0
98
1e-1
133
1e-2
205
1e-3
392
1e-5
687
1e-7
4305
#succ
15/15
NEWUOA ros noiseless 1.00 (0.4)1.0 (0.5)1.00 (0.1)1.00 (0.1)1.00 (0.1)7.3 (0.7)566 (230)0/15
BFGS ros noiseless 1.6 (0.3)1.6 (0.7)1.6 (0.7)1.4 (0.3)1.0 (0.3)1.00 (0.6)9e40/15
MCS huyer noiseless 1.1 (0.2)2.4 (0.2)2.9 (1)2.8 (0.8)2.8 (2)4e40/15
NELDERDOERR doerr noiseless 1.1 (1)2.4 (0.8)2.8 (5)3.5 (3)3.7 (2)6.2 (3)43 (36)0/15
SLSQP-11 -207 0.66 (0.2)0.58 (0.1)0.70 (0.2)★20.74 (0.1)★20.56 (0.1)★20.53 (0.0)★3727 (958)0/15
BFGS-P-StPt 1.1 (0.3)0.76 (0.3)0.94 (0.2)1.0 (0.3)0.74 (0.1)0.68 (0.1)3.7 (7)★22/15

Δ fopt
f15, 10-D
1e1
4774
1e0
39246
1e-1
73643
1e-2
74669
1e-3
75790
1e-5
77814
1e-7
79834
#succ
12/15
NEWUOA ros noiseless 170 (110)6e40/15
BFGS ros noiseless 4e40/15
MCS huyer noiseless 4e40/15
NELDERDOERR doerr noiseless 47 (19)2e50/15
SLSQP-11 -207 2e50/15
BFGS-P-StPt 8e40/15

Δ fopt
f16, 10-D
1e1
425
1e0
7029
1e-1
15779
1e-2
45669
1e-3
51151
1e-5
65798
1e-7
71570
#succ
15/15
NEWUOA ros noiseless 4.7 (6)9e40/15
BFGS ros noiseless 1e50/15
MCS huyer noiseless 17 (18)86 (39)4e40/15
NELDERDOERR doerr noiseless 1.4 (4)23 (25)2e50/15
SLSQP-11 -207 6940 (9813)2e50/15
BFGS-P-StPt 4e50/15

Δ fopt
f17, 10-D
1e1
26
1e0
429
1e-1
2203
1e-2
6329
1e-3
9851
1e-5
20190
1e-7
26503
#succ
15/15
NEWUOA ros noiseless 1.4 (0.6)2143 (2603)2e50/15
BFGS ros noiseless 53 (102)8e40/15
MCS huyer noiseless 1.0 (2)1374 (1781)4e40/15
NELDERDOERR doerr noiseless 1.2 (1)447 (545)2e50/15
SLSQP-11 -207 32 (50)2e50/15
BFGS-P-StPt 58 (163)1e50/15

Δ fopt
f18, 10-D
1e1
238
1e0
836
1e-1
7012
1e-2
15928
1e-3
27536
1e-5
37234
1e-7
42708
#succ
15/15
NEWUOA ros noiseless 558 (72)4e50/15
BFGS ros noiseless 4958 (3377)8e40/15
MCS huyer noiseless 57 (43)4e40/15
NELDERDOERR doerr noiseless 72 (103)3542 (4366)2e50/15
SLSQP-11 -207 2547 (3033)2e50/15
BFGS-P-StPt 3543 (2994)1e50/15

Δ fopt
f19, 10-D
1e1
1
1e0
1
1e-1
10609
1e-2
9.8e5
1e-3
1.4e6
1e-5
1.4e6
1e-7
1.4e6
#succ
15/15
NEWUOA ros noiseless 27 (13)3.2e5 (7e5)1e60/15
BFGS ros noiseless 1.9e4 (2e4)8e40/15
MCS huyer noiseless 1 (0)1 (0)1.0 (0.0)4e40/15
NELDERDOERR doerr noiseless 24 (12)1.2e4 (2e4)2e50/15
SLSQP-11 -207 1 (0)1 (0)6.8e-3 (5e-5)3e50/15
BFGS-P-StPt 1 (0)1 (0)0.01 (2e-3)3e50/15

Δ fopt
f20, 10-D
1e1
32
1e0
15426
1e-1
5.5e5
1e-2
5.7e5
1e-3
5.7e5
1e-5
5.8e5
1e-7
5.9e5
#succ
15/15
NEWUOA ros noiseless 1.00 (0.4)1.9 (2)1e50/15
BFGS ros noiseless 2.3 (0.5)1.1 (1)1e50/15
MCS huyer noiseless 4.4 (0.3)1.0 (1)4e40/15
NELDERDOERR doerr noiseless 2.3 (0.7)5.7 (2)2e50/15
SLSQP-11 -207 1 (0)4.0 (4)2e50/15
BFGS-P-StPt 17 (3)1.5 (0.4)1e50/15

Δ fopt
f21, 10-D
1e1
130
1e0
2236
1e-1
4392
1e-2
4487
1e-3
4618
1e-5
5074
1e-7
11329
#succ
15/15
NEWUOA ros noiseless 2.1 (3)7.4 (12)4.8 (7)4.7 (10)4.6 (3)4.2 (6)1.9 (2)13/15
BFGS ros noiseless 4.6 (4)2.9 (3)2.8 (5)2.7 (4)2.7 (3)2.5 (2)2.0 (3)6/15
MCS huyer noiseless 1.0 (0.9)20 (29)10 (8)10 (15)10 (10)9.1 (7)4.9 (14)6/15
NELDERDOERR doerr noiseless 8.4 (16)6.0 (14)3.7 (3)3.6 (2)3.5 (2)3.3 (3)1.6 (1)15/15
SLSQP-11 -207 1.8 (3)1.4 (3)1.2 (2)1.1 (3)1.1 (2)1.0 (2)0.70 (0.9)15/15
BFGS-P-StPt 2.7 (6)3.0 (2)2.5 (4)2.4 (5)2.4 (0.8)2.2 (2)7.8 (8)0/15

Δ fopt
f22, 10-D
1e1
98
1e0
2839
1e-1
6353
1e-2
6620
1e-3
6798
1e-5
8296
1e-7
10351
#succ
15/15
NEWUOA ros noiseless 6.7 (9)1.8 (1)2.5 (2)2.4 (2)2.4 (6)2.0 (0.9)1.7 (3)14/15
BFGS ros noiseless 6.6 (8)3.1 (5)4.4 (4)4.2 (3)4.2 (6)3.5 (3)5.7 (7)7/15
MCS huyer noiseless 1.1 (0.8)3.2 (2)6.4 (5)6.1 (6)6.0 (5)4.9 (3)12 (24)3/15
NELDERDOERR doerr noiseless 18 (19)2.5 (2)5.0 (16)4.9 (1)4.9 (10)4.0 (7)3.3 (1)14/15
SLSQP-11 -207 1.2 (1)0.60 (2)0.82 (2)0.79 (0.8)0.78 (0.6)0.67 (1)2.9 (5)9/15
BFGS-P-StPt 5.3 (0.7)1.5 (1)3.5 (5)3.4 (6)3.3 (3)8.2 (6)5e40/15

Δ fopt
f23, 10-D
1e1
3.0
1e0
915
1e-1
16425
1e-2
1.8e5
1e-3
2.0e5
1e-5
2.1e5
1e-7
2.1e5
#succ
15/15
NEWUOA ros noiseless 7.0 (5)3.6 (3)7e40/15
BFGS ros noiseless 15 (37)128 (135)5e40/15
MCS huyer noiseless 3.1 (5)15 (19)4e40/15
NELDERDOERR doerr noiseless 1.6 (0.8)1.4 (3)11 (10)2e50/15
SLSQP-11 -207 9.3 (5)15 (21)87 (128)2e50/15
BFGS-P-StPt 145 (207)264 (163)3e50/15

Δ fopt
f24, 10-D
1e1
98761
1e0
1.0e6
1e-1
7.5e7
1e-2
7.5e7
1e-3
7.5e7
1e-5
7.5e7
1e-7
7.5e7
#succ
1/15
NEWUOA ros noiseless 7e40/15
BFGS ros noiseless 4e40/15
MCS huyer noiseless 4e40/15
NELDERDOERR doerr noiseless 2.6 (5)2e50/15
SLSQP-11 -207 2e50/15
BFGS-P-StPt 7e40/15

Previous dimension | Dimension = 20 | Next dimension

Δ fopt
f1, 20-D
1e1
43
1e0
43
1e-1
43
1e-2
43
1e-3
43
1e-5
43
1e-7
43
#succ
15/15
NEWUOA ros noiseless 1.0 (0.0)1.0 (0.0)1.0 (0.0)1.0 (0.0)1.0 (0.0)1.0 (0.0)1.0 (0.0)15/15
BFGS ros noiseless 1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)15/15
MCS huyer noiseless 2.4 (3)6.4 (4)6.8 (3)7.0 (3)7.0 (3)7.0 (2)7.0 (0.1)15/15
NELDERDOERR doerr noiseless 3.3 (1)6.7 (3)11 (4)16 (5)21 (10)32 (7)40 (6)15/15
SLSQP-11 -207 0.58 (0)★40.58 (0)★40.58 (0)★40.58 (0)★40.58 (0)★40.58 (0)★40.58 (0)★415/15
BFGS-P-StPt 1.1 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)1.1 (0)6.0 (9)12/15

Δ fopt
f2, 20-D
1e1
385
1e0
386
1e-1
387
1e-2
388
1e-3
390
1e-5
391
1e-7
393
#succ
15/15
NEWUOA ros noiseless 18 (7)42 (21)71 (30)92 (36)125 (42)174 (55)219 (54)15/15
BFGS ros noiseless 20 (4)24 (5)26 (4)27 (3)27 (2)28 (1)28 (3)15/15
MCS huyer noiseless 5.4 (2)14 (5)21 (14)41 (28)43 (26)46 (26)8e40/15
NELDERDOERR doerr noiseless 13 (2)17 (4)19 (8)23 (15)28 (17)36 (9)48 (18)15/15
SLSQP-11 -207 2.5 (0.8)★32.6 (0.7)★42.8 (0.9)★43.0 (0.5)★43.2 (1)★33.5 (0.8)★33.8 (1.0)★315/15
BFGS-P-StPt 4.5 (0.6)4.8 (0.6)5.0 (0.9)5.3 (0.6)5.6 (1)6.1 (2)6.6 (1)15/15

Δ fopt
f3, 20-D
1e1
5066
1e0
7626
1e-1
7635
1e-2
7637
1e-3
7643
1e-5
7646
1e-7
7651
#succ
15/15
NEWUOA ros noiseless 1e50/15
BFGS ros noiseless 1e50/15
MCS huyer noiseless 28 (24)★48e40/15
NELDERDOERR doerr noiseless 4e50/15
SLSQP-11 -207 4e50/15
BFGS-P-StPt 2e50/15

Δ fopt
f4, 20-D
1e1
4722
1e0
7628
1e-1
7666
1e-2
7686
1e-3
7700
1e-5
7758
1e-7
1.4e5
#succ
9/15
NEWUOA ros noiseless 2e50/15
BFGS ros noiseless 2e50/15
MCS huyer noiseless 8e40/15
NELDERDOERR doerr noiseless 4e50/15
SLSQP-11 -207 4e50/15
BFGS-P-StPt 3e50/15

Δ fopt
f5, 20-D
1e1
41
1e0
41
1e-1
41
1e-2
41
1e-3
41
1e-5
41
1e-7
41
#succ
15/15
NEWUOA ros noiseless 1.2 (0.1)1.4 (0.3)1.6 (0.5)1.6 (0.5)1.6 (0.3)1.6 (0.4)1.6 (0.5)15/15
BFGS ros noiseless 2.3 (0.4)2.7 (0.3)2.8 (0.5)2.8 (0.4)2.8 (0.5)2.8 (0.8)2.8 (0.5)15/15
MCS huyer noiseless 0.99 (0.0)★40.99 (0.0)★40.99 (0.0)★40.99 (0.0)★40.99 (0.0)★40.99 (0.0)★40.99 (0.0)★415/15
NELDERDOERR doerr noiseless 5.2 (2)6.1 (2)6.3 (2)6.3 (2)6.3 (1)6.3 (3)6.3 (2)15/15
SLSQP-11 -207 1.7 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)15/15
BFGS-P-StPt 1.7 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)2.2 (0)15/15

Δ fopt
f6, 20-D
1e1
1296
1e0
2343
1e-1
3413
1e-2
4255
1e-3
5220
1e-5
6728
1e-7
8409
#succ
15/15
NEWUOA ros noiseless 1.00 (0.8)★31.0 (0.5)★31.00 (0.5)★31.1 (0.5)★21.1 (0.6)★21.3 (0.9)★31.3 (0.9)★315/15
BFGS ros noiseless 3.6 (2)3.5 (1)3.4 (0.7)3.5 (1)3.5 (0.8)3.6 (0.8)45 (33)0/15
MCS huyer noiseless 8e40/15
NELDERDOERR doerr noiseless 9.1 (3)15 (8)20 (11)46 (46)79 (67)4e50/15
SLSQP-11 -207 2.5 (0.5)2.0 (0.9)2.1 (0.7)2.3 (1.0)2.4 (1)2.6 (1)8.7 (16)0/15
BFGS-P-StPt 4.4 (2)4.0 (1)4.1 (1)4.4 (1)4.9 (2)8.7 (5)265 (358)7/15

Δ fopt
f7, 20-D
1e1
1351
1e0
4274
1e-1
9503
1e-2
16523
1e-3
16524
1e-5
16524
1e-7
16969
#succ
15/15
NEWUOA ros noiseless 5e50/15
BFGS ros noiseless 21000/15
MCS huyer noiseless 8e40/15
NELDERDOERR doerr noiseless 370 (361)4e50/15
SLSQP-11 -207 4e50/15
BFGS-P-StPt 23000/15

Δ fopt
f8, 20-D
1e1
2039
1e0
3871
1e-1
4040
1e-2
4148
1e-3
4219
1e-5
4371
1e-7
4484
#succ
15/15
NEWUOA ros noiseless 1.00 (0.2)1.00 (0.3)1.0 (0.5)1.0 (0.5)1.0 (0.5)1.00 (0.6)1.00 (0.6)15/15
BFGS ros noiseless 1.8 (0.5)1.2 (0.1)1.2 (0.2)1.2 (0.1)1.2 (0.1)1.2 (0.1)1.2 (0.1)15/15
MCS huyer noiseless 1.5 (0.5)1.7 (0.7)1.8 (1)1.8 (1)1.8 (1)1.8 (1)1.8 (1)15/15
NELDERDOERR doerr noiseless 2.8 (6)4.7 (3)5.5 (2)6.0 (3)6.5 (9)7.7 (14)9.1 (8)15/15
SLSQP-11 -207 0.78 (0.3)0.76 (0.6)0.78 (1)0.78 (0.7)0.78 (0.3)0.77 (0.3)0.76 (0.2)15/15
BFGS-P-StPt 1.3 (0.5)2.0 (1)1.9 (0.4)1.9 (1.0)1.9 (0.9)1.8 (1)1.8 (1)15/15

Δ fopt
f9, 20-D
1e1
1716
1e0
3102
1e-1
3277
1e-2
3379
1e-3
3455
1e-5
3594
1e-7
3727
#succ
15/15
NEWUOA ros noiseless 1.0 (0.2)1.00 (0.4)1.00 (0.9)1.0 (0.4)1 (0.8)1 (0.5)1.00 (0.4)15/15
BFGS ros noiseless 2.2 (0.4)2.2 (1)2.1 (0.9)2.1 (1)2.0 (1)2.0 (1)1.9 (1)15/15
MCS huyer noiseless 1.00 (0.4)1.3 (0.7)1.5 (0.7)1.6 (0.5)1.6 (0.7)1.7 (0.6)1.6 (0.5)15/15
NELDERDOERR doerr noiseless 3.3 (0.8)6.1 (5)6.6 (8)7.0 (3)7.5 (5)8.4 (4)9.3 (7)15/15
SLSQP-11 -207 0.35 (0)★40.28 (0)★40.32 (0)★40.35 (0)★40.36 (3e-3)★40.36 (3e-3)★40.36 (3e-3)★415/15
BFGS-P-StPt 0.42 (0)0.32 (4e-3)0.36 (3e-3)0.38 (7e-3)0.39 (6e-3)0.40 (3e-3)0.39 (9e-3)15/15

Δ fopt
f10, 20-D
1e1
7413
1e0
8661
1e-1
10735
1e-2
13641
1e-3
14920
1e-5
17073
1e-7
17476
#succ
15/15
NEWUOA ros noiseless 1.7 (0.6)2.6 (0.6)3.3 (1.0)3.3 (1)4.0 (1)4.7 (0.8)5.8 (1)15/15
BFGS ros noiseless 1.0 (0.1)1.0 (0.1)1.00 (0.5)1.1 (0.4)1.1 (0.7)3.1 (9)1e60/15
MCS huyer noiseless 8e40/15
NELDERDOERR doerr noiseless 30 (35)4e50/15
SLSQP-11 -207 0.13 (0.0)★30.12 (0.0)★30.10 (0.0)★30.09 (0.0)★20.08 (0.0)★30.09 (0.0)★28.0 (8)1/15
BFGS-P-StPt 0.22 (0.1)0.21 (0.1)0.18 (0.1)0.15 (0.0)0.15 (0.0)0.14 (0.0)0.14 (0.0)★415/15

Δ fopt
f11, 20-D
1e1
1002
1e0
2228
1e-1
6278
1e-2
8586
1e-3
9762
1e-5
12285
1e-7
14831
#succ
15/15
NEWUOA ros noiseless 15 (2)13 (2)5.8 (0.6)5.6 (0.4)6.1 (0.2)6.6 (0.3)6.5 (0.2)15/15
BFGS ros noiseless 1 (0.6)1.0 (0.4)1.3 (2)2.6 (2)147 (126)2e50/15
MCS huyer noiseless 8e40/15
NELDERDOERR doerr noiseless 17 (6)24 (16)74 (27)4e50/15
SLSQP-11 -207 0.15 (0.0)★30.09 (0.1)★30.04 (0.0)★30.03 (5e-3)★30.03 (0.0)★30.64 (0.1)36 (27)0/15
BFGS-P-StPt 0.76 (0.5)0.38 (0.4)0.15 (0.1)0.12 (0.0)0.12 (0.1)0.11 (0.1)0.31 (0.6)★312/15

Δ fopt
f12, 20-D
1e1
1042
1e0
1938
1e-1
2740
1e-2
3156
1e-3
4140
1e-5
12407
1e-7
13827
#succ
15/15
NEWUOA ros noiseless 3.0 (3)3.0 (2)3.0 (1)3.0 (0.9)2.5 (2)1.0 (0.4)1.00 (0.4)15/15
BFGS ros noiseless 1.6 (2)1.6 (1)1.6 (2)1.7 (1)1.6 (0.6)1.8 (2)45 (59)1/15
MCS huyer noiseless 1.1 (0.8)8.4 (18)12 (5)24 (42)43 (82)94 (135)8e40/15
NELDERDOERR doerr noiseless 13 (26)45 (44)61 (81)396 (428)1393 (1860)4e50/15
SLSQP-11 -207 2.8 (1)2.1 (1)1.7 (0.8)1.6 (0.8)1.3 (0.4)1.8 (1)3.3 (7)9/15
BFGS-P-StPt 3.2 (0.7)2.4 (0.6)2.0 (0.4)1.9 (0.5)1.5 (0.4)0.58 (0.1)0.56 (0.1)★312/15

Δ fopt
f13, 20-D
1e1
652
1e0
2021
1e-1
2751
1e-2
3507
1e-3
18749
1e-5
24455
1e-7
30201
#succ
15/15
NEWUOA ros noiseless 1.00 (0.7)3.0 (2)9.3 (8)37 (37)19 (29)2e50/15
BFGS ros noiseless 1.7 (0.3)1.0 (0.0)1.00 (0.0)1.00 (0.0)23 (30)5e50/15
MCS huyer noiseless 34 (43)37 (50)61 (88)331 (446)8e40/15
NELDERDOERR doerr noiseless 12 (20)18 (33)31 (18)87 (109)98 (117)4e50/15
SLSQP-11 -207 1.2 (0.1)0.55 (0.0)0.51 (0.0)0.50 (0.0)★431 (38)131 (239)5e50/15
BFGS-P-StPt 1.4 (0.0)0.65 (0.0)0.59 (8e-3)0.56 (0.0)0.12 (3e-3)22 (54)315 (126)0/15

Δ fopt
f14, 20-D
1e1
75
1e0
239
1e-1
304
1e-2
451
1e-3
932
1e-5
1648
1e-7
15661
#succ
15/15
NEWUOA ros noiseless 1.5 (0.6)1.0 (0.4)1.0 (0.4)1.00 (0.2)1.0 (0.1)9.1 (0.7)43 (24)0/15
BFGS ros noiseless 2.7 (1)1.8 (0.7)2.0 (0.6)1.8 (0.5)1.2 (0.2)1.1 (0.2)2e50/15
MCS huyer noiseless 1 (0.5)2.1 (0.7)3.4 (0.9)3.7 (0.7)3.2 (0.6)8e40/15
NELDERDOERR doerr noiseless 2.0 (1.0)2.1 (1)3.5 (2)3.7 (1.0)3.0 (0.6)21 (14)4e50/15
SLSQP-11 -207 0.75 (0.1)0.52 (0.1)0.69 (0.0)0.76 (0.1)★20.53 (0.1)★30.51 (0.0)★44e50/15
BFGS-P-StPt 0.97 (0.1)0.69 (0.2)0.83 (0.1)0.92 (0.2)0.66 (0.1)0.67 (0.1)6.3 (6)★20/15

Δ fopt
f15, 20-D
1e1
30378
1e0
1.5e5
1e-1
3.1e5
1e-2
3.2e5
1e-3
3.2e5
1e-5
4.5e5
1e-7
4.6e5
#succ
15/15
NEWUOA ros noiseless 1e50/15
BFGS ros noiseless 1e50/15
MCS huyer noiseless 8e40/15
NELDERDOERR doerr noiseless 4e50/15
SLSQP-11 -207 4e50/15
BFGS-P-StPt 2e50/15

Δ fopt
f16, 20-D
1e1
1384
1e0
27265
1e-1
77015
1e-2
1.4e5
1e-3
1.9e5
1e-5
2.0e5
1e-7
2.2e5
#succ
15/15
NEWUOA ros noiseless 16 (16)2e50/15
BFGS ros noiseless 3e50/15
MCS huyer noiseless 11 (13)8e40/15
NELDERDOERR doerr noiseless 7.2 (7)4e50/15
SLSQP-11 -207 4e50/15
BFGS-P-StPt 8e50/15

Δ fopt
f17, 20-D
1e1
63
1e0
1030
1e-1
4005
1e-2
12242
1e-3
30677
1e-5
56288
1e-7
80472
#succ
15/15
NEWUOA ros noiseless 16 (106)2e60/15
BFGS ros noiseless 359 (535)4e50/15
MCS huyer noiseless 1 (0.7)8e40/15
NELDERDOERR doerr noiseless 2.1 (2)4e50/15
SLSQP-11 -207 111 (708)4e50/15
BFGS-P-StPt 490 (241)4e50/15

Δ fopt
f18, 20-D
1e1
621
1e0
3972
1e-1
19561
1e-2
28555
1e-3
67569
1e-5
1.3e5
1e-7
1.5e5
#succ
15/15
NEWUOA ros noiseless 1.2e4 (2e4)2e60/15
BFGS ros noiseless 4e50/15
MCS huyer noiseless 8e40/15
NELDERDOERR doerr noiseless 4320 (5380)4e50/15
SLSQP-11 -207 4e50/15
BFGS-P-StPt 5e50/15

Δ fopt
f19, 20-D
1e1
1
1e0
1
1e-1
3.4e5
1e-2
4.7e6
1e-3
6.2e6
1e-5
6.7e6
1e-7
6.7e6
#succ
15/15
NEWUOA ros noiseless 76 (98)4.3e6 (4e6)2e60/15
BFGS ros noiseless 1.2e6 (9e5)2e50/15
MCS huyer noiseless 1 (0)1 (0)1 (0.9)8e40/15
NELDERDOERR doerr noiseless 73 (41)4.3e5 (4e5)4e50/15
SLSQP-11 -207 1 (0)1 (0)5.6e-4 (0)5e50/15
BFGS-P-StPt 1 (0)1 (0)0.00 (2e-4)5e50/15

Δ fopt
f20, 20-D
1e1
82
1e0
46150
1e-1
3.1e6
1e-2
5.5e6
1e-3
5.5e6
1e-5
5.6e6
1e-7
5.6e6
#succ
14/15
NEWUOA ros noiseless 1.00 (0.4)15 (11)4e50/15
BFGS ros noiseless 2.1 (0.4)5.8 (4)4e50/15
MCS huyer noiseless 4.7 (0.1)12 (12)8e40/15
NELDERDOERR doerr noiseless 2.2 (0.5)28 (51)4e50/15
SLSQP-11 -207 0.65 (0)14 (23)4e50/15
BFGS-P-StPt 14 (3)7.2 (9)4e50/15

Δ fopt
f21, 20-D
1e1
561
1e0
6541
1e-1
14103
1e-2
14318
1e-3
14643
1e-5
15567
1e-7
17589
#succ
15/15
NEWUOA ros noiseless 1.7 (0.9)2.2 (2)1.2 (2)1.2 (1)1.2 (2)1.1 (2)1.0 (2)15/15
BFGS ros noiseless 1.9 (1)5.5 (4)4.6 (5)4.6 (3)4.5 (3)4.3 (4)7.3 (8)2/15
MCS huyer noiseless 26 (31)32 (31)26 (23)25 (42)25 (35)23 (38)32 (31)2/15
NELDERDOERR doerr noiseless 7.6 (8)4.0 (4)2.0 (2)2.1 (2)2.1 (2)2.0 (2)1.8 (1)15/15
SLSQP-11 -207 0.66 (0.6)0.56 (0.8)2.8 (1)2.8 (0.6)2.7 (1.0)2.6 (0.7)3.3 (5)7/15
BFGS-P-StPt 3.3 (3)2.0 (1)2.7 (2)2.7 (4)2.6 (4)4.7 (4)76 (57)0/15

Δ fopt
f22, 20-D
1e1
467
1e0
5580
1e-1
23491
1e-2
24163
1e-3
24948
1e-5
26847
1e-7
1.3e5
#succ
12/15
NEWUOA ros noiseless 1.00 (2)4.9 (9)6.8 (9)6.6 (5)6.4 (9)6.0 (7)1.2 (0.9)7/15
BFGS ros noiseless 2.5 (3)1.8 (5)8.1 (9)7.9 (9)7.7 (7)10 (14)14 (11)0/15
MCS huyer noiseless 17 (22)20 (27)50 (64)48 (69)47 (63)8e40/15
NELDERDOERR doerr noiseless 5.2 (11)6.5 (17)8.3 (7)8.2 (6)8.0 (11)7.5 (7)1.5 (1)13/15
SLSQP-11 -207 1.0 (0.8)3.2 (8)4.1 (2)4.0 (9)3.8 (2)3.6 (6)4.3 (3)1/15
BFGS-P-StPt 0.39 (0.3)1.1 (2)8.6 (9)8.4 (6)8.2 (6)55 (56)1e50/15

Δ fopt
f23, 20-D
1e1
3.0
1e0
1614
1e-1
67457
1e-2
3.7e5
1e-3
4.9e5
1e-5
8.1e5
1e-7
8.4e5
#succ
15/15
NEWUOA ros noiseless 12 (12)3.5 (3)32 (26)2e50/15
BFGS ros noiseless 50 (161)304 (273)1e50/15
MCS huyer noiseless 1.4 (2)124 (121)8e40/15
NELDERDOERR doerr noiseless 2.0 (2)1.4 (1)86 (65)4e50/15
SLSQP-11 -207 13 (8)18 (27)4e50/15
BFGS-P-StPt 2331 (3854)808 (1087)8e50/15

Δ fopt
f24, 20-D
1e1
1.3e6
1e0
7.5e6
1e-1
5.2e7
1e-2
5.2e7
1e-3
5.2e7
1e-5
5.2e7
1e-7
5.2e7
#succ
3/15
NEWUOA ros noiseless 2e50/15
BFGS ros noiseless 1e50/15
MCS huyer noiseless 8e40/15
NELDERDOERR doerr noiseless 4e50/15
SLSQP-11 -207 4e50/15
BFGS-P-StPt 2e50/15

Previous dimension | Dimension = 40 | First dimension

Δ fopt
f1, 40-D
1e1
83
1e0
83
1e-1
83
1e-2
83
1e-3
83
1e-5
83
1e-7
83
#succ
15/15
NEWUOA ros noiseless 1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)15/15
BFGS ros noiseless 1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)1 (0)15/15
BFGS-P-StPt 1.0 (0)1.0 (0)1.0 (0)1.0 (0)1.0 (0)1.0 (0)37 (148)6/15

Δ fopt
f2, 40-D
1e1
796
1e0
797
1e-1
799
1e-2
799
1e-3
800
1e-5
802
1e-7
804
#succ
15/15
NEWUOA ros noiseless 26 (5)44 (13)68 (17)85 (16)108 (16)139 (20)168 (34)15/15
BFGS ros noiseless 36 (3)42 (3)45 (5)48 (6)51 (6)53 (3)54 (5)15/15
BFGS-P-StPt 5.9 (0.9)★46.5 (1)★46.9 (2)★47.2 (1)★47.5 (2)★47.9 (1)★48.4 (1)★415/15

Δ fopt
f3, 40-D
1e1
15526
1e0
15602
1e-1
15612
1e-2
15641
1e-3
15646
1e-5
15651
1e-7
15656
#succ
15/15
NEWUOA ros noiseless ★2★2★2★2★2★23e5★20/15
BFGS ros noiseless 3e50/15
BFGS-P-StPt 7e50/15

Δ fopt
f4, 40-D
1e1
15536
1e0
15601
1e-1
15659
1e-2
15678
1e-3
15703
1e-5
15733
1e-7
2.8e5
#succ
6/15
NEWUOA ros noiseless 6e50/15
BFGS ros noiseless 5e50/15
BFGS-P-StPt 9e50/15

Δ fopt
f5, 40-D
1e1
98
1e0
116
1e-1
120
1e-2
121
1e-3
121
1e-5
121
1e-7
121
#succ
15/15
NEWUOA ros noiseless 1.0 (0.2)1.00 (0.3)★21.0 (0.2)★21.00 (0.3)★21.00 (0.1)★21.00 (0.3)★21.00 (0.3)★215/15
BFGS ros noiseless 2.1 (0.4)2.3 (0.6)2.3 (0.5)2.3 (0.6)2.3 (0.5)2.3 (0.5)2.3 (0.5)15/15
BFGS-P-StPt 1.3 (0)1.5 (0)1.4 (0)1.4 (0)1.4 (0)1.4 (0)1.4 (0)15/15

Δ fopt
f6, 40-D
1e1
3507
1e0
5523
1e-1
7168
1e-2
9470
1e-3
11538
1e-5
15007
1e-7
19222
#succ
15/15
NEWUOA ros noiseless 1.00 (0.1)★41.0 (0.1)★41.0 (0.2)★41.00 (0.2)★41.0 (0.2)★41.00 (0.1)★41.00 (0.2)★415/15
BFGS ros noiseless 4.5 (1)4.6 (2)4.7 (1)4.6 (0.8)4.6 (0.8)5.1 (3)25 (82)0/15
BFGS-P-StPt 7.3 (1)6.8 (0.7)7.2 (1.0)7.7 (3)7.7 (0.5)11 (4)297 (325)7/15

Δ fopt
f7, 40-D
1e1
10698
1e0
17839
1e-1
41037
1e-2
66294
1e-3
66294
1e-5
66294
1e-7
68145
#succ
15/15
NEWUOA ros noiseless 2e60/15
BFGS ros noiseless 41000/15
BFGS-P-StPt 43000/15

Δ fopt
f8, 40-D
1e1
7080
1e0
10655
1e-1
11012
1e-2
11265
1e-3
11430
1e-5
11701
1e-7
11969
#succ
15/15
NEWUOA ros noiseless 1.0 (0.2)1.0 (0.3)1.00 (0.6)1.00 (0.7)1.00 (0.3)1.0 (0.1)1 (0.6)15/15
BFGS ros noiseless 2.4 (0.2)2.2 (0.4)2.2 (0.5)2.1 (0.9)2.1 (0.9)2.1 (0.9)2.0 (0.9)15/15
BFGS-P-StPt 1.2 (0.3)1.7 (1)1.7 (0.5)1.7 (0.9)1.6 (1.0)1.6 (0.9)2.1 (1.0)15/15

Δ fopt
f9, 40-D
1e1
6122
1e0
12982
1e-1
13300
1e-2
13496
1e-3
13651
1e-5
13909
1e-7
14142
#succ
15/15
NEWUOA ros noiseless 1 (0.2)1.0 (0.3)1.0 (0.7)1 (0.7)1.0 (0.7)1.0 (0.4)1.00 (0.4)15/15
BFGS ros noiseless 2.6 (0.2)1.8 (0.8)1.8 (1)1.8 (1)1.7 (1)1.7 (0.1)1.7 (1)15/15
BFGS-P-StPt 0.41 (0)★40.24 (2e-3)★40.26 (5e-3)★40.27 (3e-3)★40.28 (8e-3)★40.28 (8e-3)★40.28 (6e-3)★415/15

Δ fopt
f10, 40-D
1e1
25536
1e0
29762
1e-1
35676
1e-2
51579
1e-3
56007
1e-5
65128
1e-7
70824
#succ
15/15
NEWUOA ros noiseless 1.3 (0.2)1.6 (0.4)1.8 (0.7)1.5 (0.3)1.7 (0.2)1.9 (0.5)2.1 (0.2)15/15
BFGS ros noiseless 1.00 (0.2)1.00 (0.1)1.0 (0.4)1.6 (2)8.0 (7)134 (144)4e60/15
BFGS-P-StPt 0.19 (0.0)★40.17 (0.0)★40.15 (0.0)★40.11 (0.0)★40.10 (0.0)★40.10 (0.0)★40.10 (0.0)★415/15

Δ fopt
f11, 40-D
1e1
2368
1e0
4855
1e-1
11681
1e-2
25315
1e-3
29749
1e-5
38949
1e-7
48211
#succ
15/15
NEWUOA ros noiseless 13 (2)10 (3)4.9 (1)2.8 (0.5)2.8 (0.5)2.7 (0.4)2.7 (0.3)15/15
BFGS ros noiseless 1.0 (0.4)1.0 (0.8)1.00 (0.9)2.3 (0.7)65 (56)4e50/15
BFGS-P-StPt 3.8 (4)2.0 (2)0.85 (0.9)0.40 (0.4)★20.35 (0.4)★40.28 (0.3)★48.1 (32)12/15

Δ fopt
f12, 40-D
1e1
4169
1e0
7452
1e-1
9174
1e-2
10751
1e-3
13146
1e-5
22758
1e-7
25192
#succ
15/15
NEWUOA ros noiseless 1.4 (1)1.4 (1)1.4 (1)1.5 (0.5)1.4 (0.7)1.00 (0.3)1.00 (0.3)15/15
BFGS ros noiseless 1.0 (2)1.0 (0.6)1.0 (0.7)1.0 (0.5)1.00 (0.4)15 (30)656 (1417)0/15
BFGS-P-StPt 2.3 (0.9)1.6 (0.4)1.4 (0.5)1.3 (0.6)1.1 (0.5)0.70 (0.1)0.67 (0.2)★215/15

Δ fopt
f13, 40-D
1e1
2029
1e0
6916
1e-1
8734
1e-2
11861
1e-3
71936
1e-5
98467
1e-7
1.2e5
#succ
15/15
NEWUOA ros noiseless 1.0 (2)2.0 (2)3.0 (3)13 (12)7.3 (10)28 (39)4e50/15
BFGS ros noiseless 1.4 (0.1)1.0 (0.0)1 (0.0)1.00 (0.0)46 (51)2e60/15
BFGS-P-StPt 1.4 (0.1)0.52 (0.0)0.55 (0.0)0.48 (9e-3)★40.09 (2e-3)★40.45 (0.1)★3142 (186)0/15

Δ fopt
f14, 40-D
1e1
304
1e0
616
1e-1
777
1e-2
1105
1e-3
2207
1e-5
4825
1e-7
57711
#succ
15/15
NEWUOA ros noiseless 1.0 (0.6)1.0 (0.4)1.00 (0.3)1.00 (0.4)1.00 (0.2)8.6 (0.5)24 (0.5)0/15
BFGS ros noiseless 1.7 (0.9)1.6 (0.4)1.8 (0.5)1.7 (0.4)1.2 (0.2)1.0 (0.1)7e50/15
BFGS-P-StPt 0.59 (0.1)★30.56 (0.0)★40.73 (0.1)★20.92 (0.1)0.71 (0.1)★40.57 (0.1)★412 (14)0/15

Δ fopt
f15, 40-D
1e1
1.9e5
1e0
7.9e5
1e-1
1.0e6
1e-2
1.1e6
1e-3
1.1e6
1e-5
1.1e6
1e-7
1.1e6
#succ
15/15
NEWUOA ros noiseless ★3★3★3★3★3★33e5★30/15
BFGS ros noiseless 3e50/15
BFGS-P-StPt 8e50/15

Δ fopt
f16, 40-D
1e1
5244
1e0
72122
1e-1
3.2e5
1e-2
7.1e5
1e-3
1.4e6
1e-5
2.0e6
1e-7
2.0e6
#succ
15/15
NEWUOA ros noiseless 17 (14)★4★4★4★4★4★46e5★40/15
BFGS ros noiseless 1e60/15
BFGS-P-StPt 1e60/15

Δ fopt
f17, 40-D
1e1
399
1e0
4220
1e-1
14158
1e-2
34948
1e-3
51958
1e-5
1.3e5
1e-7
2.7e5
#succ
14/15
NEWUOA ros noiseless 38 (138)4e60/15
BFGS ros noiseless 382 (219)1e60/15
BFGS-P-StPt 49 (188)2e60/15

Δ fopt
f18, 40-D
1e1
1442
1e0
16998
1e-1
47068
1e-2
1.3e5
1e-3
1.9e5
1e-5
6.7e5
1e-7
9.5e5
#succ
15/15
NEWUOA ros noiseless 4e60/30
BFGS ros noiseless 1e60/15
BFGS-P-StPt 2e60/15

Δ fopt
f19, 40-D
1e1
1
1e0
1
1e-1
1.4e6
1e-2
1.7e7
1e-3
2.6e7
1e-5
4.5e7
1e-7
4.5e7
#succ
8/15
NEWUOA ros noiseless 352 (131)4e60/30
BFGS ros noiseless 8e50/15
BFGS-P-StPt 1 (0)★41 (0)★44.5e-4 (3e-5)★41e60/15

Δ fopt
f20, 40-D
1e1
222
1e0
1.3e5
1e-1
1.6e8
1e-2
1e-3
1e-5
1e-7
#succ
0/15
NEWUOA ros noiseless 1.00 (0.3)★4311 (297)    0/30
BFGS ros noiseless 1.5 (0.2)33 (38)    0/15
BFGS-P-StPt 10 (2)158 (226)    0/15

Δ fopt
f21, 40-D
1e1
1044
1e0
21144
1e-1
1.0e5
1e-2
1.0e5
1e-3
1.0e5
1e-5
1.0e5
1e-7
1.0e5
#succ
26/30
NEWUOA ros noiseless 1.00 (2)1.0 (0.8)1.0 (1)1.0 (1)1 (1)1.0 (1)1.00 (1)26/30
BFGS ros noiseless 2.9 (4)2.3 (5)2.1 (4)2.1 (0.9)2.1 (1)2.1 (2)9.3 (8)2/15
BFGS-P-StPt 0.57 (0.8)0.84 (0.8)0.94 (1)0.94 (1)0.94 (0.6)3.2 (2)2e50/15

Δ fopt
f22, 40-D
1e1
3090
1e0
35442
1e-1
6.5e5
1e-2
6.5e5
1e-3
6.5e5
1e-5
6.5e5
1e-7
6.5e5
#succ
8/30
NEWUOA ros noiseless 4.0 (1)1.0 (2)1.0 (1)1 (1)1.0 (1)1.00 (1)1.0 (1)8/30
BFGS ros noiseless 1.5 (3)1.5 (1)3e50/15
BFGS-P-StPt 1.1 (3)1.1 (0.6)2e50/15

Δ fopt
f23, 40-D
1e1
7.0
1e0
11925
1e-1
75453
1e-2
6.6e5
1e-3
1.3e6
1e-5
3.2e6
1e-7
3.4e6
#succ
15/15
NEWUOA ros noiseless 10 (6)1.8 (2)★23e50/15
BFGS ros noiseless 78 (22)263 (147)2e50/15
BFGS-P-StPt 40 (36)77 (109)2e60/15

Δ fopt
f24, 40-D
1e1
5.8e6
1e0
9.8e7
1e-1
3.0e8
1e-2
3.0e8
1e-3
3.0e8
1e-5
3.0e8
1e-7
3.0e8
#succ
1/15
NEWUOA ros noiseless 4e50/15
BFGS ros noiseless 3e50/15
BFGS-P-StPt 6e50/15

Average runtime (aRT in number of function evaluations) divided by the respective best aRT measured during BBOB-2009 in different dimensions. This aRT ratio and, in braces as dispersion measure, the half difference between 10 and 90%-tile of bootstrapped run lengths appear for each algorithm and target, the corresponding reference aRT  in the first row. The different target ∆f-values are shown in the top row. #succ is the number of trials that reached the (final) target fopt+ 10−8. The median number of conducted function evaluations is additionally given in italics, if the target in the last column was never reached. Entries, succeeded by a star, are statistically significantly better (according to the rank-sum test) when compared to all other algorithms of the table, with p = 0.05 or p = 10−k when the number k following the star is larger than 1, with Bonferroni correction by the number of functions (24). A ↓ indicates the same tested against the best algorithm from BBOB 2009. Best results are printed in bold.
Data produced with COCO v2.2.1.244