Preface |
|
xi | |
Introduction |
|
xv | |
Part 1 Randomness In Optimization |
|
1 | (48) |
|
|
3 | (10) |
|
1.1 No better than random search |
|
|
3 | (4) |
|
1.1.1 Uniform random search |
|
|
4 | (1) |
|
|
5 | (1) |
|
|
5 | (2) |
|
1.2 Better or worse than random search |
|
|
7 | (6) |
|
1.2.1 Positive correlation problems |
|
|
8 | (2) |
|
1.2.2 Negative correlation problems |
|
|
10 | (3) |
|
Chapter 2 Random Number Generators (RNGs) |
|
|
13 | (20) |
|
|
14 | (1) |
|
|
15 | (1) |
|
|
15 | (2) |
|
|
16 | (1) |
|
|
16 | (1) |
|
2.4 Simplified randomness |
|
|
17 | (7) |
|
2.4.1 Linear congruential generators |
|
|
18 | (2) |
|
|
20 | (2) |
|
|
22 | (2) |
|
|
24 | (9) |
|
|
24 | (1) |
|
|
24 | (3) |
|
|
27 | (1) |
|
|
28 | (1) |
|
|
28 | (1) |
|
2.5.6 Composite distributions |
|
|
28 | (5) |
|
Chapter 3 The Effects Of Randomness |
|
|
33 | (16) |
|
|
34 | (3) |
|
|
34 | (2) |
|
|
36 | (1) |
|
3.1.3 No Man's Land techniques |
|
|
37 | (1) |
|
|
37 | (3) |
|
3.3 Distribution of the Next Possible Positions (DNPP) |
|
|
40 | (2) |
|
3.4 Confinement, constraints and repairs |
|
|
42 | (4) |
|
|
44 | (1) |
|
|
44 | (1) |
|
3.4.3 Moderate confinement |
|
|
45 | (1) |
|
|
45 | (1) |
|
3.4.5 Reflection-diffusion |
|
|
45 | (1) |
|
|
46 | (3) |
Part 2 Optimizer Comparison |
|
49 | (82) |
|
Chapter 4 Algorithms And Optimizers |
|
|
53 | (16) |
|
4.1 The Minimaliste algorithm |
|
|
54 | (5) |
|
4.1.1 General description |
|
|
54 | (1) |
|
4.1.2 Minimaliste in practice |
|
|
54 | (3) |
|
|
57 | (2) |
|
|
59 | (3) |
|
|
59 | (1) |
|
|
60 | (2) |
|
|
62 | (4) |
|
|
62 | (3) |
|
|
65 | (1) |
|
4.4 Applications of randomness |
|
|
66 | (3) |
|
Chapter 5 Performance Criteria |
|
|
69 | (40) |
|
5.1 Eff-Res: construction and properties |
|
|
69 | (5) |
|
5.1.1 Simple example using random search |
|
|
71 | (3) |
|
5.2 Criteria and measurements |
|
|
74 | (20) |
|
|
77 | (10) |
|
5.2.2 Semi-subjective criteria |
|
|
87 | (7) |
|
5.3 Practical construction of an Eff-Res |
|
|
94 | (14) |
|
5.3.1 Detailed example: (Minimaliste, Alpine 2D) |
|
|
95 | (11) |
|
5.3.2 Qualitative interpretations |
|
|
106 | (2) |
|
|
108 | (1) |
|
Chapter 6 Comparing Optimizers |
|
|
109 | (22) |
|
6.1 Data collection and preprocessing |
|
|
111 | (3) |
|
6.2 Critical analysis of comparisons |
|
|
114 | (9) |
|
6.2.1 Influence of criteria and the number of attempts |
|
|
115 | (1) |
|
6.2.2 Influence of effort levels |
|
|
115 | (2) |
|
|
117 | (4) |
|
6.2.4 Influence of the RNG |
|
|
121 | (2) |
|
6.3 Uncertainty in statistical analysis |
|
|
123 | (2) |
|
6.3.1 Independence of tests |
|
|
125 | (1) |
|
6.3.2 Confidence threshold |
|
|
125 | (1) |
|
|
125 | (1) |
|
|
125 | (5) |
|
|
126 | (3) |
|
|
129 | (1) |
|
6.5 Precision and prudence |
|
|
130 | (1) |
Part 3 Appendices |
|
131 | (154) |
|
Chapter 7 Mathematical Notions |
|
|
133 | (6) |
|
7.1 Sets closed under permutations |
|
|
133 | (1) |
|
7.2 Drawing with or without repetition |
|
|
133 | (2) |
|
7.3 Properties of the Additive and Multiplicative generators |
|
|
135 | (4) |
|
|
136 | (1) |
|
|
136 | (3) |
|
Chapter 8 Biases And Signatures |
|
|
139 | (8) |
|
8.1 The impossible plateau |
|
|
139 | (1) |
|
|
140 | (7) |
|
Chapter 9 A Pseudo-Scientific Article |
|
|
147 | (8) |
|
|
147 | (4) |
|
|
151 | (4) |
|
Chapter 10 Common Mistakes |
|
|
155 | (4) |
|
Chapter 11 Unnecessary Randomness? List-Based Optimizers |
|
|
159 | (8) |
|
|
160 | (2) |
|
11.2 Semi-empirical lists |
|
|
162 | (1) |
|
|
163 | (4) |
|
|
167 | (6) |
|
|
167 | (1) |
|
|
167 | (1) |
|
|
168 | (1) |
|
|
168 | (1) |
|
|
168 | (1) |
|
|
169 | (1) |
|
|
169 | (1) |
|
12.8 Traveling salesman: six cities |
|
|
170 | (1) |
|
12.9 Traveling salesman: fourteen cities (Burma 14) |
|
|
170 | (1) |
|
|
171 | (1) |
|
|
171 | (2) |
|
|
173 | (112) |
|
13.1 Random generation and sampling |
|
|
173 | (18) |
|
13.1.1 Preamble for Scilab codes |
|
|
174 | (1) |
|
13.1.2 Drawing of a pseudo-random number, according to options |
|
|
174 | (4) |
|
|
178 | (1) |
|
|
179 | (4) |
|
13.1.5 Uniform initializations (continuous, combinatorial) |
|
|
183 | (1) |
|
13.1.6 Regular initializations (Sobol, Halton) |
|
|
183 | (1) |
|
13.1.7 No Man's Land techniques |
|
|
184 | (2) |
|
|
186 | (3) |
|
13.1.9 Movements and confinements |
|
|
189 | (2) |
|
|
191 | (1) |
|
13.3 Combinatorial operations |
|
|
191 | (7) |
|
|
198 | (2) |
|
13.5 Minimaliste algorithm |
|
|
200 | (5) |
|
|
205 | (11) |
|
|
216 | (18) |
|
|
234 | (7) |
|
|
241 | (14) |
|
13.9.1 Problem definitions |
|
|
241 | (13) |
|
|
254 | (1) |
|
13.10 Treatment of results |
|
|
255 | (8) |
|
13.10.1 Quality (including curves) |
|
|
255 | (1) |
|
13.10.2 Other criteria (including curves) |
|
|
256 | (5) |
|
13.10.3 Construction of an Eff-Res |
|
|
261 | (2) |
|
13.11 Treatment of the Eff-Res |
|
|
263 | (8) |
|
13.11.1 Graphic representation |
|
|
263 | (1) |
|
|
264 | (1) |
|
13.11.3 Performance criteria (including curves) |
|
|
265 | (6) |
|
13.12 Histograms, polar diagrams |
|
|
271 | (2) |
|
|
273 | (4) |
|
13.14 Tests (bias, correlation) |
|
|
277 | (8) |
Bibliography |
|
285 | (8) |
Index |
|
293 | |