|
|
1 | |
|
|
2 | |
|
|
2 | |
|
|
3 | |
|
|
3 | |
|
|
3 | |
|
1.1.5 Parametrisation Language |
|
|
4 | |
|
|
4 | |
|
|
5 | |
|
1.1.8 Tool Interoperability |
|
|
5 | |
|
|
5 | |
|
1.1.10 Scientific Workflows |
|
|
6 | |
|
|
6 | |
|
1.2.1 Experiment Specification Language |
|
|
6 | |
|
1.2.2 Experiment Management Tool |
|
|
7 | |
|
|
8 | |
|
1.2.4 Scientific Workflows |
|
|
8 | |
|
1.2.5 Service-Oriented Grid Architecture |
|
|
9 | |
|
|
10 | |
|
|
10 | |
|
|
13 | |
|
|
13 | |
|
2.2 Distributed Technology History |
|
|
14 | |
|
|
15 | |
|
|
16 | |
|
2.3.2 Web Services Runtime Environment |
|
|
18 | |
|
2.4 Grid Security Infrastructure |
|
|
19 | |
|
|
20 | |
|
2.6 Grid Architectural Model |
|
|
22 | |
|
|
22 | |
|
2.6.2 Grid Services Layer |
|
|
28 | |
|
|
30 | |
|
|
35 | |
|
3 The ZEN Experiment Specification Language |
|
|
37 | |
|
3.1 Functionality and Use Cases |
|
|
37 | |
|
3.1.1 Shared Memory Application Scalability |
|
|
38 | |
|
3.1.2 ZEN Transformation System |
|
|
39 | |
|
3.1.3 Shared Memory Loop Scheduling |
|
|
40 | |
|
3.1.4 Distributed Processor Arrays |
|
|
41 | |
|
3.1.5 Distributed Memory Arrays |
|
|
41 | |
|
|
43 | |
|
|
43 | |
|
3.2 Formal Language Specification |
|
|
44 | |
|
|
44 | |
|
|
49 | |
|
3.2.3 ZEN Substitute Directive |
|
|
50 | |
|
3.2.4 Local Substitute Directive |
|
|
51 | |
|
3.2.5 Homonym ZEN Variables |
|
|
51 | |
|
3.2.6 ZEN Assignment Directive |
|
|
53 | |
|
3.2.7 Multi-dimensional Value Set |
|
|
54 | |
|
3.2.8 ZEN Constraint Directive |
|
|
55 | |
|
3.2.9 ZEN Performance Directive |
|
|
59 | |
|
3.2.10 Parameter Study Experiment |
|
|
62 | |
|
3.2.11 Experiment Generation Algorithm |
|
|
62 | |
|
3.2.12 Online Monitoring and Analysis |
|
|
65 | |
|
|
68 | |
|
4 ZENTURIO Experiment Management Tool |
|
|
69 | |
|
4.1 User Portal Functionality |
|
|
69 | |
|
|
70 | |
|
4.1.2 Experiment Preparation |
|
|
71 | |
|
|
73 | |
|
4.1.4 Application Data Visualiser |
|
|
73 | |
|
|
76 | |
|
|
76 | |
|
4.2.2 Linearised Augmented Plane Wave |
|
|
79 | |
|
4.2.3 Three-Dimensional Particle-in-Cell |
|
|
84 | |
|
4.2.4 Benders Decomposition |
|
|
86 | |
|
4.2.5 Three-Dimensional FFT Benchmarks |
|
|
89 | |
|
|
94 | |
|
|
94 | |
|
|
105 | |
|
4.4.1 Experiment Generator |
|
|
107 | |
|
4.4.2 Experiment Executor |
|
|
108 | |
|
4.4.3 Experiment State Transition Diagram |
|
|
110 | |
|
4.4.4 Experiment Data Repository |
|
|
110 | |
|
|
111 | |
|
|
113 | |
|
|
114 | |
|
5.2 Interoperable Tool Set |
|
|
116 | |
|
5.2.1 Object Code Browser |
|
|
117 | |
|
5.2.2 Function Profiler (Z_prof) |
|
|
117 | |
|
5.2.3 Function Tracer (Z_trace) |
|
|
118 | |
|
5.2.4 Function Coverager (Z_cov) |
|
|
119 | |
|
5.2.5 Sequential Debugger (Z_debug) |
|
|
121 | |
|
5.2.6 Memory Allocation Tool (ZJVIAT) |
|
|
121 | |
|
5.2.7 Resource Tracker (ZRT2) |
|
|
122 | |
|
5.2.8 Deadlock Detector (Z_deadlock) |
|
|
122 | |
|
5.3 Tool Interoperability |
|
|
122 | |
|
|
122 | |
|
5.3.2 Interaction with a Browser |
|
|
123 | |
|
5.3.3 Performance Steering |
|
|
124 | |
|
5.3.4 Just-in-Time Debugging |
|
|
126 | |
|
5.3.5 Interaction with a Debugger |
|
|
127 | |
|
|
128 | |
|
5.4.1 Dynamic Instrumentation |
|
|
128 | |
|
5.4.2 The Process Manager |
|
|
130 | |
|
5.4.3 Dynamic Instrumentation of MPI Applications |
|
|
134 | |
|
5.5 The Grid Services Layer |
|
|
136 | |
|
5.5.1 Web Application and Services Platform (WASP) |
|
|
138 | |
|
|
139 | |
|
5.5.3 Abstract Grid Service |
|
|
140 | |
|
|
142 | |
|
|
143 | |
|
|
144 | |
|
5.5.7 Dynamic Instrumentor |
|
|
144 | |
|
|
145 | |
|
|
146 | |
|
|
146 | |
|
|
149 | |
|
|
151 | |
|
|
151 | |
|
5.8 WASP Versus GT3 Technology Evaluation |
|
|
152 | |
|
|
153 | |
|
|
154 | |
|
5.8.3 UDDI-Based Service Repository |
|
|
155 | |
|
|
155 | |
|
|
155 | |
|
|
156 | |
|
|
159 | |
|
5.8.8 Grid Service Throughput |
|
|
160 | |
|
|
163 | |
|
|
164 | |
|
|
165 | |
|
|
167 | |
|
6.1.1 Schedule Dependencies |
|
|
169 | |
|
|
170 | |
|
6.2 Genetic Search Engine |
|
|
174 | |
|
|
175 | |
|
|
177 | |
|
|
177 | |
|
|
178 | |
|
|
178 | |
|
|
179 | |
|
6.2.7 Convergence Criterion |
|
|
180 | |
|
6.3 Genetic Workflow Scheduling |
|
|
180 | |
|
|
180 | |
|
6.4 Throughput Scheduling |
|
|
192 | |
|
6.5 Performance Tuning of Parallel Applications |
|
|
194 | |
|
6.5.1 Parallel Applications on the Grid |
|
|
195 | |
|
|
201 | |
|
7 Scientific Grid Workflows |
|
|
203 | |
|
|
204 | |
|
7.1.1 Computational Activity |
|
|
205 | |
|
7.1.2 Control Flow Dependencies |
|
|
206 | |
|
7.1.3 Data Flow Dependencies |
|
|
207 | |
|
7.1.4 Conditional Activity |
|
|
207 | |
|
7.1.5 Parallel Loop Activity |
|
|
208 | |
|
7.1.6 Sequential Loop Activity |
|
|
211 | |
|
|
213 | |
|
|
214 | |
|
|
911 | |
|
|
220 | |
|
7.2.3 Layered Partitioning |
|
|
226 | |
|
|
227 | |
|
|
231 | |
|
|
235 | |
|
7.3.1 -Workflow Partitioning |
|
|
236 | |
|
7.3.2 Control Flow Management |
|
|
241 | |
|
7.3.3 Data Flow Management |
|
|
242 | |
|
7.3.4 Virtual Single Execution Environment |
|
|
293 | |
|
|
244 | |
|
|
248 | |
|
7.3.7 WIEN2k Execution Experiments |
|
|
253 | |
|
7.3.8 Steering Experiments |
|
|
255 | |
|
|
260 | |
|
|
263 | |
|
|
269 | |
|
|
271 | |
|
8.1 Experiment Management |
|
|
271 | |
|
|
271 | |
|
|
273 | |
|
8.4 Optimisation and Scheduling |
|
|
273 | |
|
|
274 | |
|
8.5.1 Scientific Workflows |
|
|
276 | |
|
|
279 | |
|
|
279 | |
|
9.1.1 Experiment Specification |
|
|
279 | |
|
9.1.2 Experiment Management |
|
|
280 | |
|
|
281 | |
|
9.1.4 Tool Integration Design |
|
|
281 | |
|
9.1.5 Web Services for the Grid |
|
|
283 | |
|
9.1.6 Scientific Workflows |
|
|
283 | |
10 Appendix |
|
285 | |
|
|
285 | |
|
|
288 | |
|
|
289 | |
|
|
292 | |
References |
|
297 | |
Index |
|
311 | |