|
1 Overview of Differential Equations |
|
|
1 | (12) |
|
1.1 Classification of Differential Equations |
|
|
1 | (2) |
|
1.1.1 Ordinary Differential Equations |
|
|
1 | (1) |
|
1.1.2 Partial Differential Equations |
|
|
2 | (1) |
|
1.1.3 Delay Differential Equations |
|
|
2 | (1) |
|
1.1.4 Stochastic Differential Equations |
|
|
2 | (1) |
|
1.1.5 Differential Algebraic Equations |
|
|
3 | (1) |
|
1.2 Types of Differential Equation Problems |
|
|
3 | (2) |
|
1.2.1 Initial Value Problem |
|
|
3 | (1) |
|
1.2.2 Boundary Value Problem |
|
|
3 | (2) |
|
1.3 Differential Equations Associated with Physical Problems Arising in Engineering |
|
|
5 | (1) |
|
1.4 General Introduction of Numerical Methods for Solving Differential Equations |
|
|
5 | (6) |
|
|
6 | (1) |
|
1.4.2 Finite Difference Method |
|
|
6 | (2) |
|
1.4.3 Finite Element Method |
|
|
8 | (1) |
|
1.4.4 Finite Volume Method |
|
|
9 | (1) |
|
1.4.5 Spline Based Method |
|
|
9 | (2) |
|
1.4.6 Neural Network Method |
|
|
11 | (1) |
|
1.5 Advantages of Neural Network Method for Solving Differential Equations |
|
|
11 | (2) |
|
2 History of Neural Networks |
|
|
13 | (4) |
|
2.1 The 1940s: The Beginning of Neural Networks |
|
|
13 | (1) |
|
2.2 The 1950s and 1960s: The First Golden Age of Neural Networks |
|
|
14 | (1) |
|
2.3 The 1970s: The Quiet Years |
|
|
15 | (1) |
|
2.4 The 1980s: Renewed Enthusiasm |
|
|
15 | (2) |
|
3 Preliminaries of Neural Networks |
|
|
17 | (26) |
|
3.1 What Is Neural Network? |
|
|
17 | (1) |
|
3.2 Biological Neural Network |
|
|
18 | (1) |
|
3.3 Artificial Neural Network |
|
|
19 | (1) |
|
3.4 Mathematical Model of Artificial Neural Network |
|
|
19 | (2) |
|
|
21 | (3) |
|
3.5.1 Linear Activation Function |
|
|
22 | (1) |
|
3.5.2 Sign Activation Function |
|
|
22 | (1) |
|
3.5.3 Sigmoid Activation Function |
|
|
22 | (1) |
|
3.5.4 Step Activation Function |
|
|
23 | (1) |
|
3.6 Neural Network Architecture |
|
|
24 | (9) |
|
3.6.1 Feed Forward Neural Networks |
|
|
24 | (1) |
|
3.6.2 Recurrent Neural Networks |
|
|
25 | (1) |
|
3.6.3 Radial Basis Function Neural Network |
|
|
26 | (2) |
|
|
28 | (2) |
|
3.6.5 Cellular Neural Network |
|
|
30 | (1) |
|
3.6.6 Finite Element Neural Network |
|
|
31 | (1) |
|
3.6.7 Wavelet Neural Network |
|
|
31 | (2) |
|
3.7 Learning in Neural Networks |
|
|
33 | (1) |
|
3.7.1 Supervised Learning |
|
|
33 | (1) |
|
3.7.2 Unsupervised Learning |
|
|
34 | (1) |
|
3.7.3 Reinforcement Learning |
|
|
34 | (1) |
|
3.7.4 Competitive Learning |
|
|
34 | (1) |
|
3.8 Multi-layer Perceptron |
|
|
34 | (7) |
|
3.8.1 Backpropagation Algorithm |
|
|
35 | (1) |
|
3.8.2 The RPROP Learning Algorithm |
|
|
35 | (2) |
|
3.8.3 The Levenberg-Marquardt Learning Algorithm |
|
|
37 | (1) |
|
|
38 | (2) |
|
3.8.5 Particle Swarm Optimization |
|
|
40 | (1) |
|
3.9 Neural Networks as Universal Approximator |
|
|
41 | (2) |
|
4 Neural Network Methods for Solving Differential Equations |
|
|
43 | (58) |
|
4.1 Method of Multilayer Perceptron Neural Network |
|
|
43 | (22) |
|
4.1.1 Gradient Computation |
|
|
44 | (1) |
|
4.1.2 Gradient Computation with Respect to Network Inputs |
|
|
45 | (1) |
|
4.1.3 Gradient Computation with Respect to Network Parameters |
|
|
46 | (1) |
|
4.1.4 Network Parameter Updation |
|
|
46 | (1) |
|
4.1.5 Recent Development in MLPNN for Solving Differential Equations |
|
|
47 | (18) |
|
4.2 Method of Radial Basis Function Neural Networks |
|
|
65 | (2) |
|
4.3 Method of Multiquadric Radial Basis Function Neural Network |
|
|
67 | (10) |
|
4.3.1 DRBFN Procedure for Solving Differential Equations |
|
|
67 | (2) |
|
4.3.2 IRBFN Procedure for Solving Differential Equations |
|
|
69 | (1) |
|
4.3.3 Recent Development in the RBF and MQRBF Neural Network Techniques |
|
|
69 | (8) |
|
4.4 Method of Cellular Neural Networks |
|
|
77 | (11) |
|
4.4.1 Principle for CNN Templates Findings |
|
|
78 | (2) |
|
4.4.2 Design of the Complete CNN Processor |
|
|
80 | (1) |
|
4.4.3 Recent Development in the Cellular Neural Network Technique |
|
|
80 | (8) |
|
4.5 Method of Finite Element Neural Networks |
|
|
88 | (3) |
|
4.5.1 Boundary Conditions in FENN |
|
|
90 | (1) |
|
4.6 Method of Wavelet Neural Networks |
|
|
91 | (2) |
|
4.7 Some Workout Examples |
|
|
93 | (8) |
Conclusion |
|
101 | (2) |
Appendix |
|
103 | (2) |
References |
|
105 | (6) |
Index |
|
111 | |