Preface |
|
xi | |
Acknowledgments |
|
xv | |
|
1 Logic And Data Analysis |
|
|
1 | (50) |
|
1.1 The Logic of Inference |
|
|
5 | (17) |
|
1.1.1 Deductive Inference and Rational Belief Networks |
|
|
5 | (2) |
|
1.1.2 Plausible Inference |
|
|
7 | (6) |
|
|
13 | (3) |
|
1.1.4 The Logic of Data Analysis |
|
|
16 | (6) |
|
|
22 | (25) |
|
1.2.1 The Goal of Data Visualization |
|
|
24 | (1) |
|
|
25 | (7) |
|
|
32 | (3) |
|
1.2.4 Descriptive Statistics |
|
|
35 | (7) |
|
1.2.5 Data Checks: Expected versus Unexpected Data Values and Patterns |
|
|
42 | (5) |
|
|
47 | (4) |
|
1.3.1 Emphasis on Worked Examples |
|
|
47 | (2) |
|
|
49 | (1) |
|
1.3.3 Outline of the Text |
|
|
49 | (2) |
|
2 Mechanics Of Probability Calculations |
|
|
51 | (68) |
|
2.1 Symbolic Manipulations |
|
|
51 | (38) |
|
2.1.1 Formal Symbolic Operations for Logical Expressions |
|
|
52 | (5) |
|
2.1.2 Intuitive Rationale behind the Basic Rules of Probability Theory |
|
|
57 | (4) |
|
2.1.3 Extending the Question |
|
|
61 | (1) |
|
|
62 | (4) |
|
2.1.5 The Five-Card Monty Hall Problem |
|
|
66 | (4) |
|
2.1.6 Inverse Probability |
|
|
70 | (19) |
|
2.2 Probabilities and Probability Distributions |
|
|
89 | (8) |
|
2.2.1 Multiplicity Factors |
|
|
89 | (3) |
|
2.2.2 Bernoulli Trials: The Binomial Distribution |
|
|
92 | (2) |
|
2.2.3 Bernoulli Trials: The Negative Binomial Distribution |
|
|
94 | (3) |
|
2.3 Sampling Distributions and Likelihood Functions |
|
|
97 | (12) |
|
2.3.1 Constructing Likelihood Functions from Sampling Distributions |
|
|
98 | (5) |
|
2.3.2 The Optional Stopping Problem |
|
|
103 | (6) |
|
2.4 Distributions Derived from Bernoulli Trials |
|
|
109 | (7) |
|
2.4.1 Multinomial Distribution |
|
|
109 | (4) |
|
2.4.2 Poisson Distribution |
|
|
113 | (3) |
|
|
116 | (3) |
|
2.5.1 Marginalization: The Core of Advanced Techniques |
|
|
116 | (1) |
|
2.5.2 Single Probabilities |
|
|
117 | (1) |
|
2.5.3 Probability Distributions |
|
|
117 | (1) |
|
|
117 | (2) |
|
3 Probability And Information: From Priors To Posteriors |
|
|
119 | (63) |
|
3.1 Probability Distributions: Definition and Characteristics |
|
|
120 | (4) |
|
3.1.1 Probability and Information |
|
|
120 | (4) |
|
3.2 Discrete Distributions |
|
|
124 | (7) |
|
3.2.1 Uniform Distribution |
|
|
124 | (3) |
|
3.2.2 Binomial Distribution" |
|
|
127 | (2) |
|
3.2.3 Poisson Distribution |
|
|
129 | (2) |
|
3.3 Continuous Distributions |
|
|
131 | (10) |
|
3.3.1 Uniform Distribution |
|
|
131 | (3) |
|
3.3.2 Exponential Distribution |
|
|
134 | (3) |
|
3.3.3 Gaussian Distribution |
|
|
137 | (4) |
|
3.4 Assigning Prior Probabilities over Parameters |
|
|
141 | (22) |
|
3.4.1 Three Types of Prior over Parameter Values |
|
|
142 | (1) |
|
|
143 | (7) |
|
|
150 | (6) |
|
|
156 | (2) |
|
3.4.5 Inference under Reparameterization |
|
|
158 | (5) |
|
3.5 Updating Information Based on Data: The Effect of Prior Information |
|
|
163 | (16) |
|
|
179 | (3) |
|
3.6.1 Prior Paralysis: Don't Be a Victim |
|
|
179 | (1) |
|
3.6.2 Comparison to the Frequentist Algorithm |
|
|
179 | (1) |
|
|
180 | (2) |
|
4 Prediction And Decision |
|
|
182 | (75) |
|
4.1 Predictive Sampling Distributions |
|
|
184 | (18) |
|
|
186 | (9) |
|
4.1.2 Posterior Predictive |
|
|
195 | (7) |
|
4.2 Prediction in Time-Varying Systems |
|
|
202 | (18) |
|
4.2.1 Optimal State Estimation |
|
|
205 | (5) |
|
|
210 | (10) |
|
|
220 | (33) |
|
4.3.1 The Mathematics of Decision Theory |
|
|
221 | (10) |
|
4.3.2 Decision and Measurement |
|
|
231 | (15) |
|
4.3.3 Clinically Relevant Differences |
|
|
246 | (7) |
|
|
253 | (4) |
|
4.4.1 Integrating Basic Measurement and Predictive Distributions |
|
|
253 | (1) |
|
4.4.2 Decision theory Is everywhere |
|
|
254 | (3) |
|
5 Models And Measurements |
|
|
257 | (102) |
|
5.1 Observables, Models, and Measurements |
|
|
259 | (18) |
|
5.1.1 Measurement and Uncertainty |
|
|
259 | (5) |
|
5.1.2 Data versus Parameter Coordinates |
|
|
264 | (5) |
|
|
269 | (8) |
|
5.2 The Measurement Algorithm |
|
|
277 | (6) |
|
|
277 | (1) |
|
|
278 | (5) |
|
5.3 Single-Source Measurements |
|
|
283 | (55) |
|
5.3.1 Transparent Measurement |
|
|
283 | (8) |
|
|
291 | (5) |
|
|
296 | (8) |
|
5.3.4 Straight-Line Models |
|
|
304 | (6) |
|
5.3.5 Binary Classification |
|
|
310 | (7) |
|
5.3.6 Two-Alternative Forced-Choice |
|
|
317 | (8) |
|
|
325 | (13) |
|
5.4 Multiple-Source Measurements |
|
|
338 | (16) |
|
5.4.1 Central Problem of Multiple-Source Measurement |
|
|
339 | (1) |
|
5.4.2 Multiple Sources: Transparent I |
|
|
340 | (3) |
|
5.4.3 Multiple Sources: Transparent II |
|
|
343 | (4) |
|
5.4.4 Multiple Sources: Straight-Line Model |
|
|
347 | (6) |
|
5.4.5 Multiple Sources: Summary |
|
|
353 | (1) |
|
|
354 | (5) |
|
|
355 | (3) |
|
5.5.2 Measurement: Summary |
|
|
358 | (1) |
|
|
359 | (148) |
|
6.1 Model Comparison Algorithm |
|
|
362 | (20) |
|
6.1.1 Models and Measurement |
|
|
362 | (2) |
|
6.1.2 Hypotheses and Models |
|
|
364 | (2) |
|
|
366 | (7) |
|
|
373 | (9) |
|
|
382 | (17) |
|
6.2.1 Occam's Razor: History and Implementation |
|
|
382 | (3) |
|
6.2.2 Occam Factor: Examples |
|
|
385 | (14) |
|
|
399 | (37) |
|
|
399 | (6) |
|
|
405 | (5) |
|
6.3.3 Model Comparison for the Gaussian Likelihood |
|
|
410 | (15) |
|
6.3.4 Straight-Line Models |
|
|
425 | (11) |
|
|
436 | (41) |
|
6.4.1 Logic of Model Comparison with S Sources |
|
|
437 | (16) |
|
6.4.2 Interrelationships among Variables: Multisource Method of Testing |
|
|
453 | (24) |
|
|
477 | (9) |
|
6.5.1 Logic of in Competing Models Revisited |
|
|
477 | (9) |
|
|
486 | (21) |
|
6.6.1 Other Approaches to Hypothesis Testing |
|
|
486 | (13) |
|
6.6.2 Pitfalls of the Frequentist Algorithm as Used in Practice |
|
|
499 | (5) |
|
|
504 | (1) |
|
6.6.4 Where Do We Go from Here? |
|
|
505 | (2) |
|
|
|
|
507 | (12) |
|
A.1 Add, Subtract, Multiply, Divide, Evaluate: How to Ask Arithmetic Questions |
|
|
507 | (1) |
|
A.2 Assignment, Indexing, and Variable Types |
|
|
508 | (3) |
|
A.3 Logical Expressions, Indexing, and Flow Control |
|
|
511 | (2) |
|
|
513 | (1) |
|
|
514 | (3) |
|
A.6 Give It a Try and See What Happens |
|
|
517 | (2) |
|
B Mathematics Review: Logarithmic And Exponential Functions |
|
|
519 | (9) |
|
|
519 | (1) |
|
B.2 Exponential Functions |
|
|
519 | (2) |
|
B.3 Logarithmic Functions |
|
|
521 | (1) |
|
B.3.1 Computing Logarithmic Functions |
|
|
521 | (3) |
|
B.3.2 Uses of Logarithmic Functions |
|
|
524 | (1) |
|
B.3.3 Marginalization and the Logsum Problem |
|
|
525 | (3) |
|
C The Bayesian Toolbox: Marginalization And Coordinate Transformation |
|
|
528 | (15) |
|
C.1 Probability Mass Functions versus Probability Density Functions |
|
|
528 | (1) |
|
C.1.1 Unity Probability Mass |
|
|
529 | (1) |
|
C.1.2 Limitless Possibilities |
|
|
530 | (2) |
|
C.1.3 Area under the Curve |
|
|
532 | (3) |
|
C.1.4 Sequences of Areas: Discretization |
|
|
535 | (6) |
|
C.1.5 Approximate Marginalization of Probability Densities |
|
|
541 | (2) |
|
C.2 Coordinate Transforms |
|
|
543 | (36) |
|
C.2.1 Linking Functions for Coordinate Transformation |
|
|
544 | (2) |
|
C.2.2 Transforming Probability Mass Functions |
|
|
546 | (11) |
|
C.2.3 Approximate Transformation of Probability Densities |
|
|
557 | (18) |
|
C.2.4 Calculus-Based Methods for Coordinate Transformation |
|
|
575 | (4) |
|
|
579 | (1) |
References |
|
580 | (9) |
Index |
|
589 | |