Acknowledgements |
|
xi | |
Note to the Reader |
|
xiii | |
Interdependence of Chapters |
|
xiv | |
Introduction |
|
1 | (14) |
|
1 Fundamental Functional Equations |
|
|
15 | (17) |
|
|
16 | (7) |
|
1.2 Logarithmic Sequences |
|
|
23 | (5) |
|
|
28 | (4) |
|
|
32 | (30) |
|
2.1 Probability Distributions on Finite Sets |
|
|
33 | (6) |
|
2.2 Definition and Properties of Shannon Entropy |
|
|
39 | (5) |
|
2.3 Entropy in Terms of Coding |
|
|
44 | (8) |
|
2.4 Entropy in Terms of Diversity |
|
|
52 | (6) |
|
2.5 The Chain Rule Characterizes Entropy |
|
|
58 | (4) |
|
|
62 | (29) |
|
3.1 Definition and Properties of Relative Entropy |
|
|
63 | (3) |
|
3.2 Relative Entropy in Terms of Coding |
|
|
66 | (4) |
|
3.3 Relative Entropy in Terms of Diversity |
|
|
70 | (4) |
|
3.4 Relative Entropy in Measure Theory, Geometry and Statistics |
|
|
74 | (11) |
|
3.5 Characterization of Relative Entropy |
|
|
85 | (6) |
|
4 Deformations of Shannon Entropy |
|
|
91 | (42) |
|
4.1 q-Logarithmic Entropies |
|
|
92 | (8) |
|
|
100 | (11) |
|
4.3 Renyi Entropies and Hill Numbers |
|
|
111 | (8) |
|
4.4 Properties of the Hill Numbers |
|
|
119 | (8) |
|
4.5 Characterization of the Hill Number of a Given Order |
|
|
127 | (6) |
|
|
133 | (36) |
|
5.1 Quasiarithmetic Means |
|
|
135 | (7) |
|
|
142 | (7) |
|
5.3 Strictly Increasing Homogeneous Means |
|
|
149 | (6) |
|
5.4 Increasing Homogeneous Means |
|
|
155 | (7) |
|
|
162 | (7) |
|
6 Species Similarity and Magnitude |
|
|
169 | (55) |
|
6.1 The Importance of Species Similarity |
|
|
171 | (11) |
|
6.2 Properties of the Similarity-Sensitive Diversity Measures |
|
|
182 | (10) |
|
|
192 | (14) |
|
6.4 Introduction to Magnitude |
|
|
206 | (11) |
|
6.5 Magnitude in Geometry and Analysis |
|
|
217 | (7) |
|
|
224 | (33) |
|
7.1 Introduction to Value |
|
|
226 | (10) |
|
7.2 Value and Relative Entropy |
|
|
236 | (4) |
|
7.3 Characterization of Value |
|
|
240 | (5) |
|
7.4 Total Characterization of the Hill Numbers |
|
|
245 | (12) |
|
8 Mutual Information and Metacommunities |
|
|
257 | (46) |
|
8.1 Joint Entropy, Conditional Entropy and Mutual Information |
|
|
258 | (11) |
|
8.2 Diversity Measures for Subcommunities |
|
|
269 | (4) |
|
8.3 Diversity Measures for Metacommunities |
|
|
273 | (10) |
|
8.4 Properties of the Metacommunity Measures |
|
|
283 | (11) |
|
8.5 All Entropy Is Relative |
|
|
294 | (5) |
|
|
299 | (4) |
|
|
303 | (26) |
|
9.1 Moment Generating Functions |
|
|
304 | (3) |
|
9.2 Large Deviations and Convex Duality |
|
|
307 | (8) |
|
9.3 Multiplicative Characterization of the p-Norms |
|
|
315 | (7) |
|
9.4 Multiplicative Characterization of the Power Means |
|
|
322 | (7) |
|
|
329 | (14) |
|
10.1 Measure-Preserving Maps |
|
|
330 | (6) |
|
10.2 Characterization of Information Loss |
|
|
336 | (7) |
|
11 Entropy Modulo a Prime |
|
|
343 | (25) |
|
11.1 Fermat Quotients and the Definition of Entropy |
|
|
344 | (8) |
|
11.2 Characterizations of Entropy and Information Loss |
|
|
352 | (3) |
|
11.3 The Residues of Real Entropy |
|
|
355 | (4) |
|
|
359 | (9) |
|
12 The Categorical Origins of Entropy |
|
|
368 | (27) |
|
12.1 Operads and Their Algebras |
|
|
369 | (8) |
|
12.2 Categorical Algebras and Internal Algebras |
|
|
377 | (7) |
|
12.3 Entropy as an Internal Algebra |
|
|
384 | (1) |
|
12.4 The Universal Internal Algebra |
|
|
385 | (10) |
|
Appendix A Proofs of Background Facts |
|
|
395 | (14) |
|
A.1 Forms of the Chain Rule for Entropy |
|
|
395 | (3) |
|
A.2 The Expected Number of Species in a Random Sample |
|
|
398 | (1) |
|
A.3 The Diversity Profile Determines the Distribution |
|
|
399 | (2) |
|
|
401 | (1) |
|
A.5 Diversity of Integer Orders |
|
|
402 | (1) |
|
A.6 The Maximum Entropy of a Coupling |
|
|
403 | (3) |
|
|
406 | (1) |
|
A.8 Cumulant Generating Functions Are Convex |
|
|
407 | (1) |
|
A.9 Functions on a Finite Field |
|
|
408 | (1) |
|
Appendix B Summary of Conditions |
|
|
409 | (3) |
References |
|
412 | (19) |
Index of Notation |
|
431 | (2) |
Index |
|
433 | |