Preface |
|
xvii | |
|
|
1 | (12) |
|
1.1 Compression Techniques |
|
|
3 | (3) |
|
1.1.1 Lossless Compression |
|
|
4 | (1) |
|
|
5 | (1) |
|
1.1.3 Measures of Performance |
|
|
5 | (1) |
|
|
6 | (4) |
|
|
10 | (1) |
|
1.4 Projects and Problems |
|
|
10 | (3) |
|
2 Mathematical Preliminaries for Lossless Compression |
|
|
13 | (30) |
|
|
13 | (1) |
|
2.2 A Brief Introduction to Information Theory |
|
|
13 | (12) |
|
2.2.1 Derivation of Average Information |
|
|
20 | (5) |
|
|
25 | (4) |
|
|
25 | (1) |
|
|
25 | (1) |
|
|
26 | (3) |
|
2.3.4 Composite Source Model |
|
|
29 | (1) |
|
|
29 | (8) |
|
2.4.1 Uniquely Decodable Codes |
|
|
30 | (3) |
|
|
33 | (1) |
|
2.4.3 The Kraft-McMillan Inequality |
|
|
34 | (3) |
|
2.5 Algorithmic Information Theory |
|
|
37 | (1) |
|
2.6 Minimum Description Length Principle |
|
|
38 | (1) |
|
|
39 | (1) |
|
2.8 Projects and Problems |
|
|
40 | (3) |
|
|
43 | (48) |
|
|
43 | (1) |
|
3.2 The Huffman Coding Algorithm |
|
|
43 | (22) |
|
3.2.1 Minimum Variance Huffman Codes |
|
|
47 | (3) |
|
3.2.2 Canonical Huffman Codes |
|
|
50 | (2) |
|
3.2.3 Length-Limited Huffman Codes |
|
|
52 | (3) |
|
3.2.4 Optimality of Huffman Codes |
|
|
55 | (1) |
|
3.2.5 Length of Huffman Codes |
|
|
56 | (2) |
|
3.2.6 Extended Huffman Codes |
|
|
58 | (3) |
|
3.2.7 Implementation of Huffman Codes |
|
|
61 | (4) |
|
3.3 Nonbinary Huffman Codes |
|
|
65 | (2) |
|
3.4 Adaptive Huffman Coding |
|
|
67 | (8) |
|
|
68 | (3) |
|
|
71 | (2) |
|
|
73 | (2) |
|
|
75 | (1) |
|
|
76 | (3) |
|
3.6.1 CCSDS Recommendation for Lossless Compression |
|
|
77 | (2) |
|
|
79 | (2) |
|
3.8 Applications of Huffman Coding |
|
|
81 | (5) |
|
3.8.1 Lossless Image Compression |
|
|
81 | (2) |
|
|
83 | (2) |
|
|
85 | (1) |
|
|
86 | (1) |
|
3.10 Projects and Problems |
|
|
87 | (4) |
|
|
91 | (44) |
|
|
91 | (1) |
|
|
91 | (2) |
|
|
93 | (9) |
|
|
94 | (7) |
|
4.3.2 Deciphering the Tag |
|
|
101 | (1) |
|
4.4 Generating a Binary Code |
|
|
102 | (17) |
|
4.4.1 Uniqueness and Efficiency of the Arithmetic Code |
|
|
103 | (3) |
|
4.4.2 Algorithm Implementation |
|
|
106 | (5) |
|
4.4.3 Integer Implementation |
|
|
111 | (8) |
|
4.5 Adaptive Arithmetic Coding |
|
|
119 | (1) |
|
4.6 Binary Arithmetic Coding |
|
|
120 | (7) |
|
|
125 | (1) |
|
|
125 | (1) |
|
|
126 | (1) |
|
4.7 Comparison of Huffman and Arithmetic Coding |
|
|
127 | (3) |
|
|
130 | (1) |
|
|
131 | (1) |
|
4.10 Projects and Problems |
|
|
131 | (4) |
|
|
135 | (28) |
|
|
135 | (1) |
|
|
135 | (1) |
|
|
136 | (3) |
|
|
137 | (2) |
|
|
139 | (11) |
|
|
139 | (4) |
|
|
143 | (7) |
|
|
150 | (6) |
|
5.5.1 File Compression-UNIX compress |
|
|
151 | (1) |
|
5.5.2 Image Compression-The Graphics Interchange Format (GIF) |
|
|
151 | (1) |
|
5.5.3 Image Compression-Portable Network Graphics (PNG) |
|
|
152 | (1) |
|
5.5.4 Compression over Modems-V.42 bis |
|
|
153 | (3) |
|
5.6 Beyond Compression--Lempel-Ziv Complexity |
|
|
156 | (2) |
|
|
158 | (1) |
|
5.8 Projects and Problems |
|
|
159 | (4) |
|
6 Context-Based Compression |
|
|
163 | (20) |
|
|
163 | (1) |
|
|
163 | (2) |
|
6.3 Prediction with Partial Match (ppm) |
|
|
165 | (9) |
|
6.3.1 The Basic Algorithm |
|
|
165 | (5) |
|
|
170 | (2) |
|
|
172 | (1) |
|
6.3.4 The Exclusion Principle |
|
|
173 | (1) |
|
6.4 The Burrows-Wheeler Transform |
|
|
174 | (4) |
|
6.4.1 Move-to-Front Coding |
|
|
177 | (1) |
|
6.5 Associative Coder of Buyanovsky (ACB) |
|
|
178 | (1) |
|
6.6 Dynamic Markov Compression |
|
|
179 | (3) |
|
|
182 | (1) |
|
6.8 Projects and Problems |
|
|
182 | (1) |
|
7 Lossless Image Compression |
|
|
183 | (34) |
|
|
183 | (1) |
|
|
183 | (3) |
|
7.2.1 The Old JPEG Standard |
|
|
184 | (2) |
|
|
186 | (4) |
|
|
190 | (2) |
|
7.5 Prediction Using Conditional Averages |
|
|
192 | (1) |
|
7.6 Multiresolution Approaches |
|
|
193 | (5) |
|
7.6.1 Progressive Image Transmission |
|
|
193 | (5) |
|
|
198 | (13) |
|
|
199 | (1) |
|
7.7.2 CCITT Group 3 and 4-Recommendations T.4 and T.6 |
|
|
200 | (3) |
|
|
203 | (6) |
|
|
209 | (2) |
|
|
211 | (2) |
|
|
213 | (1) |
|
7.10 Projects and Problems |
|
|
214 | (3) |
|
8 Mathematical Preliminaries for Lossy Coding |
|
|
217 | (34) |
|
|
217 | (1) |
|
|
217 | (3) |
|
|
220 | (5) |
|
8.3.1 The Human Visual System |
|
|
223 | (1) |
|
8.3.2 Auditory Perception |
|
|
224 | (1) |
|
8.4 Information Theory Revisited |
|
|
225 | (7) |
|
8.4.1 Conditional Entropy |
|
|
225 | (3) |
|
8.4.2 Average Mutual Information |
|
|
228 | (1) |
|
8.4.3 Differential Entropy |
|
|
229 | (3) |
|
8.5 Rate Distortion Theory |
|
|
232 | (8) |
|
|
240 | (8) |
|
|
240 | (3) |
|
8.6.2 Linear System Models |
|
|
243 | (5) |
|
|
248 | (1) |
|
|
248 | (1) |
|
8.8 Projects and Problems |
|
|
249 | (2) |
|
|
251 | (44) |
|
|
251 | (1) |
|
|
251 | (1) |
|
9.3 The Quantization Problem |
|
|
252 | (5) |
|
|
257 | (11) |
|
9.5 Adaptive Quantization |
|
|
268 | (9) |
|
9.5.1 Forward Adaptive Quantization |
|
|
269 | (2) |
|
9.5.2 Backward Adaptive Quantization |
|
|
271 | (6) |
|
9.6 Nonuniform Quantization |
|
|
277 | (10) |
|
9.6.1 pdf-Optimized Quantization |
|
|
278 | (4) |
|
9.6.2 Companded Quantization |
|
|
282 | (5) |
|
9.7 Entropy-Coded Quantization |
|
|
287 | (5) |
|
9.7.1 Entropy Coding of Lloyd-Max Quantizer Outputs |
|
|
288 | (1) |
|
9.7.2 Entropy-Constrained Quantization |
|
|
289 | (1) |
|
9.7.3 High-Rate Optimum Quantization |
|
|
289 | (3) |
|
|
292 | (1) |
|
9.9 Projects and Problems |
|
|
293 | (2) |
|
|
295 | (50) |
|
|
295 | (1) |
|
|
295 | (3) |
|
10.3 Advantages of Vector Quantization over Scalar Quantization |
|
|
298 | (6) |
|
10.4 The Linde-Buzo-Gray Algorithm |
|
|
304 | (16) |
|
10.4.1 Initializing the LBG Algorithm |
|
|
309 | (6) |
|
10.4.2 The Empty Cell Problem |
|
|
315 | (1) |
|
10.4.3 Use of LBG for Image Compression |
|
|
315 | (5) |
|
10.5 Tree-Structured Vector Quantizers |
|
|
320 | (4) |
|
10.5.1 Design of Tree-Structured Vector Quantizers |
|
|
323 | (1) |
|
10.5.2 Pruned Tree-Structured Vector Quantizers |
|
|
324 | (1) |
|
10.6 Structured Vector Quantizers |
|
|
324 | (8) |
|
10.6.1 Pyramid Vector Quantization |
|
|
326 | (1) |
|
10.6.2 Polar and Spherical Vector Quantizers |
|
|
327 | (1) |
|
10.6.3 Lattice Vector Quantizers |
|
|
328 | (4) |
|
10.7 Variations on the Theme |
|
|
332 | (5) |
|
10.7.1 Gain-Shape Vector Quantization |
|
|
332 | (1) |
|
10.7.2 Mean-Removed Vector Quantization |
|
|
332 | (1) |
|
10.7.3 Classified Vector Quantization |
|
|
333 | (1) |
|
10.7.4 Multistage Vector Quantization |
|
|
334 | (1) |
|
10.7.5 Adaptive Vector Quantization |
|
|
335 | (2) |
|
10.8 Trellis-Coded Quantization |
|
|
337 | (3) |
|
|
340 | (2) |
|
10.10 Projects and Problems |
|
|
342 | (3) |
|
|
345 | (28) |
|
|
345 | (1) |
|
|
345 | (3) |
|
|
348 | (4) |
|
|
352 | (5) |
|
|
357 | (4) |
|
11.5.1 Adaptive Quantization in DPCM |
|
|
358 | (1) |
|
11.5.2 Adaptive Prediction in DPCM |
|
|
358 | (3) |
|
|
361 | (4) |
|
11.6.1 Constant Factor Adaptive Delta Modulation (CFDM) |
|
|
363 | (1) |
|
11.6.2 Continuously Variable Slope Delta Modulation |
|
|
364 | (1) |
|
|
365 | (4) |
|
|
366 | (3) |
|
|
369 | (2) |
|
|
371 | (1) |
|
11.10 Projects and Problems |
|
|
371 | (2) |
|
12 Mathematical Preliminaries for Transforms, Subbands, and Wavelets |
|
|
373 | (36) |
|
|
373 | (1) |
|
|
373 | (1) |
|
|
374 | (6) |
|
12.3.1 Dot or Inner Product |
|
|
375 | (1) |
|
|
375 | (2) |
|
|
377 | (1) |
|
|
377 | (2) |
|
12.3.5 Inner Product-Formal Definition |
|
|
379 | (1) |
|
12.3.6 Orthogonal and Orthonormal Sets |
|
|
379 | (1) |
|
|
380 | (2) |
|
|
382 | (3) |
|
12.5.1 Parseval's Theorem |
|
|
384 | (1) |
|
12.5.2 Modulation Property |
|
|
384 | (1) |
|
12.5.3 Convolution Theorem |
|
|
385 | (1) |
|
|
385 | (5) |
|
|
386 | (1) |
|
|
386 | (1) |
|
|
387 | (1) |
|
|
388 | (2) |
|
|
390 | (4) |
|
12.7.1 Ideal Sampling-Frequency Domain View |
|
|
390 | (2) |
|
12.7.2 Ideal Sampling-Time Domain View |
|
|
392 | (2) |
|
12.8 Discrete Fourier Transform |
|
|
394 | (2) |
|
|
396 | (10) |
|
|
399 | (1) |
|
12.9.2 Partial Fraction Expansion |
|
|
399 | (4) |
|
|
403 | (1) |
|
12.9.4 Z-Transform Properties |
|
|
404 | (1) |
|
12.9.5 Discrete Convolution |
|
|
404 | (2) |
|
|
406 | (1) |
|
12.11 Projects and Problems |
|
|
407 | (2) |
|
|
409 | (38) |
|
|
409 | (1) |
|
|
409 | (5) |
|
|
414 | (4) |
|
13.4 Transforms of Interest |
|
|
418 | (6) |
|
13.4.1 Karhunen-Loeve Transform |
|
|
418 | (2) |
|
13.4.2 Discrete Cosine Transform |
|
|
420 | (3) |
|
13.4.3 Discrete Sine Transform |
|
|
423 | (1) |
|
13.4.4 Discrete Walsh-Hadamard Transform |
|
|
423 | (1) |
|
13.5 Quantization and Coding of Transform Coefficients |
|
|
424 | (8) |
|
13.5.1 Operational Rate-Distortion Bit Allocation |
|
|
428 | (4) |
|
13.6 Application to Image Compression--JPEG |
|
|
432 | (8) |
|
|
432 | (1) |
|
|
432 | (2) |
|
|
434 | (4) |
|
|
438 | (2) |
|
13.7 Application to Audio Compression--The MDCT |
|
|
440 | (3) |
|
|
443 | (1) |
|
13.9 Projects and Problems |
|
|
444 | (3) |
|
|
447 | (50) |
|
|
447 | (1) |
|
|
447 | (5) |
|
|
452 | (7) |
|
14.3.1 Some Filters Used in Subband Coding |
|
|
456 | (3) |
|
14.4 The Basic Subband Coding Algorithm |
|
|
459 | (3) |
|
|
459 | (2) |
|
14.4.2 Quantization and Coding |
|
|
461 | (1) |
|
|
461 | (1) |
|
14.5 Design of Filter Banks |
|
|
462 | (5) |
|
|
463 | (3) |
|
|
466 | (1) |
|
14.6 Perfect Reconstruction Using Two-Channel Filter Banks |
|
|
467 | (7) |
|
14.6.1 Two-Channel PR Quadrature Mirror Filters |
|
|
470 | (2) |
|
14.6.2 Power Symmetric FIR Filters |
|
|
472 | (2) |
|
14.7 M-Band Quadrature Mirror Filter Banks |
|
|
474 | (3) |
|
14.8 The Polyphase Decomposition |
|
|
477 | (5) |
|
|
482 | (2) |
|
14.10 Application to Speech Coding---G.722 |
|
|
484 | (1) |
|
14.11 Application to Audio Coding---MPEG Audio |
|
|
485 | (1) |
|
14.12 Application to Image Compression |
|
|
486 | (6) |
|
14.12.1 Decomposing an Image |
|
|
488 | (2) |
|
14.12.2 Coding the Subbands |
|
|
490 | (2) |
|
|
492 | (1) |
|
14.14 Projects and Problems |
|
|
493 | (4) |
|
|
497 | (32) |
|
|
497 | (1) |
|
|
497 | (3) |
|
|
500 | (4) |
|
15.4 Multiresolution Analysis and the Scaling Function |
|
|
504 | (6) |
|
15.5 Implementation Using Filters |
|
|
510 | (6) |
|
15.5.1 Scaling and Wavelet Coefficients |
|
|
513 | (3) |
|
15.5.2 Families of Wavelets |
|
|
516 | (1) |
|
15.6 Biorthogonal Wavelets |
|
|
516 | (7) |
|
|
523 | (4) |
|
|
527 | (1) |
|
15.9 Projects and Problems |
|
|
528 | (1) |
|
16 Wavelet-Based Image Compression |
|
|
529 | (40) |
|
|
529 | (1) |
|
|
529 | (3) |
|
16.3 Embedded Zerotree Coder |
|
|
532 | (8) |
|
16.4 Set Partitioning in Hierarchical Trees |
|
|
540 | (7) |
|
|
547 | (21) |
|
16.5.1 Color Component Transform |
|
|
548 | (1) |
|
|
549 | (1) |
|
|
549 | (2) |
|
|
551 | (1) |
|
|
552 | (7) |
|
|
559 | (2) |
|
16.5.7 JPEG 2000 bitstream |
|
|
561 | (7) |
|
|
568 | (1) |
|
16.7 Projects and Problems |
|
|
568 | (1) |
|
|
569 | (22) |
|
|
569 | (1) |
|
|
569 | (4) |
|
|
570 | (1) |
|
|
571 | (1) |
|
17.2.3 Psychoacoustic Model |
|
|
572 | (1) |
|
|
573 | (8) |
|
|
573 | (2) |
|
|
575 | (2) |
|
17.3.3 Layer III Coding--mp3 |
|
|
577 | (4) |
|
17.4 MPEG Advanced Audio Coding |
|
|
581 | (6) |
|
|
582 | (4) |
|
|
586 | (1) |
|
17.5 Dolby AC-3 (Dolby Digital) |
|
|
587 | (2) |
|
|
588 | (1) |
|
|
589 | (1) |
|
|
589 | (2) |
|
18 Analysis/Synthesis and Analysis by Synthesis Schemes |
|
|
591 | (42) |
|
|
591 | (1) |
|
|
591 | (2) |
|
|
593 | (18) |
|
18.3.1 The Channel Vocoder |
|
|
594 | (2) |
|
18.3.2 The Linear Predictive Coder (Government Standard LPC-10) |
|
|
596 | (7) |
|
18.3.3 Code-Excited Linear Predicton (CELP) |
|
|
603 | (3) |
|
|
606 | (2) |
|
18.3.5 Mixed Excitation Linear Prediction (MELP) |
|
|
608 | (3) |
|
18.4 Wideband Speech Compression---ITU-T G.722.2 |
|
|
611 | (2) |
|
18.5 Coding of Speech for Internet Applications |
|
|
613 | (10) |
|
|
613 | (5) |
|
|
618 | (3) |
|
|
621 | (2) |
|
|
623 | (8) |
|
|
631 | (1) |
|
18.8 Projects and Problems |
|
|
632 | (1) |
|
|
633 | (42) |
|
|
633 | (1) |
|
|
633 | (2) |
|
|
635 | (3) |
|
19.4 Video Signal Representation |
|
|
638 | (6) |
|
19.5 ITU-T Recommendation H.261 |
|
|
644 | (5) |
|
19.5.1 Motion Compensation |
|
|
644 | (2) |
|
|
646 | (1) |
|
|
647 | (1) |
|
19.5.4 Quantization and Coding |
|
|
647 | (2) |
|
|
649 | (1) |
|
|
649 | (1) |
|
19.7 Asymmetric Applications |
|
|
650 | (2) |
|
19.8 The MPEG-1 Video Standard |
|
|
652 | (3) |
|
19.9 The MPEG-2 Video Standard---H.262 |
|
|
655 | (3) |
|
19.10 ITU-T Recommendation H.263 |
|
|
658 | (6) |
|
19.10.1 Unrestricted Motion Vector Mode |
|
|
660 | (1) |
|
19.10.2 Syntax-Based Arithmetic Coding Mode |
|
|
660 | (1) |
|
19.10.3 Advanced Prediction Mode |
|
|
661 | (1) |
|
19.10.4 PB-Frames and Improved PB-Frames Mode |
|
|
661 | (1) |
|
19.10.5 Advanced Intra Coding Mode |
|
|
661 | (1) |
|
19.10.6 Deblocking Filter Mode |
|
|
661 | (1) |
|
19.10.7 Reference Picture Selection Mode |
|
|
662 | (1) |
|
19.10.8 Temporal, SNR, and Spatial Scalability Mode |
|
|
662 | (1) |
|
19.10.9 Reference Picture Resampling |
|
|
662 | (1) |
|
19.10.10 Reduced-Resolution Update Mode |
|
|
662 | (1) |
|
19.10.11 Alternative Inter VLC Mode |
|
|
662 | (1) |
|
19.10.12 Modified Quantization Mode |
|
|
663 | (1) |
|
19.10.13 Enhanced Reference Picture Selection Mode |
|
|
663 | (1) |
|
19.11 ITU-T Recommendation H.264, MPEG-4 Part 10, Advanced Video Coding |
|
|
664 | (5) |
|
19.11.1 Motion-Compensated Prediction |
|
|
664 | (1) |
|
|
665 | (1) |
|
|
666 | (1) |
|
|
666 | (2) |
|
|
668 | (1) |
|
|
669 | (1) |
|
|
670 | (3) |
|
|
671 | (1) |
|
19.13.2 Compression Issues in ATM Networks |
|
|
671 | (1) |
|
19.13.3 Compression Algorithms for Packet Video |
|
|
672 | (1) |
|
|
673 | (1) |
|
19.15 Projects and Problems |
|
|
674 | (1) |
|
A Probability and Random Processes |
|
|
675 | (16) |
|
|
675 | (5) |
|
A.1.1 Frequency of Occurrence |
|
|
675 | (1) |
|
A.1.2 A Measure of Belief |
|
|
676 | (2) |
|
A.1.3 The Axiomatic Approach |
|
|
678 | (2) |
|
|
680 | (1) |
|
A.3 Distribution Functions |
|
|
681 | (2) |
|
|
683 | (2) |
|
|
685 | (1) |
|
|
685 | (1) |
|
|
685 | (1) |
|
A.5 Types of Distribution |
|
|
685 | (2) |
|
A.5.1 Uniform Distribution |
|
|
685 | (1) |
|
A.5.2 Gaussian Distribution |
|
|
686 | (1) |
|
A.5.3 Laplacian Distribution |
|
|
686 | (1) |
|
|
686 | (1) |
|
|
687 | (2) |
|
A.7 Projects and Problems |
|
|
689 | (2) |
|
B A Brief Review of Matrix Concepts |
|
|
691 | (6) |
|
|
691 | (1) |
|
|
692 | (5) |
|
|
697 | (2) |
Bibliography |
|
699 | (18) |
Index |
|
717 | |