|
1 Image and Video Compression: An Overview |
|
|
1 | (48) |
|
1.1 Compression: Generic Approaches |
|
|
2 | (4) |
|
1.1.1 Alternative Representation |
|
|
3 | (2) |
|
|
5 | (1) |
|
|
5 | (1) |
|
1.1.4 Rate-Distortion Control |
|
|
6 | (1) |
|
1.2 Motivation for Processing in the Compressed Domain |
|
|
6 | (2) |
|
1.3 Overview of Different Image and Video Compression Techniques and Standards |
|
|
8 | (1) |
|
1.4 Image Compression Techniques |
|
|
9 | (11) |
|
1.4.1 Baseline Sequential JPEG Lossy Encoding Scheme |
|
|
10 | (1) |
|
|
10 | (1) |
|
|
10 | (1) |
|
|
11 | (1) |
|
1.4.1.4 Encoding DC Coefficients |
|
|
12 | (1) |
|
1.4.1.5 Encoding AC Coefficients |
|
|
13 | (1) |
|
|
13 | (1) |
|
|
14 | (1) |
|
|
15 | (1) |
|
1.4.2.1 Discrete Wavelet Transform (DWT) |
|
|
16 | (2) |
|
|
18 | (1) |
|
1.4.2.3 Bit-Stream Layering, Packetization, and Entropy Coding |
|
|
19 | (1) |
|
|
19 | (1) |
|
1.5 Video Compression Techniques |
|
|
20 | (21) |
|
|
22 | (1) |
|
1.5.1.1 Encoding Structure |
|
|
22 | (1) |
|
|
23 | (2) |
|
1.5.1.3 Method of Encoding Pictures |
|
|
25 | (2) |
|
1.5.1.4 Motion Estimation |
|
|
27 | (1) |
|
1.5.1.5 Handling Interlaced Video |
|
|
28 | (1) |
|
|
29 | (1) |
|
1.5.2.1 Video Object Layer |
|
|
29 | (2) |
|
1.5.2.2 Background Encoding |
|
|
31 | (1) |
|
1.5.2.3 Wavelet Encoding of Still Images |
|
|
31 | (1) |
|
|
31 | (1) |
|
1.5.3.1 Slices and Slice Groups |
|
|
32 | (1) |
|
1.5.3.2 Additional Picture Types |
|
|
32 | (1) |
|
1.5.3.3 Adaptive Frame/Field-Coding Operation |
|
|
32 | (3) |
|
1.5.3.4 Intra-frame Prediction |
|
|
35 | (2) |
|
1.5.3.5 Inter-frame Prediction in P Slices |
|
|
37 | (1) |
|
1.5.3.6 Inter-frame Prediction in B Slices |
|
|
38 | (1) |
|
1.5.3.7 Integer Transform and Scaling |
|
|
38 | (1) |
|
|
39 | (1) |
|
1.5.3.9 Second Transformation of DC Coefficients |
|
|
40 | (1) |
|
|
40 | (1) |
|
1.5.3.11 In-Loop Deblocking Filter |
|
|
40 | (1) |
|
1.5.3.12 Network Abstraction Layer |
|
|
40 | (1) |
|
1.6 Examples of a Few Operations in the Compressed Domain |
|
|
41 | (2) |
|
1.7 Issues and Performance Measures |
|
|
43 | (5) |
|
1.7.1 Complexity of Algorithms |
|
|
43 | (1) |
|
1.7.2 Quality of Processed Images or Videos |
|
|
44 | (1) |
|
1.7.2.1 Similarity with respect to a Benchmark or Reference Image |
|
|
45 | (1) |
|
1.7.2.2 Visibility of Artifacts |
|
|
46 | (1) |
|
1.7.2.3 Measure of Colorfulness |
|
|
47 | (1) |
|
1.7.3 Level of Compression of the Input and Output Data |
|
|
48 | (1) |
|
|
48 | (1) |
|
|
49 | (56) |
|
2.1 Orthogonal Expansion of a Function |
|
|
50 | (10) |
|
2.1.1 Trivial Expansion with Dirac Delta Functions |
|
|
53 | (1) |
|
2.1.2 Fourier Series Expansion |
|
|
53 | (1) |
|
|
53 | (1) |
|
2.1.3.1 Properties of Fourier Transform |
|
|
54 | (3) |
|
2.1.4 Shannon's Orthonormal Bases for Band-limited Functions |
|
|
57 | (1) |
|
|
57 | (1) |
|
2.1.5.1 Multiresolution Approximations |
|
|
58 | (2) |
|
2.1.5.2 Wavelet Bases for Multiresolution Approximations |
|
|
60 | (1) |
|
2.2 Transforms of Discrete Functions |
|
|
60 | (37) |
|
2.2.1 Discrete Fourier Transform (DFT) |
|
|
61 | (1) |
|
2.2.1.1 The Transform Matrix |
|
|
62 | (1) |
|
2.2.1.2 Discrete Fourier Transform as Fourier Series of a Periodic Function |
|
|
62 | (1) |
|
2.2.1.3 Circular Convolution |
|
|
63 | (1) |
|
2.2.1.4 Energy Preservation |
|
|
64 | (1) |
|
|
64 | (1) |
|
2.2.2 Generalized Discrete Fourier Transform (GDFT) |
|
|
65 | (1) |
|
2.2.2.1 Transform Matrices |
|
|
66 | (1) |
|
2.2.2.2 Convolution-Multiplication Properties |
|
|
66 | (1) |
|
2.2.3 Discrete Trigonometric Transforms |
|
|
67 | (1) |
|
2.2.3.1 Symmetric Extensions of Finite Sequences |
|
|
68 | (1) |
|
2.2.3.2 Symmetric Periodic Extension |
|
|
68 | (6) |
|
2.2.3.3 Different Types of Discrete Trigonometric Transforms |
|
|
74 | (3) |
|
2.2.3.4 Convolution Multiplication Properties |
|
|
77 | (2) |
|
|
79 | (1) |
|
2.2.4.1 Matrix Representation |
|
|
79 | (1) |
|
2.2.4.2 Downsampling and Upsampling Properties of the DCTs |
|
|
79 | (1) |
|
2.2.4.3 Subband Relationship of the type-II DCT |
|
|
80 | (1) |
|
2.2.4.4 Approximate DCT Computation |
|
|
81 | (1) |
|
2.2.4.5 Composition and Decomposition of the DCT Blocks |
|
|
81 | (1) |
|
2.2.4.6 Properties of Block Composition Matrices |
|
|
82 | (4) |
|
2.2.4.7 Matrix Factorization |
|
|
86 | (1) |
|
2.2.4.8 8-Point Type-II DCT Matrix (C8) |
|
|
86 | (1) |
|
2.2.4.9 Integer Cosine Transforms |
|
|
87 | (2) |
|
|
89 | (1) |
|
2.2.6 Discrete Wavelet Transform (DWT) |
|
|
89 | (1) |
|
2.2.6.1 Orthonormal Basis with a Single Mother Wavelet |
|
|
89 | (1) |
|
2.2.6.2 Orthonormal Basis with Two Mother Wavelets |
|
|
90 | (1) |
|
|
90 | (1) |
|
|
91 | (1) |
|
2.2.6.5 DWT through Filter Banks |
|
|
92 | (3) |
|
2.2.6.6 Lifting-based DWT |
|
|
95 | (2) |
|
2.3 Transforms in 2-D Space |
|
|
97 | (7) |
|
2.3.1 2-D Discrete Cosine Transform |
|
|
99 | (1) |
|
2.3.1.1 Matrix Representation |
|
|
99 | (1) |
|
2.3.1.2 Subband Approximation of the Type-II DCT |
|
|
99 | (1) |
|
2.3.1.3 Composition and Decomposition of the DCT Blocks in 2-D |
|
|
100 | (1) |
|
2.3.1.4 Symmetric Convolution and Convolution-Multiplication Properties for 2-D DCT |
|
|
100 | (1) |
|
2.3.1.5 Fast DCT Algorithms |
|
|
100 | (2) |
|
2.3.2 2-D Discrete Wavelet Transform |
|
|
102 | (1) |
|
2.3.2.1 Computational Complexity |
|
|
103 | (1) |
|
|
104 | (1) |
|
|
105 | (30) |
|
3.1 Linear Shift Invariant (LSI) Systems |
|
|
106 | (1) |
|
|
107 | (1) |
|
3.3 Filtering a Finite Length Sequence |
|
|
108 | (9) |
|
3.3.1 Extension by Zero Padding |
|
|
108 | (1) |
|
3.3.1.1 Linear Convolution Matrix |
|
|
109 | (1) |
|
|
110 | (1) |
|
3.3.2.1 Circular Convolution Matrix |
|
|
110 | (1) |
|
3.3.2.2 Linear Convolution Performed through Circular Convolution |
|
|
111 | (1) |
|
3.3.3 Antiperiodic Extension |
|
|
111 | (1) |
|
3.3.3.1 Skew Circular Convolution Matrix |
|
|
112 | (1) |
|
3.3.3.2 Circular Convolution as a Series of Skew Circular Convolution |
|
|
112 | (1) |
|
3.3.4 Symmetric Extension |
|
|
112 | (1) |
|
3.3.4.1 Symmetric Convolution Matrices |
|
|
113 | (2) |
|
3.3.4.2 Linear Convolution through Symmetric Convolution |
|
|
115 | (2) |
|
|
117 | (9) |
|
3.4.1 Overlapping and Save Methods in the Transform Domain |
|
|
118 | (1) |
|
3.4.2 Overlapping and Add Methods in the Transform Domain |
|
|
119 | (1) |
|
3.4.2.1 Filtering with Symmetric FIR |
|
|
120 | (3) |
|
3.4.2.2 Filtering with Antisymmetric FIR |
|
|
123 | (1) |
|
3.4.2.3 Filtering with an Arbitrary FIR |
|
|
124 | (1) |
|
3.4.2.4 Efficient Computation |
|
|
124 | (2) |
|
|
126 | (6) |
|
|
126 | (1) |
|
3.5.1.1 Sparse Computation |
|
|
127 | (1) |
|
3.5.1.2 Computation through Spatial Domain |
|
|
128 | (1) |
|
3.5.1.3 Quality of Filtered Images with Sparse Computation |
|
|
129 | (1) |
|
3.5.2 Nonseparable Filters |
|
|
130 | (2) |
|
3.6 Application of Filtering |
|
|
132 | (2) |
|
3.6.1 Removal of Blocking Artifacts |
|
|
132 | (1) |
|
|
132 | (2) |
|
|
134 | (1) |
|
|
135 | (34) |
|
|
136 | (1) |
|
|
137 | (3) |
|
|
137 | (1) |
|
4.2.2 CIE XYZ Color Space |
|
|
137 | (1) |
|
4.2.3 CIE Chromaticity Coordinates |
|
|
138 | (1) |
|
|
139 | (1) |
|
4.3 Processing Colors in the Compressed Domain |
|
|
140 | (1) |
|
4.4 Color Saturation and Desaturation |
|
|
140 | (6) |
|
4.4.1 Normalized YCbCr Color Space |
|
|
142 | (1) |
|
|
142 | (2) |
|
4.4.3 Desaturation of Colors |
|
|
144 | (1) |
|
4.4.4 Computation in the Block DCT Space |
|
|
144 | (1) |
|
|
145 | (1) |
|
|
145 | (1) |
|
|
145 | (1) |
|
4.4.5.3 DCT-domain Techniques |
|
|
146 | (1) |
|
|
146 | (7) |
|
4.5.1 Estimating Spectral Components of a Single Illuminant |
|
|
147 | (1) |
|
4.5.1.1 Computation in the Block DCT Space |
|
|
148 | (2) |
|
4.5.1.2 Cost of Computation and Storage |
|
|
150 | (1) |
|
|
151 | (1) |
|
4.5.2.1 Color Correction in the YCbCr Color Space |
|
|
152 | (1) |
|
4.5.2.2 Color Correction by Chromatic Shift |
|
|
153 | (1) |
|
|
153 | (6) |
|
|
154 | (1) |
|
4.6.2 Multicontrast Enhancement |
|
|
154 | (1) |
|
4.6.3 Multicontrast Enhancement with Dynamic Range Compression |
|
|
155 | (1) |
|
4.6.4 Color Enhancement by Scaling DCT Coefficients |
|
|
155 | (1) |
|
4.6.4.1 Preservation of Contrast |
|
|
155 | (1) |
|
4.6.4.2 Preservation of Color |
|
|
156 | (1) |
|
|
157 | (1) |
|
4.6.5 Examples of Color Enhancement |
|
|
158 | (1) |
|
4.6.5.1 Iterative Enhancement |
|
|
158 | (1) |
|
|
159 | (10) |
|
|
169 | (26) |
|
5.1 Image Halving and Image Doubling in the Compressed Domain |
|
|
170 | (14) |
|
5.1.1 Using Linear, Distributive and Unitary Transform Properties |
|
|
170 | (2) |
|
5.1.2 Using Convolution-Multiplication Properties |
|
|
172 | (1) |
|
5.1.2.1 Two-fold Downsampling of 8-point DCT Blocks in 1-D |
|
|
173 | (2) |
|
5.1.2.2 Twofold Upsampling of 8-point DCT Blocks in 1-D |
|
|
175 | (1) |
|
|
175 | (1) |
|
5.1.3 Using Subband DCT Approximation with Block Composition and Decomposition |
|
|
176 | (1) |
|
|
177 | (2) |
|
|
179 | (3) |
|
5.1.4 Performance Analysis |
|
|
182 | (2) |
|
5.2 Resizing with Integral Factors |
|
|
184 | (3) |
|
5.2.1 L × M Downsampling Algorithm (LMDS) |
|
|
184 | (2) |
|
5.2.2 L × M upsampling Algorithm (LMUS) |
|
|
186 | (1) |
|
5.3 Resizing with Arbitrary Factors |
|
|
187 | (4) |
|
|
191 | (2) |
|
|
192 | (1) |
|
|
193 | (2) |
|
|
195 | (40) |
|
6.1 Intertransforms Conversion |
|
|
196 | (12) |
|
|
197 | (1) |
|
6.1.1.1 Inserting Zeroes in DWT Coefficients |
|
|
197 | (2) |
|
6.1.1.2 DCT Domain Upsampling in 2D |
|
|
199 | (1) |
|
6.1.1.3 Upsampling the DCT for Multilevel DWT |
|
|
200 | (1) |
|
6.1.1.4 Wavelet Synthesis in the Compressed Domain |
|
|
200 | (3) |
|
6.1.1.5 Transcoding in 2-D |
|
|
203 | (1) |
|
|
204 | (1) |
|
6.1.2.1 Even and Odd Downsampling of DCT Blocks |
|
|
204 | (2) |
|
6.1.2.2 Even and Odd Downsampling in 2-D |
|
|
206 | (1) |
|
6.1.2.3 Wavelet Analysis in the DCT Domain |
|
|
206 | (1) |
|
|
207 | (1) |
|
|
208 | (1) |
|
6.2 Image Transcoding: JPEG2000 to JPEG |
|
|
208 | (3) |
|
6.2.1 Transcoding with WBDT |
|
|
209 | (1) |
|
6.2.2 Transcoding with Wavelet Doubling |
|
|
209 | (1) |
|
6.2.3 Transcoding with DCT Domain Doubling |
|
|
209 | (1) |
|
6.2.4 Performance Metrics for Transcoding Schemes |
|
|
210 | (1) |
|
|
211 | (14) |
|
6.3.1 Inverse Motion Compensation |
|
|
215 | (1) |
|
6.3.1.1 Single Blockwise Inverse Motion Compensation |
|
|
215 | (2) |
|
6.3.1.2 Macroblockwise Inverse Motion Compensation |
|
|
217 | (1) |
|
6.3.1.3 Video Downscaling and IMC: Integrated Scheme |
|
|
218 | (2) |
|
6.3.2 Motion Vector Refinement |
|
|
220 | (1) |
|
6.3.2.1 Adaptive Motion Vector Resampling (AMVR) |
|
|
220 | (1) |
|
|
221 | (1) |
|
6.3.2.3 Nonlinear Motion Vector Resampling (NLMR) Method |
|
|
221 | (1) |
|
6.3.3 Macroblock Type Declaration |
|
|
222 | (1) |
|
6.3.4 Downsizing MPEG2 Video |
|
|
222 | (2) |
|
6.3.5 Arbitrary Video Downsizing |
|
|
224 | (1) |
|
|
225 | (2) |
|
|
227 | (4) |
|
|
228 | (2) |
|
6.5.1.1 Motion Estimation |
|
|
230 | (1) |
|
|
230 | (1) |
|
|
230 | (1) |
|
6.5.1.4 Advantage of the Hybrid Approach |
|
|
231 | (1) |
|
|
231 | (1) |
|
6.6 Error Resilient Transcoding |
|
|
231 | (3) |
|
|
234 | (1) |
|
7 Image and Video Analysis |
|
|
235 | (16) |
|
7.1 Image and Video Editing |
|
|
235 | (6) |
|
7.1.1 Document Processing |
|
|
236 | (2) |
|
7.1.2 Caption Localization in a Video |
|
|
238 | (1) |
|
|
239 | (2) |
|
|
241 | (2) |
|
|
243 | (2) |
|
|
245 | (1) |
|
|
246 | (1) |
|
7.6 Image and Video Indexing |
|
|
247 | (3) |
|
|
247 | (1) |
|
|
248 | (1) |
|
7.6.2.1 Key Frame Selection |
|
|
248 | (1) |
|
7.6.2.2 Key Video Object Plane Selection |
|
|
249 | (1) |
|
|
250 | (1) |
Bibliography |
|
251 | (14) |
Index |
|
265 | |