1 Introduction |
|
1 | |
Part I Digital Video |
|
|
2 Introduction to Digital Video |
|
|
7 | |
|
2.1 The Beginning of Moving Pictures |
|
|
7 | |
|
2.2 Digital Picture and Video Representation |
|
|
8 | |
|
|
14 | |
|
|
17 | |
|
3.1 DCT-Based Video Encoding |
|
|
17 | |
|
|
18 | |
|
3.1.2 Discrete Cosine Transformation |
|
|
19 | |
|
|
20 | |
|
|
23 | |
|
3.1.5 Variable Length Coding |
|
|
24 | |
|
3.2 Inter-frame Coding: Motion Estimation and Compensation |
|
|
25 | |
|
3.3 Scalable Video Encoding |
|
|
29 | |
|
|
30 | |
|
3.3.2 Temporal Scalability |
|
|
30 | |
|
3.3.3 Spatial Scalability |
|
|
31 | |
|
|
31 | |
|
|
32 | |
|
3.3.6 Fine Granular Scalability (FGS) |
|
|
33 | |
|
3.3.7 Multiple Description Coding (MDC) |
|
|
35 | |
|
3.4 Wavelet-Based Video Encoding |
|
|
35 | |
|
3.5 Video Coding Standards |
|
|
38 | |
Part II Video Traces and Statistics |
|
|
4 Metrics and Statistics for Video Traces |
|
|
45 | |
|
|
45 | |
|
|
46 | |
|
|
47 | |
|
|
47 | |
|
|
48 | |
|
|
50 | |
|
|
50 | |
|
|
51 | |
|
4.3 Correlation between Video Frame Sizes and Qualities |
|
|
54 | |
|
4.4 Additional Metrics for FGS Encodings |
|
|
55 | |
|
4.5 Additional Metric for MDC Encodings |
|
|
58 | |
|
|
59 | |
|
5.1 Overview of Video Trace Generation and Evaluation Process |
|
|
59 | |
|
|
60 | |
|
|
61 | |
|
5.1.3 Video Source YUV Test Sequences |
|
|
62 | |
|
5.1.4 Video Source Pre-Encoded Video |
|
|
62 | |
|
|
62 | |
|
5.3 Evaluation of MPEG-4 Encodings |
|
|
63 | |
|
5.3.1 Single—Layer Encoding |
|
|
66 | |
|
5.3.2 Temporal Scalable Encoding |
|
|
67 | |
|
5.3.3 Spatial Scalable Encoding |
|
|
71 | |
|
5.4 Evaluation of H.264 Encodings |
|
|
73 | |
|
5.5 Evaluation of MPEG-4 FGS Encodings |
|
|
75 | |
|
5.6 Evaluation of Wavelet Video Traces |
|
|
77 | |
|
5.7 Evaluation of Pre-Encoded Content |
|
|
79 | |
|
5.8 Evaluation of MDC Encodings |
|
|
80 | |
|
6 Statistical Results from Video Traces |
|
|
83 | |
|
6.1 Video Trace Statistics for MPEG-4 Encoded Video |
|
|
83 | |
|
6.1.1 Examples from Silence of the Lambs Single Layer Encodings |
|
|
83 | |
|
6.1.2 Videos and Encoder Modes for Evaluated MPEG-4 Video Traces |
|
|
93 | |
|
6.1.3 Single Layer Encoded Video |
|
|
97 | |
|
6.1.4 Temporal Scalable Encoded Video |
|
|
100 | |
|
6.1.5 Spatial Scalable Encoded Video |
|
|
104 | |
|
6.2 Video Trace Statistics for H.264 Video Trace Files |
|
|
109 | |
|
6.3 Video Trace Statistics for Pre-Encoded Video |
|
|
118 | |
|
6.4 Video Trace Statistics for Wavelet Encoded Video |
|
|
125 | |
|
6.4.1 Analysis of Video Traffic |
|
|
125 | |
|
6.4.2 Analysis of Video Quality |
|
|
134 | |
|
6.4.3 Correlation Between Frame Sizes and Qualities |
|
|
140 | |
|
6.4.4 Comparison Between Wavelet and MPEG-4 Encoded Video |
|
|
141 | |
|
6.5 Video Trace Statistics for MPEG-4 FGS Encoded Video |
|
|
153 | |
|
6.6 Video Trace Statistics for MDC Encoded Video |
|
|
165 | |
Part III Applications for Video Traces |
|
|
7 IP Overhead Considerations for Video Services |
|
|
173 | |
|
7.1 Introduction and Motivation |
|
|
173 | |
|
|
175 | |
|
7.2.1 Real Time Protocol (RTP) and User Datagram Protocol (UDP) |
|
|
175 | |
|
7.2.2 Transmission Control Protocol (TCP) |
|
|
176 | |
|
7.2.3 Internet Protocol (IP) |
|
|
177 | |
|
|
177 | |
|
7.3.1 Session Description Protocol (SDP) |
|
|
178 | |
|
7.3.2 Session Announcement Protocol (SAP) |
|
|
178 | |
|
7.3.3 Session Initiation Protocol (SIP) |
|
|
178 | |
|
7.3.4 Real Time Streaming Protocol (RTSP) |
|
|
179 | |
|
7.3.5 Real Time Control Protocol (RTCP) |
|
|
179 | |
|
7.4 Header Compression Schemes |
|
|
180 | |
|
7.5 Short Example for Overhead Calculation |
|
|
182 | |
|
8 Using Video Traces for Network Simulations |
|
|
183 | |
|
8.1 Generating Traffic from Traces |
|
|
183 | |
|
8.1.1 Stream Level Issues |
|
|
183 | |
|
8.1.2 Frame/Packet Level Issues |
|
|
188 | |
|
8.2 Simulation Output Data Analysis |
|
|
191 | |
|
8.2.1 Performance Metrics in Video Trace Simulations |
|
|
191 | |
|
8.2.2 Estimating Performance Metrics |
|
|
193 | |
|
9 Incorporating Transmission Errors into Simulations Using Video Traces |
|
|
195 | |
|
9.1 Video Encoding and Decoding |
|
|
196 | |
|
9.1.1 Single Layer and Temporal Scalable Encoding |
|
|
196 | |
|
9.1.2 Spatial and SNR Scalable Video |
|
|
198 | |
|
9.2 Video Quality after Network Transport |
|
|
200 | |
|
9.2.1 Single Layer and Temporal Scalable Video |
|
|
203 | |
|
9.2.2 Spatial Scalable Video |
|
|
205 | |
|
|
205 | |
|
9.3 Video °Met, Distortion |
|
|
206 | |
|
9.3.1 Comparison of Rate-Controlled and Non-Rate-Controlled Video Encoding for Single-Layer Video |
|
|
207 | |
|
9.3.2 Comparison of Rate-Controlled and Non-Rate-Controlled Video Encoding for Scalable Video |
|
|
211 | |
|
9.4 Perceptual Considerations for Offset Distortions or Qualities |
|
|
213 | |
|
9.5 Using Video Offset Distortion Traces |
|
|
215 | |
|
9.5.1 Assessing the Video Quality After Network Transport Using Video Traces |
|
|
217 | |
|
|
217 | |
|
9.6 Offset Distortion Influence on Simulation Results |
|
|
218 | |
|
|
219 | |
|
9.6.2 Spatial Scalable Video |
|
|
221 | |
|
9.7 Error-Prone and Lost MDC Descriptors |
|
|
224 | |
|
10 Tools for Working with Video Traces |
|
|
229 | |
|
10.1 Using Video Traces with Network Simulators |
|
|
229 | |
|
|
231 | |
|
|
232 | |
|
|
233 | |
|
10.2 The VideoMeter Tool for Linux |
|
|
235 | |
|
|
237 | |
|
|
239 | |
|
10.3 RMSE and PSNR Calculator |
|
|
240 | |
|
10.4 MPEG-4 Frame Size Parser |
|
|
242 | |
|
10.5 Offset Distortion Calculators |
|
|
243 | |
|
|
243 | |
|
10.5.2 Spatial Scalability |
|
|
245 | |
|
|
247 | |
List of Abbreviations |
|
249 | |
Acknowledgements |
|
253 | |
References |
|
255 | |
Index |
|
267 | |