|
|
x | |
Acknowledgments |
|
xi | |
|
|
1 | (6) |
|
We Are Surrounded by Visual Content |
|
|
1 | (1) |
|
Creative Video for Live Visuals |
|
|
1 | (2) |
|
Live Entertainment Is Forever Changed |
|
|
3 | (1) |
|
Real-Time Video Content Is the Engine that Powers Virtual Production |
|
|
4 | (1) |
|
|
5 | (2) |
|
SECTION 1 EXPLORING REAL-TIME CONTENT |
|
|
7 | (58) |
|
Chapter 2 Defining Real-Time Video Content |
|
|
8 | (6) |
|
Defining the Term "Real-Time" |
|
|
8 | (3) |
|
The Master Variable: Time |
|
|
11 | (2) |
|
Variable Triggers Combined with Variable Results |
|
|
13 | (1) |
|
Chapter 3 Foundations Part 1: The Video Image |
|
|
14 | (4) |
|
How Do Computers Display Images? |
|
|
14 | (1) |
|
What Defines a Computer Image? |
|
|
15 | (1) |
|
Making Real-Time Images: Generative Content |
|
|
16 | (1) |
|
Making Real-Time Images: Software and Game Engines |
|
|
16 | (2) |
|
Chapter 4 Foundations Part 2: Code and Generative Content |
|
|
18 | (9) |
|
|
18 | (1) |
|
|
19 | (1) |
|
|
20 | (1) |
|
|
21 | (1) |
|
Case Study - Blair Neal - Trace Your Road |
|
|
22 | (5) |
|
Chapter 5 Foundations Part 3: Broadcast |
|
|
27 | (12) |
|
|
27 | (3) |
|
|
30 | (1) |
|
|
31 | (1) |
|
|
32 | (1) |
|
|
32 | (2) |
|
Case Study - Bluman Associates - Dave at The BRITS 2020 |
|
|
34 | (1) |
|
The Project and Use of Real-Time |
|
|
34 | (1) |
|
|
35 | (1) |
|
The Tests, Research or Development to Provide the Solutions |
|
|
36 | (2) |
|
The End Goal (Not Modified to Be Successful!) and the Result |
|
|
38 | (1) |
|
Chapter 6 Real-Time Content Generation Applications |
|
|
39 | (11) |
|
|
39 | (1) |
|
|
39 | (1) |
|
|
40 | (1) |
|
Media Server Effects Engines |
|
|
41 | (1) |
|
|
41 | (1) |
|
|
42 | (1) |
|
|
43 | (1) |
|
Case Study - Electronic Countermeasures - The Foo Fighters 26th Anniversary Tour |
|
|
44 | (6) |
|
Chapter 7 A Collision of Technologies |
|
|
50 | (15) |
|
What Are All the Tools We Combine? |
|
|
50 | (1) |
|
Media Control and Management |
|
|
50 | (1) |
|
Projection Mapping and Scenery Tracking |
|
|
51 | (1) |
|
|
52 | (1) |
|
|
52 | (2) |
|
|
54 | (2) |
|
Front Plate and Back Plate |
|
|
56 | (1) |
|
Virtual Production Stage Types |
|
|
56 | (1) |
|
|
56 | (1) |
|
|
57 | (1) |
|
|
57 | (1) |
|
|
57 | (1) |
|
|
58 | (1) |
|
|
58 | (1) |
|
|
58 | (1) |
|
|
58 | (1) |
|
Case Study - Rich & Miyu - AR Livestreamer |
|
|
58 | (1) |
|
A TouchDesigner Based Software Solution for AR Applications |
|
|
58 | (7) |
|
SECTION 2 REAL-TIME CONTENT ENTERTAINMENT APPLICATIONS |
|
|
65 | (60) |
|
Chapter 8 Content Production |
|
|
66 | (8) |
|
|
66 | (1) |
|
|
67 | (1) |
|
|
67 | (1) |
|
Interactive Content Production |
|
|
68 | (1) |
|
Environmental Responsiveness |
|
|
68 | (1) |
|
Camera Perspective Generated Content |
|
|
69 | (1) |
|
Case Study - Fray Studio - Real-Time Update |
|
|
69 | (5) |
|
Chapter 9 Augmented Reality |
|
|
74 | (8) |
|
|
75 | (1) |
|
|
76 | (1) |
|
Human Tracking and Motion Capture |
|
|
76 | (1) |
|
Case Study - ALL of It Now - CoLdpLay x BTS |
|
|
77 | (1) |
|
|
77 | (1) |
|
|
78 | (1) |
|
Creative Pipeline - The Creative Process |
|
|
78 | (1) |
|
On Set Deployment/Challenges |
|
|
78 | (1) |
|
Post-Production Challenges |
|
|
79 | (1) |
|
|
79 | (3) |
|
Chapter 10 Background Replacement |
|
|
82 | (10) |
|
|
82 | (1) |
|
|
83 | (2) |
|
|
85 | (3) |
|
Case Study - Fernando Gonzalez Ortiz - The Lion and The Firebird |
|
|
88 | (1) |
|
The New Frontier in Student Filmmaking with Virtual Production |
|
|
88 | (4) |
|
Chapter 11 Extended Reality and Mixed Reality |
|
|
92 | (14) |
|
Front Plate and Back Plate |
|
|
92 | (2) |
|
|
94 | (1) |
|
|
95 | (2) |
|
|
97 | (1) |
|
|
97 | (1) |
|
LED vs Green Screen, Part 2 |
|
|
98 | (1) |
|
|
98 | (1) |
|
|
99 | (1) |
|
|
99 | (1) |
|
|
99 | (1) |
|
|
100 | (1) |
|
|
100 | (1) |
|
|
101 | (1) |
|
Case Study - Lux Machina - Worlds 2020 |
|
|
102 | (4) |
|
Chapter 12 The Future of Real-Time Content |
|
|
106 | (19) |
|
|
106 | (1) |
|
|
107 | (1) |
|
Case Study - Bild Studios - Al Wasl - The Interactive Experience |
|
|
108 | (1) |
|
How Bild turned Al Wasl Plaza into the world's largest interactive installation for Expo City Dubai |
|
|
108 | (2) |
|
Al Wasl - The Interactive Experience |
|
|
110 | (2) |
|
Phase 1 Technical Feasibility and Creative Exploration |
|
|
112 | (1) |
|
|
112 | (2) |
|
The Need for a Technical and Creative Feasibility Study |
|
|
114 | (1) |
|
Choice of Real-Time Engine |
|
|
114 | (1) |
|
|
115 | (1) |
|
Splitting Up the Real-Time Rendering Power |
|
|
115 | (1) |
|
|
115 | (1) |
|
|
116 | (3) |
|
|
119 | (1) |
|
Phase 3 Creative Development |
|
|
120 | (1) |
|
Phase 4 Onsite Installation |
|
|
120 | (1) |
|
Thoughts by David Bajt, Co-Founder of Bild and Principal Consultant for Al Wasl Expo Projects |
|
|
121 | (1) |
|
Thoughts by Expo City Dubai Executive Creative Director, Amna Abulhoul |
|
|
122 | (3) |
|
SECTION 3 STRATEGIES USING REAL-TIME CONTENT |
|
|
125 | (47) |
|
Chapter 13 Team Leadership and Structure |
|
|
126 | (8) |
|
|
126 | (1) |
|
|
126 | (1) |
|
|
126 | (1) |
|
|
127 | (1) |
|
|
127 | (1) |
|
|
127 | (1) |
|
|
128 | (1) |
|
Scenic Design/Art Department/Virtual Art Department |
|
|
128 | (1) |
|
|
128 | (1) |
|
|
129 | (1) |
|
Clients of the Video Team |
|
|
129 | (1) |
|
|
129 | (1) |
|
|
129 | (1) |
|
Case Study - Visual Noise Creative - MTV VMAs 2021 |
|
|
129 | (5) |
|
Chapter 14 Inter-Department Communication |
|
|
134 | (9) |
|
Crafting Good Collaborative Relationships |
|
|
134 | (3) |
|
Case Study - EVOKE Studios - Siemens Hannover Messe Digital 2021 |
|
|
137 | (1) |
|
Doing Something First, It Can Be Tricky |
|
|
138 | (1) |
|
|
138 | (2) |
|
|
140 | (1) |
|
|
140 | (3) |
|
Chapter 15 Production Planning |
|
|
143 | (10) |
|
|
143 | (1) |
|
|
144 | (1) |
|
|
145 | (1) |
|
|
145 | (1) |
|
|
145 | (1) |
|
Scenic and Storyboard Review |
|
|
145 | (1) |
|
|
146 | (1) |
|
|
146 | (1) |
|
Build and Publish Content Production Workflow |
|
|
146 | (1) |
|
Development and Testing, Review and Reiterate |
|
|
147 | (1) |
|
Case Study - dandelion & burdock - Johnnie Walker Princes Street Interactive World Map |
|
|
147 | (1) |
|
|
147 | (1) |
|
|
147 | (1) |
|
|
148 | (1) |
|
|
148 | (3) |
|
|
151 | (2) |
|
Chapter 16 Obstacles to Success |
|
|
153 | (8) |
|
|
153 | (1) |
|
|
154 | (1) |
|
Digital Is Perceived as Easy |
|
|
154 | (1) |
|
Real-Time Can Be Time Consuming |
|
|
155 | (1) |
|
|
155 | (1) |
|
Case Study - Savages - Practice Makes Process |
|
|
156 | (1) |
|
A Case for Intentional Practice |
|
|
156 | (5) |
|
Chapter 17 Creative First |
|
|
161 | (11) |
|
When Technology Leads Design Discussion |
|
|
161 | (1) |
|
What Is the Creative Goal? |
|
|
162 | (1) |
|
Technology Serves Creative Intent |
|
|
163 | (1) |
|
Matt Swoboda - Founder - Notch |
|
|
163 | (1) |
|
Ashraf Nehru - Founder - Disguise |
|
|
163 | (1) |
|
Greg Hermanovic - Founder and President - Derivative |
|
|
164 | (1) |
|
Francis Maes - Founder - SMODE Tech |
|
|
165 | (1) |
|
Emric and Martin - Co-Founders - VYV |
|
|
165 | (1) |
|
Case Study - Luke Halls Studio - Forest of Us |
|
|
166 | (6) |
|
|
|
Appendix A Real-Time Content Production Tools and Capabilities |
|
|
172 | (1) |
|
Appendix B VFX Map for Real-Time Content |
|
|
173 | (1) |
|
|
174 | (7) |
Index |
|
181 | |