| List of Figures |
|
xii | |
| List of Tables |
|
xiv | |
| Preface |
|
xv | |
| Acknowledgments |
|
xvi | |
| Part I What Do We Already Know? |
|
1 | (44) |
|
|
|
3 | (13) |
|
1.1 Intelligent Music Production - An Emerging Field |
|
|
3 | (1) |
|
|
|
4 | (1) |
|
|
|
4 | (1) |
|
|
|
5 | (1) |
|
|
|
5 | (1) |
|
1.3 Motivation and Justification |
|
|
5 | (3) |
|
1.3.1 Camera Comparison and the 'Instamix' |
|
|
7 | (1) |
|
|
|
7 | (1) |
|
1.3.3 Aims and Objectives |
|
|
7 | (1) |
|
|
|
8 | (5) |
|
1.4.1 Early Automation in Audio Effects |
|
|
8 | (1) |
|
1.4.2 Automatic Microphone Mixing |
|
|
9 | (2) |
|
1.4.3 Steps Towards Intelligent Systems |
|
|
11 | (1) |
|
1.4.4 The Automatic Mixing Revolution |
|
|
11 | (2) |
|
1.5 Applications and Impact |
|
|
13 | (3) |
|
1.5.1 Intelligent Assistants |
|
|
13 | (1) |
|
|
|
14 | (1) |
|
|
|
14 | (1) |
|
1.5.4 Metering and Diagnostics |
|
|
15 | (1) |
|
|
|
15 | (1) |
|
2 Understanding Audio Effects |
|
|
16 | (19) |
|
2.1 Fundamental Properties |
|
|
16 | (2) |
|
2.2 Audio Effect Classification |
|
|
18 | (6) |
|
2.2.1 Classification by Perception |
|
|
18 | (2) |
|
2.2.2 Classification by Technique |
|
|
20 | (1) |
|
2.2.3 Classification by Control |
|
|
20 | (4) |
|
2.3 Traditional Audio Effects |
|
|
24 | (11) |
|
|
|
24 | (1) |
|
|
|
24 | (1) |
|
|
|
25 | (2) |
|
|
|
27 | (1) |
|
2.3.5 Expanders and Noise Gates |
|
|
28 | (1) |
|
|
|
29 | (3) |
|
|
|
32 | (1) |
|
|
|
33 | (2) |
|
|
|
35 | (10) |
|
3.1 Fundamentals and Concepts |
|
|
35 | (4) |
|
|
|
35 | (2) |
|
3.1.2 The Role of the Mix Engineer |
|
|
37 | (1) |
|
3.1.3 The Mixing Workflow |
|
|
37 | (1) |
|
|
|
38 | (1) |
|
|
|
39 | (1) |
|
|
|
39 | (3) |
|
3.2.1 Live Versus Pre-recorded |
|
|
40 | (1) |
|
|
|
41 | (1) |
|
3.2.3 Static Versus Time Varying Mix |
|
|
41 | (1) |
|
|
|
42 | (5) |
|
|
|
42 | (1) |
|
3.3.2 Effect of Experience |
|
|
42 | (1) |
|
|
|
42 | (1) |
|
3.3.4 Approaches and Subjectivity |
|
|
43 | (2) |
| Part II How Do We Construct Intelligent Structures? |
|
45 | (50) |
|
|
|
47 | (16) |
|
4.1 Intelligent and Adaptive Digital Audio Effects |
|
|
47 | (1) |
|
4.2 Building Blocks of Intelligent Audio Effects |
|
|
48 | (3) |
|
|
|
48 | (1) |
|
4.2.2 Feature Extraction with Noise |
|
|
49 | (1) |
|
4.2.3 Side-chain Processing |
|
|
50 | (1) |
|
4.3 Cross-adaptive Processing |
|
|
51 | (1) |
|
|
|
52 | (1) |
|
4.5 Automatic Mixing Systems |
|
|
53 | (1) |
|
4.6 Building Blocks of Automatic Mixing Tools |
|
|
54 | (3) |
|
4.6.1 Reference Signals and Adaptive Thresholds |
|
|
56 | (1) |
|
|
|
57 | (1) |
|
|
|
57 | (1) |
|
|
|
57 | (5) |
|
4.7.1 Automated, Automatic, Autonomous |
|
|
57 | (1) |
|
4.7.2 Incorporating Best Practices into Constrained Control Rules |
|
|
58 | (4) |
|
|
|
62 | (1) |
|
5 Data Collection and Representation |
|
|
63 | (20) |
|
|
|
64 | (8) |
|
|
|
64 | (2) |
|
5.1.2 Open Multitrack Testbed |
|
|
66 | (2) |
|
5.1.3 Audio Processing Data |
|
|
68 | (2) |
|
5.1.4 Other Notable Datasets |
|
|
70 | (2) |
|
5.2 Data Collection Methods |
|
|
72 | (4) |
|
|
|
72 | (1) |
|
|
|
73 | (3) |
|
|
|
76 | (7) |
|
|
|
76 | (3) |
|
5.3.2 Ontologies and Knowledge Representation |
|
|
79 | (2) |
|
|
|
81 | (2) |
|
6 Perceptual Evaluation in Music Production |
|
|
83 | (12) |
|
|
|
84 | (1) |
|
6.2 Subject Selection and Surveys |
|
|
84 | (1) |
|
6.3 Stimulus Presentation |
|
|
85 | (3) |
|
6.3.1 Pairwise or Multiple Stimuli |
|
|
85 | (1) |
|
6.3.2 To MUSHRA or not to MUSHRA |
|
|
85 | (2) |
|
6.3.3 Free Switching and Time-aligned Stimuli |
|
|
87 | (1) |
|
|
|
88 | (2) |
|
6.4.1 Discrete and Continuous Rating and Ranking |
|
|
88 | (1) |
|
|
|
89 | (1) |
|
|
|
89 | (1) |
|
6.4.4 Method of Adjustment Tests |
|
|
90 | (1) |
|
|
|
90 | (2) |
|
6.5.1 Headphones or Speakers |
|
|
90 | (1) |
|
6.5.2 Listening Environment |
|
|
90 | (1) |
|
|
|
91 | (1) |
|
6.5.4 Visual Distractions |
|
|
91 | (1) |
|
|
|
91 | (1) |
|
6.6 Perceptual Evaluation of Mixing Systems |
|
|
92 | (3) |
| Part III How Do We Perform Intelligent Music Production? |
|
95 | (78) |
|
|
|
97 | (18) |
|
|
|
97 | (3) |
|
7.1.1 Balance Assumptions |
|
|
97 | (2) |
|
7.1.2 Intelligent Multitrack Faders |
|
|
99 | (1) |
|
|
|
100 | (1) |
|
7.2.1 Panning Assumptions |
|
|
100 | (1) |
|
7.2.2 Intelligent Multitrack Panning |
|
|
101 | (1) |
|
|
|
101 | (3) |
|
|
|
101 | (1) |
|
7.3.2 Intelligent Single Track Equalizers |
|
|
102 | (1) |
|
7.3.3 Intelligent Multitrack Equalizers |
|
|
103 | (1) |
|
7.4 Dynamic Range Compression |
|
|
104 | (3) |
|
7.4.1 Dynamic Range Compression Assumptions |
|
|
104 | (1) |
|
7.4.2 Intelligent Single Track Compressors |
|
|
105 | (1) |
|
7.4.3 Intelligent Multitrack Compressors |
|
|
106 | (1) |
|
|
|
107 | (2) |
|
|
|
107 | (1) |
|
7.5.2 Intelligent Single Track Reverb |
|
|
108 | (1) |
|
|
|
109 | (5) |
|
7.6.1 Distortion Amount Automation |
|
|
109 | (3) |
|
7.6.2 Subjective Evaluation |
|
|
112 | (1) |
|
7.6.3 Adaptive Anti-aliasing |
|
|
113 | (1) |
|
|
|
113 | (1) |
|
7.7 Instrument-specific Processing and Multi-effect Systems |
|
|
114 | (1) |
|
|
|
115 | (18) |
|
8.1 Fundamentals and Concepts |
|
|
115 | (1) |
|
|
|
116 | (7) |
|
8.2.1 Automatic Take Selection |
|
|
116 | (1) |
|
8.2.2 Structural Segmentation |
|
|
116 | (1) |
|
|
|
116 | (2) |
|
8.2.4 Polarity Correction |
|
|
118 | (1) |
|
|
|
118 | (2) |
|
|
|
120 | (2) |
|
8.2.7 Microphone Artifacts |
|
|
122 | (1) |
|
|
|
123 | (2) |
|
|
|
123 | (1) |
|
8.3.2 Multitrack Sequences |
|
|
124 | (1) |
|
|
|
125 | (4) |
|
|
|
125 | (3) |
|
8.4.2 Processing Chain Recommendation |
|
|
128 | (1) |
|
|
|
129 | (1) |
|
8.5 Live Sound Reinforcement |
|
|
129 | (1) |
|
8.5.1 Feedback Prevention |
|
|
129 | (1) |
|
|
|
130 | (1) |
|
8.6 Reverse Audio Engineering |
|
|
130 | (3) |
|
|
|
133 | (33) |
|
9.1 Fundamentals and Concepts |
|
|
134 | (5) |
|
|
|
134 | (1) |
|
|
|
135 | (1) |
|
|
|
135 | (2) |
|
9.1.4 Dimensionality Reduction |
|
|
137 | (2) |
|
|
|
139 | (14) |
|
9.2.1 Beyond the Channel Strip |
|
|
139 | (6) |
|
9.2.2 Digital Audio Effects |
|
|
145 | (1) |
|
|
|
146 | (2) |
|
|
|
148 | (4) |
|
9.2.5 Haptics and Auditory Displays |
|
|
152 | (1) |
|
|
|
153 | (13) |
|
9.3.1 A Shared Vocabulary |
|
|
153 | (3) |
|
9.3.2 Term Categorization |
|
|
156 | (2) |
|
|
|
158 | (2) |
|
9.3.4 Similarity Measures |
|
|
160 | (4) |
|
9.3.5 Semantic Audio Processing |
|
|
164 | (2) |
|
|
|
166 | (7) |
|
|
|
166 | (1) |
|
10.2 What We Have Covered |
|
|
167 | (1) |
|
|
|
168 | (3) |
|
|
|
168 | (1) |
|
10.3.2 Multitrack Audio Effects |
|
|
169 | (1) |
|
10.3.3 Mixing for Hearing Loss |
|
|
169 | (1) |
|
|
|
170 | (1) |
|
|
|
171 | (1) |
|
|
|
171 | (2) |
| Appendix A Additional Resources |
|
173 | (8) |
|
Intelligent Sound Engineering Blog |
|
|
173 | (1) |
|
Intelligent Sound Engineering YouTube Channel |
|
|
173 | (1) |
|
|
|
174 | (1) |
|
Web Audio Evaluation Tool |
|
|
174 | (1) |
|
|
|
174 | (1) |
|
|
|
174 | (1) |
|
|
|
174 | (7) |
| Bibliography |
|
181 | (18) |
| Index |
|
199 | |