|
|
|
1 | (28) |
|
|
|
1 | (3) |
|
|
|
1 | (1) |
|
EAGLES organisational structure |
|
|
2 | (1) |
|
|
|
3 | (1) |
|
Spoken Language systems, standards and resources |
|
|
4 | (5) |
|
|
|
4 | (1) |
|
Standards and resources for Spoken Language systems |
|
|
5 | (4) |
|
The EAGLES Spoken Language Working Group (WG5) |
|
|
9 | (5) |
|
Subgroups of the EAGLES Spoken Language Working Group |
|
|
11 | (1) |
|
Relationships with the other EAGLES Working Groups |
|
|
11 | (1) |
|
|
|
11 | (2) |
|
Production of the handbook |
|
|
13 | (1) |
|
Consultation with the R&D Community |
|
|
13 | (1) |
|
|
|
14 | (11) |
|
|
|
14 | (1) |
|
|
|
15 | (6) |
|
The main chapters of the handbook |
|
|
21 | (4) |
|
The current state of play |
|
|
25 | (1) |
|
|
|
25 | (2) |
|
Revision and completion of existing documentation |
|
|
25 | (1) |
|
Extended survey of existing practice |
|
|
25 | (1) |
|
Extension of language base |
|
|
26 | (1) |
|
|
|
26 | (1) |
|
Move to prescriptive recommendations |
|
|
26 | (1) |
|
Publication and dissemination |
|
|
26 | (1) |
|
Coordination with other bodies |
|
|
26 | (1) |
|
|
|
27 | (1) |
|
|
|
28 | (1) |
| Part III: Spoken language system assessment |
|
29 | (274) |
|
Assessment methodologies and experimental design |
|
|
30 | (37) |
|
|
|
30 | (3) |
|
|
|
30 | (2) |
|
Role of statistical analysis and experimentation in Language Engineering Standards (LES) |
|
|
32 | (1) |
|
Statistical and experimental procedures for analysing data corpora |
|
|
33 | (13) |
|
|
|
33 | (1) |
|
Populations, samples and other terminology |
|
|
33 | (1) |
|
|
|
34 | (1) |
|
|
|
34 | (1) |
|
Estimating sample means, proportions and variances |
|
|
35 | (5) |
|
|
|
40 | (6) |
|
|
|
46 | (6) |
|
Experimental selection of material |
|
|
46 | (3) |
|
|
|
49 | (2) |
|
|
|
51 | (1) |
|
|
|
52 | (7) |
|
|
|
52 | (1) |
|
|
|
53 | (3) |
|
Functional adequacy and user acceptance |
|
|
56 | (2) |
|
|
|
58 | (1) |
|
|
|
59 | (1) |
|
Assessing speaker verification and recognition systems |
|
|
59 | (2) |
|
Sampling rare events in speaker verification and recognition systems |
|
|
60 | (1) |
|
Employing expert judgments to augment speaker verification and assessment for forensic aspects of speaker verification and recognition |
|
|
60 | (1) |
|
Interactive dialogue systems |
|
|
61 | (6) |
|
|
|
61 | (3) |
|
|
|
64 | (3) |
|
Assessment of recognition systems |
|
|
67 | (27) |
|
|
|
67 | (4) |
|
Classification of recognition systems |
|
|
67 | (2) |
|
Speech quality and conditions |
|
|
69 | (1) |
|
Capability profile versus requirement profile |
|
|
70 | (1) |
|
Assessment purpose versus methodology |
|
|
71 | (1) |
|
Definitions and nomenclature |
|
|
71 | (4) |
|
The performance measure as percentage |
|
|
71 | (1) |
|
|
|
72 | (2) |
|
|
|
74 | (1) |
|
|
|
74 | (1) |
|
Analysis of Variance design |
|
|
75 | (1) |
|
Description of methodologies |
|
|
75 | (3) |
|
|
|
75 | (1) |
|
|
|
76 | (1) |
|
Specific calibrated databases |
|
|
77 | (1) |
|
Diagnostic methods with a specific vocabulary |
|
|
77 | (1) |
|
|
|
78 | (1) |
|
|
|
78 | (4) |
|
Pre-production parameters |
|
|
78 | (1) |
|
Post-production parameters |
|
|
79 | (1) |
|
|
|
79 | (1) |
|
Recogniser specific parameters |
|
|
79 | (1) |
|
|
|
80 | (2) |
|
Experimental design of small vocabulary word recognition |
|
|
82 | (5) |
|
|
|
82 | (2) |
|
|
|
84 | (1) |
|
|
|
84 | (3) |
|
|
|
87 | (1) |
|
|
|
87 | (1) |
|
Experimental design of large vocabulary continuous speech recognition |
|
|
87 | (7) |
|
|
|
88 | (2) |
|
|
|
90 | (1) |
|
|
|
91 | (1) |
|
|
|
91 | (1) |
|
|
|
92 | (1) |
|
|
|
93 | (1) |
|
Assessment of speaker verification systems |
|
|
94 | (73) |
|
|
|
94 | (2) |
|
Speaker classification tasks |
|
|
94 | (1) |
|
|
|
95 | (1) |
|
A taxonomy of speaker recognition systems |
|
|
96 | (8) |
|
|
|
96 | (2) |
|
Levels of text dependence |
|
|
98 | (1) |
|
Interaction mode with the user |
|
|
98 | (1) |
|
|
|
99 | (2) |
|
|
|
101 | (3) |
|
|
|
104 | (10) |
|
|
|
104 | (1) |
|
|
|
105 | (1) |
|
Speech quantity and variety |
|
|
105 | (1) |
|
Speaker population size and typology |
|
|
106 | (1) |
|
Speaker purpose and other human factors |
|
|
107 | (2) |
|
|
|
109 | (3) |
|
|
|
112 | (2) |
|
|
|
114 | (33) |
|
|
|
114 | (3) |
|
Closed-set identification |
|
|
117 | (5) |
|
|
|
122 | (22) |
|
|
|
144 | (1) |
|
|
|
145 | (2) |
|
Comparative and indirect assessment |
|
|
147 | (3) |
|
|
|
147 | (2) |
|
|
|
149 | (1) |
|
Transformation of speech databases |
|
|
150 | (1) |
|
Applications, systems and products |
|
|
150 | (9) |
|
|
|
151 | (1) |
|
|
|
152 | (3) |
|
Examples of speaker verification systems |
|
|
155 | (1) |
|
Examples of speaker verification products |
|
|
156 | (1) |
|
|
|
157 | (2) |
|
|
|
159 | (1) |
|
System and product assessment |
|
|
159 | (4) |
|
|
|
160 | (1) |
|
|
|
161 | (1) |
|
|
|
162 | (1) |
|
|
|
163 | (3) |
|
|
|
163 | (1) |
|
|
|
164 | (1) |
|
|
|
165 | (1) |
|
|
|
165 | (1) |
|
|
|
166 | (1) |
|
Assessment of synthesis systems |
|
|
167 | (83) |
|
|
|
167 | (4) |
|
What are speech output systems? |
|
|
167 | (1) |
|
Why speech output assessment? |
|
|
168 | (1) |
|
|
|
169 | (2) |
|
Towards a taxonomy of assessment tasks and techniques |
|
|
171 | (5) |
|
|
|
171 | (2) |
|
|
|
173 | (1) |
|
|
|
174 | (1) |
|
|
|
174 | (1) |
|
Judgment vs. functional testing |
|
|
175 | (1) |
|
Global vs. analytic assessment |
|
|
176 | (1) |
|
|
|
176 | (12) |
|
|
|
177 | (3) |
|
|
|
180 | (3) |
|
|
|
183 | (1) |
|
|
|
183 | (4) |
|
Comparability across languages |
|
|
187 | (1) |
|
|
|
188 | (9) |
|
|
|
188 | (6) |
|
|
|
194 | (3) |
|
|
|
197 | (29) |
|
|
|
197 | (7) |
|
|
|
204 | (22) |
|
Further developments in speech output testing |
|
|
226 | (10) |
|
|
|
226 | (1) |
|
Long-term strategy: Towards predictive tests |
|
|
227 | (3) |
|
Linguistic testing: Creating test environments for linguistic interfaces |
|
|
230 | (2) |
|
Acoustic testing: Developments for the near future |
|
|
232 | (4) |
|
Conclusion: summary of test descriptions |
|
|
236 | (14) |
|
SAM Standard Segmental Test |
|
|
237 | (1) |
|
CLuster IDentification Test (CLID) |
|
|
238 | (1) |
|
|
|
239 | (1) |
|
Diagnostic Rhyme Test (DRT) |
|
|
240 | (1) |
|
Modified Rhyme Test (MRT) |
|
|
241 | (1) |
|
Haskins Syntactic Sentences |
|
|
242 | (1) |
|
SAM Semantically Unpredictable Sentences (SUS) |
|
|
243 | (1) |
|
Harvard Psychoacoustic Sentences |
|
|
244 | (1) |
|
|
|
245 | (1) |
|
SAM Prosodic Function Test |
|
|
246 | (1) |
|
|
|
247 | (1) |
|
ITU-T Overall Quality Test |
|
|
248 | (2) |
|
Assessment of interactive systems |
|
|
250 | (53) |
|
|
|
250 | (3) |
|
|
|
250 | (1) |
|
|
|
251 | (2) |
|
Interactive dialogue systems |
|
|
253 | (4) |
|
|
|
253 | (4) |
|
|
|
257 | (23) |
|
|
|
259 | (5) |
|
|
|
264 | (3) |
|
|
|
267 | (10) |
|
Iterative design methodology for spoken language dialogue systems |
|
|
277 | (3) |
|
Readings in interactive dialogue system specification |
|
|
280 | (1) |
|
|
|
280 | (23) |
|
|
|
281 | (2) |
|
|
|
283 | (4) |
|
|
|
287 | (12) |
|
Recommendations on evaluation methodology |
|
|
299 | (1) |
|
Readings in interactive dialogue system evaluation |
|
|
300 | (3) |
| Bibliographical references |
|
303 | (18) |
| Glossary |
|
321 | (14) |
| List of abbreviations |
|
335 | (6) |
| Index |
|
341 | |