Preface |
|
vii | |
|
|
1 | |
|
|
1 | |
|
|
2 | |
|
|
3 | |
|
1.4 Plots, trends, and seasonal variation |
|
|
4 | |
|
1.4.1 A flying start: Air passenger bookings |
|
|
4 | |
|
1.4.2 Unemployment: Maine |
|
|
7 | |
|
1.4.3 Multiple time series: Electricity, beer and chocolate data |
|
|
10 | |
|
1.4.4 Quarterly exchange rate: GBP to NZ dollar |
|
|
14 | |
|
1.4.5 Global temperature series |
|
|
16 | |
|
1.5 Decomposition of series |
|
|
19 | |
|
|
19 | |
|
|
19 | |
|
1.5.3 Estimating trends and seasonal effects |
|
|
20 | |
|
|
21 | |
|
|
22 | |
|
1.6 Summary of commands used in examples |
|
|
24 | |
|
|
24 | |
|
|
27 | |
|
|
27 | |
|
2.2 Expectation and the ensemble |
|
|
27 | |
|
|
27 | |
|
2.2.2 The ensemble and stationarity |
|
|
30 | |
|
|
31 | |
|
|
32 | |
|
|
33 | |
|
|
35 | |
|
|
35 | |
|
2.3.2 Example based on air passenger series |
|
|
37 | |
|
2.3.3 Example based on the Font Reservoir series |
|
|
40 | |
|
2.4 Covariance of sums of random variables |
|
|
41 | |
|
2.5 Summary of commands used in examples |
|
|
42 | |
|
|
42 | |
|
|
45 | |
|
|
45 | |
|
3.2 Leading variables and associated variables |
|
|
45 | |
|
|
45 | |
|
3.2.2 Building approvals publication |
|
|
46 | |
|
|
49 | |
|
|
51 | |
|
|
51 | |
|
|
51 | |
|
3.3.3 Interpretation of the Bass model* |
|
|
51 | |
|
|
52 | |
|
3.4 Exponential smoothing and the Holt-Winters method |
|
|
55 | |
|
3.4.1 Exponential smoothing |
|
|
55 | |
|
3.4.2 Holt-Winters method |
|
|
59 | |
|
3.4.3 Four-year-ahead forecasts for the air passenger data |
|
|
62 | |
|
3.5 Summary of commands used in examples |
|
|
64 | |
|
|
64 | |
|
4 Basic Stochastic Models |
|
|
67 | |
|
|
67 | |
|
|
68 | |
|
|
68 | |
|
|
68 | |
|
|
68 | |
|
4.2.4 Second-order properties and the correlogram |
|
|
69 | |
|
4.2.5 Fitting a white noise model |
|
|
70 | |
|
|
71 | |
|
|
71 | |
|
|
71 | |
|
4.3.3 The backward shift operator |
|
|
71 | |
|
4.3.4 Random walk: Second-order properties |
|
|
72 | |
|
4.3.5 Derivation of second-order properties* |
|
|
72 | |
|
4.3.6 The difference operator |
|
|
72 | |
|
|
73 | |
|
4.4 Fitted models and diagnostic plots |
|
|
74 | |
|
4.4.1 Simulated random walk series |
|
|
74 | |
|
4.4.2 Exchange rate series |
|
|
75 | |
|
4.4.3 Random walk with drift |
|
|
77 | |
|
4.5 Autoregressive models |
|
|
79 | |
|
|
79 | |
|
4.5.2 Stationary and non-stationary AR processes |
|
|
79 | |
|
4.5.3 Second-order properties of an AR(1) model |
|
|
80 | |
|
4.5.4 Derivation of second-order properties for an AR(1) process* |
|
|
80 | |
|
4.5.5 Correlogram of an AR(1) process |
|
|
81 | |
|
4.5.6 Partial autocorrelation |
|
|
81 | |
|
|
81 | |
|
|
82 | |
|
4.6.1 Model fitted to simulated series |
|
|
82 | |
|
4.6.2 Exchange rate series: Fitted AR model |
|
|
84 | |
|
4.6.3 Global temperature series: Fitted AR model |
|
|
85 | |
|
4.7 Summary of R commands |
|
|
87 | |
|
|
87 | |
|
|
91 | |
|
|
91 | |
|
|
92 | |
|
|
92 | |
|
|
93 | |
|
|
93 | |
|
|
94 | |
|
5.3.1 Model fitted to simulated data |
|
|
94 | |
|
5.3.2 Model fitted to the temperature series (1970-2005) |
|
|
95 | |
|
5.3.3 Autocorrelation and the estimation of sample statistics* |
|
|
96 | |
|
5.4 Generalised least squares |
|
|
98 | |
|
5.4.1 GLS fit to simulated series |
|
|
98 | |
|
5.4.2 Confidence interval for the trend in the temperature series |
|
|
99 | |
|
5.5 Linear models with seasonal variables |
|
|
99 | |
|
|
99 | |
|
5.5.2 Additive seasonal indicator variables |
|
|
99 | |
|
5.5.3 Example: Seasonal model for the temperature series |
|
|
100 | |
|
5.6 Harmonic seasonal models |
|
|
101 | |
|
|
102 | |
|
5.6.2 Fit to simulated series |
|
|
103 | |
|
5.6.3 Harmonic model fitted to temperature series (1970-2005) |
|
|
105 | |
|
5.7 Logarithmic transformations |
|
|
109 | |
|
|
109 | |
|
5.7.2 Example using the air passenger series |
|
|
109 | |
|
|
113 | |
|
|
113 | |
|
5.8.2 Example of a simulated and fitted non-linear series |
|
|
113 | |
|
5.9 Forecasting from regression |
|
|
115 | |
|
|
115 | |
|
|
115 | |
|
5.10 Inverse transform and bias correction |
|
|
115 | |
|
5.10.1 Log-normal residual errors |
|
|
115 | |
|
5.10.2 Empirical correction factor for forecasting means |
|
|
117 | |
|
5.10.3 Example using the air passenger data |
|
|
117 | |
|
5.11 Summary of R commands |
|
|
118 | |
|
|
118 | |
|
|
121 | |
|
|
121 | |
|
6.2 Strictly stationary series |
|
|
121 | |
|
6.3 Moving average models |
|
|
122 | |
|
6.3.1 MA (q) process: Definition and properties |
|
|
122 | |
|
6.3.2 R examples: Correlogram and simulation |
|
|
123 | |
|
|
124 | |
|
6.4.1 Model fitted to simulated series |
|
|
124 | |
|
6.4.2 Exchange rate series: Fitted MA model |
|
|
126 | |
|
6.5 Mixed models: The ARMA process |
|
|
127 | |
|
|
127 | |
|
6.5.2 Derivation of second-order properties* |
|
|
128 | |
|
6.6 ARMA models: Empirical analysis |
|
|
129 | |
|
6.6.1 Simulation and fitting |
|
|
129 | |
|
6.6.2 Exchange rate series |
|
|
129 | |
|
6.6.3 Electricity production series |
|
|
130 | |
|
|
133 | |
|
6.7 Summary of R commands |
|
|
135 | |
|
|
135 | |
|
|
137 | |
|
|
137 | |
|
7.2 Non-seasonal ARIMA models |
|
|
137 | |
|
7.2.1 Differencing and the electricity series |
|
|
137 | |
|
|
138 | |
|
7.2.3 Definition and examples |
|
|
139 | |
|
7.2.4 Simulation and fitting |
|
|
140 | |
|
7.2.5 IMA(1, 1) model fitted to the beer production series |
|
|
141 | |
|
7.3 Seasonal ARIMA models |
|
|
142 | |
|
|
142 | |
|
|
143 | |
|
|
145 | |
|
|
145 | |
|
7.4.2 Modelling volatility: Definition of the ARCH model |
|
|
147 | |
|
7.4.3 Extensions and GARCH models - |
|
|
148 | |
|
7.4.4 Simulation and fitted GARCH model |
|
|
149 | |
|
7.4.5 Fit to S&P500 series |
|
|
150 | |
|
7.4.6 Volatility in climate series |
|
|
152 | |
|
7.4.7 GARCH in forecasts and simulations |
|
|
155 | |
|
7.5 Summary of R commands |
|
|
155 | |
|
|
155 | |
|
|
159 | |
|
|
159 | |
|
8.2 Fractional differencing |
|
|
159 | |
|
8.3 Fitting to simulated data |
|
|
161 | |
|
8.4 Assessing evidence of long-term dependence |
|
|
164 | |
|
|
164 | |
|
8.4.2 Bellcore Ethernet data |
|
|
165 | |
|
|
166 | |
|
|
167 | |
|
8.6 Summary of additional commands used |
|
|
168 | |
|
|
168 | |
|
|
171 | |
|
|
171 | |
|
|
171 | |
|
|
171 | |
|
9.2.2 Unit of measurement of frequency |
|
|
172 | |
|
|
173 | |
|
|
173 | |
|
|
175 | |
|
9.4 Spectra of simulated series |
|
|
175 | |
|
|
175 | |
|
9.4.2 AR(1): Positive coefficient |
|
|
177 | |
|
9.4.3 AR(1): Negative coefficient |
|
|
178 | |
|
|
178 | |
|
9.5 Sampling interval and record length |
|
|
179 | |
|
|
181 | |
|
|
181 | |
|
|
183 | |
|
|
183 | |
|
9.6.2 Fault detection on electric motors |
|
|
183 | |
|
9.6.3 Measurement of vibration dose |
|
|
184 | |
|
|
187 | |
|
|
189 | |
|
9.7 Discrete Fourier transform (DFT)* |
|
|
190 | |
|
9.8 The spectrum of a random process* |
|
|
192 | |
|
9.8.1 Discrete white noise |
|
|
193 | |
|
|
193 | |
|
9.8.3 Derivation of spectrum |
|
|
193 | |
|
9.9 Autoregressive spectrum estimation |
|
|
194 | |
|
|
194 | |
|
|
194 | |
|
9.10.2 Confidence intervals |
|
|
195 | |
|
|
196 | |
|
|
196 | |
|
|
197 | |
|
9.10.6 Spectral analysis compared with wavelets |
|
|
197 | |
|
9.11 Summary of additional commands used |
|
|
197 | |
|
|
198 | |
10 System Identification |
|
201 | |
|
|
201 | |
|
10.2 Identifying the gain of a linear system |
|
|
201 | |
|
|
201 | |
|
10.2.2 Natural frequencies |
|
|
202 | |
|
10.2.3 Estimator of the gain function |
|
|
202 | |
|
10.3 Spectrum of an AR(p) process |
|
|
203 | |
|
10.4 Simulated single mode of vibration system |
|
|
203 | |
|
|
205 | |
|
|
207 | |
|
|
208 | |
11 Multivariate Models |
|
211 | |
|
|
211 | |
|
|
211 | |
|
11.3 Tests for unit roots |
|
|
214 | |
|
|
216 | |
|
|
216 | |
|
11.4.2 Exchange rate series |
|
|
218 | |
|
11.5 Bivariate and multivariate white noise |
|
|
219 | |
|
11.6 Vector autoregressive models |
|
|
220 | |
|
11.6.1 VAR model fitted to US economic series |
|
|
222 | |
|
11.7 Summary of R commands |
|
|
227 | |
|
|
227 | |
12 State Space Models |
|
229 | |
|
|
229 | |
|
12.2 Linear state space models |
|
|
230 | |
|
12.2.1 Dynamic linear model |
|
|
230 | |
|
|
231 | |
|
|
232 | |
|
|
233 | |
|
12.3 Fitting to simulated univariate time series |
|
|
234 | |
|
12.3.1 Random walk plus noise model |
|
|
234 | |
|
12.3.2 Regression model with time-varying coefficients |
|
|
236 | |
|
12.4 Fitting to univariate time series |
|
|
238 | |
|
12.5 Bivariate time series – river salinity |
|
|
239 | |
|
12.6 Estimating the variance matrices |
|
|
242 | |
|
|
243 | |
|
12.8 Summary of additional commands used |
|
|
244 | |
|
|
244 | |
References |
|
247 | |
Index |
|
249 | |