The book introduces a framework for examining the validity of tests that aim to assess second-language (L2) proficiency development over time and/or in relation to L2 instruction. It also reports the findings of a longitudinal study that aimed to examine the sensitivity to change of a test of L2 proficiency development. Specifically, the study examined changes over time in Progress scores and the linguistic characteristics of essays written in response to Progress by learners who took the test before, during and after a period of L2 instruction in different countries. The book furthers our understanding of the nature of L2 proficiency as it develops over time and in relation to L2 instruction and provides a framework that can be used in future endeavours to design and validate tests of L2 proficiency development. The book is intended for graduate students, test developers, and researchers doing research in applied linguistics and L2 assessment.
|
|
13 | (2) |
|
|
15 | (2) |
|
|
17 | (4) |
|
Chapter 2 Evaluating Tests of Second Language Development |
|
|
21 | (32) |
|
2.1 Approaches to Assessing Second Language Development |
|
|
23 | (4) |
|
2.2 Evaluating and Validating Tests of L2 Development |
|
|
27 | (11) |
|
|
28 | (1) |
|
|
28 | (9) |
|
|
37 | (1) |
|
2.3 Previous Research on Changes in L2 Test Scores Over Time |
|
|
38 | (3) |
|
2.4 Explaining Changes in L2 Test Performance Over Time |
|
|
41 | (7) |
|
2.5 Methods for Examining Changes in L2 Test Performance Over Time |
|
|
48 | (5) |
|
Chapter 3 The Pearson Progress Test |
|
|
53 | (10) |
|
Chapter 4 Research Questions and Method |
|
|
63 | (20) |
|
4.1 Dataset and Variables |
|
|
64 | (2) |
|
|
66 | (17) |
|
|
67 | (1) |
|
4.2.1.1 Grammatical Aspects |
|
|
68 | (6) |
|
4.2.1.2 Discourse Aspects |
|
|
74 | (2) |
|
4.2.1.3 Sociolinguistics Aspects |
|
|
76 | (1) |
|
4.2.1.4 Strategic Aspects |
|
|
77 | (1) |
|
4.2.2 Statistical Analyses |
|
|
78 | (5) |
|
Chapter 5 Changes in Progress Scores |
|
|
83 | (20) |
|
5.1 Changes in Progress Overall Scores |
|
|
83 | (12) |
|
5.2 Changes in Progress Skills Scores |
|
|
95 | (6) |
|
5.3 Changes in Progress Essay Scores |
|
|
101 | (2) |
|
Chapter 6 Changes in Grammatical Aspects |
|
|
103 | (26) |
|
|
103 | (3) |
|
|
106 | (2) |
|
|
108 | (6) |
|
|
114 | (15) |
|
Chapter 7 Changes in Discourse, Sociolinguistic and Strategic Aspects |
|
|
129 | (24) |
|
7.1 Changes in Discourse Aspects |
|
|
129 | (6) |
|
7.2 Changes in Sociolinguistics Aspects |
|
|
135 | (5) |
|
7.3 Changes in Strategic Aspects |
|
|
140 | (5) |
|
7.4 Relationship between Linguistic Indices and Essay Scores |
|
|
145 | (8) |
|
Chapter 8 Discussion and Implications |
|
|
153 | (10) |
|
8.1 Summary and Discussion of Findings |
|
|
153 | (6) |
|
8.1.1 Change in Progress Overall, Skills and Essay Scores |
|
|
153 | (1) |
|
8.1.2 Change in Progress Essay Characteristics |
|
|
154 | (4) |
|
8.1.3 Relationship between Progress Essay Characteristics and Scores |
|
|
158 | (1) |
|
8.2 Implications for the Progress Validity Argument |
|
|
159 | (1) |
|
8.3 Limitations and Implications |
|
|
160 | (3) |
|
|
160 | (2) |
|
8.3.2 Contributions and Implications |
|
|
162 | (1) |
Stage 1 |
|
163 | (1) |
Stage 2 |
|
163 | (2) |
Stage 3 |
|
165 | (2) |
References |
|
167 | |
Khaled Barkaoui is an associate professor at the Faculty of Education, York University, Canada. His current research and teaching focus on second-language (L2) assessment, L2 writing, L2 program evaluation, longitudinal and mixed-methods research, and English for Academic Purposes (EAP).