The 99 respondents in this study rated 55 paired stem-responses according to eight different criteria. One of those criteria concerned general complexity. Respondents rated stem-responses in terms of a 5-point scale in which "5" denoted very complex and "1" very simple. Respondents had the option of not rating items they felt uncertain of. Moreover, if a respondent wasn't present for this phase of the study, a "no response" rating was recorded. |
Restatement No. |
Respondent Ratings | |||||
5 | 4 | 3 | 2 | 1 | 0 (no response) |
|
1 | 1 | 2 | 11 | 23 | 44 | 18 |
2 | 0 | 14 | 21 | 29 | 17 | 18 |
3 | 1 | 0 | 7 | 27 | 46 | 18 |
4 | 1 | 3 | 8 | 25 | 43 | 19 |
5 | 4 | 11 | 31 | 25 | 9 | 19 |
6 | 2 | 2 | 17 | 39 | 20 | 19 |
7 | 0 | 3 | 14 | 35 | 28 | 19 |
8 | 1 | 2 | 23 | 30 | 24 | 19 |
9 | 1 | 6 | 17 | 30 | 26 | 19 |
10 | 5 | 11 | 16 | 20 | 27 | 20 |
11 | 0 | 1 | 4 | 31 | 43 | 20 |
12 | 5 | 14 | 23 | 25 | 13 | 19 |
13 | 1 | 4 | 16 | 23 | 36 | 19 |
14 | 0 | 2 | 5 | 34 | 39 | 19 |
15 | 4 | 4 | 10 | 34 | 27 | 20 |
16 | 3 | 3 | 25 | 34 | 15 | 19 |
17 | 10 | 21 | 21 | 13 | 8 | 36 |
18 | 10 | 20 | 13 | 24 | 12 | 20 |
19 | 3 | 4 | 19 | 30 | 25 | 18 |
20 | 0 | 4 | 6 | 17 | 53 | 19 |
21 | 0 | 2 | 15 | 27 | 36 | 19 |
22 | 1 | 8 | 18 | 28 | 25 | 19 |
23 | 3 | 5 | 8 | 34 | 28 | 21 |
24 | 0 | 0 | 7 | 32 | 41 | 19 |
25 | 11 | 12 | 26 | 23 | 8 | 19 |
26 | 11 | 12 | 26 | 23 | 8 | 19 |
27 | 0 | 2 | 12 | 32 | 32 | 31 |
28 | 0 | 3 | 9 | 27 | 39 | 31 |
29 | 0 | 4 | 16 | 30 | 28 | 21 |
30 | 1 | 8 | 5 | 28 | 36 | 21 |
31 | 1 | 4 | 7 | 29 | 37 | 21 |
32 | 4 | 7 | 17 | 23 | 27 | 21 |
33 | 2 | 0 | 19 | 23 | 32 | 23 |
34 | 0 | 2 | 11 | 33 | 32 | 21 |
35 | 0 | 1 | 13 | 30 | 34 | 21 |
36 | 4 | 18 | 11 | 24 | 21 | 21 |
37 | 0 | 0 | 15 | 35 | 28 | 21 |
38 | 5 | 14 | 13 | 35 | 11 | 21 |
39 | 0 | 3 | 14 | 34 | 25 | 23 |
40 | 1 | 4 | 28 | 18 | 25 | 23 |
41 | 0 | 3 | 14 | 34 | 25 | 23 |
42 | 0 | 2 | 4 | 14 | 56 | 23 |
43 | 0 | 10 | 25 | 23 | 18 | 23 |
44 | 0 | 10 | 25 | 23 | 18 | 23 |
45 | 2 | 22 | 14 | 21 | 17 | 23 |
46 | 3 | 6 | 8 | 33 | 26 | 23 |
47 | 0 | 5 | 17 | 22 | 32 | 23 |
48 | 1 | 3 | 21 | 31 | 20 | 23 |
49 | 3 | 2 | 12 | 14 | 45 | 23 |
50 | 3 | 1 | 18 | 27 | 25 | 25 |
51 | 0 | 0 | 5 | 25 | 46 | 23 |
52 | 0 | 6 | 14 | 30 | 26 | 23 |
53 | 0 | 14 | 19 | 20 | 19 | 27 |
54 | 0 | 2 | 3 | 26 | 47 | 21 |
55 | 0 | 0 | 7 | 33 | 38 | 21 |
THIS ARTICLE Phase 1 General Complexity Ratings Phase 2 General Complexity Ratings |
|||
Abstract | Background | Method | Results |
Conclusion | References | Appendix 1 | Appendix 2 |