| The 99 respondents in this study rated 55 paired stem-responses according to eight different criteria. One of those criteria concerned general complexity. Respondents rated stem-responses in terms of a 5-point scale in which "5" denoted very complex and "1" very simple. Respondents had the option of not rating items they felt uncertain of. Moreover, if a respondent wasn't present for this phase of the study, a "no response" rating was recorded. |
| Restatement No. |
Respondent Ratings | |||||
| 5 | 4 | 3 | 2 | 1 | 0 (no response) |
|
| 1 | 1 | 2 | 11 | 23 | 44 | 18 |
| 2 | 0 | 14 | 21 | 29 | 17 | 18 |
| 3 | 1 | 0 | 7 | 27 | 46 | 18 |
| 4 | 1 | 3 | 8 | 25 | 43 | 19 |
| 5 | 4 | 11 | 31 | 25 | 9 | 19 |
| 6 | 2 | 2 | 17 | 39 | 20 | 19 |
| 7 | 0 | 3 | 14 | 35 | 28 | 19 |
| 8 | 1 | 2 | 23 | 30 | 24 | 19 |
| 9 | 1 | 6 | 17 | 30 | 26 | 19 |
| 10 | 5 | 11 | 16 | 20 | 27 | 20 |
| 11 | 0 | 1 | 4 | 31 | 43 | 20 |
| 12 | 5 | 14 | 23 | 25 | 13 | 19 |
| 13 | 1 | 4 | 16 | 23 | 36 | 19 |
| 14 | 0 | 2 | 5 | 34 | 39 | 19 |
| 15 | 4 | 4 | 10 | 34 | 27 | 20 |
| 16 | 3 | 3 | 25 | 34 | 15 | 19 |
| 17 | 10 | 21 | 21 | 13 | 8 | 36 |
| 18 | 10 | 20 | 13 | 24 | 12 | 20 |
| 19 | 3 | 4 | 19 | 30 | 25 | 18 |
| 20 | 0 | 4 | 6 | 17 | 53 | 19 |
| 21 | 0 | 2 | 15 | 27 | 36 | 19 |
| 22 | 1 | 8 | 18 | 28 | 25 | 19 |
| 23 | 3 | 5 | 8 | 34 | 28 | 21 |
| 24 | 0 | 0 | 7 | 32 | 41 | 19 |
| 25 | 11 | 12 | 26 | 23 | 8 | 19 |
| 26 | 11 | 12 | 26 | 23 | 8 | 19 |
| 27 | 0 | 2 | 12 | 32 | 32 | 31 |
| 28 | 0 | 3 | 9 | 27 | 39 | 31 |
| 29 | 0 | 4 | 16 | 30 | 28 | 21 |
| 30 | 1 | 8 | 5 | 28 | 36 | 21 |
| 31 | 1 | 4 | 7 | 29 | 37 | 21 |
| 32 | 4 | 7 | 17 | 23 | 27 | 21 |
| 33 | 2 | 0 | 19 | 23 | 32 | 23 |
| 34 | 0 | 2 | 11 | 33 | 32 | 21 |
| 35 | 0 | 1 | 13 | 30 | 34 | 21 |
| 36 | 4 | 18 | 11 | 24 | 21 | 21 |
| 37 | 0 | 0 | 15 | 35 | 28 | 21 |
| 38 | 5 | 14 | 13 | 35 | 11 | 21 |
| 39 | 0 | 3 | 14 | 34 | 25 | 23 |
| 40 | 1 | 4 | 28 | 18 | 25 | 23 |
| 41 | 0 | 3 | 14 | 34 | 25 | 23 |
| 42 | 0 | 2 | 4 | 14 | 56 | 23 |
| 43 | 0 | 10 | 25 | 23 | 18 | 23 |
| 44 | 0 | 10 | 25 | 23 | 18 | 23 |
| 45 | 2 | 22 | 14 | 21 | 17 | 23 |
| 46 | 3 | 6 | 8 | 33 | 26 | 23 |
| 47 | 0 | 5 | 17 | 22 | 32 | 23 |
| 48 | 1 | 3 | 21 | 31 | 20 | 23 |
| 49 | 3 | 2 | 12 | 14 | 45 | 23 |
| 50 | 3 | 1 | 18 | 27 | 25 | 25 |
| 51 | 0 | 0 | 5 | 25 | 46 | 23 |
| 52 | 0 | 6 | 14 | 30 | 26 | 23 |
| 53 | 0 | 14 | 19 | 20 | 19 | 27 |
| 54 | 0 | 2 | 3 | 26 | 47 | 21 |
| 55 | 0 | 0 | 7 | 33 | 38 | 21 |
| THIS ARTICLE Phase 1 General Complexity Ratings |
|||
| Abstract | Background | Method | Results |
| Conclusion | References | Appendix 1 | Appendix 2 |