Shiken: JALT Testing & Evaluation SIG Newsletter
Vol. 15 No. 1. March 2011 (p. 19 - 30) [ISSN 1881-5537]
PDF Version

Part I: Open Questions

1. What does a regression fallacy refer to? How can it be avoided?
   
   
2. What is test maintenance? What sort of test maintenance procedures should schools creating their own entrance exams employ?
   
   
3. What is questionnaire acquiescence? Why should it be of concern to survey designers? How can it be reduced?
   
   
4. In a fixed choice test, what is the difference between an illegal value and an outlier? How can test designers reduce both of these?
   
   
5. What steps should be taken to discourage the leakage of entrance examination test items onto the Internet while the exams are being held in a manner similar to that happened during the Kyoto, Doshisha, Rikkyo and Waseda university entrance exams of February 2011?
   

Part II: Multiple Choice Questions

1. In surveys and structured interviews, which statement is true about filter questions? NOTE: Just one answer is considered fully correct.
   
   (A) Not all respondents are expected to answer the question(s) following a filter question. (B) They are designed to assess whether or not respondents are being honest. (C) They are designed to detect whether or not some type of guessing is occurring. (D) Their primary purpose is to prime respondents for ensuing questions.
   

[ p. 19 ]

2. Which statements are true about fundamental attribution errors? NOTE: Two of the statements below are considered correct.
   
   (A) They generally pertain to the behavior of single individuals. (B) They occur if some type of stereotype is made about outgroup members as a whole. (C) They over-emphasize personality trait variables. (D) They over-emphasize situational or environmental variables.
   
   
3. If you were using OCR sheets in a large scale survey, which of the following would bevconsidered data processing errors? NOTE: At least two statements below are correct.
   
   (A) A response sheet is rejected because too many items were left blank. (B) A response sheet was not collected because an examinee failed to turn it in. (C) A response sheet was not marked because it stuck to the previous response sheet. (D) A poorly marked response sheet was misread.
   
   
4. Assuming that we are dealing with data from a normally distributed curve, which of these statements would be true according to the three-sigma rule? NOTE: Just one answer is considered correct.
   
   (A) 1 in 22 observations will likely be at least one standard deviation above or below the mean. (B) 1 in 68 observations will likely be at least two standard deviations above or below the mean. (C) 1 in 95 observations will likely be at least three standard deviations ± the mean.
   

---

NEWSLETTER: Topic IndexAuthor IndexTitle IndexDate Index
TEVAL SIG: Main Page Background Links Join

---

HTML: http://jalt.org/test/SSQ10.htm   /   PDF: http://jalt.org/test/PDF/SSQ10.pdf

---

ASSESSMENT LITERACY ONLINE SELF-STUDY SERIES:

Quiz #1: Qs   / Qs   / As   *    2: Qs   / As   *    3: Qs   / As   *    4: Qs   / As   *    5: Qs   / As   *    6: Qs   / As   *    7: Qs   / As   *    8: Qs   / As   *    9: Qs   / As   *    10: Qs   / As   *    11: A HREF="SSQ11.htm">Qs   / As  

---

[ p. 20 ]