Skip to main content
JALT Testing & Evaluation SIG

Main navigation

  • Home
  • About TEVAL SIG
    • TEVAL's Mission
    • Officers
    • Constitution
  • Publications
    • Shiken Journal
    • Shiken Current Issue
    • Statistics Corner: Questions and Answers about Language Testing Statistics (book)
    • Shiken Back Issues
    • Submission Guidelines
    • TEVAL News
    • Shiken Issues Pre May 2012
  • News
    • TEVAL Talk Time
    • Grants Information
    • Introduction to jMetrik
    • Shiken Journal Call for Papers
    • Statistics Corner
    • Ethical Issues in Language Testing - Dr. Isbell
    • Dr. Isbell Pansig Plenary Slides
  • Events
  • Join
  • Contact Us
    • Facebook
    • email
User account menu
  • Log in

Breadcrumb

  1. Home

Rasch analysis of a congruent and incongruent collocations test

Article appearing in Shiken 20.2 (November, 2016) pp. 25-43.

Authors: Christopher Nicklin & Garrett DeOrio
Nippon Medical School

Abstract:
In order to investigate the hypothesis that collocations might be easier to acquire productively through the use of illustrations due to the pictorial superiority effect (Nelson, Reed, & Walling, 1976), the Congruent and Incongruent Collocations (CIC) test was specifically designed to assess the knowledge of a group of students regarding a group of 15 congruent and 15 incongruent collocational phrases. The CIC test was developed to be administered as a pretest, posttest, and delayed posttest to a group of second year Japanese medical students (N = 109).

The results of the pretest were analysed using the Rasch dichotomous model (Rasch, 1960), which revealed that the CIC test was of an appropriate difficulty level for the students with the majority of the items being well targeted. However, not all of the items fit the expectations of the Rasch model, and a test for invariance showed that the CIC test was not a reliably invariant instrument for assessing a samples knowledge regarding the group of collocations being tested.

Keywords: Rasch analysis, congruent and incongruent collocations, collocations test, pictorial superiority effect, vocabulary

Download full article (PDF)

PanSIG Conference, Chiba, May 16-18, 2025

PanSIG
Kanda University of International Studies

SHIKEN

A Journal of Language Testing and Evaluation in Japan

Site editors

  • Reset your password
RSS feed

JALT is the Japan Association for Language Teaching, a nonprofit organization dedicated to the improvement of language teaching and learning. The TEVAL SIG is a Special Interest Group of researchers within JALT who are interested in testing and the evaluation of language learning outcomes.

Powered by Drupal