Submitted by Cliff Donath on Sun, 07/10/2011 - 07:31
Title | An item response model for characterizing test compromise |
Publication Type | Journal Article |
Year of Publication | 2002 |
Authors | Segall, DO |
Journal | Journal of Educational and Behavioral Statistics |
Volume | 27 |
Number | 2 |
Pagination | 163-179 |
Publication Language | eng |
Keywords | computerized adaptive testing |
Abstract | This article presents an item response model for characterizing test-compromise that enables the estimation of item-preview and score-gain distributions observed in on-demand high-stakes testing programs. Model parameters and posterior distributions are estimated by Markov Chain Monte Carlo (MCMC) procedures. Results of a simulation study suggest that when at least some of the items taken by a small sample of test takers are known to be secure (uncompromised), the procedure can provide useful summaries of test-compromise and its impact on test scores. The article includes discussions of operational use of the proposed procedure, possible model violations and extensions, and application to computerized adaptive testing. |