TY - JOUR
T1 - A Bayesian method for the detection of item preknowledge in computerized adaptive testing
JF - Applied Psychological Measurement
Y1 - 2003
A1 - McLeod, L.
A1 - Lewis, C.
A1 - Thissen, D.
KW - Adaptive Testing
KW - Cheating
KW - Computer Assisted Testing
KW - Individual Differences computerized adaptive testing
KW - Item
KW - Item Analysis (Statistical)
KW - Mathematical Modeling
KW - Response Theory
AB - With the increased use of continuous testing in computerized adaptive testing, new concerns about test security have evolved, such as how to ensure that items in an item pool are safeguarded from theft. In this article, procedures to detect test takers using item preknowledge are explored. When test takers use item preknowledge, their item responses deviate from the underlying item response theory (IRT) model, and estimated abilities may be inflated. This deviation may be detected through the use of person-fit indices. A Bayesian posterior log odds ratio index is proposed for detecting the use of item preknowledge. In this approach to person fit, the estimated probability that each test taker has preknowledge of items is updated after each item response. These probabilities are based on the IRT parameters, a model specifying the probability that each item has been memorized, and the test taker's item responses. Simulations based on an operational computerized adaptive test (CAT) pool are used to demonstrate the use of the odds ratio index. (PsycINFO Database Record (c) 2005 APA )
VL - 27
ER -