01559nas a2200145 4500008003900000245009000039210006900129300001200198490000700210520109400217100001201311700001801323700001901341856005301360 2008 d00aSeverity of Organized Item Theft in Computerized Adaptive Testing: A Simulation Study0 aSeverity of Organized Item Theft in Computerized Adaptive Testin a543-5580 v323 a
Criteria had been proposed for assessing the severity of possible test security violations for computerized tests with high-stakes outcomes. However, these criteria resulted from theoretical derivations that assumed uniformly randomized item selection. This study investigated potential damage caused by organized item theft in computerized adaptive testing (CAT) for two realistic item selection methods, maximum item information and a-stratified with content blocking, using the randomized method as a baseline for comparison. Damage caused by organized item theft was evaluated by the number of compromised items each examinee could encounter and the impact of the compromised items on examinees' ability estimates. Severity of test security violation was assessed under self-organized and organized item theft simulation scenarios. Results indicated that though item theft could cause severe damage to CAT with either item selection method, the maximum item information method was more vulnerable to the organized item theft simulation than was the a-stratified method.
1 aQing Yi1 aJinming Zhang1 aChang, Hua-Hua uhttp://apm.sagepub.com/content/32/7/543.abstract