01889nas a2200157 4500008003900000245006900039210006800108300001200176490000700188520141000195100001901605700001601624700002001640700001801660856005301678 2014 d00aGeneral Test Overlap Control: Improved Algorithm for CAT and CCT0 aGeneral Test Overlap Control Improved Algorithm for CAT and CCT a229-2440 v383 a
This article proposed a new online test overlap control algorithm that is an improvement of Chen’s algorithm in controlling general test overlap rate for item pooling among a group of examinees. Chen’s algorithm is not very efficient in that not only item pooling between current examinee and prior examinees is controlled for but also item pooling between previous examinees, which would have been controlled for when they were current examinees. The proposed improvement increases efficiency by only considering item pooling between current and previous examinees, and its improved performance over Chen is demonstrated in a simulated computerized adaptive testing (CAT) environment. Moreover, the proposed algorithm is adapted for computerized classification testing (CCT) using the sequential probability ratio test procedure and is evaluated against some existing exposure control procedures. The proposed algorithm appears to work best in controlling general test overlap rate among the exposure control procedures examined without sacrificing much classification precision, though longer tests might be required for more stringent control of item pooling among larger groups. Given the capability of the proposed algorithm in controlling item pooling among a group of examinees of any size and its ease of implementation, it appears to be a good test overlap control method.
1 aChen, Shu-Ying1 aLei, Pui-Wa1 aChen, Jyun-Hong1 aLiu, Tzu-Chen uhttp://apm.sagepub.com/content/38/3/229.abstract