Submitted by zhenli on Thu, 06/16/2016 - 08:09
| Title | Monitoring Items in Real Time to Enhance CAT Security |
| Publication Type | Journal Article |
| Year of Publication | 2016 |
| Authors | Zhang, J, Li, J |
| Journal | Journal of Educational Measurement |
| Volume | 53 |
| Number | 2 |
| Pagination | 131–151 |
| ISSN | 1745-3984 |
| Abstract | An IRT-based sequential procedure is developed to monitor items for enhancing test security. The procedure uses a series of statistical hypothesis tests to examine whether the statistical characteristics of each item under inspection have changed significantly during CAT administration. This procedure is compared with a previously developed CTT-based procedure through simulation studies. The results show that when the total number of examinees is fixed both procedures can control the rate of type I errors at any reasonable significance level by choosing an appropriate cutoff point and meanwhile maintain a low rate of type II errors. Further, the IRT-based method has a much lower type II error rate or more power than the CTT-based method when the number of compromised items is small (e.g., 5), which can be achieved if the IRT-based procedure can be applied in an active mode in the sense that flagged items can be replaced with new items. |
| URL | http://dx.doi.org/10.1111/jedm.12104 |
| DOI | 10.1111/jedm.12104 |