TY - JOUR T1 - Factors Affecting the Classification Accuracy and Average Length of a Variable-Length Cognitive Diagnostic Computerized Test JF - Journal of Computerized Adaptive Testing Y1 - 2018 A1 - Huebner, Alan A1 - Finkelman, Matthew D. A1 - Weissman, Alexander VL - 6 UR - http://iacat.org/jcat/index.php/jcat/article/view/55/30 IS - 1 ER - TY - JOUR T1 - A Stochastic Method for Balancing Item Exposure Rates in Computerized Classification Tests JF - Applied Psychological Measurement Y1 - 2012 A1 - Huebner, Alan A1 - Li, Zhushan AB -

Computerized classification tests (CCTs) classify examinees into categories such as pass/fail, master/nonmaster, and so on. This article proposes the use of stochastic methods from sequential analysis to address item overexposure, a practical concern in operational CCTs. Item overexposure is traditionally dealt with in CCTs by the Sympson-Hetter (SH) method, but this method is unable to restrict the exposure of the most informative items to the desired level. The authors’ new method of stochastic item exposure balance (SIEB) works in conjunction with the SH method and is shown to greatly reduce the number of overexposed items in a pool and improve overall exposure balance while maintaining classification accuracy comparable with using the SH method alone. The method is demonstrated using a simulation study.

VL - 36 UR - http://apm.sagepub.com/content/36/3/181.abstract ER - TY - JOUR T1 - A Stochastic Method for Balancing Item Exposure Rates in Computerized Classification Tests JF - Applied Psychological Measurement Y1 - 2012 A1 - Huebner, Alan A1 - Li, Zhushan AB -

Computerized classification tests (CCTs) classify examinees into categories such as pass/fail, master/nonmaster, and so on. This article proposes the use of stochastic methods from sequential analysis to address item overexposure, a practical concern in operational CCTs. Item overexposure is traditionally dealt with in CCTs by the Sympson-Hetter (SH) method, but this method is unable to restrict the exposure of the most informative items to the desired level. The authors’ new method of stochastic item exposure balance (SIEB) works in conjunction with the SH method and is shown to greatly reduce the number of overexposed items in a pool and improve overall exposure balance while maintaining classification accuracy comparable with using the SH method alone. The method is demonstrated using a simulation study.

VL - 36 UR - http://apm.sagepub.com/content/36/3/181.abstract ER - TY - JOUR T1 - Restrictive Stochastic Item Selection Methods in Cognitive Diagnostic Computerized Adaptive Testing JF - Journal of Educational Measurement Y1 - 2011 A1 - Wang, Chun A1 - Chang, Hua-Hua A1 - Huebner, Alan AB -

This paper proposes two new item selection methods for cognitive diagnostic computerized adaptive testing: the restrictive progressive method and the restrictive threshold method. They are built upon the posterior weighted Kullback-Leibler (KL) information index but include additional stochastic components either in the item selection index or in the item selection procedure. Simulation studies show that both methods are successful at simultaneously suppressing overexposed items and increasing the usage of underexposed items. Compared to item selection based upon (1) pure KL information and (2) the Sympson-Hetter method, the two new methods strike a better balance between item exposure control and measurement accuracy. The two new methods are also compared with Barrada et al.'s (2008) progressive method and proportional method.

VL - 48 UR - http://dx.doi.org/10.1111/j.1745-3984.2011.00145.x ER -