01415nas a2200145 4500008003900000245012900039210006900168300001200237490000700249520089000256100002001146700002301166700002701189856005301216 2007 d00aComputerized Adaptive Testing for Polytomous Motivation Items: Administration Mode Effects and a Comparison With Short Forms0 aComputerized Adaptive Testing for Polytomous Motivation Items Ad a412-4290 v313 a
In a randomized experiment (n = 515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible consequences of model misfit. CAT efficiency was studied by a systematic comparison of the CAT with two types of conventional fixed length short forms, which are created to be good CAT competitors. Results showed no essential administration mode effects. Efficiency analyses show that CAT outperformed the short forms in almost all aspects when results are aggregated along the latent trait scale. The real and the simulated data results are very similar, which indicate that the real data results are not affected by model misfit.
1 aHol, Michiel, A1 aVorst, Harrie, C M1 aMellenbergh, Gideon, J uhttp://apm.sagepub.com/content/31/5/412.abstract01542nas a2200145 4500008003900000245014500039210006900184300001200253490000700265520100100272100002001273700002301293700002701316856005301343 2005 d00aA Randomized Experiment to Compare Conventional, Computerized, and Computerized Adaptive Administration of Ordinal Polytomous Attitude Items0 aRandomized Experiment to Compare Conventional Computerized and C a159-1830 v293 aA total of 520 high school students were randomly assigned to a paper-and-pencil test (PPT), a computerized standard test (CST), or a computerized adaptive test (CAT) version of the Dutch School Attitude Questionnaire (SAQ), consisting of ordinal polytomous items. The CST administered items in the same order as the PPT. The CAT administered all items of three SAQ subscales in adaptive order using Samejima’s graded response model, so that six different stopping rule settings could be applied afterwards. School marks were used as external criteria. Results showed significant but small multivariate administration mode effects on conventional raw scores and small to medium effects on maximum likelihood latent trait estimates. When the precision of CAT latent trait estimates decreased, correlations with grade point average in general decreased. However, the magnitude of the decrease was not very large as compared to the PPT, the CST, and the CAT without the stopping rule.
1 aHol, Michiel, A1 aVorst, Harrie, C M1 aMellenbergh, Gideon, J uhttp://apm.sagepub.com/content/29/3/159.abstract