TitleTest design optimization in CAT early stage with the nominal response model
Publication TypeJournal Article
Year of Publication2007
AuthorsPassos, VL, Berger, MPF, Tan, FE
JournalApplied Psychological Measurement
Volume31
Number3
Pagination213-232
Publication Languageeng
ISBN Number0146-6216 (Print)
Accession Number2007-06921-005
Keywordscomputerized adaptive testing, nominal response model, robust performance, test design optimization
Abstract

The early stage of computerized adaptive testing (CAT) refers to the phase of the trait estimation during the administration of only a few items. This phase can be characterized by bias and instability of estimation. In this study, an item selection criterion is introduced in an attempt to lessen this instability: the D-optimality criterion. A polytomous unconstrained CAT simulation is carried out to evaluate this criterion's performance under different test premises. The simulation shows that the extent of early stage instability depends primarily on the quality of the item pool information and its size and secondarily on the item selection criteria. The efficiency of the D-optimality criterion is similar to the efficiency of other known item selection criteria. Yet, it often yields estimates that, at the beginning of CAT, display a more robust performance against instability. (PsycINFO Database Record (c) 2007 APA, all rights reserved)