TitleFrom Blueprints to Systems: An Integrated Approach to Adaptive Testing
Publication TypeConference Paper
Year of Publication2017
AuthorsKingsbury, G, Zara, T
Conference NameIACAT 2017 Conference
Date Published08/2017
PublisherNiigata Seiryo University
Conference LocationNiigata, Japan
KeywordsCAT, integrated approach, Keynote

For years, test blueprints have told test developers how many items and what types of items will be included in a test. Adaptive testing adopted this approach from paper testing, and it is reasonably useful. Unfortunately, 'how many items and what types of items' are not all the elements one should consider when choosing items for an adaptive test. To fill in gaps, practitioners have developed tools to allow an adaptive test to behave appropriately (i.e. examining exposure control, content balancing, item drift procedures, etc.). Each of these tools involves the use of a separate process external to the primary item selection process.

The use of these subsidiary processes makes item selection less optimal and makes it difficult to prioritize aspects of selection. This discussion describes systems-based adaptive testing. This approach uses metadata concerning items, test takers and test elements to select items. These elements are weighted by the stakeholders to shape an expanded blueprint designed for adaptive testing. 

Session Video