Continuous Testing (an avenue for CAT research)

Submitted by on Fri, 05/18/2012 - 13:05
TitleContinuous Testing (an avenue for CAT research)
Publication TypeConference Paper
Year of Publication2011
AuthorsKingsbury, GG
Conference NameAnnual Conference of the International Association for Computerized Adaptive Testing
Date Published10/2011
KeywordsCAT, item filter, item filtration
Abstract

Publishing an Adaptive Test

  • Write Items
  • Field Test Items
  • Select an Operational Pool
  • Publish Pool
  • Distribute Pool
  • Administer Tests
  • Rinse and Repeat

Problems with Publishing

  • The static pool

    • Restricts content
    • Restricts psychometrics
    • Restricts corrections
    • Structures item exposure
  • The publication process

    • Creates logistic problems
    • Slows response to new content
  • Item filtration – An alternative to test publishing

    • Realtime test creation
    • Begins with entire item pool
    • Removes items until one item is chosen to administer

Research Questions

  • Since filtering adds constraints, what is the psychometric impact?
  • Can we use filtering to control item drift?
  • How does filtering interact with item selection?
Files: 
PDF icon IACAT 2011 Kingsbury Continuous Testing.pdf