|Title||From Reliability to Validity: Expanding Adaptive Testing Practice to Find the Most Valid Score for Each Test Taker|
|Publication Type||Conference Paper|
|Year of Publication||2011|
|Conference Name||Annual Conference of the International Association for Computerized Adaptive Testing|
|Keywords||CAT, CIV, construct-irrelevant variance, Individual Score Validity, ISV, low test taking motivation, Reliability, validity|
CAT is an exception to the traditional conception of validity. It is one of the few examples of individualized testing. Item difficulty is tailored to each examinee. The intent, however, is increased efficiency. Focus on reliability (reduced standard error); Equivalence with paper & pencil tests is valued; Validity is enhanced through improved reliability.
How Else Might We Individualize Testing Using CAT?
An ISV-Based View of Validity
Test Event -- An examinee encounters a series of items in a particular context.
CAT Goal: individualize testing to address CIV threats to score validity (i.e., maximize ISV).
Some Research Issues: