01889nas a2200157   4500008004100000245007800041210006900119260009700188520126000285100001801545700001801563700002001581700001701601700001601618856009701634       2009                        eng d00aCriterion-related validity of an innovative CAT-based personality measure0 aCriterionrelated validity of an innovative CATbased personality   aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.3 aThis paper describes development and initial criterion-related validation of the PreVisor Computer Adaptive Personality Scales (PCAPS), a computerized adaptive testing-based personality measure that uses an ideal point IRT model based on forced-choice, paired-comparison responses. Based on results from a large consortium study, a composite of six PCAPS scales identified as relevant to the population of interest (first-line supervisors) had an estimated operational validity against an overall job performance criterion of ρ = .25. Uncorrected and corrected criterion-related validity results for each of the six PCAPS scales making up the composite are also reported.  Because the PCAPS algorithm computes intermediate scale scores until a stopping rule is triggered, we were able to graph number of statement-pairs presented against criterion-related validities. Results showed generally monotonically 
increasing functions.  However, asymptotic validity levels, or at least a reduction in the rate of increase in slope, were often reached after 5-7 statement-pairs were presented.  In the case of the composite measure, there was some evidence that validities decreased after about six statement-pairs. A possible explanation for this is provided.1 aSchneider, RJ1 aMcLellan, R A1 aKantrowitz, T M1 aHouston, J S1 aBorman, W C  uhttp://iacat.org/content/criterion-related-validity-innovative-cat-based-personality-measure