TY - JOUR T1 - A comparison of content-balancing procedures for estimating multiple clinical domains in computerized adaptive testing: Relative precision, validity, and detection of persons with misfitting responses JF - Applied Psychological Measurement Y1 - 2010 A1 - Riley, B. B. A1 - Dennis, M. L. A1 - Conrad, K. J. AB - This simulation study sought to compare four different computerized adaptive testing (CAT) content-balancing procedures designed for use in a multidimensional assessment with respect to measurement precision, symptom severity classification, validity of clinical diagnostic recommendations, and sensitivity to atypical responding. The four content-balancing procedures were (a) no content balancing, (b) screener-based, (c) mixed (screener plus content balancing), and (d) full content balancing. In full content balancing and in mixed content balancing following administration of the screener items, item selection was based on (a) whether the target numberof items for the item’s subscale was reached and (b) the item’s information function. Mixed and full content balancing provided the best representation of items from each of the main subscales of the Internal Mental Distress Scale. These procedures also resulted in higher CAT to full-scale correlations for the Trauma and Homicidal/Suicidal Thought subscales and improved detection of atypical responding.Keywords VL - 34 SN - 0146-62161552-3497 ER - TY - JOUR T1 - Relative precision, efficiency and construct validity of different starting and stopping rules for a computerized adaptive test: The GAIN Substance Problem Scale JF - Journal of Applied Measurement Y1 - 2007 A1 - Riley, B. B. A1 - Conrad, K. J. A1 - Bezruczko, N. A1 - Dennis, M. L. KW - My article AB - Substance abuse treatment programs are being pressed to measure and make clinical decisions more efficiently about an increasing array of problems. This computerized adaptive testing (CAT) simulation examined the relative efficiency, precision and construct validity of different starting and stopping rules used to shorten the Global Appraisal of Individual Needs’ (GAIN) Substance Problem Scale (SPS) and facilitate diagnosis based on it. Data came from 1,048 adolescents and adults referred to substance abuse treatment centers in 5 sites. CAT performance was evaluated using: (1) average standard errors, (2) average number of items, (3) bias in personmeasures, (4) root mean squared error of person measures, (5) Cohen’s kappa to evaluate CAT classification compared to clinical classification, (6) correlation between CAT and full-scale measures, and (7) construct validity of CAT classification vs. clinical classification using correlations with five theoretically associated instruments. Results supported both CAT efficiency and validity. VL - 8 ER - TY - Generic T1 - The use of computerized adaptive testing to assess psychopathology using the Global Appraisal of Individual Needs T2 - American Evaluation Association Y1 - 2007 A1 - Conrad, K. J. A1 - Riley, B. B. A1 - Dennis, M. L. JF - American Evaluation Association PB - American Evaluation Association CY - Portland, OR USA ER -