01538nas a2200169 4500008004200000245012100042210006900163520094900232100001801181700001701199700002501216700001801241700002201259700002201281700002001303856004501323 In Press d 00aDevelopment of a Computerized Adaptive Test for Anxiety Based on the Dutch–Flemish Version of the PROMIS Item Bank0 aDevelopment of a Computerized Adaptive Test for Anxiety Based on3 aWe used the Dutch–Flemish version of the USA PROMIS adult V1.0 item bank for Anxiety as input for developing a computerized adaptive test (CAT) to measure the entire latent anxiety continuum. First, psychometric analysis of a combined clinical and general population sample (N = 2,010) showed that the 29-item bank has psychometric properties that are required for a CAT administration. Second, a post hoc CAT simulation showed efficient and highly precise measurement, with an average number of 8.64 items for the clinical sample, and 9.48 items for the general population sample. Furthermore, the accuracy of our CAT version was highly similar to that of the full item bank administration, both in final score estimates and in distinguishing clinical subjects from persons without a mental health disorder. We discuss the future directions and limitations of CAT development with the Dutch–Flemish version of the PROMIS Anxiety item bank.1 aFlens, Gerard1 aSmits, Niels1 aTerwee, Caroline, B.1 aDekker, Joost1 aHuijbrechts, Irma1 aSpinhoven, Philip1 ade Beurs, Edwin uhttps://doi.org/10.1177/107319111774674200728nas a2200193 4500008004500000245009100045210006900136300001000205490000700215653003500222653003400257653002900291653002600320100001900346700002700365700002400392700002100416856009700437 2023 Engldsh 00aHow Do Trait Change Patterns Affect the Performance of Adaptive Measurement of Change?0 aHow Do Trait Change Patterns Affect the Performance of Adaptive  a32-580 v1010aadaptive measurement of change10acomputerized adaptive testing10alongitudinal measurement10atrait change patterns1 aTai, Ming, Him1 aCooperman, Allison, W.1 aDeWeese, Joseph, N.1 aWeiss, David, J. uhttp://iacat.org/how-do-trait-change-patterns-affect-performance-adaptive-measurement-change00480nas a2200133 4500008003900000245007300039210006700112490000600179653003400185653001300219653003500232100002600267856005300293 2022 d00aThe (non)Impact of Misfitting Items in Computerized Adaptive Testing0 anonImpact of Misfitting Items in Computerized Adaptive Testing0 v910acomputerized adaptive testing10aitem fit10athree-parameter logistic model1 aDeMars, Christine, E. uhttps://jcatpub.net/index.php/jcat/issue/view/2601308nas a2200133 4500008003900000245003900039210003500078300001000113490000700123520095700130100001901087700002301106856004501129 2020 d00aA Blocked-CAT Procedure for CD-CAT0 aBlockedCAT Procedure for CDCAT a49-640 v443 aThis article introduces a blocked-design procedure for cognitive diagnosis computerized adaptive testing (CD-CAT), which allows examinees to review items and change their answers during test administration. Four blocking versions of the new procedure were proposed. In addition, the impact of several factors, namely, item quality, generating model, block size, and test length, on the classification rates was investigated. Three popular item selection indices in CD-CAT were used and their efficiency compared using the new procedure. An additional study was carried out to examine the potential benefit of item review. The results showed that the new procedure is promising in that allowing item review resulted only in a small loss in attribute classification accuracy under some conditions. Moreover, using a blocked-design CD-CAT is beneficial to the extent that it alleviates the negative impact of test anxiety on examinees’ true performance.1 aKaplan, Mehmet1 ade la Torre, Jimmy uhttps://doi.org/10.1177/014662161983550002729nas a2200145 4500008003900000245012200039210006900161490000700230520216000237100003002397700002702427700002802454700002502482856007602507 2020 d00aComputerized adaptive testing to screen children for emotional and behavioral problems by preventive child healthcare0 aComputerized adaptive testing to screen children for emotional a0 v203 a

Background

Questionnaires to detect emotional and behavioral problems (EBP) in Preventive Child Healthcare (PCH) should be short which potentially affects validity and reliability. Simulation studies have shown that Computerized Adaptive Testing (CAT) could overcome these weaknesses. We studied the applicability (using the measures participation rate, satisfaction, and efficiency) and the validity of CAT in routine PCH practice.

Methods

We analyzed data on 461 children aged 10–11 years (response 41%), who were assessed during routine well-child examinations by PCH professionals. Before the visit, parents completed the CAT and the Child Behavior Checklist (CBCL). Satisfaction was measured by parent- and PCH professional-report. Efficiency of the CAT procedure was measured as number of items needed to assess whether a child has serious problems or not. Its validity was assessed using the CBCL as the criterion.

Results

Parents and PCH professionals rated the CAT on average as good. The procedure required at average 16 items to assess whether a child has serious problems or not. Agreement of scores on the CAT scales with corresponding CBCL scales was high (range of Spearman correlations 0.59–0.72). Area Under Curves (AUC) were high (range: 0.95–0.97) for the Psycat total, externalizing, and hyperactivity scales using corresponding CBCL scale scores as criterion. For the Psycat internalizing scale the AUC was somewhat lower but still high (0.86).

Conclusions

CAT is a valid procedure for the identification of emotional and behavioral problems in children aged 10–11 years. It may support the efficient and accurate identification of children with overall, and potentially also specific, emotional and behavioral problems in routine PCH.

1 aTheunissen, Meninou, H.C.1 ade Wolff, Marianne, S.1 aDeurloo, Jacqueline, A.1 aVogels, Anton, G. C. uhttps://bmcpediatr.biomedcentral.com/articles/10.1186/s12887-020-2018-101806nas a2200145 4500008003900000245012400039210006900163300001000232490000700242520130500249100001801554700002401572700001901596856004501615 2020 d00aMultidimensional Test Assembly Using Mixed-Integer Linear Programming: An Application of Kullback–Leibler Information0 aMultidimensional Test Assembly Using MixedInteger Linear Program a17-320 v443 aMany educational testing programs require different test forms with minimal or no item overlap. At the same time, the test forms should be parallel in terms of their statistical and content-related properties. A well-established method to assemble parallel test forms is to apply combinatorial optimization using mixed-integer linear programming (MILP). Using this approach, in the unidimensional case, Fisher information (FI) is commonly used as the statistical target to obtain parallelism. In the multidimensional case, however, FI is a multidimensional matrix, which complicates its use as a statistical target. Previous research addressing this problem focused on item selection criteria for multidimensional computerized adaptive testing (MCAT). Yet these selection criteria are not directly transferable to the assembly of linear parallel test forms. To bridge this gap the authors derive different statistical targets, based on either FI or the Kullback–Leibler (KL) divergence, that can be applied in MILP models to assemble multidimensional parallel test forms. Using simulated item pools and an item pool based on empirical items, the proposed statistical targets are compared and evaluated. Promising results with respect to the KL-based statistical targets are presented and discussed.1 aDebeer, Dries1 avan Rijn, Peter, W.1 aAli, Usama, S. uhttps://doi.org/10.1177/014662161982758601943nas a2200145 4500008003900000245007700039210006900116300001200185490000700197520148100204100002101685700002301706700002301729856004501752 2019 d00aComputerized Adaptive Testing for Cognitively Based Multiple-Choice Data0 aComputerized Adaptive Testing for Cognitively Based MultipleChoi a388-4010 v433 aCognitive diagnosis models (CDMs) are latent class models that hold great promise for providing diagnostic information about student knowledge profiles. The increasing use of computers in classrooms enhances the advantages of CDMs for more efficient diagnostic testing by using adaptive algorithms, referred to as cognitive diagnosis computerized adaptive testing (CD-CAT). When multiple-choice items are involved, CD-CAT can be further improved by using polytomous scoring (i.e., considering the specific options students choose), instead of dichotomous scoring (i.e., marking answers as either right or wrong). In this study, the authors propose and evaluate the performance of the Jensen–Shannon divergence (JSD) index as an item selection method for the multiple-choice deterministic inputs, noisy “and” gate (MC-DINA) model. Attribute classification accuracy and item usage are evaluated under different conditions of item quality and test termination rule. The proposed approach is compared with the random selection method and an approximate approach based on dichotomized responses. The results show that under the MC-DINA model, JSD improves the attribute classification accuracy significantly by considering the information from distractors, even with a very short test length. This result has important implications in practical classroom settings as it can allow for dramatically reduced testing times, thus resulting in more targeted learning opportunities.1 aYigit, Hulya, D.1 aSorrel, Miguel, A.1 ade la Torre, Jimmy uhttps://doi.org/10.1177/014662161879866501777nas a2200145 4500008003900000245005500039210005400094300001300148490000700161520135000168100001901518700002601537700002301563856004501586 2019 d00aDeveloping Multistage Tests Using D-Scoring Method0 aDeveloping Multistage Tests Using DScoring Method a988-10080 v793 aThe D-scoring method for scoring and equating tests with binary items proposed by Dimitrov offers some of the advantages of item response theory, such as item-level difficulty information and score computation that reflects the item difficulties, while retaining the merits of classical test theory such as the simplicity of number correct score computation and relaxed requirements for model sample sizes. Because of its unique combination of those merits, the D-scoring method has seen quick adoption in the educational and psychological measurement field. Because item-level difficulty information is available with the D-scoring method and item difficulties are reflected in test scores, it conceptually makes sense to use the D-scoring method with adaptive test designs such as multistage testing (MST). In this study, we developed and compared several versions of the MST mechanism using the D-scoring approach and also proposed and implemented a new framework for conducting MST simulation under the D-scoring method. Our findings suggest that the score recovery performance under MST with D-scoring was promising, as it retained score comparability across different MST paths. We found that MST using the D-scoring method can achieve improvements in measurement precision and efficiency over linear-based tests that use D-scoring method.1 aHan, Kyung, T.1 aDimitrov, Dimiter, M.1 aAl-Mashary, Faisal uhttps://doi.org/10.1177/001316441984142801188nas a2200133 4500008003900000245006600039210006500105300001200170490000700182520079400189100001300983700001300996856004501009 2018 d00aConstructing Shadow Tests in Variable-Length Adaptive Testing0 aConstructing Shadow Tests in VariableLength Adaptive Testing a538-5520 v423 aImposing content constraints is very important in most operational computerized adaptive testing (CAT) programs in educational measurement. Shadow test approach to CAT (Shadow CAT) offers an elegant solution to imposing statistical and nonstatistical constraints by projecting future consequences of item selection. The original form of Shadow CAT presumes fixed test lengths. The goal of the current study was to extend Shadow CAT to tests under variable-length termination conditions and evaluate its performance relative to other content balancing approaches. The study demonstrated the feasibility of constructing Shadow CAT with variable test lengths and in operational CAT programs. The results indicated the superiority of the approach compared with other content balancing methods.1 aDiao, Qi1 aRen, Hao uhttps://doi.org/10.1177/014662161775373601267nas a2200157 4500008003900000245009900039210006900138300001200207490000700219520076400226100001800990700001501008700001801023700002301041856004501064 2018 d00aA Continuous a-Stratification Index for Item Exposure Control in Computerized Adaptive Testing0 aContinuous aStratification Index for Item Exposure Control in Co a523-5370 v423 aThe method of a-stratification aims to reduce item overexposure in computerized adaptive testing, as items that are administered at very high rates may threaten the validity of test scores. In existing methods of a-stratification, the item bank is partitioned into a fixed number of nonoverlapping strata according to the items’a, or discrimination, parameters. This article introduces a continuous a-stratification index which incorporates exposure control into the item selection index itself and thus eliminates the need for fixed discrete strata. The new continuous a-stratification index is compared with existing stratification methods via simulation studies in terms of ability estimation bias, mean squared error, and control of item exposure rates.1 aHuebner, Alan1 aWang, Chun1 aDaly, Bridget1 aPinkelman, Colleen uhttps://doi.org/10.1177/014662161875828901537nas a2200181 4500008003900000245006700039210006500106300001200171490000700183520099700190100002001187700001801207700002101225700002201246700002201268700002001290856004501310 2017 d00aATS-PD: An Adaptive Testing System for Psychological Disorders0 aATSPD An Adaptive Testing System for Psychological Disorders a792-8150 v773 aThe clinical assessment of mental disorders can be a time-consuming and error-prone procedure, consisting of a sequence of diagnostic hypothesis formulation and testing aimed at restricting the set of plausible diagnoses for the patient. In this article, we propose a novel computerized system for the adaptive testing of psychological disorders. The proposed system combines a mathematical representation of psychological disorders, known as the “formal psychological assessment,” with an algorithm designed for the adaptive assessment of an individual’s knowledge. The assessment algorithm is extended and adapted to the new application domain. Testing the system on a real sample of 4,324 healthy individuals, screened for obsessive-compulsive disorder, we demonstrate the system’s ability to support clinical testing, both by identifying the correct critical areas for each individual and by reducing the number of posed questions with respect to a standard written questionnaire.1 aDonadello, Ivan1 aSpoto, Andrea1 aSambo, Francesco1 aBadaloni, Silvana1 aGranziol, Umberto1 aVidotto, Giulio uhttps://doi.org/10.1177/001316441665218802096nas a2200181 4500008004100000245004600041210004600087260005500133520153800188653002501726653000801751100002801759700001901787700001301806700002001819700001301839856006201852 2017 eng d00aBayesian Perspectives on Adaptive Testing0 aBayesian Perspectives on Adaptive Testing aNiigata, JapanbNiigata Seiryo Universityc08/20173 a

Although adaptive testing is usually treated from the perspective of maximum-likelihood parameter estimation and maximum-informaton item selection, a Bayesian pespective is more natural, statistically efficient, and computationally tractable. This observation not only holds for the core process of ability estimation but includes such processes as item calibration, and real-time monitoring of item security as well. Key elements of the approach are parametric modeling of each relevant process, updating of the parameter estimates after the arrival of each new response, and optimal design of the next step.

The purpose of the symposium is to illustrates the role of Bayesian statistics in this approach. The first presentation discusses a basic Bayesian algorithm for the sequential update of any parameter in adaptive testing and illustrates the idea of Bayesian optimal design for the two processes of ability estimation and online item calibration. The second presentation generalizes the ideas to the case of 62 IACAT 2017 ABSTRACTS BOOKLET adaptive testing with polytomous items. The third presentation uses the fundamental Bayesian idea of sampling from updated posterior predictive distributions (“multiple imputations”) to deal with the problem of scoring incomplete adaptive tests.

Session Video 1

Session Video 2

 

10aBayesian Perspective10aCAT1 avan der Linden, Wim, J.1 aJiang, Bingnan1 aRen, Hao1 aChoi, Seung, W.1 aDiao, Qi uhttp://iacat.org/bayesian-perspectives-adaptive-testing-001568nas a2200181 4500008003900000245011800039210006900157300001100226490000700237520097700244100001801221700001701239700002501256700001801281700002201299700002001321856004501341 2017 d00aDevelopment of a Computer Adaptive Test for Depression Based on the Dutch-Flemish Version of the PROMIS Item Bank0 aDevelopment of a Computer Adaptive Test for Depression Based on  a79-1050 v403 aWe developed a Dutch-Flemish version of the patient-reported outcomes measurement information system (PROMIS) adult V1.0 item bank for depression as input for computerized adaptive testing (CAT). As item bank, we used the Dutch-Flemish translation of the original PROMIS item bank (28 items) and additionally translated 28 U.S. depression items that failed to make the final U.S. item bank. Through psychometric analysis of a combined clinical and general population sample (N = 2,010), 8 added items were removed. With the final item bank, we performed several CAT simulations to assess the efficiency of the extended (48 items) and the original item bank (28 items), using various stopping rules. Both item banks resulted in highly efficient and precise measurement of depression and showed high similarity between the CAT simulation scores and the full item bank scores. We discuss the implications of using each item bank and stopping rule for further CAT development.1 aFlens, Gerard1 aSmits, Niels1 aTerwee, Caroline, B.1 aDekker, Joost1 aHuijbrechts, Irma1 ade Beurs, Edwin uhttps://doi.org/10.1177/016327871668416801179nas a2200157 4500008003900000245008400039210006900123300001200192490000700204520068700211100002000898700001600918700001800934700002200952856004700974 2017 d00aThe Development of MST Test Information for the Prediction of Test Performances0 aDevelopment of MST Test Information for the Prediction of Test P a570-5860 v773 aThe current study proposes novel methods to predict multistage testing (MST) performance without conducting simulations. This method, called MST test information, is based on analytic derivation of standard errors of ability estimates across theta levels. We compared standard errors derived analytically to the simulation results to demonstrate the validity of the proposed method in both measurement precision and classification accuracy. The results indicate that the MST test information effectively predicted the performance of MST. In addition, the results of the current study highlighted the relationship among the test construction, MST design factors, and MST performance.1 aPark, Ryoungsun1 aKim, Jiseon1 aChung, Hyewon1 aDodd, Barbara, G. uhttp://dx.doi.org/10.1177/001316441666296001828nas a2200169 4500008003900000020001400039245009100053210006900144260001500213300001400228490000700242520131200249100001401561700001701575700002101592856004501613 2017 d a0146-621600aProjection-Based Stopping Rules for Computerized Adaptive Testing in Licensure Testing0 aProjectionBased Stopping Rules for Computerized Adaptive Testing c2018/06/01 a275 - 2900 v423 aThe confidence interval (CI) stopping rule is commonly used in licensure settings to make classification decisions with fewer items in computerized adaptive testing (CAT). However, it tends to be less efficient in the near-cut regions of the ? scale, as the CI often fails to be narrow enough for an early termination decision prior to reaching the maximum test length. To solve this problem, this study proposed the projection-based stopping rules that base the termination decisions on the algorithmically projected range of the final ? estimate at the hypothetical completion of the CAT. A simulation study and an empirical study were conducted to show the advantages of the projection-based rules over the CI rule, in which the projection-based rules reduced the test length without jeopardizing critical psychometric qualities of the test, such as the ? and classification precision. Operationally, these rules do not require additional regularization parameters, because the projection is simply a hypothetical extension of the current test within the existing CAT environment. Because these new rules are specifically designed to address the decreased efficiency in the near-cut regions as opposed to for the entire scale, the authors recommend using them in conjunction with the CI rule in practice.1 aLuo, Xiao1 aKim, Doyoung1 aDickison, Philip uhttps://doi.org/10.1177/014662161772679004649nas a2200145 4500008004100000245010200041210006900143260005500212520406800267653003004335653001604365653002204381100002904403856007104432 2017 eng d00aUsing Automated Item Generation in a Large-scale Medical Licensure Exam Program: Lessons Learned.0 aUsing Automated Item Generation in a Largescale Medical Licensur aNiigata, JapanbNiigata Seiryo Universityc08.20173 a

On-demand testing has become commonplace with most large-scale testing programs. Continuous testing is appealing for candidates in that it affords greater flexibility in scheduling a session at the desired location. Furthermore, the push for more comprehensive systems of assessment (e.g. CBAL) is predicated on the availability of more frequently administered tasks given the purposeful link between instruction and assessment in these frameworks. However, continuous testing models impose several challenges to programs, including overexposure of items. Robust item banks are therefore needed to support routine retirement and replenishment of items. In a traditional approach to developing items, content experts select a topic and then develop an item consisting of a stem, lead-in question, a correct answer and list of distractors. The item then undergoes review by a panel of experts to validate the content and identify any potential flaws. The process involved in developing quality MCQ items can be time-consuming as well as costly, with estimates as high as $1500-$2500 USD per item (Rudner, 2010). The Medical Council of Canada (MCC) has been exploring a novel item development process to supplement traditional approaches. Specifically, the use of automated item generation (AIG), which uses technology to generate test items from cognitive models, has been studied for over five years. Cognitive models are representations of the knowledge and skills that are required to solve any given problem. While developing a cognitive model for a medical scenario, for example, content experts are asked to deconstruct the (clinical) reasoning process involved via clearly stated variables and related elements. The latter information is then entered into a computer program that uses algorithms to generate MCQs. The MCC has been piloting AIG –based items for over five years with the MCC Qualifying Examination Part I (MCCQE I), a pre-requisite for licensure in Canada. The aim of this presentation is to provide an overview of the practical lessons learned in the use and operational rollout of AIG with the MCCQE I. Psychometrically, the quality of the items is at least equal, and in many instances superior, to that of traditionally written MCQs, based on difficulty, discrimination, and information. In fact, 96% of the AIG based items piloted in a recent administration were retained for future operational scoring based on pre-defined inclusion criteria. AIG also offers a framework for the systematic creation of plausible distractors, in that the content experts not only need to provide the clinical reasoning underlying a correct response but also the cognitive errors associated with each of the distractors (Lai et al. 2016). Consequently, AIG holds great promise in regard to improving and tailoring diagnostic feedback for remedial purposes (Pugh, De Champlain, Gierl, Lai, Touchie, 2016). Furthermore, our test development process has been greatly enhanced by the addition of AIG as it requires that item writers use metacognitive skills to describe how they solve problems. We are hopeful that sharing our experiences with attendees might not only help other testing organizations interested in adopting AIG, but also foster discussion which might benefit all participants.

References

Lai, H., Gierl, M.J., Touchie, C., Pugh, D., Boulais, A.P., & De Champlain, A.F. (2016). Using automatic item generation to improve the quality of MCQ distractors. Teaching and Learning in Medicine, 28, 166-173.

Pugh, D., De Champlain, A.F., Lai, H., Gierl, M., & Touchie, C. (2016). Using cognitive models to develop quality multiple choice questions. Medical Teacher, 38, 838-843.

Rudner, L. (2010). Implementing the Graduate Management Admission Test Computerized Adaptive Test. In W. van der Linden & C. Glass (Eds.), Elements of adaptive testing (pp. 151-165). New York, NY: Springer. 

Presentation Video

10aAutomated item generation10alarge scale10amedical licensure1 aDe Champlain, André, F. uhttps://drive.google.com/open?id=14N8hUc8qexAy5W_94TykEDABGVIJHG1h01269nas a2200301 4500008003900000022001400039245021000053210006900263260000800332300001600340490000700356520033300363100001600696700001300712700001400725700001900739700001600758700001500774700001500789700001500804700002000819700001400839700001400853700001800867700001200885700002400897856004600921 2017 d a1573-264900aThe validation of a computer-adaptive test (CAT) for assessing health-related quality of life in children and adolescents in a clinical sample: study design, methods and first results of the Kids-CAT study0 avalidation of a computeradaptive test CAT for assessing healthre cMay a1105–11170 v263 aRecently, we developed a computer-adaptive test (CAT) for assessing health-related quality of life (HRQoL) in children and adolescents: the Kids-CAT. It measures five generic HRQoL dimensions. The aims of this article were (1) to present the study design and (2) to investigate its psychometric properties in a clinical setting.1 aBarthel, D.1 aOtto, C.1 aNolte, S.1 aMeyrose, A.-K.1 aFischer, F.1 aDevine, J.1 aWalter, O.1 aMierke, A.1 aFischer, K., I.1 aThyen, U.1 aKlein, M.1 aAnkermann, T.1 aRose, M1 aRavens-Sieberer, U. uhttps://doi.org/10.1007/s11136-016-1437-901678nas a2200145 4500008003900000245012000039210006900159300001200228490000700240520117900247100001501426700002001441700001801461856005301479 2016 d00aExploration of Item Selection in Dual-Purpose Cognitive Diagnostic Computerized Adaptive Testing: Based on the RRUM0 aExploration of Item Selection in DualPurpose Cognitive Diagnosti a625-6400 v403 aCognitive diagnostic computerized adaptive testing (CD-CAT) can be divided into two broad categories: (a) single-purpose tests, which are based on the subject’s knowledge state (KS) alone, and (b) dual-purpose tests, which are based on both the subject’s KS and traditional ability level ( ). This article seeks to identify the most efficient item selection method for the latter type of CD-CAT corresponding to various conditions and various evaluation criteria, respectively, based on the reduced reparameterized unified model (RRUM) and the two-parameter logistic model of item response theory (IRT-2PLM). The Shannon entropy (SHE) and Fisher information methods were combined to produce a new synthetic item selection index, that is, the “dapperness with information (DWI)” index, which concurrently considers both KS and within one step. The new method was compared with four other methods. The results showed that, in most conditions, the new method exhibited the best performance in terms of KS estimation and the second-best performance in terms of estimation. Item utilization uniformity and computing time are also considered for all the competing methods.1 aDai, Buyun1 aZhang, Minqiang1 aLi, Guangming uhttp://apm.sagepub.com/content/40/8/625.abstract01608nas a2200169 4500008003900000022001400039245009800053210006900151300001200220490000700232520108900239100001601328700001601344700001901360700001801379856004101397 2016 d a1745-398400aHybrid Computerized Adaptive Testing: From Group Sequential Design to Fully Sequential Design0 aHybrid Computerized Adaptive Testing From Group Sequential Desig a45–620 v533 aComputerized adaptive testing (CAT) and multistage testing (MST) have become two of the most popular modes in large-scale computer-based sequential testing.  Though most designs of CAT and MST exhibit strength and weakness in recent large-scale implementations, there is no simple answer to the question of which design is better because different modes may fit different practical situations. This article proposes a hybrid adaptive framework to combine both CAT and MST, inspired by an analysis of the history of CAT and MST. The proposed procedure is a design which transitions from a group sequential design to a fully sequential design. This allows for the robustness of MST in early stages, but also shares the advantages of CAT in later stages with fine tuning of the ability estimator once its neighborhood has been identified. Simulation results showed that hybrid designs following our proposed principles provided comparable or even better estimation accuracy and efficiency than standard CAT and MST designs, especially for examinees at the two ends of the ability range.1 aWang, Shiyu1 aLin, Haiyan1 aChang, Hua-Hua1 aDouglas, Jeff uhttp://dx.doi.org/10.1111/jedm.1210001510nas a2200145 4500008003900000245008500039210006900124300001200193490000700205520103200212100001901244700002301263700002501286856005301311 2015 d00aNew Item Selection Methods for Cognitive Diagnosis Computerized Adaptive Testing0 aNew Item Selection Methods for Cognitive Diagnosis Computerized  a167-1880 v393 aThis article introduces two new item selection methods, the modified posterior-weighted Kullback–Leibler index (MPWKL) and the generalized deterministic inputs, noisy “and” gate (G-DINA) model discrimination index (GDI), that can be used in cognitive diagnosis computerized adaptive testing. The efficiency of the new methods is compared with the posterior-weighted Kullback–Leibler (PWKL) item selection index using a simulation study in the context of the G-DINA model. The impact of item quality, generating models, and test termination rules on attribute classification accuracy or test length is also investigated. The results of the study show that the MPWKL and GDI perform very similarly, and have higher correct attribute classification rates or shorter mean test lengths compared with the PWKL. In addition, the GDI has the shortest implementation time among the three indices. The proportion of item usage with respect to the required attributes across the different conditions is also tracked and discussed.1 aKaplan, Mehmet1 ade la Torre, Jimmy1 aBarrada, Juan Ramón uhttp://apm.sagepub.com/content/39/3/167.abstract01689nas a2200145 4500008003900000245007800039210006900117300001200186490000700198520124300205100001201448700001301460700001701473856005301490 2014 d00aA Comparison of Four Item-Selection Methods for Severely Constrained CATs0 aComparison of Four ItemSelection Methods for Severely Constraine a677-6960 v743 a

This study compared four item-selection procedures developed for use with severely constrained computerized adaptive tests (CATs). Severely constrained CATs refer to those adaptive tests that seek to meet a complex set of constraints that are often not conclusive to each other (i.e., an item may contribute to the satisfaction of several constraints at the same time). The procedures examined in the study included the weighted deviation model (WDM), the weighted penalty model (WPM), the maximum priority index (MPI), and the shadow test approach (STA). In addition, two modified versions of the MPI procedure were introduced to deal with an edge case condition that results in the item selection procedure becoming dysfunctional during a test. The results suggest that the STA worked best among all candidate methods in terms of measurement accuracy and constraint management. For the other three heuristic approaches, they did not differ significantly in measurement accuracy and constraint management at the lower bound level. However, the WPM method appears to perform considerably better in overall constraint management than either the WDM or MPI method. Limitations and future research directions were also discussed.

1 aHe, Wei1 aDiao, Qi1 aHauser, Carl uhttp://epm.sagepub.com/content/74/4/677.abstract01425nas a2200157 4500008003900000245009200039210006900131300001200200490000700212520092000219100002001139700001601159700001801175700002101193856005301214 2014 d00aEnhancing Pool Utilization in Constructing the Multistage Test Using Mixed-Format Tests0 aEnhancing Pool Utilization in Constructing the Multistage Test U a268-2800 v383 a

This study investigated a new pool utilization method of constructing multistage tests (MST) using the mixed-format test based on the generalized partial credit model (GPCM). MST simulations of a classification test were performed to evaluate the MST design. A linear programming (LP) model was applied to perform MST reassemblies based on the initial MST construction. Three subsequent MST reassemblies were performed. For each reassembly, three test unit replacement ratios (TRRs; 0.22, 0.44, and 0.66) were investigated. The conditions of the three passing rates (30%, 50%, and 70%) were also considered in the classification testing. The results demonstrated that various MST reassembly conditions increased the overall pool utilization rates, while maintaining the desired MST construction. All MST testing conditions performed equally well in terms of the precision of the classification decision.

1 aPark, Ryoungsun1 aKim, Jiseon1 aChung, Hyewon1 aDodd, Barbara, G uhttp://apm.sagepub.com/content/38/4/268.abstract00504nas a2200133 4500008003900000245011400039210006900153300001200222490000700234100001900241700001800260700002400278856006800302 2013 d00aA Comparison of Exposure Control Procedures in CAT Systems Based on Different Measurement Models for Testlets0 aComparison of Exposure Control Procedures in CAT Systems Based o a113-1350 v261 aBoyd, Aimee, M1 aDodd, Barbara1 aFitzpatrick, Steven uhttp://www.tandfonline.com/doi/abs/10.1080/08957347.2013.76543401640nas a2200157 4500008003900000245007600039210006900115300001200184490000700196520114800203100002301351700001801374700001601392700002101408856005301429 2013 d00aA Comparison of Exposure Control Procedures in CATs Using the 3PL Model0 aComparison of Exposure Control Procedures in CATs Using the 3PL  a857-8740 v733 a

This study compares the progressive-restricted standard error (PR-SE) exposure control procedure to three commonly used procedures in computerized adaptive testing, the randomesque, Sympson–Hetter (SH), and no exposure control methods. The performance of these four procedures is evaluated using the three-parameter logistic model under the manipulated conditions of item pool size (small vs. large) and stopping rules (fixed-length vs. variable-length). PR-SE provides the advantage of similar constraints to SH, without the need for a preceding simulation study to execute it. Overall for the large and small item banks, the PR-SE method administered almost all of the items from the item pool, whereas the other procedures administered about 52% or less of the large item bank and 80% or less of the small item bank. The PR-SE yielded the smallest amount of item overlap between tests across conditions and administered fewer items on average than SH. PR-SE obtained these results with similar, and acceptable, measurement precision compared to the other exposure control procedures while vastly improving on item pool usage.

1 aLeroux, Audrey, J.1 aLopez, Myriam1 aHembry, Ian1 aDodd, Barbara, G uhttp://epm.sagepub.com/content/73/5/857.abstract01409nas a2200157 4500008003900000245009300039210006900132300001000201490000700211520091300218100002301131700001501154700001701169700001301186856005201199 2013 d00aThe Influence of Item Calibration Error on Variable-Length Computerized Adaptive Testing0 aInfluence of Item Calibration Error on VariableLength Computeriz a24-400 v373 a

Variable-length computerized adaptive testing (VL-CAT) allows both items and test length to be “tailored” to examinees, thereby achieving the measurement goal (e.g., scoring precision or classification) with as few items as possible. Several popular test termination rules depend on the standard error of the ability estimate, which in turn depends on the item parameter values. However, items are chosen on the basis of their parameter estimates, and capitalization on chance may occur. In this article, the authors investigated the effects of capitalization on chance on test length and classification accuracy in several VL-CAT simulations. The results confirm that capitalization on chance occurs in VL-CAT and has complex effects on test length, ability estimation, and classification accuracy. These results have important implications for the design and implementation of VL-CATs.

1 aPatton, Jeffrey, M1 aYing Cheng1 aYuan, Ke-Hai1 aDiao, Qi uhttp://apm.sagepub.com/content/37/1/24.abstract01277nas a2200133 4500008003900000245006600039210006500105300001200170490000700182520086900189100001301058700001901071856005301090 2013 d00aIntegrating Test-Form Formatting Into Automated Test Assembly0 aIntegrating TestForm Formatting Into Automated Test Assembly a361-3740 v373 a

Automated test assembly uses the methodology of mixed integer programming to select an optimal set of items from an item bank. Automated test-form generation uses the same methodology to optimally order the items and format the test form. From an optimization point of view, production of fully formatted test forms directly from the item pool using a simultaneous optimization model is more attractive than any of the current, more time-consuming two-stage processes. The goal of this study was to provide such simultaneous models both for computer-delivered and paper forms, as well as explore their performances relative to two-stage optimization. Empirical examples are presented to show that it is possible to automatically produce fully formatted optimal test forms directly from item pools up to some 2,000 items on a regular PC in realistic times.

1 aDiao, Qi1 aLinden, Wim, J uhttp://apm.sagepub.com/content/37/5/361.abstract01630nas a2200157 4500008003900000245010100039210006900140300001200209490000700221520111200228100001501340700001601355700001901371700002501390856005701415 2013 d00aA Semiparametric Model for Jointly Analyzing Response Times and Accuracy in Computerized Testing0 aSemiparametric Model for Jointly Analyzing Response Times and Ac a381-4170 v383 a

The item response times (RTs) collected from computerized testing represent an underutilized type of information about items and examinees. In addition to knowing the examinees’ responses to each item, we can investigate the amount of time examinees spend on each item. Current models for RTs mainly focus on parametric models, which have the advantage of conciseness, but may suffer from reduced flexibility to fit real data. We propose a semiparametric approach, specifically, the Cox proportional hazards model with a latent speed covariate to model the RTs, embedded within the hierarchical framework proposed by van der Linden to model the RTs and response accuracy simultaneously. This semiparametric approach combines the flexibility of nonparametric modeling and the brevity and interpretability of the parametric modeling. A Markov chain Monte Carlo method for parameter estimation is given and may be used with sparse data obtained by computerized adaptive testing. Both simulation studies and real data analysis are carried out to demonstrate the applicability of the new model.

1 aWang, Chun1 aFan, Zhewen1 aChang, Hua-Hua1 aDouglas, Jeffrey, A. uhttp://jeb.sagepub.com/cgi/content/abstract/38/4/38101744nas a2200145 4500008003900000245009400039210006900133300001200202490000700214520125900221100001901480700002501499700002101524856005301545 2012 d00aBalancing Flexible Constraints and Measurement Precision in Computerized Adaptive Testing0 aBalancing Flexible Constraints and Measurement Precision in Comp a629-6480 v723 a

Managing test specifications—both multiple nonstatistical constraints and flexibly defined constraints—has become an important part of designing item selection procedures for computerized adaptive tests (CATs) in achievement testing. This study compared the effectiveness of three procedures: constrained CAT, flexible modified constrained CAT, and the weighted penalty model in balancing multiple flexible constraints and maximizing measurement precision in a fixed-length CAT. The study also addressed the effect of two different test lengths—25 items and 50 items—and of including or excluding the randomesque item exposure control procedure with the three methods, all of which were found effective in selecting items that met flexible test constraints when used in the item selection process for longer tests. When the randomesque method was included to control for item exposure, the weighted penalty model and the flexible modified constrained CAT models performed better than did the constrained CAT procedure in maintaining measurement precision. When no item exposure control method was used in the item selection process, no practical difference was found in the measurement precision of each balancing method.

1 aMoyer, Eric, L1 aGalindo, Jennifer, L1 aDodd, Barbara, G uhttp://epm.sagepub.com/content/72/4/629.abstract01906nas a2200133 4500008003900000245013200039210006900171300001200240490000700252520142100259100001801680700002101698856005301719 2012 d00aComparison of Exposure Controls, Item Pool Characteristics, and Population Distributions for CAT Using the Partial Credit Model0 aComparison of Exposure Controls Item Pool Characteristics and Po a159-1750 v723 a

This study investigated item exposure control procedures under various combinations of item pool characteristics and ability distributions in computerized adaptive testing based on the partial credit model. Three variables were manipulated: item pool characteristics (120 items for each of easy, medium, and hard item pools), two ability distributions (normally distributed and negatively skewed data), and three exposure control procedures (randomesque procedure, progressive–restricted procedure, and maximum information procedure). A number of measurement precision indexes such as descriptive statistics, correlations between known and estimated ability levels, bias, root mean squared error, and average absolute difference, exposure rates, item usage, and item overlap were computed to assess the impact of matched or nonmatched item pool and ability distributions on the accuracy of ability estimation and the performance of exposure control procedures. As expected, the medium item pool produced better precision of measurement than both the easy and hard item pools. The progressive–restricted procedure performed better in terms of maximum exposure rates, item average overlap, and pool utilization than both the randomesque procedure and the maximum information procedure. The easy item pool with the negatively skewed data as a mismatched condition produced the worst performance.

1 aLee, HwaYoung1 aDodd, Barbara, G uhttp://epm.sagepub.com/content/72/1/159.abstract00442nas a2200121 4500008003900000245008600039210006900125300001200194490000700206100001800213700002100231856006800252 2012 d00aItem Selection and Ability Estimation Procedures for a Mixed-Format Adaptive Test0 aItem Selection and Ability Estimation Procedures for a MixedForm a305-3260 v251 aHo, Tsung-Han1 aDodd, Barbara, G uhttp://www.tandfonline.com/doi/abs/10.1080/08957347.2012.71468601421nas a2200157 4500008003900000245008000039210006900119300001200188490000700200520092800207100001601135700001801151700002101169700002001190856005301210 2012 d00aPanel Design Variations in the Multistage Test Using the Mixed-Format Tests0 aPanel Design Variations in the Multistage Test Using the MixedFo a574-5880 v723 a

This study compared various panel designs of the multistage test (MST) using mixed-format tests in the context of classification testing. Simulations varied the design of the first-stage module. The first stage was constructed according to three levels of test information functions (TIFs) with three different TIF centers. Additional computerized adaptive test (CAT) conditions provided baseline comparisons. Three passing rate conditions were also included. The various MST conditions using mixed-format tests were constructed properly and performed well. When the levels of TIFs at the first stage were higher, the simulations produced a greater number of correct classifications. CAT with the randomesque-10 procedure yielded comparable results to the MST with increased levels of TIFs. Finally, all MST conditions achieved better test security results compared with CAT’s maximum information conditions.

1 aKim, Jiseon1 aChung, Hyewon1 aDodd, Barbara, G1 aPark, Ryoungsun uhttp://epm.sagepub.com/content/72/4/574.abstract00922nas a2200121 4500008003900000245007500039210006900114300001200183490000700195520052700202100001800729856005300747 2012 d00aThe Problem of Bias in Person Parameter Estimation in Adaptive Testing0 aProblem of Bias in Person Parameter Estimation in Adaptive Testi a255-2700 v363 a

It is shown that deviations of estimated from true values of item difficulty parameters, caused for example by item calibration errors, the neglect of randomness of item difficulty parameters, testlet effects, or rule-based item generation, can lead to systematic bias in point estimation of person parameters in the context of adaptive testing. This effect occurs even when the errors of the item difficulty parameters are themselves unbiased. Analytical calculations as well as simulation studies are discussed.

1 aDoebler, Anna uhttp://apm.sagepub.com/content/36/4/255.abstract01222nas a2200157 4500008003900000245013900039210006900178300001200247490000700259520066600266100002100932700001900953700001500972700002400987856005301011 2012 d00aOn the Reliability and Validity of a Numerical Reasoning Speed Dimension Derived From Response Times Collected in Computerized Testing0 aReliability and Validity of a Numerical Reasoning Speed Dimensio a245-2630 v723 a

Data from 181 college students were used to assess whether math reasoning item response times in computerized testing can provide valid and reliable measures of a speed dimension. The alternate forms reliability of the speed dimension was .85. A two-dimensional structural equation model suggests that the speed dimension is related to the accuracy of speeded responses. Speed factor scores were significantly correlated with performance on the ACT math scale. Results suggest that the speed dimension underlying response times can be reliably measured and that the dimension is related to the accuracy of performance under the pressure of time limits.

1 aDavison, Mark, L1 aSemmes, Robert1 aHuang, Lan1 aClose, Catherine, N uhttp://epm.sagepub.com/content/72/2/245.abstract00770nas a2200145 4500008004100000245005700041210005700098260001200155520031700167653001500484100001700499700001300516700001900529856007600548 2011 eng d00aImpact of Item Drift on Candidate Ability Estimation0 aImpact of Item Drift on Candidate Ability Estimation c10/20113 a

For large operational pools, candidate ability estimates appear robust to item drift, especially under conditions that may represent ‘normal’ amounts of drift. Even with ‘extreme’ conditions of drift (e.g., 20% of items drifting 1.00 logits), decision consistency was still high.

10aitem drift1 aHagge, Sarah1 aWoo, Ada1 aDickison, Phil uhttp://iacat.org/content/impact-item-drift-candidate-ability-estimation01203nas a2200145 4500008003900000245005800039210005600097300001000153490000700163520077300170100001900943700002200962700002100984856005201005 2011 d00aA New Stopping Rule for Computerized Adaptive Testing0 aNew Stopping Rule for Computerized Adaptive Testing a37-530 v713 a

The goal of the current study was to introduce a new stopping rule for computerized adaptive testing (CAT). The predicted standard error reduction (PSER) stopping rule uses the predictive posterior variance to determine the reduction in standard error that would result from the administration of additional items. The performance of the PSER was compared with that of the minimum standard error stopping rule and a modified version of the minimum information stopping rule in a series of simulated adaptive tests, drawn from a number of item pools. Results indicate that the PSER makes efficient use of CAT item pools, administering fewer items when predictive gains in information are small and increasing measurement precision when information is abundant.

1 aChoi, Seung, W1 aGrady, Matthew, W1 aDodd, Barbara, G uhttp://epm.sagepub.com/content/71/1/37.abstract02116nas a2200193 4500008004100000245007900041210006900120260001200189520146800201653002801669653000801697653001801705100002001723700001701743700002301760700002301783700002301806856009301829 2011 eng d00aThe Use of Decision Trees for Adaptive Item Selection and Score Estimation0 aUse of Decision Trees for Adaptive Item Selection and Score Esti c10/20113 a

Conducted post-hoc simulations comparing the relative efficiency, and precision of decision trees (using CHAID and CART) vs. IRT-based CAT.

Conclusions

Decision tree methods were more efficient than CAT

But,...

Conclusions

CAT selects items based on two criteria: Item location relative to current estimate of theta, Item discrimination

Decision Trees select items that best discriminate between groups defined by the total score.

CAT is optimal only when trait level is well estimated.
Findings suggest that combining decision tree followed by CAT item selection may be advantageous.

10aadaptive item selection10aCAT10adecision tree1 aRiley, Barth, B1 aFunk, Rodney1 aDennis, Michael, L1 aLennox, Richard, D1 aFinkelman, Matthew uhttp://iacat.org/content/use-decision-trees-adaptive-item-selection-and-score-estimation01763nas a2200157 4500008004100000020002300041245020500064210006900269300001200338490000700350520108200357100001501439700001601454700001601470856011901486 2010 eng d a0146-62161552-349700aA comparison of content-balancing procedures for estimating multiple clinical domains in computerized adaptive testing: Relative precision, validity, and detection of persons with misfitting responses0 acomparison of contentbalancing procedures for estimating multipl a410-4230 v343 aThis simulation study sought to compare four different computerized adaptive testing (CAT) content-balancing procedures designed for use in a multidimensional assessment with respect to measurement precision, symptom severity classification, validity of clinical diagnostic recommendations, and sensitivity to atypical responding. The four content-balancing procedures were (a) no content balancing, (b) screener-based, (c) mixed (screener plus content balancing), and (d) full content balancing. In full content balancing and in mixed content balancing following administration of the screener items, item selection was based on (a) whether the target numberof items for the item’s subscale was reached and (b) the item’s information function. Mixed and full content balancing provided the best representation of items from each of the main subscales of the Internal Mental Distress Scale. These procedures also resulted in higher CAT to full-scale correlations for the Trauma and Homicidal/Suicidal Thought subscales and improved detection of atypical responding.Keywords1 aRiley, B B1 aDennis, M L1 aConrad, K J uhttp://iacat.org/content/comparison-content-balancing-procedures-estimating-multiple-clinical-domains-computerized01688nas a2200145 4500008003900000245020500039210006900244300001200313490000700325520109200332100002001424700002301444700002201467856005301489 2010 d00aA Comparison of Content-Balancing Procedures for Estimating Multiple Clinical Domains in Computerized Adaptive Testing: Relative Precision, Validity, and Detection of Persons With Misfitting Responses0 aComparison of ContentBalancing Procedures for Estimating Multipl a410-4230 v343 a

This simulation study sought to compare four different computerized adaptive testing (CAT) content-balancing procedures designed for use in a multidimensional assessment with respect to measurement precision, symptom severity classification, validity of clinical diagnostic recommendations, and sensitivity to atypical responding. The four content-balancing procedures were (a) no content balancing, (b) screener-based, (c) mixed (screener plus content balancing), and (d) full content balancing. In full content balancing and in mixed content balancing following administration of the screener items, item selection was based on (a) whether the target number of items for the item’s subscale was reached and (b) the item’s information function. Mixed and full content balancing provided the best representation of items from each of the main subscales of the Internal Mental Distress Scale. These procedures also resulted in higher CAT to full-scale correlations for the Trauma and Homicidal/Suicidal Thought subscales and improved detection of atypical responding.

1 aRiley, Barth, B1 aDennis, Michael, L1 aConrad, Kendon, J uhttp://apm.sagepub.com/content/34/6/410.abstract01176nas a2200145 4500008003900000245005900039210005700098300001200155490000700167520073700174100002200911700002100933700002300954856005300977 2010 d00aA Comparison of Item Selection Techniques for Testlets0 aComparison of Item Selection Techniques for Testlets a424-4370 v343 a

This study examined the performance of the maximum Fisher’s information, the maximum posterior weighted information, and the minimum expected posterior variance methods for selecting items in a computerized adaptive testing system when the items were grouped in testlets. A simulation study compared the efficiency of ability estimation among the item selection techniques under varying conditions of local-item dependency when the response model was either the three-parameter-logistic item response theory or the three-parameter-logistic testlet response theory. The item selection techniques performed similarly within any particular condition, the practical implications of which are discussed within the article.

1 aMurphy, Daniel, L1 aDodd, Barbara, G1 aVaughn, Brandon, K uhttp://apm.sagepub.com/content/34/6/424.abstract03099nas a2200445 4500008004100000020004100041245012000082210006900202250001500271260001000286300001100296490000700307520175400314653003802068653002102106653001002127653000902137653002202146653002802168653003302196653001102229653001102240653000902251653001602260653001802276653001902294653003102313653003102344653001602375100001602391700001002407700001402417700001502431700001402446700001502460700001802475700002402493700001802517856011802535 2010 eng d a0161-8105 (Print)0161-8105 (Linking)00aDevelopment and validation of patient-reported outcome measures for sleep disturbance and sleep-related impairments0 aDevelopment and validation of patientreported outcome measures f a2010/06/17 cJun 1 a781-920 v333 aSTUDY OBJECTIVES: To develop an archive of self-report questions assessing sleep disturbance and sleep-related impairments (SRI), to develop item banks from this archive, and to validate and calibrate the item banks using classic validation techniques and item response theory analyses in a sample of clinical and community participants. DESIGN: Cross-sectional self-report study. SETTING: Academic medical center and participant homes. PARTICIPANTS: One thousand nine hundred ninety-three adults recruited from an Internet polling sample and 259 adults recruited from medical, psychiatric, and sleep clinics. INTERVENTIONS: None. MEASUREMENTS AND RESULTS: This study was part of PROMIS (Patient-Reported Outcomes Information System), a National Institutes of Health Roadmap initiative. Self-report item banks were developed through an iterative process of literature searches, collecting and sorting items, expert content review, qualitative patient research, and pilot testing. Internal consistency, convergent validity, and exploratory and confirmatory factor analysis were examined in the resulting item banks. Factor analyses identified 2 preliminary item banks, sleep disturbance and SRI. Item response theory analyses and expert content review narrowed the item banks to 27 and 16 items, respectively. Validity of the item banks was supported by moderate to high correlations with existing scales and by significant differences in sleep disturbance and SRI scores between participants with and without sleep disorders. CONCLUSIONS: The PROMIS sleep disturbance and SRI item banks have excellent measurement properties and may prove to be useful for assessing general aspects of sleep and SRI with various groups of patients and interventions.10a*Outcome Assessment (Health Care)10a*Self Disclosure10aAdult10aAged10aAged, 80 and over10aCross-Sectional Studies10aFactor Analysis, Statistical10aFemale10aHumans10aMale10aMiddle Aged10aPsychometrics10aQuestionnaires10aReproducibility of Results10aSleep Disorders/*diagnosis10aYoung Adult1 aBuysse, D J1 aYu, L1 aMoul, D E1 aGermain, A1 aStover, A1 aDodds, N E1 aJohnston, K L1 aShablesky-Cade, M A1 aPilkonis, P A uhttp://iacat.org/content/development-and-validation-patient-reported-outcome-measures-sleep-disturbance-and-sleep00410nas a2200133 4500008004100000245004600041210004600087300001200133100001800145700001600163700001300179700001700192856006700209 2010 eng d00aInnovative Items for Computerized Testing0 aInnovative Items for Computerized Testing a215-2301 aParshall, C G1 aHarmes, J C1 aDavey, T1 aPashley, P J uhttp://iacat.org/content/innovative-items-computerized-testing01295nas a2200181 4500008004100000020004100041245005800082210005600140250001500196260001000211300000900221490000700230520075600237100001400993700001501007700001401022856007701036 2010 Eng d a0013-1644 (Print)0013-1644 (Linking)00aA new stopping rule for computerized adaptive testing0 anew stopping rule for computerized adaptive testing a2011/02/01 cDec 1 a1-170 v703 aThe goal of the current study was to introduce a new stopping rule for computerized adaptive testing. The predicted standard error reduction stopping rule (PSER) uses the predictive posterior variance to determine the reduction in standard error that would result from the administration of additional items. The performance of the PSER was compared to that of the minimum standard error stopping rule and a modified version of the minimum information stopping rule in a series of simulated adaptive tests, drawn from a number of item pools. Results indicate that the PSER makes efficient use of CAT item pools, administering fewer items when predictive gains in information are small and increasing measurement precision when information is abundant.1 aChoi, S W1 aGrady, M W1 aDodd, B G uhttp://iacat.org/content/new-stopping-rule-computerized-adaptive-testing00515nas a2200133 4500008004100000245009400041210006900135300001200204490000700216100001200223700001400235700001600249856011600265 2010 Eng d00aStratified and maximum information item selection procedures in computer adaptive testing0 aStratified and maximum information item selection procedures in  a202-2260 v471 aDeng, H1 aAnsley, T1 aChang, H -H uhttp://iacat.org/content/stratified-and-maximum-information-item-selection-procedures-computer-adaptive-testing01719nas a2200157 4500008003900000022001400039245009400053210006900147300001400216490000700230520121600237100001401453700002001467700001901487856005501506 2010 d a1745-398400aStratified and Maximum Information Item Selection Procedures in Computer Adaptive Testing0 aStratified and Maximum Information Item Selection Procedures in  a202–2260 v473 a

In this study we evaluated and compared three item selection procedures: the maximum Fisher information procedure (F), the a-stratified multistage computer adaptive testing (CAT) (STR), and a refined stratification procedure that allows more items to be selected from the high a strata and fewer items from the low a strata (USTR), along with completely random item selection (RAN). The comparisons were with respect to error variances, reliability of ability estimates and item usage through CATs simulated under nine test conditions of various practical constraints and item selection space. The results showed that F had an apparent precision advantage over STR and USTR under unconstrained item selection, but with very poor item usage. USTR reduced error variances for STR under various conditions, with small compromises in item usage. Compared to F, USTR enhanced item usage while achieving comparable precision in ability estimates; it achieved a precision level similar to F with improved item usage when items were selected under exposure control and with limited item selection space. The results provide implications for choosing an appropriate item selection procedure in applied settings.

1 aDeng, Hui1 aAnsley, Timothy1 aChang, Hua-Hua uhttp://dx.doi.org/10.1111/j.1745-3984.2010.00109.x02753nas a2200241 4500008004100000020004600041245009400087210006900181250001500250300000800265490000600273520198300279100001502262700001602277700001402293700001302307700002002320700001902340700001702359700001302376700001402389856010802403 2010 eng d a1477-7525 (Electronic)1477-7525 (Linking)00aValidation of a computer-adaptive test to evaluate generic health-related quality of life0 aValidation of a computeradaptive test to evaluate generic health a2010/12/07 a1470 v83 aBACKGROUND: Health Related Quality of Life (HRQoL) is a relevant variable in the evaluation of health outcomes. Questionnaires based on Classical Test Theory typically require a large number of items to evaluate HRQoL. Computer Adaptive Testing (CAT) can be used to reduce tests length while maintaining and, in some cases, improving accuracy. This study aimed at validating a CAT based on Item Response Theory (IRT) for evaluation of generic HRQoL: the CAT-Health instrument. METHODS: Cross-sectional study of subjects aged over 18 attending Primary Care Centres for any reason. CAT-Health was administered along with the SF-12 Health Survey. Age, gender and a checklist of chronic conditions were also collected. CAT-Health was evaluated considering: 1) feasibility: completion time and test length; 2) content range coverage, Item Exposure Rate (IER) and test precision; and 3) construct validity: differences in the CAT-Health scores according to clinical variables and correlations between both questionnaires. RESULTS: 396 subjects answered CAT-Health and SF-12, 67.2% females, mean age (SD) 48.6 (17.7) years. 36.9% did not report any chronic condition. Median completion time for CAT-Health was 81 seconds (IQ range = 59-118) and it increased with age (p < 0.001). The median number of items administered was 8 (IQ range = 6-10). Neither ceiling nor floor effects were found for the score. None of the items in the pool had an IER of 100% and it was over 5% for 27.1% of the items. Test Information Function (TIF) peaked between levels -1 and 0 of HRQoL. Statistically significant differences were observed in the CAT-Health scores according to the number and type of conditions. CONCLUSIONS: Although domain-specific CATs exist for various areas of HRQoL, CAT-Health is one of the first IRT-based CATs designed to evaluate generic HRQoL and it has proven feasible, valid and efficient, when administered to a broad sample of individuals attending primary care settings.1 aRebollo, P1 aCastejon, I1 aCuervo, J1 aVilla, G1 aGarcia-Cueto, E1 aDiaz-Cuervo, H1 aZardain, P C1 aMuniz, J1 aAlonso, J uhttp://iacat.org/content/validation-computer-adaptive-test-evaluate-generic-health-related-quality-life00574nas a2200109 4500008004100000245011400041210006900155260009700224100001200321700001500333856011600348 2009 eng d00aComparison of ability estimation and item selection methods in multidimensional computerized adaptive testing0 aComparison of ability estimation and item selection methods in m aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aDiao, Q1 aReckase, M uhttp://iacat.org/content/comparison-ability-estimation-and-item-selection-methods-multidimensional-computerized01651nas a2200157 4500008003900000245010700039210006900146300001000215490000700225520113900232100001501371700001901386700002101405700001501426856005201441 2009 d00aConstraint-Weighted a-Stratification for Computerized Adaptive Testing With Nonstatistical Constraints0 aConstraintWeighted aStratification for Computerized Adaptive Tes a35-490 v693 a

a-stratification is a method that utilizes items with small discrimination (a) parameters early in an exam and those with higher a values when more is learned about the ability parameter. It can achieve much better item usage than the maximum information criterion (MIC). To make a-stratification more practical and more widely applicable, a method for weighting the item selection process in a-stratification as a means of satisfying multiple test constraints is proposed. This method is studied in simulation against an analogous method without stratification as well as a-stratification using descending-rather than ascending-a procedures. In addition, a variation of a-stratification that allows for unbalanced usage of a parameters is included in the study to examine the trade-off between efficiency and exposure control. Finally, MIC and randomized item selection are included as baseline measures. Results indicate that the weighting mechanism successfully addresses the constraints, that stratification helps to a great extent balancing exposure rates, and that the ascending-a design improves measurement precision.

1 aYing Cheng1 aChang, Hua-Hua1 aDouglas, Jeffrey1 aFanmin Guo uhttp://epm.sagepub.com/content/69/1/35.abstract00614nas a2200145 4500008004100000245016200041210006900203300001000272490000700282100001300289700001900302700001500321700001100336856012100347 2009 eng d00aConstraint-weighted a-stratification for computerized adaptive testing with nonstatistical constraints: Balancing measurement efficiency and exposure control0 aConstraintweighted astratification for computerized adaptive tes a35-490 v691 aCheng, Y1 aChang, Hua-Hua1 aDouglas, J1 aGuo, F uhttp://iacat.org/content/constraint-weighted-stratification-computerized-adaptive-testing-nonstatistical-constraints01413nas a2200121 4500008003900000245009000039210006900129300001200198490000700210520100200217100001501219856005701234 2009 d00aA Knowledge-Based Approach for Item Exposure Control in Computerized Adaptive Testing0 aKnowledgeBased Approach for Item Exposure Control in Computerize a530-5580 v343 a

The purpose of this study is to investigate a functional relation between item exposure parameters (IEPs) and item parameters (IPs) over parallel pools. This functional relation is approximated by a well-known tool in machine learning. Let P and Q be parallel item pools and suppose IEPs for P have been obtained via a Sympson and Hetter–type simulation. Based on these simulated parameters, a functional relation k = fP (a, b, c) relating IPs to IEPs of P is obtained by an artificial neural network and used to estimate IEPs of Q without tedious simulation. Extensive experiments using real and synthetic pools showed that this approach worked pretty well for many variants of the Sympson and Hetter procedure. It worked excellently for the conditional Stocking and Lewis multinomial selection procedure and the Chen and Lei item exposure and test overlap control procedure. This study provides the first step in an alternative means to estimate IEPs without iterative simulation.

1 aDoong, S H uhttp://jeb.sagepub.com/cgi/content/abstract/34/4/53003143nas a2200457 4500008004100000020004100041245015500082210006900237250001500306260000800321300001200329490000700341520174100348653002502089653001902114653002502133653003002158653001502188653003602203653001002239653002102249653003302270653001102303653001102314653000902325653001802334653001702352653001902369653001602388100001502404700001002419700001502429700002502444700001802469700001702487700001602504700001602520700001402536700001602550856011902566 2009 eng d a0962-9343 (Print)0962-9343 (Linking)00aMeasuring global physical health in children with cerebral palsy: Illustration of a multidimensional bi-factor model and computerized adaptive testing0 aMeasuring global physical health in children with cerebral palsy a2009/02/18 cApr a359-3700 v183 aPURPOSE: The purposes of this study were to apply a bi-factor model for the determination of test dimensionality and a multidimensional CAT using computer simulations of real data for the assessment of a new global physical health measure for children with cerebral palsy (CP). METHODS: Parent respondents of 306 children with cerebral palsy were recruited from four pediatric rehabilitation hospitals and outpatient clinics. We compared confirmatory factor analysis results across four models: (1) one-factor unidimensional; (2) two-factor multidimensional (MIRT); (3) bi-factor MIRT with fixed slopes; and (4) bi-factor MIRT with varied slopes. We tested whether the general and content (fatigue and pain) person score estimates could discriminate across severity and types of CP, and whether score estimates from a simulated CAT were similar to estimates based on the total item bank, and whether they correlated as expected with external measures. RESULTS: Confirmatory factor analysis suggested separate pain and fatigue sub-factors; all 37 items were retained in the analyses. From the bi-factor MIRT model with fixed slopes, the full item bank scores discriminated across levels of severity and types of CP, and compared favorably to external instruments. CAT scores based on 10- and 15-item versions accurately captured the global physical health scores. CONCLUSIONS: The bi-factor MIRT CAT application, especially the 10- and 15-item versions, yielded accurate global physical health scores that discriminated across known severity groups and types of CP, and correlated as expected with concurrent measures. The CATs have potential for collecting complex data on the physical health of children with CP in an efficient manner.10a*Computer Simulation10a*Health Status10a*Models, Statistical10aAdaptation, Psychological10aAdolescent10aCerebral Palsy/*physiopathology10aChild10aChild, Preschool10aFactor Analysis, Statistical10aFemale10aHumans10aMale10aMassachusetts10aPennsylvania10aQuestionnaires10aYoung Adult1 aHaley, S M1 aNi, P1 aDumas, H M1 aFragala-Pinkham, M A1 aHambleton, RK1 aMontpetit, K1 aBilodeau, N1 aGorton, G E1 aWatson, K1 aTucker, C A uhttp://iacat.org/content/measuring-global-physical-health-children-cerebral-palsy-illustration-multidimensional-bi00540nas a2200121 4500008004100000245007000041210006900111260009700180100001200277700001900289700001500308856009500323 2009 eng d00aObtaining reliable diagnostic information through constrained CAT0 aObtaining reliable diagnostic information through constrained CA aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aWang, C1 aChang, Hua-Hua1 aDouglas, J uhttp://iacat.org/content/obtaining-reliable-diagnostic-information-through-constrained-cat03432nas a2200481 4500008004100000020004600041245013800087210006900225250001500294260000800309300001200317490000700329520191400336653002702250653002302277653003102300653001502331653001602346653001002362653002102372653002402393653002302417653003802440653001102478653002202489653001102511653001102522653000902533653003702542653002102579653003102600653002602631653001702657653003202674653001602706653002802722100001602750700001502766700001002781700001502791700002502806856011902831 2008 eng d a1532-821X (Electronic)0003-9993 (Linking)00aAssessing self-care and social function using a computer adaptive testing version of the pediatric evaluation of disability inventory0 aAssessing selfcare and social function using a computer adaptive a2008/04/01 cApr a622-6290 v893 aOBJECTIVE: To examine score agreement, validity, precision, and response burden of a prototype computer adaptive testing (CAT) version of the self-care and social function scales of the Pediatric Evaluation of Disability Inventory compared with the full-length version of these scales. DESIGN: Computer simulation analysis of cross-sectional and longitudinal retrospective data; cross-sectional prospective study. SETTING: Pediatric rehabilitation hospital, including inpatient acute rehabilitation, day school program, outpatient clinics; community-based day care, preschool, and children's homes. PARTICIPANTS: Children with disabilities (n=469) and 412 children with no disabilities (analytic sample); 38 children with disabilities and 35 children without disabilities (cross-validation sample). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Summary scores from prototype CAT applications of each scale using 15-, 10-, and 5-item stopping rules; scores from the full-length self-care and social function scales; time (in seconds) to complete assessments and respondent ratings of burden. RESULTS: Scores from both computer simulations and field administration of the prototype CATs were highly consistent with scores from full-length administration (r range, .94-.99). Using computer simulation of retrospective data, discriminant validity, and sensitivity to change of the CATs closely approximated that of the full-length scales, especially when the 15- and 10-item stopping rules were applied. In the cross-validation study the time to administer both CATs was 4 minutes, compared with over 16 minutes to complete the full-length scales. CONCLUSIONS: Self-care and social function score estimates from CAT administration are highly comparable with those obtained from full-length scale administration, with small losses in validity and precision and substantial decreases in administration time.10a*Disability Evaluation10a*Social Adjustment10aActivities of Daily Living10aAdolescent10aAge Factors10aChild10aChild, Preschool10aComputer Simulation10aCross-Over Studies10aDisabled Children/*rehabilitation10aFemale10aFollow-Up Studies10aHumans10aInfant10aMale10aOutcome Assessment (Health Care)10aReference Values10aReproducibility of Results10aRetrospective Studies10aRisk Factors10aSelf Care/*standards/trends10aSex Factors10aSickness Impact Profile1 aCoster, W J1 aHaley, S M1 aNi, P1 aDumas, H M1 aFragala-Pinkham, M A uhttp://iacat.org/content/assessing-self-care-and-social-function-using-computer-adaptive-testing-version-pediatric03309nas a2200433 4500008004100000020004600041245007700087210006900164250001500233260001100248300001200259490000700271520203200278653002702310653003002337653002102367653001002388653000902398653001502407653003602422653002102458653004402479653002402523653001102547653001102558653001302569653000902582653001602591653003002607653003002637653003102667100001502698700001302713700001502726700001402741700001502755700001402770856009102784 2008 eng d a1528-1159 (Electronic)0362-2436 (Linking)00aComputerized adaptive testing in back pain: Validation of the CAT-5D-QOL0 aComputerized adaptive testing in back pain Validation of the CAT a2008/05/23 cMay 20 a1384-900 v333 aSTUDY DESIGN: We have conducted an outcome instrument validation study. OBJECTIVE: Our objective was to develop a computerized adaptive test (CAT) to measure 5 domains of health-related quality of life (HRQL) and assess its feasibility, reliability, validity, and efficiency. SUMMARY OF BACKGROUND DATA: Kopec and colleagues have recently developed item response theory based item banks for 5 domains of HRQL relevant to back pain and suitable for CAT applications. The domains are Daily Activities (DAILY), Walking (WALK), Handling Objects (HAND), Pain or Discomfort (PAIN), and Feelings (FEEL). METHODS: An adaptive algorithm was implemented in a web-based questionnaire administration system. The questionnaire included CAT-5D-QOL (5 scales), Modified Oswestry Disability Index (MODI), Roland-Morris Disability Questionnaire (RMDQ), SF-36 Health Survey, and standard clinical and demographic information. Participants were outpatients treated for mechanical back pain at a referral center in Vancouver, Canada. RESULTS: A total of 215 patients completed the questionnaire and 84 completed a retest. On average, patients answered 5.2 items per CAT-5D-QOL scale. Reliability ranged from 0.83 (FEEL) to 0.92 (PAIN) and was 0.92 for the MODI, RMDQ, and Physical Component Summary (PCS-36). The ceiling effect was 0.5% for PAIN compared with 2% for MODI and 5% for RMQ. The CAT-5D-QOL scales correlated as anticipated with other measures of HRQL and discriminated well according to the level of satisfaction with current symptoms, duration of the last episode, sciatica, and disability compensation. The average relative discrimination index was 0.87 for PAIN, 0.67 for DAILY and 0.62 for WALK, compared with 0.89 for MODI, 0.80 for RMDQ, and 0.59 for PCS-36. CONCLUSION: The CAT-5D-QOL is feasible, reliable, valid, and efficient in patients with back pain. This methodology can be recommended for use in back pain research and should improve outcome assessment, facilitate comparisons across studies, and reduce patient burden.10a*Disability Evaluation10a*Health Status Indicators10a*Quality of Life10aAdult10aAged10aAlgorithms10aBack Pain/*diagnosis/psychology10aBritish Columbia10aDiagnosis, Computer-Assisted/*standards10aFeasibility Studies10aFemale10aHumans10aInternet10aMale10aMiddle Aged10aPredictive Value of Tests10aQuestionnaires/*standards10aReproducibility of Results1 aKopec, J A1 aBadii, M1 aMcKenna, M1 aLima, V D1 aSayre, E C1 aDvorak, M uhttp://iacat.org/content/computerized-adaptive-testing-back-pain-validation-cat-5d-qol00678nas a2200157 4500008004100000245017700041210006900218260003100287100001600318700001200334700001300346700001500359700001400374700001300388856011900401 2008 eng d00aDeveloping a progressive approach to using the GAIN in order to reduce the duration and cost of assessment with the GAIN short screener, Quick and computer adaptive testing0 aDeveloping a progressive approach to using the GAIN in order to  aWashington D.C., USAc20081 aDennis, M L1 aFunk, R1 aTitus, J1 aRiley, B B1 aHosman, S1 aKinne, S uhttp://iacat.org/content/developing-progressive-approach-using-gain-order-reduce-duration-and-cost-assessment-gain03228nas a2200397 4500008004100000020002700041245014200068210006900210250001500279260001100294300001200305490000700317520193600324653002702260653003002287653001002317653000902327653002202336653003602358653001602394653002402410653004402434653001102478653001602489653002602505653003002531653003002561653003102591100001302622700001402635700001502649700001402664700001702678700001502695856012002710 2008 eng d a1528-1159 (Electronic)00aLetting the CAT out of the bag: Comparing computer adaptive tests and an 11-item short form of the Roland-Morris Disability Questionnaire0 aLetting the CAT out of the bag Comparing computer adaptive tests a2008/05/23 cMay 20 a1378-830 v333 aSTUDY DESIGN: A post hoc simulation of a computer adaptive administration of the items of a modified version of the Roland-Morris Disability Questionnaire. OBJECTIVE: To evaluate the effectiveness of adaptive administration of back pain-related disability items compared with a fixed 11-item short form. SUMMARY OF BACKGROUND DATA: Short form versions of the Roland-Morris Disability Questionnaire have been developed. An alternative to paper-and-pencil short forms is to administer items adaptively so that items are presented based on a person's responses to previous items. Theoretically, this allows precise estimation of back pain disability with administration of only a few items. MATERIALS AND METHODS: Data were gathered from 2 previously conducted studies of persons with back pain. An item response theory model was used to calibrate scores based on all items, items of a paper-and-pencil short form, and several computer adaptive tests (CATs). RESULTS: Correlations between each CAT condition and scores based on a 23-item version of the Roland-Morris Disability Questionnaire ranged from 0.93 to 0.98. Compared with an 11-item short form, an 11-item CAT produced scores that were significantly more highly correlated with scores based on the 23-item scale. CATs with even fewer items also produced scores that were highly correlated with scores based on all items. For example, scores from a 5-item CAT had a correlation of 0.93 with full scale scores. Seven- and 9-item CATs correlated at 0.95 and 0.97, respectively. A CAT with a standard-error-based stopping rule produced scores that correlated at 0.95 with full scale scores. CONCLUSION: A CAT-based back pain-related disability measure may be a valuable tool for use in clinical and research contexts. Use of CAT for other common measures in back pain research, such as other functional scales or measures of psychological distress, may offer similar advantages.10a*Disability Evaluation10a*Health Status Indicators10aAdult10aAged10aAged, 80 and over10aBack Pain/*diagnosis/psychology10aCalibration10aComputer Simulation10aDiagnosis, Computer-Assisted/*standards10aHumans10aMiddle Aged10aModels, Psychological10aPredictive Value of Tests10aQuestionnaires/*standards10aReproducibility of Results1 aCook, KF1 aChoi, S W1 aCrane, P K1 aDeyo, R A1 aJohnson, K L1 aAmtmann, D uhttp://iacat.org/content/letting-cat-out-bag-comparing-computer-adaptive-tests-and-11-item-short-form-roland-morris03424nas a2200385 4500008004100000020004100041245010600082210006900188250001500257260001200272300001000284490000700294520220300301653002702504653001502531653001002546653002102556653002402577653002802601653003802629653001102667653001102678653001102689653003902700653000902739653002402748653003102772653004002803100001802843700001502861700001302876700001702889700001402906856011802920 2008 eng d a0271-6798 (Print)0271-6798 (Linking)00aMeasuring physical functioning in children with spinal impairments with computerized adaptive testing0 aMeasuring physical functioning in children with spinal impairmen a2008/03/26 cApr-May a330-50 v283 aBACKGROUND: The purpose of this study was to assess the utility of measuring current physical functioning status of children with scoliosis and kyphosis by applying computerized adaptive testing (CAT) methods. Computerized adaptive testing uses a computer interface to administer the most optimal items based on previous responses, reducing the number of items needed to obtain a scoring estimate. METHODS: This was a prospective study of 77 subjects (0.6-19.8 years) who were seen by a spine surgeon during a routine clinic visit for progress spine deformity. Using a multidimensional version of the Pediatric Evaluation of Disability Inventory CAT program (PEDI-MCAT), we evaluated content range, accuracy and efficiency, known-group validity, concurrent validity with the Pediatric Outcomes Data Collection Instrument, and test-retest reliability in a subsample (n = 16) within a 2-week interval. RESULTS: We found the PEDI-MCAT to have sufficient item coverage in both self-care and mobility content for this sample, although most patients tended to score at the higher ends of both scales. Both the accuracy of PEDI-MCAT scores as compared with a fixed format of the PEDI (r = 0.98 for both mobility and self-care) and test-retest reliability were very high [self-care: intraclass correlation (3,1) = 0.98, mobility: intraclass correlation (3,1) = 0.99]. The PEDI-MCAT took an average of 2.9 minutes for the parents to complete. The PEDI-MCAT detected expected differences between patient groups, and scores on the PEDI-MCAT correlated in expected directions with scores from the Pediatric Outcomes Data Collection Instrument domains. CONCLUSIONS: Use of the PEDI-MCAT to assess the physical functioning status, as perceived by parents of children with complex spinal impairments, seems to be feasible and achieves accurate and efficient estimates of self-care and mobility function. Additional item development will be needed at the higher functioning end of the scale to avoid ceiling effects for older children. LEVEL OF EVIDENCE: This is a level II prospective study designed to establish the utility of computer adaptive testing as an evaluation method in a busy pediatric spine practice.10a*Disability Evaluation10aAdolescent10aChild10aChild, Preschool10aComputer Simulation10aCross-Sectional Studies10aDisabled Children/*rehabilitation10aFemale10aHumans10aInfant10aKyphosis/*diagnosis/rehabilitation10aMale10aProspective Studies10aReproducibility of Results10aScoliosis/*diagnosis/rehabilitation1 aMulcahey, M J1 aHaley, S M1 aDuffy, T1 aPengsheng, N1 aBetz, R R uhttp://iacat.org/content/measuring-physical-functioning-children-spinal-impairments-computerized-adaptive-testing01943nas a2200277 4500008004100000020004100041245007300082210006900155250001500224260000800239300001000247490000700257520099700264653001601261653002901277653004801306653006201354653001101416653002401427653004601451653003101497653001301528100001401541700001501555856009501570 2008 eng d a0007-1102 (Print)0007-1102 (Linking)00aPredicting item exposure parameters in computerized adaptive testing0 aPredicting item exposure parameters in computerized adaptive tes a2008/05/17 cMay a75-910 v613 aThe purpose of this study is to find a formula that describes the relationship between item exposure parameters and item parameters in computerized adaptive tests by using genetic programming (GP) - a biologically inspired artificial intelligence technique. Based on the formula, item exposure parameters for new parallel item pools can be predicted without conducting additional iterative simulations. Results show that an interesting formula between item exposure parameters and item parameters in a pool can be found by using GP. The item exposure parameters predicted based on the found formula were close to those observed from the Sympson and Hetter (1985) procedure and performed well in controlling item exposure rates. Similar results were observed for the Stocking and Lewis (1998) multinomial model for item selection and the Sympson and Hetter procedure with content balancing. The proposed GP approach has provided a knowledge-based solution for finding item exposure parameters.10a*Algorithms10a*Artificial Intelligence10aAptitude Tests/*statistics & numerical data10aDiagnosis, Computer-Assisted/*statistics & numerical data10aHumans10aModels, Statistical10aPsychometrics/statistics & numerical data10aReproducibility of Results10aSoftware1 aChen, S-Y1 aDoong, S H uhttp://iacat.org/content/predicting-item-exposure-parameters-computerized-adaptive-testing01828nas a2200229 4500008004100000020004100041245010800082210006900190250001500259300000900274490000600283520101700289653001601306653001501322653005701337653001101394653003001405653001801435100001401453700001401467856011701481 2008 eng d a1529-7713 (Print)1529-7713 (Linking)00aStrategies for controlling item exposure in computerized adaptive testing with the partial credit model0 aStrategies for controlling item exposure in computerized adaptiv a2008/01/09 a1-170 v93 aExposure control research with polytomous item pools has determined that randomization procedures can be very effective for controlling test security in computerized adaptive testing (CAT). The current study investigated the performance of four procedures for controlling item exposure in a CAT under the partial credit model. In addition to a no exposure control baseline condition, the Kingsbury-Zara, modified-within-.10-logits, Sympson-Hetter, and conditional Sympson-Hetter procedures were implemented to control exposure rates. The Kingsbury-Zara and the modified-within-.10-logits procedures were implemented with 3 and 6 item candidate conditions. The results show that the Kingsbury-Zara and modified-within-.10-logits procedures with 6 item candidates performed as well as the conditional Sympson-Hetter in terms of exposure rates, overlap rates, and pool utilization. These two procedures are strongly recommended for use with partial credit CATs due to their simplicity and strength of their results.10a*Algorithms10a*Computers10a*Educational Measurement/statistics & numerical data10aHumans10aQuestionnaires/*standards10aUnited States1 aDavis, LL1 aDodd, B G uhttp://iacat.org/content/strategies-controlling-item-exposure-computerized-adaptive-testing-partial-credit-model02406nas a2200193 4500008004100000020002200041245011700063210006900180250001500249300001100264490000600275520172700281100001502008700001702023700001602040700001802056700001802074856012002092 2008 eng d a1740-7745 (Print)00aUsing item banks to construct measures of patient reported outcomes in clinical trials: investigator perceptions0 aUsing item banks to construct measures of patient reported outco a2008/11/26 a575-860 v53 aBACKGROUND: Item response theory (IRT) promises more sensitive and efficient measurement of patient-reported outcomes (PROs) than traditional approaches; however, the selection and use of PRO measures from IRT-based item banks differ from current methods of using PRO measures. PURPOSE: To anticipate barriers to the adoption of IRT item banks into clinical trials. METHODS: We conducted semistructured telephone or in-person interviews with 42 clinical researchers who published results from clinical trials in the Journal of the American Medical Association, the New England Journal of Medicine, or other leading clinical journals from July 2005 through May 2006. Interviews included a brief tutorial on IRT item banks. RESULTS: After the tutorial, 39 of 42 participants understood the novel products available from an IRT item bank, namely customized short forms and computerized adaptive testing. Most participants (38/42) thought that item banks could be useful in their clinical trials, but they mentioned several potential barriers to adoption, including economic and logistical constraints, concerns about whether item banks are better than current PRO measures, concerns about how to convince study personnel or statisticians to use item banks, concerns about FDA or sponsor acceptance, and the lack of availability of item banks validated in specific disease populations. LIMITATIONS: Selection bias might have led to more positive responses to the concept of item banks in clinical trials. CONCLUSIONS: Clinical investigators are open to a new method of PRO measurement offered in IRT item banks, but bank developers must address investigator and stakeholder concerns before widespread adoption can be expected.1 aFlynn, K E1 aDombeck, C B1 aDeWitt, E M1 aSchulman, K A1 aWeinfurt, K P uhttp://iacat.org/content/using-item-banks-construct-measures-patient-reported-outcomes-clinical-trials-investigator00634nas a2200145 4500008004100000245009700041210006900138260009700207100001600304700001200320700001900332700001300351700001300364856011100377 2007 eng d00aDevelopment of a multiple-component CAT for measuring foreign language proficiency (SIMTEST)0 aDevelopment of a multiplecomponent CAT for measuring foreign lan aD. J. Weiss (Ed.). Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing.1 aSumbling, M1 aSanz, P1 aViladrich, M C1 aDoval, E1 aRiera, L uhttp://iacat.org/content/development-multiple-component-cat-measuring-foreign-language-proficiency-simtest00502nas a2200121 4500008004100000245006000041210006000101260009700161100001900258700000700277700001500284856008100299 2007 eng d00aPartial order knowledge structures for CAT applications0 aPartial order knowledge structures for CAT applications aD. J. Weiss (Ed.), Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing.1 aDesmarais, M C1 aPu1 aBlais, J-G uhttp://iacat.org/content/partial-order-knowledge-structures-cat-applications01718nas a2200169 4500008004100000245016600041210006900207300001000276490000600286520105700292653001501349100001501364700001601379700001701395700001601412856012001428 2007 eng d00aRelative precision, efficiency and construct validity of different starting and stopping rules for a computerized adaptive test: The GAIN Substance Problem Scale0 aRelative precision efficiency and construct validity of differen a48-650 v83 aSubstance abuse treatment programs are being pressed to measure and make clinical decisions more efficiently about an increasing array of problems. This computerized adaptive testing (CAT) simulation examined the relative efficiency, precision and construct validity of different starting and stopping rules used to shorten the Global Appraisal of Individual Needs’ (GAIN) Substance Problem Scale (SPS) and facilitate diagnosis based on it. Data came from 1,048 adolescents and adults referred to substance abuse treatment centers in 5 sites. CAT performance was evaluated using: (1) average standard errors, (2) average number of items, (3) bias in personmeasures, (4) root mean squared error of person measures, (5) Cohen’s kappa to evaluate CAT classification compared to clinical classification, (6) correlation between CAT and full-scale measures, and (7) construct validity of CAT classification vs. clinical classification using correlations with five theoretically associated instruments. Results supported both CAT efficiency and validity.10aMy article1 aRiley, B B1 aConrad, K J1 aBezruczko, N1 aDennis, M L uhttp://iacat.org/content/relative-precision-efficiency-and-construct-validity-different-starting-and-stopping-rules02038nas a2200253 4500008004100000020002200041245007400063210006900137250001500206300001100221490000700232520121000239653002201449653001101471653005501482653005101537100001501588700002001603700002301623700001801646700001301664700001701677856009001694 2007 eng d a0885-3924 (Print)00aA system for interactive assessment and management in palliative care0 asystem for interactive assessment and management in palliative c a2007/03/16 a745-550 v333 aThe availability of psychometrically sound and clinically relevant screening, diagnosis, and outcome evaluation tools is essential to high-quality palliative care assessment and management. Such data will enable us to improve patient evaluations, prognoses, and treatment selections, and to increase patient satisfaction and quality of life. To accomplish these goals, medical care needs more precise, efficient, and comprehensive tools for data acquisition, analysis, interpretation, and management. We describe a system for interactive assessment and management in palliative care (SIAM-PC), which is patient centered, model driven, database derived, evidence based, and technology assisted. The SIAM-PC is designed to reliably measure the multiple dimensions of patients' needs for palliative care, and then to provide information to clinicians, patients, and the patients' families to achieve optimal patient care, while improving our capacity for doing palliative care research. This system is innovative in its application of the state-of-the-science approaches, such as item response theory and computerized adaptive testing, to many of the significant clinical problems related to palliative care.10a*Needs Assessment10aHumans10aMedical Informatics/*organization & administration10aPalliative Care/*organization & administration1 aChang, C-H1 aBoni-Saenz, A A1 aDurazo-Arvizu, R A1 aDesHarnais, S1 aLau, D T1 aEmanuel, L L uhttp://iacat.org/content/system-interactive-assessment-and-management-palliative-care00372nas a2200097 4500008004100000245003400041210003400075260009700109100001500206856005300221 2007 eng d00aUse of CAT in dynamic testing0 aUse of CAT in dynamic testing aD. J. Weiss (Ed.), Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing.1 aDe Beer, M uhttp://iacat.org/content/use-cat-dynamic-testing00582nas a2200121 4500008004100000245011800041210006900159260006500228100001600293700001500309700001600324856012000340 2007 eng d00aThe use of computerized adaptive testing to assess psychopathology using the Global Appraisal of Individual Needs0 ause of computerized adaptive testing to assess psychopathology u aPortland, OR USAbAmerican Evaluation Association cNovember1 aConrad, K J1 aRiley, B B1 aDennis, M L uhttp://iacat.org/content/use-computerized-adaptive-testing-assess-psychopathology-using-global-appraisal-individual02399nas a2200241 4500008004100000020002200041245008500063210006900148260002500217300001200242490000700254520161500261653000801876653003401884653002601918653003001944653002601974100001402000700001402014700001602028700001502044856009802059 2006 eng d a0439-755X (Print)00aThe comparison among item selection strategies of CAT with multiple-choice items0 acomparison among item selection strategies of CAT with multiplec bScience Press: China a778-7830 v383 aThe initial purpose of comparing item selection strategies for CAT was to increase the efficiency of tests. As studies continued, however, it was found that increasing the efficiency of item bank using was also an important goal of comparing item selection strategies. These two goals often conflicted. The key solution was to find a strategy with which both goals could be accomplished. The item selection strategies for graded response model in this study included: the average of the difficulty orders matching with the ability; the medium of the difficulty orders matching with the ability; maximum information; A stratified (average); and A stratified (medium). The evaluation indexes used for comparison included: the bias of ability estimates for the true; the standard error of ability estimates; the average items which the examinees have administered; the standard deviation of the frequency of items selected; and sum of the indices weighted. Using the Monte Carlo simulation method, we obtained some data and computer iterated the data 20 times each under the conditions that the item difficulty parameters followed the normal distribution and even distribution. The results were as follows; The results indicated that no matter difficulty parameters followed the normal distribution or even distribution. Every type of item selection strategies designed in this research had its strong and weak points. In general evaluation, under the condition that items were stratified appropriately, A stratified (medium) (ASM) had the best effect. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aCAT10acomputerized adaptive testing10agraded response model10aitem selection strategies10amultiple choice items1 aHai-qi, D1 aDe-zhi, C1 aShuliang, D1 aTaiping, D uhttp://iacat.org/content/comparison-among-item-selection-strategies-cat-multiple-choice-items01466nas a2200205 4500008004100000245002700041210002600068260006000094300001100154490000800165520087300173653005101046653003001097653002001127653001801147653001301165100001501178700001501193856005201208 2006 eng d00aComputer-based testing0 aComputerbased testing aWashington D.C. USAbAmerican Psychological Association a87-1000 vxiv3 a(From the chapter) There has been a proliferation of research designed to explore and exploit opportunities provided by computer-based assessment. This chapter provides an overview of the diverse efforts by researchers in this area. It begins by describing how paper-and-pencil tests can be adapted for administration by computers. Computerization provides the important advantage that items can be selected so they are of appropriate difficulty for each examinee. Some of the psychometric theory needed for computerized adaptive testing is reviewed. Then research on innovative computerized assessments is summarized. These assessments go beyond multiple-choice items by using formats made possible by computerization. Then some hardware and software issues are described, and finally, directions for future work are outlined. (PsycINFO Database Record (c) 2006 APA )10aAdaptive Testing computerized adaptive testing10aComputer Assisted Testing10aExperimentation10aPsychometrics10aTheories1 aDrasgow, F1 aChuah, S C uhttp://iacat.org/content/computer-based-testing00425nas a2200121 4500008003900000245006500039210006500104300001200169490000700181100001000188700001500198856009000213 2006 d00aComputerized adaptive testing under nonparametric IRT models0 aComputerized adaptive testing under nonparametric IRT models a121-1370 v711 aXu, X1 aDouglas, J uhttp://iacat.org/content/computerized-adaptive-testing-under-nonparametric-irt-models00448nas a2200109 4500008004100000245004200041210004200083260011500125100001300240700001800253856006700271 2006 eng d00aDesigning computerized adaptive tests0 aDesigning computerized adaptive tests aS.M. Downing and T. M. Haladyna (Eds.), Handbook of test development. New Jersey: Lawrence Erlbaum Associates.1 aDavey, T1 aPitoniak, M J uhttp://iacat.org/content/designing-computerized-adaptive-tests02394nas a2200301 4500008004100000020002200041245010800063210006900171260002400240300000900264490000600273520142200279653002201701653003401723653002301757653003201780653001801812653002101830653001801851100001401869700001301883700001401896700001901910700001501929700001701944700001301961856011801974 2006 eng d a1529-7713 (Print)00aExpansion of a physical function item bank and development of an abbreviated form for clinical research0 aExpansion of a physical function item bank and development of an bRichard M Smith: US a1-150 v73 aWe expanded an existing 33-item physical function (PF) item bank with a sufficient number of items to enable computerized adaptive testing (CAT). Ten items were written to expand the bank and the new item pool was administered to 295 people with cancer. For this analysis of the new pool, seven poorly performing items were identified for further examination. This resulted in a bank with items that define an essentially unidimensional PF construct, cover a wide range of that construct, reliably measure the PF of persons with cancer, and distinguish differences in self-reported functional performance levels. We also developed a 5-item (static) assessment form ("BriefPF") that can be used in clinical research to express scores on the same metric as the overall bank. The BriefPF was compared to the PF-10 from the Medical Outcomes Study SF-36. Both short forms significantly differentiated persons across functional performance levels. While the entire bank was more precise across the PF continuum than either short form, there were differences in the area of the continuum in which each short form was more precise: the BriefPF was more precise than the PF-10 at the lower functional levels and the PF-10 was more precise than the BriefPF at the higher levels. Future research on this bank will include the development of a CAT version, the PF-CAT. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aclinical research10acomputerized adaptive testing10aperformance levels10aphysical function item bank10aPsychometrics10atest reliability10aTest Validity1 aBode, R K1 aLai, J-S1 aDineen, K1 aHeinemann, A W1 aShevrin, D1 aVon Roenn, J1 aCella, D uhttp://iacat.org/content/expansion-physical-function-item-bank-and-development-abbreviated-form-clinical-research00471nas a2200133 4500008003900000245008700039210006900126300001200195490000700207100002200214700001500236700002000251856006600271 2006 d00aHow Big Is Big Enough? Sample Size Requirements for CAST Item Parameter Estimation0 aHow Big Is Big Enough Sample Size Requirements for CAST Item Par a241-2550 v191 aChuah, Siang Chee1 aDrasgow, F1 aLuecht, Richard uhttp://www.tandfonline.com/doi/abs/10.1207/s15324818ame1903_500583nas a2200121 4500008004100000245016300041210006900204260001800273100001800291700001600309700001400325856012200339 2006 eng d00aA variant of the progressive restricted item exposure control procedure in computerized adaptive testing systems based on the 3PL and the partial credit model0 avariant of the progressive restricted item exposure control proc aSan Francisco1 aMcClarty, L K1 aSperling, R1 aDodd, B G uhttp://iacat.org/content/variant-progressive-restricted-item-exposure-control-procedure-computerized-adaptive-testing00635nas a2200169 4500008004100000020001300041245012900054210006900183300001200252490000700264100001300271700001400284700001400298700001300312700002200325856011800347 2005 eng d a0003999300aAssessing Mobility in Children Using a Computer Adaptive Testing Version of the Pediatric Evaluation of Disability Inventory0 aAssessing Mobility in Children Using a Computer Adaptive Testing a932-9390 v861 aHaley, S1 aRaczek, A1 aCoster, W1 aDumas, H1 aFragalapinkham, M uhttp://iacat.org/content/assessing-mobility-children-using-computer-adaptive-testing-version-pediatric-evaluation03119nas a2200385 4500008004100000020002200041245012900063210006900192250001500261260000800276300001000284490000700294520188400301653002502185653002702210653001502237653001002252653002102262653002802283653003802311653001102349653001102360653001102371653000902382653004602391653002702437653003002464653003202494100001502526700001602541700001602557700001502573700002502588856012002613 2005 eng d a0003-9993 (Print)00aAssessing mobility in children using a computer adaptive testing version of the pediatric evaluation of disability inventory0 aAssessing mobility in children using a computer adaptive testing a2005/05/17 cMay a932-90 v863 aOBJECTIVE: To assess score agreement, validity, precision, and response burden of a prototype computerized adaptive testing (CAT) version of the Mobility Functional Skills Scale (Mob-CAT) of the Pediatric Evaluation of Disability Inventory (PEDI) as compared with the full 59-item version (Mob-59). DESIGN: Computer simulation analysis of cross-sectional and longitudinal retrospective data; and cross-sectional prospective study. SETTING: Pediatric rehabilitation hospital, including inpatient acute rehabilitation, day school program, outpatient clinics, community-based day care, preschool, and children's homes. PARTICIPANTS: Four hundred sixty-nine children with disabilities and 412 children with no disabilities (analytic sample); 41 children without disabilities and 39 with disabilities (cross-validation sample). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Summary scores from a prototype Mob-CAT application and versions using 15-, 10-, and 5-item stopping rules; scores from the Mob-59; and number of items and time (in seconds) to administer assessments. RESULTS: Mob-CAT scores from both computer simulations (intraclass correlation coefficient [ICC] range, .94-.99) and field administrations (ICC=.98) were in high agreement with scores from the Mob-59. Using computer simulations of retrospective data, discriminant validity, and sensitivity to change of the Mob-CAT closely approximated that of the Mob-59, especially when using the 15- and 10-item stopping rule versions of the Mob-CAT. The Mob-CAT used no more than 15% of the items for any single administration, and required 20% of the time needed to administer the Mob-59. CONCLUSIONS: Comparable score estimates for the PEDI mobility scale can be obtained from CAT administrations, with losses in validity and precision for shorter forms, but with a considerable reduction in administration time.10a*Computer Simulation10a*Disability Evaluation10aAdolescent10aChild10aChild, Preschool10aCross-Sectional Studies10aDisabled Children/*rehabilitation10aFemale10aHumans10aInfant10aMale10aOutcome Assessment (Health Care)/*methods10aRehabilitation Centers10aRehabilitation/*standards10aSensitivity and Specificity1 aHaley, S M1 aRaczek, A E1 aCoster, W J1 aDumas, H M1 aFragala-Pinkham, M A uhttp://iacat.org/content/assessing-mobility-children-using-computer-adaptive-testing-version-pediatric-evaluation-002238nas a2200205 4500008004100000020004600041245009500087210006900182260002700251300001200278490000700290520149400297653002701791653003001818653001701848653002501865100001901890700001001909856011301919 2005 eng d a1560-4292 (Print); 1560-4306 (Electronic)00aA Bayesian student model without hidden nodes and its comparison with item response theory0 aBayesian student model without hidden nodes and its comparison w bIOS Press: Netherlands a291-3230 v153 aThe Bayesian framework offers a number of techniques for inferring an individual's knowledge state from evidence of mastery of concepts or skills. A typical application where such a technique can be useful is Computer Adaptive Testing (CAT). A Bayesian modeling scheme, POKS, is proposed and compared to the traditional Item Response Theory (IRT), which has been the prevalent CAT approach for the last three decades. POKS is based on the theory of knowledge spaces and constructs item-to-item graph structures without hidden nodes. It aims to offer an effective knowledge assessment method with an efficient algorithm for learning the graph structure from data. We review the different Bayesian approaches to modeling student ability assessment and discuss how POKS relates to them. The performance of POKS is compared to the IRT two parameter logistic model. Experimental results over a 34 item Unix test and a 160 item French language test show that both approaches can classify examinees as master or non-master effectively and efficiently, with relatively comparable performance. However, more significant differences are found in favor of POKS for a second task that consists in predicting individual question item outcome. Implications of these results for adaptive testing and student modeling are discussed, as well as the limitations and advantages of POKS, namely the issue of integrating concepts into its structure. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10aBayesian Student Model10acomputer adaptive testing10ahidden nodes10aItem Response Theory1 aDesmarais, M C1 aPu, X uhttp://iacat.org/content/bayesian-student-model-without-hidden-nodes-and-its-comparison-item-response-theory00597nas a2200145 4500008004100000245014400041210006900185300001200254490000700266100001300273700001400286700002100300700001500321856011500336 2005 eng d00aComputerized adaptive testing with the partial credit model: Estimation procedures, population distributions, and item pool characteristics0 aComputerized adaptive testing with the partial credit model Esti a533-5460 v291 aGorin, J1 aDodd, B G1 aFitzpatrick, S J1 aShieh, Y Y uhttp://iacat.org/content/computerized-adaptive-testing-partial-credit-model-estimation-procedures-population-001564nas a2200157 4500008003900000245014400039210006900183300001200252490000700264520099200271100002101263700002101284700002701305700002101332856005301353 2005 d00aComputerized Adaptive Testing With the Partial Credit Model: Estimation Procedures, Population Distributions, and Item Pool Characteristics0 aComputerized Adaptive Testing With the Partial Credit Model Esti a433-4560 v293 a

The primary purpose of this research is to examine the impact of estimation methods, actual latent trait distributions, and item pool characteristics on the performance of a simulated computerized adaptive testing (CAT) system. In this study, three estimation procedures are compared for accuracy of estimation: maximum likelihood estimation (MLE), expected a priori (EAP), and Warm's weighted likelihood estimation (WLE). Some research has shown that MLE and EAP perform equally well under certain conditions in polytomous CAT systems, such that they match the actual latent trait distribution. However, little research has compared these methods when prior estimates of. distributions are extremely poor. In general, it appears that MLE, EAP, and WLE procedures perform equally well when using an optimal item pool. However, the use of EAP procedures may be advantageous under nonoptimal testing conditions when the item pool is not appropriately matched to the examinees.

1 aGorin, Joanna, S1 aDodd, Barbara, G1 aFitzpatrick, Steven, J1 aShieh, Yann Yann uhttp://apm.sagepub.com/content/29/6/433.abstract02439nas a2200373 4500008004100000020004100041245008200082210006900164250001500233260000800248300001000256490000700266520136700273653001001640653000901650653002201659653003301681653003301714653001101747653001101758653000901769653001601778653004001794653001801834653001901852100001301871700001301884700001401897700001201911700001701923700001601940700001501956856009401971 2005 eng d a0895-4356 (Print)0895-4356 (Linking)00aAn item bank was created to improve the measurement of cancer-related fatigue0 aitem bank was created to improve the measurement of cancerrelate a2005/02/01 cFeb a190-70 v583 aOBJECTIVE: Cancer-related fatigue (CRF) is one of the most common unrelieved symptoms experienced by patients. CRF is underrecognized and undertreated due to a lack of clinically sensitive instruments that integrate easily into clinics. Modern computerized adaptive testing (CAT) can overcome these obstacles by enabling precise assessment of fatigue without requiring the administration of a large number of questions. A working item bank is essential for development of a CAT platform. The present report describes the building of an operational item bank for use in clinical settings with the ultimate goal of improving CRF identification and treatment. STUDY DESIGN AND SETTING: The sample included 301 cancer patients. Psychometric properties of items were examined by using Rasch analysis, an Item Response Theory (IRT) model. RESULTS AND CONCLUSION: The final bank includes 72 items. These 72 unidimensional items explained 57.5% of the variance, based on factor analysis results. Excellent internal consistency (alpha=0.99) and acceptable item-total correlation were found (range: 0.51-0.85). The 72 items covered a reasonable range of the fatigue continuum. No significant ceiling effects, floor effects, or gaps were found. A sample short form was created for demonstration purposes. The resulting bank is amenable to the development of a CAT platform.10aAdult10aAged10aAged, 80 and over10aFactor Analysis, Statistical10aFatigue/*etiology/psychology10aFemale10aHumans10aMale10aMiddle Aged10aNeoplasms/*complications/psychology10aPsychometrics10aQuestionnaires1 aLai, J-S1 aCella, D1 aDineen, K1 aBode, R1 aVon Roenn, J1 aGershon, RC1 aShevrin, D uhttp://iacat.org/content/item-bank-was-created-improve-measurement-cancer-related-fatigue01311nas a2200229 4500008004100000020002200041245007700063210006900140260002500209300001200234490000700246520057900253653002700832653003000859653002500889100001100914700001600925700001500941700001300956700001500969856009700984 2005 eng d a0439-755X (Print)00a[Item characteristic curve equating under graded response models in IRT]0 aItem characteristic curve equating under graded response models  bScience Press: China a832-8380 v373 aIn one of the largest qualificatory tests--economist test, to guarantee the comparability among different years, construct item bank and prepare for computerized adaptive testing, item characteristic curve equating and anchor test equating design under graded models in IRT are used, which have realized the item and ability parameter equating of test data in five years and succeeded in establishing an item bank. Based on it, cut scores of different years are compared by equating and provide demonstrational gist to constitute the eligibility standard of economist test. 10agraded response models10aitem characteristic curve10aItem Response Theory1 aJun, Z1 aDongming, O1 aShuyuan, X1 aHaiqi, D1 aShuqing, Q uhttp://iacat.org/content/item-characteristic-curve-equating-under-graded-response-models-irt01739nas a2200229 4500008004100000245008300041210006900124300001100193490000700204520103000211653003401241100001301275700001401288700001501302700001701317700001501334700001501349700001401364700001301378700001301391856010501404 2005 eng d00aAn item response theory-based pain item bank can enhance measurement precision0 aitem response theorybased pain item bank can enhance measurement a278-880 v303 aCancer-related pain is often under-recognized and undertreated. This is partly due to the lack of appropriate assessments, which need to be comprehensive and precise yet easily integrated into clinics. Computerized adaptive testing (CAT) can enable precise-yet-brief assessments by only selecting the most informative items from a calibrated item bank. The purpose of this study was to create such a bank. The sample included 400 cancer patients who were asked to complete 61 pain-related items. Data were analyzed using factor analysis and the Rasch model. The final bank consisted of 43 items which satisfied the measurement requirement of factor analysis and the Rasch model, demonstrated high internal consistency and reasonable item-total correlations, and discriminated patients with differing degrees of pain. We conclude that this bank demonstrates good psychometric properties, is sensitive to pain reported by patients, and can be used as the foundation for a CAT pain-testing platform for use in clinical practice.10acomputerized adaptive testing1 aLai, J-S1 aDineen, K1 aReeve, B B1 aVon Roenn, J1 aShervin, D1 aMcGuire, M1 aBode, R K1 aPaice, J1 aCella, D uhttp://iacat.org/content/item-response-theory-based-pain-item-bank-can-enhance-measurement-precision00531nas a2200109 4500008004100000245010800041210006900149260005800218100001400276700001200290856011900302 2005 eng d00aStrategies for controlling item exposure in computerized adaptive testing with the partial credit model0 aStrategies for controlling item exposure in computerized adaptiv aPearson Educational Measurement Research Report 05-011 aDavis, LL1 aDodd, B uhttp://iacat.org/content/strategies-controlling-item-exposure-computerized-adaptive-testing-partial-credit-model-001468nas a2200217 4500008004100000245004600041210004600087300001200133490000700145520085100152653001801003653002501021653003201046653001301078653002201091653002401113653001501137100001601152700001501168856006701183 2005 eng d00aTest construction for cognitive diagnosis0 aTest construction for cognitive diagnosis a262-2770 v293 aAlthough cognitive diagnostic models (CDMs) can be useful in the analysis and interpretation of existing tests, little has been developed to specify how one might construct a good test using aspects of the CDMs. This article discusses the derivation of a general CDM index based on Kullback-Leibler information that will serve as a measure of how informative an item is for the classification of examinees. The effectiveness of the index is examined for items calibrated using the deterministic input noisy "and" gate model (DINA) and the reparameterized unified model (RUM) by implementing a simple heuristic to construct a test from an item bank. When compared to randomly constructed tests from the same item bank, the heuristic shows significant improvement in classification rates. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10a(Measurement)10aCognitive Assessment10aItem Analysis (Statistical)10aProfiles10aTest Construction10aTest Interpretation10aTest Items1 aHenson, R K1 aDouglas, J uhttp://iacat.org/content/test-construction-cognitive-diagnosis10197nas a2200553 4500008004100000245016300041210006900204300001400273490000700287520862500294653001808919653003208937100001608969700001608985700001409001700001609015700001409031700001509045700001609060700001409076700001509090700001509105700001409120700001709134700001709151700001709168700001609185700001709201700001609218700001509234700001609249700001709265700002309282700001609305700002209321700001609343700001609359700001709375700001309392700001509405700001309420700001609433700001209449700001409461700001609475700002009491700001209511856012009523 2005 eng d00aToward efficient and comprehensive measurement of the alcohol problems continuum in college students: The Brief Young Adult Alcohol Consequences Questionnaire0 aToward efficient and comprehensive measurement of the alcohol pr a1180-11890 v293 aBackground: Although a number of measures of alcohol problems in college students have been studied, the psychometric development and validation of these scales have been limited, for the most part, to methods based on classical test theory. In this study, we conducted analyses based on item response theory to select a set of items for measuring the alcohol problem severity continuum in college students that balances comprehensiveness and efficiency and is free from significant gender bias., Method: We conducted Rasch model analyses of responses to the 48-item Young Adult Alcohol Consequences Questionnaire by 164 male and 176 female college students who drank on at least a weekly basis. An iterative process using item fit statistics, item severities, item discrimination parameters, model residuals, and analysis of differential item functioning by gender was used to pare the items down to those that best fit a Rasch model and that were most efficient in discriminating among levels of alcohol problems in the sample., Results: The process of iterative Rasch model analyses resulted in a final 24-item scale with the data fitting the unidimensional Rasch model very well. The scale showed excellent distributional properties, had items adequately matched to the severity of alcohol problems in the sample, covered a full range of problem severity, and appeared highly efficient in retaining all of the meaningful variance captured by the original set of 48 items., Conclusions: The use of Rasch model analyses to inform item selection produced a final scale that, in both its comprehensiveness and its efficiency, should be a useful tool for researchers studying alcohol problems in college students. To aid interpretation of raw scores, examples of the types of alcohol problems that are likely to be experienced across a range of selected scores are provided., (C)2005Research Society on AlcoholismAn important, sometimes controversial feature of all psychological phenomena is whether they are categorical or dimensional. A conceptual and psychometric framework is described for distinguishing whether the latent structure behind manifest categories (e.g., psychiatric diagnoses, attitude groups, or stages of development) is category-like or dimension-like. Being dimension-like requires (a) within-category heterogeneity and (b) between-category quantitative differences. Being category-like requires (a) within-category homogeneity and (b) between-category qualitative differences. The relation between this classification and abrupt versus smooth differences is discussed. Hybrid structures are possible. Being category-like is itself a matter of degree; the authors offer a formalized framework to determine this degree. Empirical applications to personality disorders, attitudes toward capital punishment, and stages of cognitive development illustrate the approach., (C) 2005 by the American Psychological AssociationThe authors conducted Rasch model ( G. Rasch, 1960) analyses of items from the Young Adult Alcohol Problems Screening Test (YAAPST; S. C. Hurlbut & K. J. Sher, 1992) to examine the relative severity and ordering of alcohol problems in 806 college students. Items appeared to measure a single dimension of alcohol problem severity, covering a broad range of the latent continuum. Items fit the Rasch model well, with less severe symptoms reliably preceding more severe symptoms in a potential progression toward increasing levels of problem severity. However, certain items did not index problem severity consistently across demographic subgroups. A shortened, alternative version of the YAAPST is proposed, and a norm table is provided that allows for a linking of total YAAPST scores to expected symptom expression., (C) 2004 by the American Psychological AssociationA didactic on latent growth curve modeling for ordinal outcomes is presented. The conceptual aspects of modeling growth with ordinal variables and the notion of threshold invariance are illustrated graphically using a hypothetical example. The ordinal growth model is described in terms of 3 nested models: (a) multivariate normality of the underlying continuous latent variables (yt) and its relationship with the observed ordinal response pattern (Yt), (b) threshold invariance over time, and (c) growth model for the continuous latent variable on a common scale. Algebraic implications of the model restrictions are derived, and practical aspects of fitting ordinal growth models are discussed with the help of an empirical example and Mx script ( M. C. Neale, S. M. Boker, G. Xie, & H. H. Maes, 1999). The necessary conditions for the identification of growth models with ordinal data and the methodological implications of the model of threshold invariance are discussed., (C) 2004 by the American Psychological AssociationRecent research points toward the viability of conceptualizing alcohol problems as arrayed along a continuum. Nevertheless, modern statistical techniques designed to scale multiple problems along a continuum (latent trait modeling; LTM) have rarely been applied to alcohol problems. This study applies LTM methods to data on 110 problems reported during in-person interviews of 1,348 middle-aged men (mean age = 43) from the general population. The results revealed a continuum of severity linking the 110 problems, ranging from heavy and abusive drinking, through tolerance and withdrawal, to serious complications of alcoholism. These results indicate that alcohol problems can be arrayed along a dimension of severity and emphasize the relevance of LTM to informing the conceptualization and assessment of alcohol problems., (C) 2004 by the American Psychological AssociationItem response theory (IRT) is supplanting classical test theory as the basis for measures development. This study demonstrated the utility of IRT for evaluating DSM-IV diagnostic criteria. Data on alcohol, cannabis, and cocaine symptoms from 372 adult clinical participants interviewed with the Composite International Diagnostic Interview-Expanded Substance Abuse Module (CIDI-SAM) were analyzed with Mplus ( B. Muthen & L. Muthen, 1998) and MULTILOG ( D. Thissen, 1991) software. Tolerance and legal problems criteria were dropped because of poor fit with a unidimensional model. Item response curves, test information curves, and testing of variously constrained models suggested that DSM-IV criteria in the CIDI-SAM discriminate between only impaired and less impaired cases and may not be useful to scale case severity. IRT can be used to study the construct validity of DSM-IV diagnoses and to identify diagnostic criteria with poor performance., (C) 2004 by the American Psychological AssociationThis study examined the psychometric characteristics of an index of substance use involvement using item response theory. The sample consisted of 292 men and 140 women who qualified for a Diagnostic and Statistical Manual of Mental Disorders (3rd ed., rev.; American Psychiatric Association, 1987) substance use disorder (SUD) diagnosis and 293 men and 445 women who did not qualify for a SUD diagnosis. The results indicated that men had a higher probability of endorsing substance use compared with women. The index significantly predicted health, psychiatric, and psychosocial disturbances as well as level of substance use behavior and severity of SUD after a 2-year follow-up. Finally, this index is a reliable and useful prognostic indicator of the risk for SUD and the medical and psychosocial sequelae of drug consumption., (C) 2002 by the American Psychological AssociationComparability, validity, and impact of loss of information of a computerized adaptive administration of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) were assessed in a sample of 140 Veterans Affairs hospital patients. The countdown method ( Butcher, Keller, & Bacon, 1985) was used to adaptively administer Scales L (Lie) and F (Frequency), the 10 clinical scales, and the 15 content scales. Participants completed the MMPI-2 twice, in 1 of 2 conditions: computerized conventional test-retest, or computerized conventional-computerized adaptive. Mean profiles and test-retest correlations across modalities were comparable. Correlations between MMPI-2 scales and criterion measures supported the validity of the countdown method, although some attenuation of validity was suggested for certain health-related items. Loss of information incurred with this mode of adaptive testing has minimal impact on test validity. Item and time savings were substantial., (C) 1999 by the American Psychological Association10aPsychometrics10aSubstance-Related Disorders1 aKahler, C W1 aStrong, D R1 aRead, J P1 aDe Boeck, P1 aWilson, M1 aActon, G S1 aPalfai, T P1 aWood, M D1 aMehta, P D1 aNeale, M C1 aFlay, B R1 aConklin, C A1 aClayton, R R1 aTiffany, S T1 aShiffman, S1 aKrueger, R F1 aNichol, P E1 aHicks, B M1 aMarkon, K E1 aPatrick, C J1 aIacono, William, G1 aMcGue, Matt1 aLangenbucher, J W1 aLabouvie, E1 aMartin, C S1 aSanjuan, P M1 aBavly, L1 aKirisci, L1 aChung, T1 aVanyukov, M1 aDunn, M1 aTarter, R1 aHandel, R W1 aBen-Porath, Y S1 aWatt, M uhttp://iacat.org/content/toward-efficient-and-comprehensive-measurement-alcohol-problems-continuum-college-students01900nas a2200217 4500008004100000245010000041210006900141260000800210300001100218490000700229520117300236653002201409653001501431653003701446653003101483653001101514653001901525100001201544700001501556856011101571 2004 eng d00aA computerized adaptive knowledge test as an assessment tool in general practice: a pilot study0 acomputerized adaptive knowledge test as an assessment tool in ge cMar a178-830 v263 aAdvantageous to assessment in many fields, CAT (computerized adaptive testing) use in general practice has been scarce. In adapting CAT to general practice, the basic assumptions of item response theory and the case specificity must be taken into account. In this context, this study first evaluated the feasibility of converting written extended matching tests into CAT. Second, it questioned the content validity of CAT. A stratified sample of students was invited to participate in the pilot study. The items used in this test, together with their parameters, originated from the written test. The detailed test paths of the students were retained and analysed thoroughly. Using the predefined pass-fail standard, one student failed the test. There was a positive correlation between the number of items and the candidate's ability level. The majority of students were presented with questions in seven of the 10 existing domains. Although proved to be a feasible test format, CAT cannot substitute for the existing high-stakes large-scale written test. It may provide a reliable instrument for identifying candidates who are at risk of failing in the written test.10a*Computer Systems10aAlgorithms10aEducational Measurement/*methods10aFamily Practice/*education10aHumans10aPilot Projects1 aRoex, A1 aDegryse, J uhttp://iacat.org/content/computerized-adaptive-knowledge-test-assessment-tool-general-practice-pilot-study00386nas a2200121 4500008004100000245004800041210004800089260001700137100001200154700001500166700001500181856006800196 2004 eng d00aItem parameter recovery with adaptive tests0 aItem parameter recovery with adaptive tests aSan Diego CA1 aDo, B-R1 aChuah, S C1 aDrasgow, F uhttp://iacat.org/content/item-parameter-recovery-adaptive-tests01891nas a2200181 4500008004100000020002200041245012000063210006900183260002600252300001200278490000700290520119300297653003401490653003701524653001801561100001401579856011601593 2004 eng d a0146-6216 (Print)00aStrategies for controlling item exposure in computerized adaptive testing with the generalized partial credit model0 aStrategies for controlling item exposure in computerized adaptiv bSage Publications: US a165-1850 v283 aChoosing a strategy for controlling item exposure has become an integral part of test development for computerized adaptive testing (CAT). This study investigated the performance of six procedures for controlling item exposure in a series of simulated CATs under the generalized partial credit model. In addition to a no-exposure control baseline condition, the randomesque, modified-within-.10-logits, Sympson-Hetter, conditional Sympson-Hetter, a-stratified with multiple-stratification, and enhanced a-stratified with multiple-stratification procedures were implemented to control exposure rates. Two variations of the randomesque and modified-within-.10-logits procedures were examined, which varied the size of the item group from which the next item to be administered was randomly selected. The results indicate that although the conditional Sympson-Hetter provides somewhat lower maximum exposure rates, the randomesque and modified-within-.10-logits procedures with the six-item group variation have great utility for controlling overlap rates and increasing pool utilization and should be given further consideration. (PsycINFO Database Record (c) 2007 APA, all rights reserved)10acomputerized adaptive testing10ageneralized partial credit model10aitem exposure1 aDavis, LL uhttp://iacat.org/content/strategies-controlling-item-exposure-computerized-adaptive-testing-generalized-partial01590nas a2200121 4500008003900000245012000039210006900159300001200228490000700240520114100247100002701388856005301415 2004 d00aStrategies for Controlling Item Exposure in Computerized Adaptive Testing With the Generalized Partial Credit Model0 aStrategies for Controlling Item Exposure in Computerized Adaptiv a165-1850 v283 a

Choosing a strategy for controlling item exposure has become an integral part of test development for computerized adaptive testing (CAT). This study investigated the performance of six procedures for controlling item exposure in a series of simulated CATs under the generalized partial credit model. In addition to a no-exposure control baseline condition, the randomesque, modified-within-.10-logits, Sympson-Hetter, conditional Sympson-Hetter, a-stratified with multiple-stratification, and enhanced a-stratified with multiple-stratification procedures were implemented to control exposure rates. Two variations of the randomesque and modified-within-.10-logits procedures were examined, which varied the size of the item group from which the next item to be administered was randomly selected. The results indicate that although the conditional Sympson-Hetter provides somewhat lower maximum exposure rates, the randomesque and modified-within-.10-logits procedures with the six-item group variation have great utility for controlling overlap rates and increasing pool utilization and should be given further consideration.

1 aDavis, Laurie Laughlin uhttp://apm.sagepub.com/content/28/3/165.abstract01223nas a2200193 4500008004100000245002900041210002900070260003200099300001200131520066800143653003000811653003200841653001400873653004500887100001200932700001500944700001600959856005400975 2003 eng d00aAssessing question banks0 aAssessing question banks aLondon, UKbKogan Page Ltd. a171-2303 aIn Chapter 14, Joanna Bull and James Daziel provide a comprehensive treatment of the issues surrounding the use of Question Banks and Computer Assisted Assessment, and provide a number of excellent examples of implementations. In their review of the technologies employed in Computer Assisted Assessment the authors include Computer Adaptive Testing and data generation. The authors reveal significant issues involving the impact of Intellectual Property rights and computer assisted assessment and make important suggestions for strategies to overcome these obstacles. (PsycINFO Database Record (c) 2005 APA )http://www-jime.open.ac.uk/2003/1/ (journal abstract)10aComputer Assisted Testing10aCurriculum Based Assessment10aEducation10aTechnology computerized adaptive testing1 aBull, J1 aDalziel, J1 aVreeland, T uhttp://iacat.org/content/assessing-question-banks00521nas a2200145 4500008004100000245008400041210006900125300001200194490000700206100001300213700001400226700001300240700001700253856010500270 2003 eng d00aCan an item response theory-based pain item bank enhance measurement precision?0 aCan an item response theorybased pain item bank enhance measurem aD34-D360 v251 aLai, J-S1 aDineen, K1 aCella, D1 aVon Roenn, J uhttp://iacat.org/content/can-item-response-theory-based-pain-item-bank-enhance-measurement-precision00572nas a2200121 4500008004100000245016100041210006900202260001500271100001400286700001400300700002100314856011500335 2003 eng d00aA comparison of exposure control procedures in CAT systems based on different measurement models for testlets using the verbal reasoning section of the MCAT0 acomparison of exposure control procedures in CAT systems based o aChicago IL1 aBoyd, A M1 aDodd, B G1 aFitzpatrick, S J uhttp://iacat.org/content/comparison-exposure-control-procedures-cat-systems-based-different-measurement-models00549nas a2200133 4500008004100000245011800041210006900159260001500228100001400243700001400257700001400271700001400285856011600299 2003 eng d00aA comparison of item exposure control procedures using a CAT system based on the generalized partial credit model0 acomparison of item exposure control procedures using a CAT syste aChicago IL1 aBurt, W M1 aKim, S -J1 aDavis, LL1 aDodd, B G uhttp://iacat.org/content/comparison-item-exposure-control-procedures-using-cat-system-based-generalized-partial00414nas a2200097 4500008004100000245007700041210006900118260002000187100001500207856009400222 2003 eng d00aA comparison of learning potential results at various educational levels0 acomparison of learning potential results at various educational  a25-27 June 20031 aDe Beer, M uhttp://iacat.org/content/comparison-learning-potential-results-various-educational-levels00448nas a2200109 4500008003900000245008900039210006900128300001200197490000700209100001700216856010500233 2003 d00aA computer adaptive testing simulation applied to the FIM instrument motor component0 acomputer adaptive testing simulation applied to the FIM instrume a384-3930 v841 aDijkers, M P uhttp://iacat.org/content/computer-adaptive-testing-simulation-applied-fim-instrument-motor-component00381nas a2200085 4500008004100000245007700041210006900118100001500187856009300202 2003 eng d00aDevelopment of the Learning Potential Computerised Adaptive Test (LPCAT)0 aDevelopment of the Learning Potential Computerised Adaptive Test1 aDe Beer, M uhttp://iacat.org/content/development-learning-potential-computerised-adaptive-test-lpcat01812nas a2200253 4500008004100000245013100041210006900172300001000241490000600251520095700257653001501214653002901229653002501258653001501283653002001298653001101318653003101329100001401360700001601374700001401390700001401404700002101418856011901439 2003 eng d00aAn examination of exposure control and content balancing restrictions on item selection in CATs using the partial credit model0 aexamination of exposure control and content balancing restrictio a24-420 v43 aThe purpose of the present investigation was to systematically examine the effectiveness of the Sympson-Hetter technique and rotated content balancing relative to no exposure control and no content rotation conditions in a computerized adaptive testing system (CAT) based on the partial credit model. A series of simulated fixed and variable length CATs were run using two data sets generated to multiple content areas for three sizes of item pools. The 2 (exposure control) X 2 (content rotation) X 2 (test length) X 3 (item pool size) X 2 (data sets) yielded a total of 48 conditions. Results show that while both procedures can be used with no deleterious effect on measurement precision, the gains in exposure control, pool utilization, and item overlap appear quite modest. Difficulties involved with setting the exposure control parameters in small item pools make questionable the utility of the Sympson-Hetter technique with similar item pools.10a*Computers10a*Educational Measurement10a*Models, Theoretical10aAutomation10aDecision Making10aHumans10aReproducibility of Results1 aDavis, LL1 aPastor, D A1 aDodd, B G1 aChiang, C1 aFitzpatrick, S J uhttp://iacat.org/content/examination-exposure-control-and-content-balancing-restrictions-item-selection-cats-using01743nas a2200217 4500008004100000245008700041210006900128300001200197490000700209520100200216653002101218653003001239653002601269653002501295653002001320653001401340653004901354100001401403700001401417856009401431 2003 eng d00aItem exposure constraints for testlets in the verbal reasoning section of the MCAT0 aItem exposure constraints for testlets in the verbal reasoning s a335-3560 v273 aThe current study examined item exposure control procedures for testlet scored reading passages in the Verbal Reasoning section of the Medical College Admission Test with four computerized adaptive testing (CAT) systems using the partial credit model. The first system used a traditional CAT using maximum information item selection. The second used random item selection to provide a baseline for optimal exposure rates. The third used a variation of Lunz and Stahl's randomization procedure. The fourth used Luecht and Nungester's computerized adaptive sequential testing (CAST) system. A series of simulated fixed-length CATs was run to determine the optimal item length selection procedure. Results indicated that both the randomization procedure and CAST performed well in terms of exposure control and measurement precision, with the CAST system providing the best overall solution when all variables were taken into consideration. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10aAdaptive Testing10aComputer Assisted Testing10aEntrance Examinations10aItem Response Theory10aRandom Sampling10aReasoning10aVerbal Ability computerized adaptive testing1 aDavis, LL1 aDodd, B G uhttp://iacat.org/content/item-exposure-constraints-testlets-verbal-reasoning-section-mcat00448nas a2200145 4500008004100000245005100041210005100092260001500143100001500158700001400173700001200187700001500199700001500214856007300229 2003 eng d00aMaintaining scale in computer adaptive testing0 aMaintaining scale in computer adaptive testing aChicago IL1 aSmith, R L1 aRizavi, S1 aPaez, R1 aDamiano, M1 aHerbert, E uhttp://iacat.org/content/maintaining-scale-computer-adaptive-testing00432nas a2200109 4500008004100000245007300041210006900114260001500183100001400198700001300212856009700225 2003 eng d00aPredicting item exposure parameters in computerized adaptive testing0 aPredicting item exposure parameters in computerized adaptive tes aChicago IL1 aChen, S-Y1 aDoong, H uhttp://iacat.org/content/predicting-item-exposure-parameters-computerized-adaptive-testing-000453nas a2200121 4500008004100000245007300041210006900114260001500183100001000198700001900208700001500227856008900242 2003 eng d00aA simulation study to compare CAT strategies for cognitive diagnosis0 asimulation study to compare CAT strategies for cognitive diagnos aChicago IL1 aXu, X1 aChang, Hua-Hua1 aDouglas, J uhttp://iacat.org/content/simulation-study-compare-cat-strategies-cognitive-diagnosis00475nas a2200097 4500008004100000245012000041210006900161260001500230100001400245856011800259 2003 eng d00aStrategies for controlling item exposure in computerized adaptive testing with the generalized partial credit model0 aStrategies for controlling item exposure in computerized adaptiv aChicago IL1 aDavis, LL uhttp://iacat.org/content/strategies-controlling-item-exposure-computerized-adaptive-testing-generalized-partial-002963nas a2200121 4500008004100000245010900041210006900150300000800219490000700227520247100234100001402705856012202719 2003 eng d00aStrategies for controlling item exposure in computerized adaptive testing with polytomously scored items0 aStrategies for controlling item exposure in computerized adaptiv a4580 v643 aChoosing a strategy for controlling the exposure of items to examinees has become an integral part of test development for computerized adaptive testing (CAT). Item exposure can be controlled through the use of a variety of algorithms which modify the CAT item selection process. This may be done through a randomization, conditional selection, or stratification approach. The effectiveness of each procedure as well as the degree to which measurement precision is sacrificed has been extensively studied with dichotomously scored item pools. However, only recently have researchers begun to examine these procedures in polytomously scored item pools. The current study investigated the performance of six different exposure control mechanisms under three polytomous IRT models in terms of measurement precision, test security, and ease of implementation. The three models examined in the current study were the partial credit, generalized partial credit, and graded response models. In addition to a no exposure control baseline condition, the randomesque, within .10 logits, Sympson-Hetter, conditional Sympson-Hetter, a-Stratified, and enhanced a-Stratified procedures were implemented to control item exposure rates. The a-Stratified and enhanced a-Stratified procedures were not evaluated with the partial credit model. Two variations of the randomesque and within .10 logits procedures were also examined which varied the size of the item group from which the next item to be administered was randomly selected. The results of this study were remarkably similar for all three models and indicated that the randomesque and within .10 logits procedures, when implemented with the six item group variation, provide the best option for controlling exposure rates when impact to measurement precision and ease of implementation are considered. The three item group variations of the procedures were, however, ineffective in controlling exposure, overlap, and pool utilization rates to desired levels. The Sympson-Hetter and conditional Sympson-Hetter procedures were difficult and time consuming to implement, and while they did control exposure rates to the target level, their performance in terms of item overlap (for the Sympson-Hetter) and pool utilization were disappointing. The a-Stratified and enhanced a-Stratified procedures both turned in surprisingly poor performances across all variables. (PsycINFO Database Record (c) 2004 APA, all rights reserved).1 aDavis, LL uhttp://iacat.org/content/strategies-controlling-item-exposure-computerized-adaptive-testing-polytomously-scored-items00576nas a2200145 4500008004100000245012200041210006900163300001300232490000800245100001700253700001500270700001400285700001200299856011900311 2003 eng d00aA study of the feasibility of Internet administration of a computerized health survey: The Headache Impact Test (HIT)0 astudy of the feasibility of Internet administration of a compute a 953-9610 v 121 aBayliss, M S1 aDewey, J E1 aDunlap, I1 aet. al. uhttp://iacat.org/content/study-feasibility-internet-administration-computerized-health-survey-headache-impact-test00480nas a2200109 4500008004100000245010200041210006900143260001500212100001200227700001400239856011700253 2003 eng d00aTo stratify or not: An investigation of CAT item selection procedures under practical constraints0 aTo stratify or not An investigation of CAT item selection proced aChicago IL1 aDeng, H1 aAnsley, T uhttp://iacat.org/content/stratify-or-not-investigation-cat-item-selection-procedures-under-practical-constraints02081nas a2200229 4500008004100000245012900041210006900170300001200239490000700251520124000258653001801498653002101516653004501537653003001582653001801612653002501630653002601655100001601681700001401697700001901711856012101730 2002 eng d00aA comparison of item selection techniques and exposure control mechanisms in CATs using the generalized partial credit model0 acomparison of item selection techniques and exposure control mec a147-1630 v263 aThe use of more performance items in large-scale testing has led to an increase in the research investigating the use of polytomously scored items in computer adaptive testing (CAT). Because this research has to be complemented with information pertaining to exposure control, the present research investigated the impact of using five different exposure control algorithms in two sized item pools calibrated using the generalized partial credit model. The results of the simulation study indicated that the a-stratified design, in comparison to a no-exposure control condition, could be used to reduce item exposure and overlap, increase pool utilization, and only minorly degrade measurement precision. Use of the more restrictive exposure control algorithms, such as the Sympson-Hetter and conditional Sympson-Hetter, controlled exposure to a greater extent but at the cost of measurement precision. Because convergence of the exposure control parameters was problematic for some of the more restrictive exposure control algorithms, use of the more simplistic exposure control mechanisms, particularly when the test length to item pool size ratio is large, is recommended. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)10a(Statistical)10aAdaptive Testing10aAlgorithms computerized adaptive testing10aComputer Assisted Testing10aItem Analysis10aItem Response Theory10aMathematical Modeling1 aPastor, D A1 aDodd, B G1 aChang, Hua-Hua uhttp://iacat.org/content/comparison-item-selection-techniques-and-exposure-control-mechanisms-cats-using-generalized00574nas a2200109 4500008004100000245006000041210006000101260018900161100001300350700001400363856008700377 2002 eng d00aControlling item exposure and maintaining item security0 aControlling item exposure and maintaining item security aC. N. Mills, M. T. Potenza, and J. J. Fremer (Eds.), Computer-Based Testing: Building the Foundation for Future Assessments (pp. 165-191). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.1 aDavey, T1 aNering, M uhttp://iacat.org/content/controlling-item-exposure-and-maintaining-item-security-001634nas a2200217 4500008004100000245009700041210006900138300001200207490000700219520087500226653002101101653003001122653002501152653002301177653002501200653002801225653002701253100001301280700001501293856010801308 2002 eng d00aAn EM approach to parameter estimation for the Zinnes and Griggs paired comparison IRT model0 aEM approach to parameter estimation for the Zinnes and Griggs pa a208-2270 v263 aBorman et al. recently proposed a computer adaptive performance appraisal system called CARS II that utilizes paired comparison judgments of behavioral stimuli. To implement this approach,the paired comparison ideal point model developed by Zinnes and Griggs was selected. In this article,the authors describe item response and information functions for the Zinnes and Griggs model and present procedures for estimating stimulus and person parameters. Monte carlo simulations were conducted to assess the accuracy of the parameter estimation procedures. The results indicated that at least 400 ratees (i.e.,ratings) are required to obtain reasonably accurate estimates of the stimulus parameters and their standard errors. In addition,latent trait estimation improves as test length increases. The implications of these results for test construction are also discussed. 10aAdaptive Testing10aComputer Assisted Testing10aItem Response Theory10aMaximum Likelihood10aPersonnel Evaluation10aStatistical Correlation10aStatistical Estimation1 aStark, S1 aDrasgow, F uhttp://iacat.org/content/em-approach-parameter-estimation-zinnes-and-griggs-paired-comparison-irt-model00568nas a2200145 4500008004100000245011700041210006900158300000800227490001000235100001500245700001500260700001300275700001300288856012100301 2002 eng d00aFeasibility and acceptability of computerized adaptive testing (CAT) for fatigue monitoring in clinical practice0 aFeasibility and acceptability of computerized adaptive testing C a1340 v11(7)1 aDavis, K M1 aChang, C-H1 aLai, J-S1 aCella, D uhttp://iacat.org/content/feasibility-and-acceptability-computerized-adaptive-testing-cat-fatigue-monitoring-clinical00520nas a2200121 4500008004100000245005100041210005100092260013700143100001800280700001300298700001500311856007200326 2002 eng d00aInnovative item types for computerized testing0 aInnovative item types for computerized testing aIn W. J. van der Linden and C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice. Norwell MA: Kluwer (in press).1 aParshall, C G1 aDavey, T1 aPashley, P uhttp://iacat.org/content/innovative-item-types-computerized-testing00520nam a2200097 4500008004100000245010900041210006900150260006700219100001400286856012200300 2002 eng d00aStrategies for controlling item exposure in computerized adaptive testing with polytomously scored items0 aStrategies for controlling item exposure in computerized adaptiv aUnpublished doctoral dissertation, University of Texas, Austin1 aDavis, LL uhttp://iacat.org/content/strategies-controlling-item-exposure-computerized-adaptive-testing-polytomously-scored-ite-000534nas a2200097 4500008004100000245016800041210006900209260002700278100001500305856011600320 2002 eng d00aUtility of Learning Potential Computerised Adaptive Test (LPCAT) scores in predicting academic performance of bridging students: A comparison with other predictors0 aUtility of Learning Potential Computerised Adaptive Test LPCAT s aPretoria, South Africa1 aDe Beer, M uhttp://iacat.org/content/utility-learning-potential-computerised-adaptive-test-lpcat-scores-predicting-academic01145nas a2200205 4500008004100000245008200041210006900123260005600192520043100248653002100679653003000700653001600730653001600746653001800762100001500780700001700795700001700812700001400829856009600843 2002 eng d00aThe work ahead: A psychometric infrastructure for computerized adaptive tests0 awork ahead A psychometric infrastructure for computerized adapti aMahwah, N.J. USAbLawrence Erlbaum Associates, Inc.3 a(From the chapter) Considers the past and future of computerized adaptive tests and computer-based tests and looks at issues and challenges confronting a testing program as it implements and operates a computer-based test. Recommendations for testing programs from The National Council of Measurement in Education Ad Hoc Committee on Computerized Adaptive Test Disclosure are appended. (PsycINFO Database Record (c) 2005 APA )10aAdaptive Testing10aComputer Assisted Testing10aEducational10aMeasurement10aPsychometrics1 aDrasgow, F1 aPotenza, M P1 aFreemer, J J1 aWard, W C uhttp://iacat.org/content/work-ahead-psychometric-infrastructure-computerized-adaptive-tests00460nas a2200109 4500008004100000245008800041210006900129260001500198100001200213700001900225856010600244 2001 eng d00aa-stratified computerized adaptive testing with unequal item exposure across strata0 aastratified computerized adaptive testing with unequal item expo aSeattle WA1 aDeng, H1 aChang, Hua-Hua uhttp://iacat.org/content/stratified-computerized-adaptive-testing-unequal-item-exposure-across-strata00547nas a2200109 4500008004100000245011200041210006900153260006800222100001400290700001400304856011900318 2001 eng d00aAn examination of testlet scoring and item exposure constraints in the verbal reasoning section of the MCAT0 aexamination of testlet scoring and item exposure constraints in  aMCAT Monograph Series: Association of American Medical Colleges1 aDavis, LL1 aDodd, B G uhttp://iacat.org/content/examination-testlet-scoring-and-item-exposure-constraints-verbal-reasoning-section-mcat-000465nas a2200097 4500008004100000245011200041210006900153100001400222700001400236856011700250 2001 eng d00aAn examination of testlet scoring and item exposure constraints in the Verbal Reasoning section of the MCAT0 aexamination of testlet scoring and item exposure constraints in 1 aDavis, LL1 aDodd, B G uhttp://iacat.org/content/examination-testlet-scoring-and-item-exposure-constraints-verbal-reasoning-section-mcat02097nas a2200337 4500008004100000245014400041210006900185300001200254490000700266520096600273653002501239653003601264653002501300653001001325653003001335653001101365653001001376653000901386653003101395653003201426653003601458653003401494653002001528100001601548700001401564700001601578700001901594700001301613700001501626856011801641 2001 eng d00aAn examination of the comparative reliability, validity, and accuracy of performance ratings made using computerized adaptive rating scales0 aexamination of the comparative reliability validity and accuracy a965-9730 v863 aThis laboratory research compared the reliability, validity, and accuracy of a computerized adaptive rating scale (CARS) format and 2 relatively common and representative rating formats. The CARS is a paired-comparison rating task that uses adaptive testing principles to present pairs of scaled behavioral statements to the rater to iteratively estimate a ratee's effectiveness on 3 dimensions of contextual performance. Videotaped vignettes of 6 office workers were prepared, depicting prescripted levels of contextual performance, and 112 subjects rated these vignettes using the CARS format and one or the other competing format. Results showed 23%-37% lower standard errors of measurement for the CARS format. In addition, validity was significantly higher for the CARS format (d = .18), and Cronbach's accuracy coefficients showed significantly higher accuracy, with a median effect size of .08. The discussion focuses on possible reasons for the results.10a*Computer Simulation10a*Employee Performance Appraisal10a*Personnel Selection10aAdult10aAutomatic Data Processing10aFemale10aHuman10aMale10aReproducibility of Results10aSensitivity and Specificity10aSupport, U.S. Gov't, Non-P.H.S.10aTask Performance and Analysis10aVideo Recording1 aBorman, W C1 aBuck, D E1 aHanson, M A1 aMotowidlo, S J1 aStark, S1 aDrasgow, F uhttp://iacat.org/content/examination-comparative-reliability-validity-and-accuracy-performance-ratings-made-using00489nas a2200121 4500008004100000245009500041210006900136260001500205100001800220700001400238700001900252856009600271 2001 eng d00aAn investigation of the impact of items that exhibit mild DIF on ability estimation in CAT0 ainvestigation of the impact of items that exhibit mild DIF on ab aSeattle WA1 aJennings, J A1 aDodd, B G1 aFitzpatrick, S uhttp://iacat.org/content/investigation-impact-items-exhibit-mild-dif-ability-estimation-cat00579nas a2200121 4500008004100000245015600041210006900197260002600266100001500292700001500307700002000322856011500342 2001 eng d00aItem and passage selection algorithm simulations for a computerized adaptive version of the verbal section of the Medical College Admission Test (MCAT)0 aItem and passage selection algorithm simulations for a computeri aMCAT Monograph Series1 aSmith, R W1 aPlake, B S1 ade Ayala, R. J. uhttp://iacat.org/content/item-and-passage-selection-algorithm-simulations-computerized-adaptive-version-verbal02438nas a2200169 4500008004100000245012400041210007300165300001000238490000700248520174900255653003402004100002002038700001802058700002202076700002202098856014802120 2000 eng d00aAlgoritmo mixto mínima entropía-máxima información para la selección de ítems en un test adaptativo informatizado0 aAlgoritmo mixto mínima entropíamáxima información para la selecc a12-140 v123 aEl objetivo del estudio que presentamos es comparar la eficacia como estrat egia de selección de ítems de tres algo ritmos dife rentes: a) basado en máxima info rmación; b) basado en mínima entropía; y c) mixto mínima entropía en los ítems iniciales y máxima info rmación en el resto; bajo la hipótesis de que el algo ritmo mixto, puede dotar al TAI de mayor eficacia. Las simulaciones de procesos TAI se re a l i z a ron sobre un banco de 28 ítems de respuesta graduada calibrado según el modelo de Samejima, tomando como respuesta al TAI la respuesta ori ginal de los sujetos que fueron utilizados para la c a l i b ración. Los resultados iniciales mu e s t ran cómo el cri t e rio mixto es más eficaz que cualquiera de los otros dos tomados indep e n d i e n t e m e n t e. Dicha eficacia se maximiza cuando el algo ritmo de mínima entropía se re s t ri n ge a la selección de los pri m e ros ítems del TAI, ya que con las respuestas a estos pri m e ros ítems la estimación de q comienza a ser re l evante y el algo ritmo de máxima informaciónse optimiza.Item selection algo rithms in computeri zed adap t ive testing. The aim of this paper is to compare the efficacy of three different item selection algo rithms in computeri zed adap t ive testing (CAT). These algorithms are based as follows: the first one is based on Item Info rm ation, the second one on Entropy, and the last algo rithm is a mixture of the two previous ones. The CAT process was simulated using an emotional adjustment item bank. This item bank contains 28 graded items in six categories , calibrated using Samejima (1969) Graded Response Model. The initial results show that the mixed criterium algorithm performs better than the other ones.10acomputerized adaptive testing1 aDorronsoro, J R1 aSanta-Cruz, C1 aRubio Franco, V J1 aAguado García, D uhttp://iacat.org/content/algoritmo-mixto-m%C3%ADnima-entrop%C3%ADa-m%C3%A1xima-informaci%C3%B3n-para-la-selecci%C3%B3n-de-%C3%ADtems-en-un-test00444nas a2200109 4500008004100000245007300041210006900114260002700183100001800210700001300228856009300241 2000 eng d00aApplying specific information item selection to a passage-based test0 aApplying specific information item selection to a passagebased t aNew Orleans, LA, April1 aThompson, T D1 aDavey, T uhttp://iacat.org/content/applying-specific-information-item-selection-passage-based-test00583nam a2200181 4500008004100000245005800041210005500099260005100154100001100205700001400216700001600230700001600246700001400262700001500276700001700291700001500308856007800323 2000 eng d00aComputerized adaptive testing: A primer (2nd edition)0 aComputerized adaptive testing A primer 2nd edition aHillsdale, N. J. : Lawrence Erlbaum Associates1 aWainer1 aDorans, N1 aEignor, D R1 aFlaugher, R1 aGreen, BF1 aMislevy, R1 aSteinberg, L1 aThissen, D uhttp://iacat.org/content/computerized-adaptive-testing-primer-2nd-edition00538nam a2200097 4500008004100000245011800041210006900159260008400228100001500312856011300327 2000 eng d00aThe construction and evaluation of a dynamic computerised adaptive test for the measurement of learning potential0 aconstruction and evaluation of a dynamic computerised adaptive t aUnpublished D. Litt et Phil dissertation. University of South Africa, Pretoria.1 aDe Beer, M uhttp://iacat.org/content/construction-and-evaluation-dynamic-computerised-adaptive-test-measurement-learning00605nas a2200145 4500008004100000245013100041210006900172260002000241100001400261700001600275700001400291700001400305700001900319856012100338 2000 eng d00aAn examination of exposure control and content balancing restrictions on item selection in CATs using the partial credit model0 aexamination of exposure control and content balancing restrictio aNew Orleans, LA1 aDavis, LL1 aPastor, D A1 aDodd, B G1 aChiang, C1 aFitzpatrick, S uhttp://iacat.org/content/examination-exposure-control-and-content-balancing-restrictions-item-selection-cats-using-001339nas a2200157 4500008004100000245006300041210006300104300001000167490000700177520083100184100002101015700001801036700002001054700002201074856008501096 2000 eng d00aItem selection algorithms in computerized adaptive testing0 aItem selection algorithms in computerized adaptive testing a12-140 v123 aStudied the efficacy of 3 different item selection algorithms in computerized adaptive testing. Ss were 395 university students (aged 20-25 yrs) in Spain. Ss were asked to submit answers via computer to 28 items of a personality questionnaire using item selection algorithms based on maximum item information, entropy, or mixed item-entropy algorithms. The results were evaluated according to ability of Ss to use item selection algorithms and number of questions. Initial results indicate that mixed criteria algorithms were more efficient than information or entropy algorithms for up to 15 questionnaire items, but that differences in efficiency decreased with increasing item number. Implications for developing computer adaptive testing methods are discussed. (PsycINFO Database Record (c) 2002 APA, all rights reserved).1 aGarcia, David, A1 aSanta Cruz, C1 aDorronsoro, J R1 aRubio Franco, V J uhttp://iacat.org/content/item-selection-algorithms-computerized-adaptive-testing00417nam a2200097 4500008004100000245007600041210006900117260002000186100001500206856009800221 2000 eng d00aLearning Potential Computerised Adaptive Test (LPCAT): Technical Manual0 aLearning Potential Computerised Adaptive Test LPCAT Technical Ma aPretoria: UNISA1 aDe Beer, M uhttp://iacat.org/content/learning-potential-computerised-adaptive-test-lpcat-technical-manual00410nam a2200097 4500008004100000245007300041210006900114260002000183100001500203856009400218 2000 eng d00aLearning Potential Computerised Adaptive Test (LPCAT): User's Manual0 aLearning Potential Computerised Adaptive Test LPCAT Users Manual aPretoria: UNISA1 aDe Beer, M uhttp://iacat.org/content/learning-potential-computerised-adaptive-test-lpcat-users-manual00395nas a2200109 4500008004100000245006100041210006100102260001600163100001300179700001100192856008200203 2000 eng d00aSpecific information item selection for adaptive testing0 aSpecific information item selection for adaptive testing aNew Orleans1 aDavey, T1 aFan, M uhttp://iacat.org/content/specific-information-item-selection-adaptive-testing00613nas a2200121 4500008004100000245009800041210006900139260013700208100001100345700001700356700001000373856010800383 2000 eng d00aTestlet response theory: An analog for the 3PL model useful in testlet-based adaptive testing0 aTestlet response theory An analog for the 3PL model useful in te aW. J. van der Linden and C. A. W. Glas (Eds.), Computerized Adaptive Testing: Theory and Practice (pp. 245-270). Norwell MA: Kluwer.1 aWainer1 aBradlow, E T1 aDu, Z uhttp://iacat.org/content/testlet-response-theory-analog-3pl-model-useful-testlet-based-adaptive-testing00488nas a2200133 4500008004100000245007400041210006700115260001300182100001600195700001300211700001300224700001400237856010300251 1999 eng d00aComputerized testing – Issues and applications (Mini-course manual)0 aComputerized testing Issues and applications Minicourse manual aMontreal1 aParshall, C1 aDavey, T1 aSpray, J1 aKalohn, J uhttp://iacat.org/content/computerized-testing-%E2%80%93-issues-and-applications-mini-course-manual00438nas a2200121 4500008004100000245006600041210006600107260001300173100001100186700001600197700001300213856009000226 1999 eng d00aConstructing adaptive tests to parallel conventional programs0 aConstructing adaptive tests to parallel conventional programs aMontreal1 aFan, M1 aThompson, T1 aDavey, T uhttp://iacat.org/content/constructing-adaptive-tests-parallel-conventional-programs-002467nam a2200133 4500008004100000245004300041210004300084260005200127520201600179653003402195100001502229700002402244856006502268 1999 eng d00aInnovations in computerized assessment0 aInnovations in computerized assessment aMahwah, N.J.bLawrence Erlbaum Associates, Inc.3 aChapters in this book present the challenges and dilemmas faced by researchers as they created new computerized assessments, focusing on issues addressed in developing, scoring, and administering the assessments. Chapters are: (1) "Beyond Bells and Whistles; An Introduction to Computerized Assessment" (Julie B. Olson-Buchanan and Fritz Drasgow); (2) "The Development of a Computerized Selection System for Computer Programmers in a Financial Services Company" (Michael J. Zickar, Randall C. Overton, L. Rogers Taylor, and Harvey J. Harms); (3) "Development of the Computerized Adaptive Testing Version of the Armed Services Vocational Aptitude Battery" (Daniel O. Segall and Kathleen E. Moreno); (4) "CAT for Certification and Licensure" (Betty A. Bergstrom and Mary E. Lunz); (5) "Developing Computerized Adaptive Tests for School Children" (G. Gage Kingsbury and Ronald L. Houser); (6) "Development and Introduction of a Computer Adaptive Graduate Record Examinations General Test" (Craig N. Mills); (7) "Computer Assessment Using Visual Stimuli: A Test of Dermatological Skin Disorders" (Terry A. Ackerman, John Evans, Kwang-Seon Park, Claudia Tamassia, and Ronna Turner); (8) "Creating Computerized Adaptive Tests of Music Aptitude: Problems, Solutions, and Future Directions" (Walter P. Vispoel); (9) "Development of an Interactive Video Assessment: Trials and Tribulations" (Fritz Drasgow, Julie B. Olson-Buchanan, and Philip J. Moberg); (10) "Computerized Assessment of Skill for a Highly Technical Job" (Mary Ann Hanson, Walter C. Borman, Henry J. Mogilka, Carol Manning, and Jerry W. Hedge); (11) "Easing the Implementation of Behavioral Testing through Computerization" (Wayne A. Burroughs, Janet Murray, S. Scott Wesley, Debra R. Medina, Stacy L. Penn, Steven R. Gordon, and Michael Catello); and (12) "Blood, Sweat, and Tears: Some Final Comments on Computerized Assessment." (Fritz Drasgow and Julie B. Olson-Buchanan). Each chapter contains references. (Contains 17 tables and 21 figures.) (SLD)10acomputerized adaptive testing1 aDrasgow, F1 aOlson-Buchanan, J B uhttp://iacat.org/content/innovations-computerized-assessment00520nas a2200133 4500008004100000245009300041210006900134260002100203100001600224700001400240700001400254700001400268856010400282 1999 eng d00aPerformance of the Sympson-Hetter exposure control algorithm with a polytomous item bank0 aPerformance of the SympsonHetter exposure control algorithm with aMontreal, Canada1 aPastor, D A1 aChiang, C1 aDodd, B G1 aYockey, R uhttp://iacat.org/content/performance-sympson-hetter-exposure-control-algorithm-polytomous-item-bank00386nas a2200121 4500008004100000245004400041210004400085260002100129100001300150700001700163700001800180856006600198 1999 eng d00aPretesting alongside an operational CAT0 aPretesting alongside an operational CAT aMontreal, Canada1 aDavey, T1 aPommerich, M1 aThompson, D T uhttp://iacat.org/content/pretesting-alongside-operational-cat00363nas a2200109 4500008004100000245004800041210004800089260002000137100001400157700001300171856006900184 1999 eng d00aPrinciples for administering adaptive tests0 aPrinciples for administering adaptive tests aMontreal Canada1 aMiller, T1 aDavey, T uhttp://iacat.org/content/principles-administering-adaptive-tests00606nas a2200097 4500008004100000245012700041210006900168260013500237100001400372856012200386 1999 eng d00aResearch and development of a computer-adaptive test of listening comprehension in the less-commonly taught language Hausa0 aResearch and development of a computeradaptive test of listening aM. Chalhoub-Deville (Ed.). Issues in computer-adaptive testing of reading proficiency. Cambridge, UK : Cambridge University Press.1 aDunkel, P uhttp://iacat.org/content/research-and-development-computer-adaptive-test-listening-comprehension-less-commonly-taught00400nas a2200109 4500008004100000245005700041210005700098260002000155100001400175700002100189856008000210 1998 eng d00aAlternatives for scoring computerized adaptive tests0 aAlternatives for scoring computerized adaptive tests aPhiladelphia PA1 aDodd, B G1 aFitzpatrick, S J uhttp://iacat.org/content/alternatives-scoring-computerized-adaptive-tests-000489nas a2200133 4500008004100000245005700041210005700098260005700155100001400212700002100226700001600247700001400263856007800277 1998 eng d00aAlternatives for scoring computerized adaptive tests0 aAlternatives for scoring computerized adaptive tests aMahwah, N.J., USAbLawrence Erlbaum Associates, Inc.1 aDodd, B G1 aFitzpatrick, S J1 aFremer, J J1 aWard, W C uhttp://iacat.org/content/alternatives-scoring-computerized-adaptive-tests00465nas a2200109 4500008004100000245009500041210006900136260001400205100001300219700001500232856010800247 1998 eng d00aApplication of an IRT ideal point model to computer adaptive assessment of job performance0 aApplication of an IRT ideal point model to computer adaptive ass aDallas TX1 aStark, S1 aDrasgow, F uhttp://iacat.org/content/application-irt-ideal-point-model-computer-adaptive-assessment-job-performance00540nas a2200133 4500008004100000245012500041210006900166300001200235490000700247100001200254700001100266700001400277856011500291 1998 eng d00aA comparison of maximum likelihood estimation and expected a posteriori estimation in CAT using the partial credit model0 acomparison of maximum likelihood estimation and expected a poste a569-5950 v581 aChen, S1 aHou, L1 aDodd, B G uhttp://iacat.org/content/comparison-maximum-likelihood-estimation-and-expected-posteriori-estimation-cat-using00553nas a2200157 4500008004100000245007600041210006900117260001400186100001600200700001600216700002000232700001500252700001400267700001800281856009600299 1998 eng d00aComputerized adaptive rating scales that measure contextual performance0 aComputerized adaptive rating scales that measure contextual perf aDallas TX1 aBorman, W C1 aHanson, M A1 aMontowidlo, S J1 aDrasgow, F1 aFoster, L1 aKubisiak, U C uhttp://iacat.org/content/computerized-adaptive-rating-scales-measure-contextual-performance00444nas a2200121 4500008004100000245006600041210006600107260001400173100001600187700001300203700001600216856009000232 1998 eng d00aConstructing adaptive tests to parallel conventional programs0 aConstructing adaptive tests to parallel conventional programs aSan Diego1 aThompson, T1 aDavey, T1 aNering, M L uhttp://iacat.org/content/constructing-adaptive-tests-parallel-conventional-programs-100458nas a2200121 4500008004100000245007300041210006900114260001500183100001600198700001300214700001600227856009300243 1998 eng d00aConstructing passage-based tests that parallel conventional programs0 aConstructing passagebased tests that parallel conventional progr aUrbana, IL1 aThompson, T1 aDavey, T1 aNering, M L uhttp://iacat.org/content/constructing-passage-based-tests-parallel-conventional-programs00409nas a2200109 4500008004100000245006000041210006000101260002400161100001300185700001600198856008500214 1998 eng d00aControlling item exposure and maintaining item security0 aControlling item exposure and maintaining item security a” Philadelphia PA1 aDavey, T1 aNering, M L uhttp://iacat.org/content/controlling-item-exposure-and-maintaining-item-security00426nas a2200109 4500008004100000245007000041210006900111260001500180100001300195700001600208856009200224 1998 eng d00aEvaluating and insuring measurement precision in adaptive testing0 aEvaluating and insuring measurement precision in adaptive testin aUrbana, IL1 aDavey, T1 aNering, M L uhttp://iacat.org/content/evaluating-and-insuring-measurement-precision-adaptive-testing00476nas a2200121 4500008004100000245008300041210006900124260001500193100001600208700001300224700001600237856010100253 1998 eng d00aA hybrid method for controlling item exposure in computerized adaptive testing0 ahybrid method for controlling item exposure in computerized adap aUrbana, IL1 aNering, M L1 aDavey, T1 aThompson, T uhttp://iacat.org/content/hybrid-method-controlling-item-exposure-computerized-adaptive-testing-000474nas a2200121 4500008004100000245008300041210006900124260001500193100001600208700001300224700001600237856009900253 1998 eng d00aA hybrid method for controlling item exposure in computerized adaptive testing0 ahybrid method for controlling item exposure in computerized adap aUrbana, IL1 aNering, M L1 aDavey, T1 aThompson, T uhttp://iacat.org/content/hybrid-method-controlling-item-exposure-computerized-adaptive-testing00426nas a2200121 4500008004100000245005900041210005900100260001800159100001800177700001300195700001600208856008000224 1998 eng d00aTest development exposure control for adaptive testing0 aTest development exposure control for adaptive testing aSan Diego, CA1 aParshall, C G1 aDavey, T1 aNering, M L uhttp://iacat.org/content/test-development-exposure-control-adaptive-testing00431nas a2200097 4500008004100000245008900041210006900130490001300199100001600212856010500228 1997 eng d00aComputer-adaptive testing of listening comprehension: A blueprint of CAT Development0 aComputeradaptive testing of listening comprehension A blueprint 0 vno. 10. 1 aDunkel, P A uhttp://iacat.org/content/computer-adaptive-testing-listening-comprehension-blueprint-cat-development00471nas a2200133 4500008004100000245007300041210006900114300001000183490000700193100001300200700001100213700001800224856009500242 1997 eng d00aDeveloping and scoring an innovative computerized writing assessment0 aDeveloping and scoring an innovative computerized writing assess a21-410 v341 aDavey, T1 aGodwin1 aMittelholz, D uhttp://iacat.org/content/developing-and-scoring-innovative-computerized-writing-assessment01795nas a2200169 4500008004100000245014100041210006900182300001200251490000700263520113700270653003401407100001401441700001301455700002101468700001401489856012201503 1997 eng d00aThe effect of population distribution and method of theta estimation on computerized adaptive testing (CAT) using the rating scale model0 aeffect of population distribution and method of theta estimation a422-4390 v573 aInvestigated the effect of population distribution on maximum likelihood estimation (MLE) and expected a posteriori estimation (EAP) in a simulation study of computerized adaptive testing (CAT) based on D. Andrich's (1978) rating scale model. Comparisons were made among MLE and EAP with a normal prior distribution and EAP with a uniform prior distribution within 2 data sets: one generated using a normal trait distribution and the other using a negatively skewed trait distribution. Descriptive statistics, correlations, scattergrams, and accuracy indices were used to compare the different methods of trait estimation. The EAP estimation with a normal prior or uniform prior yielded results similar to those obtained with MLE, even though the prior did not match the underlying trait distribution. An additional simulation study based on real data suggested that more work is needed to determine the optimal number of quadrature points for EAP in CAT based on the rating scale model. The choice between MLE and EAP for particular measurement situations is discussed. (PsycINFO Database Record (c) 2003 APA, all rights reserved).10acomputerized adaptive testing1 aChen, S-K1 aHou, L Y1 aFitzpatrick, S J1 aDodd, B G uhttp://iacat.org/content/effect-population-distribution-and-method-theta-estimation-computerized-adaptive-testing-cat00592nas a2200145 4500008004100000245014200041210006900183300001200252490000700264100001200271700001100283700002100294700001200315856011900327 1997 eng d00aThe effect of population distribution and methods of theta estimation on computerized adaptive testing (CAT) using the rating scale model0 aeffect of population distribution and methods of theta estimatio a422-4390 v571 aChen, S1 aHou, L1 aFitzpatrick, S J1 aDodd, B uhttp://iacat.org/content/effect-population-distribution-and-methods-theta-estimation-computerized-adaptive-testing00422nas a2200121 4500008004100000245005900041210005900100260001800159100001300177700001400190700001600204856008000220 1997 eng d00aRealistic simulation procedures for item response data0 aRealistic simulation procedures for item response data aGatlinburg TN1 aDavey, T1 aNering, M1 aThompson, T uhttp://iacat.org/content/realistic-simulation-procedures-item-response-data00380nas a2200121 4500008004100000245004400041210004400085260001800129100001400147700001800161700001300179856006600192 1997 eng d00aSimulation of realistic ability vectors0 aSimulation of realistic ability vectors aGatlinburg TN1 aNering, M1 aThompson, T D1 aDavey, T uhttp://iacat.org/content/simulation-realistic-ability-vectors00713nas a2200121 4500008004100000245008100041210006900122260025000191100001700441700001800458700001600476856009900492 1996 eng d00aAdaptive assessment and training using the neighbourhood of knowledge states0 aAdaptive assessment and training using the neighbourhood of know aFrasson, C. and Gauthier, G. and Lesgold, A. (eds.) Intelligent Tutoring Systems, Third International Conference, ITS'96, Montral, Canada, June 1996 Proceedings. Lecture Notes in Computer Science 1086. Berlin Heidelberg: Springer-Verlag 578-587.1 aDowling, C E1 aHockemeyer, C1 aLudwig, A H uhttp://iacat.org/content/adaptive-assessment-and-training-using-neighbourhood-knowledge-states00411nas a2200109 4500008004100000245006600041210006600107260001300173100001300186700001400199856008800213 1996 eng d00aConstructing adaptive tests to parallel conventional programs0 aConstructing adaptive tests to parallel conventional programs aNew York1 aDavey, T1 aThomas, L uhttp://iacat.org/content/constructing-adaptive-tests-parallel-conventional-programs00395nas a2200109 4500008004100000245006100041210006000102260001600162100001500178700001300193856007900206 1996 eng d00aPerson-fit indices and their role in the CAT environment0 aPersonfit indices and their role in the CAT environment aNew York NY1 aDavid, L A1 aLewis, C uhttp://iacat.org/content/person-fit-indices-and-their-role-cat-environment00566nas a2200121 4500008004100000245009500041210006900136260008100205100001500286700001200301700001700313856011400330 1996 eng d00aPreliminary cost-effectiveness analysis of alternative ASVAB testing concepts at MET sites0 aPreliminary costeffectiveness analysis of alternative ASVAB test aInterim report to Defense Manpower Data Center. Fairfax, VA: Lewin-VHI, Inc.1 aHogan, P F1 aDall, T1 aMcBride, J R uhttp://iacat.org/content/preliminary-cost-effectiveness-analysis-alternative-asvab-testing-concepts-met-sites00519nas a2200121 4500008004100000245012100041210006900162300001200231490000600243100001400249700001700263856011700280 1996 eng d00aValidity of item selection: A comparison of automated computerized adaptive and manual paper and pencil examinations0 aValidity of item selection A comparison of automated computerize a152-1570 v81 aLunz, M E1 aDeville, C W uhttp://iacat.org/content/validity-item-selection-comparison-automated-computerized-adaptive-and-manual-paper-and01004nas a2200145 4500008004100000245005600041210005600097300001200153490000700165520056200172100001400734700002000748700001400768856007600782 1995 eng d00aComputerized adaptive testing with polytomous items0 aComputerized adaptive testing with polytomous items a5–22.0 v193 aDiscusses polytomous item response theory models and the research that has been conducted to investigate a variety of possible operational procedures (item bank, item selection, trait estimation, stopping rule) for polytomous model-based computerized adaptive testing (PCAT). Studies are reviewed that compared PCAT systems based on competing item response theory models that are appropriate for the same measurement objective, as well as applications of PCAT in marketing and educational psychology. Directions for future research using PCAT are suggested.1 aDodd, B G1 ade Ayala, R. J.1 aKoch, W R uhttp://iacat.org/content/computerized-adaptive-testing-polytomous-items00432nas a2200133 4500008004500000245005600045210005600101300000900157490000700166100001400173700001800187700001500205856007800220 1995 Engldsh 00aComputerized Adaptive Testing With Polytomous Items0 aComputerized Adaptive Testing With Polytomous Items a5-220 v191 aDodd, B G1 aDe Ayala, R J1 aKoch. W.R. uhttp://iacat.org/content/computerized-adaptive-testing-polytomous-items-000548nas a2200133 4500008004100000245011000041210006900151260001800220100001200238700001100250700002100261700001400282856011800296 1995 eng d00aThe effect of population distribution and methods of theta estimation on CAT using the rating scale model0 aeffect of population distribution and methods of theta estimatio aSan Francisco1 aChen, S1 aHou, L1 aFitzpatrick, S J1 aDodd, B G uhttp://iacat.org/content/effect-population-distribution-and-methods-theta-estimation-cat-using-rating-scale-model00644nas a2200133 4500008004100000245017200041210006900213260004600282100001900328700001700347700001500364700001300379856011800392 1995 eng d00aThe introduction and comparability of the computer-adaptive GRE General Test (GRE Board Professional Report 88-08ap; Educational Testing Service Research Report 95-20)0 aintroduction and comparability of the computeradaptive GRE Gener aPrinceton NJ: Educational Testing Service1 aSchaeffer, G A1 aSteffen, M L1 aMills, C N1 aDurso, R uhttp://iacat.org/content/introduction-and-comparability-computer-adaptive-gre-general-test-gre-board-professional00509nas a2200121 4500008004100000245011200041210006900153300001300222490000700235100001400242700001400256856011700270 1995 eng d00aAn investigation of procedures for computerized adaptive testing using the successive intervals Rasch model0 ainvestigation of procedures for computerized adaptive testing us a976-990.0 v551 aKoch, W R1 aDodd, B G uhttp://iacat.org/content/investigation-procedures-computerized-adaptive-testing-using-successive-intervals-rasch00476nas a2200109 4500008004100000245009400041210006900135260002100204100001300225700001800238856011000256 1995 eng d00aNew algorithms for item selection and exposure control with computerized adaptive testing0 aNew algorithms for item selection and exposure control with comp aSan Francisco CA1 aDavey, T1 aParshall, C G uhttp://iacat.org/content/new-algorithms-item-selection-and-exposure-control-computerized-adaptive-testing00545nas a2200109 4500008004100000245007200041210006900113260013400182100001700316700001600333856008600349 1995 eng d00aPrerequisite relationships for the adaptive assessment of knowledge0 aPrerequisite relationships for the adaptive assessment of knowle aGreer, J. (Ed.) Proceedings of AIED'95, 7th World Conference on Artificial Intelligence in Education, Washington, DC, AACE 43-50.1 aDowling, C E1 aKaluscha, R uhttp://iacat.org/content/prerequisite-relationships-adaptive-assessment-knowledge00396nas a2200109 4500008004100000245005800041210005800099260001900157100001600176700001500192856007900207 1995 eng d00aSome new methods for content balancing adaptive tests0 aSome new methods for content balancing adaptive tests aMinneapolis MN1 aSegall, D O1 aDavey, T C uhttp://iacat.org/content/some-new-methods-content-balancing-adaptive-tests00394nas a2200121 4500008004100000245005600041210005500097300000800152490001000160100001400170700001500184856007300199 1994 eng d00aComputer adaptive testing: Assessment of the future0 aComputer adaptive testing Assessment of the future a1-30 v4 (2)1 aDiones, R1 aEverson, H uhttp://iacat.org/content/computer-adaptive-testing-assessment-future00519nas a2200121 4500008004100000245008900041210006900130260004600199100001000245700001300255700001700268856011200285 1994 eng d00aComputerized mastery testing using fuzzy set decision theory (Research Report 94-37)0 aComputerized mastery testing using fuzzy set decision theory Res aPrinceton NJ: Educational Testing Service1 aDu, Y1 aLewis, C1 aPashley, P J uhttp://iacat.org/content/computerized-mastery-testing-using-fuzzy-set-decision-theory-research-report-94-3700429nam a2200097 4500008004100000245006600041210006400107260006100171100001300232856008600245 1993 eng d00aA comparison of computer adaptive test administration methods0 acomparison of computer adaptive test administration methods aUnpublished doctoral dissertation, University of Chicago1 aDolan, S uhttp://iacat.org/content/comparison-computer-adaptive-test-administration-methods00478nas a2200109 4500008004100000245009500041210006900136260002000205100001300225700001400238856011600252 1993 eng d00aComputerized adaptive testing in computer science: assessing student programming abilities0 aComputerized adaptive testing in computer science assessing stud aIndianapolis IN1 aSyang, A1 aDale, N B uhttp://iacat.org/content/computerized-adaptive-testing-computer-science-assessing-student-programming-abilities01363nas a2200145 4500008004100000245013200041210006900173300001100242490000700253520078900260100001401049700001401063700002001077856012001097 1993 eng d00aComputerized adaptive testing using the partial credit model: Effects of item pool characteristics and different stopping rules0 aComputerized adaptive testing using the partial credit model Eff a61-77.0 v533 aSimulated datasets were used to research the effects of the systematic variation of three major variables on the performance of computerized adaptive testing (CAT) procedures for the partial credit model. The three variables studied were the stopping rule for terminating the CATs, item pool size, and the distribution of the difficulty of the items in the pool. Results indicated that the standard error stopping rule performed better across the variety of CAT conditions than the minimum information stopping rule. In addition it was found that item pools that consisted of as few as 30 items were adequate for CAT provided that the item pool was of medium difficulty. The implications of these findings for implementing CAT systems based on the partial credit model are discussed. 1 aDodd, B G1 aKoch, W R1 ade Ayala, R. J. uhttp://iacat.org/content/computerized-adaptive-testing-using-partial-credit-model-effects-item-pool-characteristics00453nas a2200133 4500008004100000245006500041210006500106300001200171490000600183100001000189700001300199700001700212856009000229 1993 eng d00aComputerized mastery testing using fuzzy set decision theory0 aComputerized mastery testing using fuzzy set decision theory a181-1930 v61 aDu, Y1 aLewis, C1 aPashley, P J uhttp://iacat.org/content/computerized-mastery-testing-using-fuzzy-set-decision-theory00753nas a2200241 4500008004100000020002200041245006700063210006400130250001500194260000800209300001100217490000700228653001500235653002600250653003700276653002300313653001800336100002100354700001400375700002400389700001400413856008400427 1993 eng d a0744-6314 (Print)00aMoving in a new direction: Computerized adaptive testing (CAT)0 aMoving in a new direction Computerized adaptive testing CAT a1993/01/01 cJan a80, 820 v2410a*Computers10aAccreditation/methods10aEducational Measurement/*methods10aLicensure, Nursing10aUnited States1 aJones-Dickson, C1 aDorsey, D1 aCampbell-Warnock, J1 aFields, F uhttp://iacat.org/content/moving-new-direction-computerized-adaptive-testing-cat00414nas a2200121 4500008004100000245006300041210005900104300001000163490000700173100001800180700001600198856007800214 1992 eng d00aThe application of latent class models in adaptive testing0 aapplication of latent class models in adaptive testing a71-880 v571 aMacready, G B1 aDayton, C M uhttp://iacat.org/content/application-latent-class-models-adaptive-testing00517nas a2200133 4500008004100000245009900041210006900140300001000209490000600219100001800225700001400243700001400257856011200271 1992 eng d00aA comparison of the partial credit and graded response models in computerized adaptive testing0 acomparison of the partial credit and graded response models in c a17-340 v51 aDe Ayala, R J1 aDodd, B G1 aKoch, W R uhttp://iacat.org/content/comparison-partial-credit-and-graded-response-models-computerized-adaptive-testing00569nas a2200145 4500008004100000245009700041210006900138260002100207100001700228700001200245700001900257700001500276700001300291856011900304 1992 eng d00aHow review options and administration mode influence scores on computerized vocabulary tests0 aHow review options and administration mode influence scores on c aSan Francisco CA1 aVispoel, W P1 aWang, T1 aDe la Torre, R1 aBleiler, T1 aDings, J uhttp://iacat.org/content/how-review-options-and-administration-mode-influence-scores-computerized-vocabulary-tests00387nas a2200109 4500008004100000245006200041210005800103300001200161490000700173100002000180856007700200 1992 eng d00aThe influence of dimensionality on CAT ability estimation0 ainfluence of dimensionality on CAT ability estimation a513-5280 v521 ade Ayala, R. J. uhttp://iacat.org/content/influence-dimensionality-cat-ability-estimation00400nas a2200109 4500008004500000245006400045210006000109300001200169490000700181100001800188856008400206 1992 Engldsh 00aThe Nominal Response Model in Computerized Adaptive Testing0 aNominal Response Model in Computerized Adaptive Testing a327-3430 v151 aDe Ayals, R J uhttp://iacat.org/content/nominal-response-model-computerized-adaptive-testing-000396nas a2200109 4500008004100000245006400041210006000105300001200165490000700177100002000184856008200204 1992 eng d00aThe nominal response model in computerized adaptive testing0 anominal response model in computerized adaptive testing a327-3430 v161 ade Ayala, R. J. uhttp://iacat.org/content/nominal-response-model-computerized-adaptive-testing00435nas a2200097 4500008004100000245007900041210006900120260004500189100001500234856008800249 1991 eng d00aAn analysis of CAT-ASVAB scores in the Marine Corps JPM data (CRM- 91-161)0 aanalysis of CATASVAB scores in the Marine Corps JPM data CRM 911 aAlexandria VA: Center for Naval Analysis1 aDivgi, D R uhttp://iacat.org/content/analysis-cat-asvab-scores-marine-corps-jpm-data-crm-91-16100531nas a2200133 4500008004100000245007400041210006900115260006600184100001500250700001400265700001600279700001300295856008900308 1991 eng d00aCollected works on the legal aspects of computerized adaptive testing0 aCollected works on the legal aspects of computerized adaptive te aChicago, IL: National Council of State Boards of Nursing, Inc1 aStenson, H1 aGraves, P1 aGardiner, J1 aDally, L uhttp://iacat.org/content/collected-works-legal-aspects-computerized-adaptive-testing00441nas a2200109 4500008004100000245007700041210006900118260001500187100001900202700001700221856009300238 1991 eng d00aThe development and evaluation of a computerized adaptive testing system0 adevelopment and evaluation of a computerized adaptive testing sy aChicago IL1 aDe la Torre, R1 aVispoel, W P uhttp://iacat.org/content/development-and-evaluation-computerized-adaptive-testing-system00416nas a2200133 4500008004100000245005100041210005100092300001000143490000700153100001400160700001400174700002100188856007300209 1990 eng d00aComputerized adaptive measurement of attitudes0 aComputerized adaptive measurement of attitudes a20-300 v231 aKoch, W R1 aDodd, B G1 aFitzpatrick, S J uhttp://iacat.org/content/computerized-adaptive-measurement-attitudes00511nam a2200169 4500008003900000245005100039210004700090260002600137100001100163700001600174700001600190700001400206700001700220700001700237700001500254856007200269 1990 d00aComputerized adaptive testing: A primer (Eds.)0 aComputerized adaptive testing A primer Eds aHillsdale NJ: Erlbaum1 aWainer1 aDorans, N J1 aFlaugher, R1 aGreen, BF1 aMislevy, R J1 aSteinberg, L1 aThissen, D uhttp://iacat.org/content/computerized-adaptive-testing-primer-eds-201698nas a2200121 4500008004100000245013100041210006900172300001200241490000700253520118500260100001401445856011701459 1990 eng d00aThe effect of item selection procedure and stepsize on computerized adaptive attitude measurement using the rating scale model0 aeffect of item selection procedure and stepsize on computerized  a355-3860 v143 aReal and simulated datasets were used to investigate the effects of the systematic variation of two major variables on the operating characteristics of computerized adaptive testing (CAT) applied to instruments consisting of poly- chotomously scored rating scale items. The two variables studied were the item selection procedure and the stepsize method used until maximum likelihood trait estimates could be calculated. The findings suggested that (1) item pools that consist of as few as 25 items may be adequate for CAT; (2) the variable stepsize method of preliminary trait estimation produced fewer cases of nonconvergence than the use of a fixed stepsize procedure; and (3) the scale value item selection procedure used in conjunction with a minimum standard error stopping rule outperformed the information item selection technique used in conjunction with a minimum information stopping rule in terms of the frequencies of nonconvergent cases, the number of items administered, and the correlations of CAT 0 estimates with full scale estimates and known 0 values. The implications of these findings for implementing CAT with rating scale items are discussed. Index terms: 1 aDodd, B G uhttp://iacat.org/content/effect-item-selection-procedure-and-stepsize-computerized-adaptive-attitude-measurement00507nas a2200109 4500008004500000245013100045210006900176300001200245490000700257100001400264856011900278 1990 Engldsh 00aThe Effect of Item Selection Procedure and Stepsize on Computerized Adaptive Attitude Measurement Using the Rating Scale Model0 aEffect of Item Selection Procedure and Stepsize on Computerized  a355-3660 v141 aDodd, B G uhttp://iacat.org/content/effect-item-selection-procedure-and-stepsize-computerized-adaptive-attitude-measurement-000479nas a2200157 4500008004100000245002200041210002200063260009900085100001100184700001600195700001400211700001700225700001700242700001500259856004700274 1990 eng d00aFuture challenges0 aFuture challenges aH. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 233-272). Hillsdale NJ: Erlbaum.1 aWainer1 aDorans, N J1 aGreen, BF1 aMislevy, R J1 aSteinberg, L1 aThissen, D uhttp://iacat.org/content/future-challenges01504nas a2200157 4500008004100000245008900041210006900130300001200199490000700211520093700218653003401155100002001189700001401209700001401223856010901237 1990 eng d00aA simulation and comparison of flexilevel and Bayesian computerized adaptive testing0 asimulation and comparison of flexilevel and Bayesian computerize a227-2390 v273 aComputerized adaptive testing (CAT) is a testing procedure that adapts an examination to an examinee's ability by administering only items of appropriate difficulty for the examinee. In this study, the authors compared Lord's flexilevel testing procedure (flexilevel CAT) with an item response theory-based CAT using Bayesian estimation of ability (Bayesian CAT). Three flexilevel CATs, which differed in test length (36, 18, and 11 items), and three Bayesian CATs were simulated; the Bayesian CATs differed from one another in the standard error of estimate (SEE) used for terminating the test (0.25, 0.10, and 0.05). Results showed that the flexilevel 36- and 18-item CATs produced ability estimates that may be considered as accurate as those of the Bayesian CAT with SEE = 0.10 and comparable to the Bayesian CAT with SEE = 0.05. The authors discuss the implications for classroom testing and for item response theory-based CAT.10acomputerized adaptive testing1 ade Ayala, R. J.1 aDodd, B G1 aKoch, W R uhttp://iacat.org/content/simulation-and-comparison-flexilevel-and-bayesian-computerized-adaptive-testing00498nas a2200109 4500008004100000245011900041210006900160300001200229490000700241100002000248856012000268 1989 eng d00aA comparison of the nominal response model and the three-parameter logistic model in computerized adaptive testing0 acomparison of the nominal response model and the threeparameter  a789-8050 v491 ade Ayala, R. J. uhttp://iacat.org/content/comparison-nominal-response-model-and-three-parameter-logistic-model-computerized-adaptive00391nas a2200109 4500008004500000245006000045210006000105300001200165490000700177100001500184856008200199 1989 Engldsh 00aEstimating Reliabilities of Computerized Adaptive Tests0 aEstimating Reliabilities of Computerized Adaptive Tests a145-1490 v131 aDivgi, D R uhttp://iacat.org/content/estimating-reliabilities-computerized-adaptive-tests00489nas a2200121 4500008004100000245009800041210006900139300001200208490000600220100001400226700001400240856011300254 1989 eng d00aAn investigation of procedures for computerized adaptive testing using partial credit scoring0 ainvestigation of procedures for computerized adaptive testing us a335-3570 v21 aKoch, W R1 aDodd, B G uhttp://iacat.org/content/investigation-procedures-computerized-adaptive-testing-using-partial-credit-scoring00523nas a2200133 4500008004500000245009500045210006900140300001200209490000700221100001400228700001400242700001800256856011500274 1989 Engldsh 00aOperational Characteristics of Adaptive Testing Procedures Using the Graded Response Model0 aOperational Characteristics of Adaptive Testing Procedures Using a129-1430 v131 aDodd, B G1 aKoch, W R1 aDe Ayala, R J uhttp://iacat.org/content/operational-characteristics-adaptive-testing-procedures-using-graded-response-model-000519nas a2200133 4500008004100000245009500041210006900136300001200205490000700217100001400224700001400238700002000252856011300272 1989 eng d00aOperational characteristics of adaptive testing procedures using the graded response model0 aOperational characteristics of adaptive testing procedures using a129-1430 v131 aDodd, B G1 aKoch, W R1 ade Ayala, R. J. uhttp://iacat.org/content/operational-characteristics-adaptive-testing-procedures-using-graded-response-model00520nas a2200121 4500008004100000245010800041210006900149260001600218100001400234700001400248700002000262856011600282 1988 eng d00aComputerized adaptive attitude measurement: A comparison of the graded response and rating scale models0 aComputerized adaptive attitude measurement A comparison of the g aNew Orleans1 aDodd, B G1 aKoch, W R1 ade Ayala, R. J. uhttp://iacat.org/content/computerized-adaptive-attitude-measurement-comparison-graded-response-and-rating-scale00529nas a2200121 4500008004100000245010800041210006900149300000900218490000700227653003400234100002000268856011900288 1988 eng d00aComputerized adaptive testing: A comparison of the nominal response model and the three parameter model0 aComputerized adaptive testing A comparison of the nominal respon a31480 v4810acomputerized adaptive testing1 ade Ayala, R. J. uhttp://iacat.org/content/computerized-adaptive-testing-comparison-nominal-response-model-and-three-parameter-model00497nam a2200097 4500008004100000245009800041210006900139260006800208100001600276856010700292 1988 eng d00aComputerized adaptive testing: The state of the art in assessment at three community colleges0 aComputerized adaptive testing The state of the art in assessment aLaguna Hills CA: League for Innovation in the Community College1 aDoucette, D uhttp://iacat.org/content/computerized-adaptive-testing-state-art-assessment-three-community-colleges-000511nas a2200109 4500008004100000245011700041210006900158260001800227100002000245700001400265856012200279 1987 eng d00aComputerized adaptive testing: A comparison of the nominal response model and the three-parameter logistic model0 aComputerized adaptive testing A comparison of the nominal respon aWashington DC1 ade Ayala, R. J.1 aKoch, W R uhttp://iacat.org/content/computerized-adaptive-testing-comparison-nominal-response-model-and-three-parameter-logistic00367nas a2200097 4500008004100000245006200041210006200103260001200165100001400177856007800191 1987 eng d00aComputerized adaptive testing with the rating scale model0 aComputerized adaptive testing with the rating scale model aChicago1 aDodd, B G uhttp://iacat.org/content/computerized-adaptive-testing-rating-scale-model00505nas a2200097 4500008004100000245011600041210006900157260004500226100001500271856012100286 1987 eng d00aProperties of some Bayesian scoring procedures for computerized adaptive tests (Research Memorandum CRM 87-161)0 aProperties of some Bayesian scoring procedures for computerized  aAlexandria VA: Center for Naval Analyses1 aDivgi, D R uhttp://iacat.org/content/properties-some-bayesian-scoring-procedures-computerized-adaptive-tests-research-memorandum00529nas a2200097 4500008004100000245014000041210006900181260004500250100001500295856012100310 1986 eng d00aDetermining the sensitivity of CAT-ASVAB scores to changes in item response curves with the medium of administration (Report No.86-189)0 aDetermining the sensitivity of CATASVAB scores to changes in ite aAlexandria VA: Center for Naval Analyses1 aDivgi, D R uhttp://iacat.org/content/determining-sensitivity-cat-asvab-scores-changes-item-response-curves-medium-administration00442nas a2200121 4500008004100000245007200041210006900113300000800182490000600190100002000196700001400216856009000230 1985 eng d00aALPHATAB: A lookup table for Bayesian computerized adaptive testing0 aALPHATAB A lookup table for Bayesian computerized adaptive testi a3260 v91 ade Ayala, R. J.1 aKoch, W R uhttp://iacat.org/content/alphatab-lookup-table-bayesian-computerized-adaptive-testing00357nas a2200109 4500008004100000245004700041210004700088260001200135100001400147700001400161856007200175 1985 eng d00aComputerized adaptive attitude measurement0 aComputerized adaptive attitude measurement aChicago1 aKoch, W R1 aDodd, B G uhttp://iacat.org/content/computerized-adaptive-attitude-measurement00517nas a2200121 4500008004100000245011900041210006900160300001200229490000700241100001500248700001600263856011600279 1985 eng d00aImplications for altering the context in which test items appear: A historical perspective on an immediate concern0 aImplications for altering the context in which test items appear a387-4130 v551 aLeary, L F1 aDorans, N J uhttp://iacat.org/content/implications-altering-context-which-test-items-appear-historical-perspective-immediate00483nas a2200121 4500008004500000245008700045210006900132300001200201490000600213100001800219700001600237856010800253 1984 Engldsh 00aItem Location Effects and Their Implications for IRT Equating and Adaptive Testing0 aItem Location Effects and Their Implications for IRT Equating an a147-1540 v81 aKingston, N M1 aDorans, N J uhttp://iacat.org/content/item-location-effects-and-their-implications-irt-equating-and-adaptive-testing00583nas a2200109 4500008004100000245015200041210006900193260006500262100001400327700001600341856011600357 1983 eng d00aTailored testing, its theory and practice. Part I: The basic model, the normal ogive submodels, and the tailored testing algorithm (NPRDC TR-83-00)0 aTailored testing its theory and practice Part I The basic model  aSan Diego CA: Navy Personnel Research and Development Center1 aUrry, V W1 aDorans, N J uhttp://iacat.org/content/tailored-testing-its-theory-and-practice-part-i-basic-model-normal-ogive-submodels-and00483nas a2200121 4500008004100000245006900041210006600110260005000176100002000226700001500246700001500261856008500276 1981 eng d00aA comparison of two methods of interactive testing Final report.0 acomparison of two methods of interactive testing Final report aNational Institute of Education Grant 79-10451 aNicewander, W A1 aChang, H S1 aDoody, E N uhttp://iacat.org/content/comparison-two-methods-interactive-testing-final-report00424nas a2200109 4500008004100000245006300041210006300104260003700167100001200204700001300216856008500229 1977 eng d00aGroup tailored tests and some problems of their utlization0 aGroup tailored tests and some problems of their utlization aLeyden, The Netherlandsc06/19771 aLewy, A1 aDoron, R uhttp://iacat.org/content/group-tailored-tests-and-some-problems-their-utlization00455nas a2200121 4500008004100000245007800041210006900119300001200188490000600200100001600206700001400222856009700236 1976 eng d00aHardware and software evolution of an adaptive ability measurement system0 aHardware and software evolution of an adaptive ability measureme a104-1070 v81 aDeWitt, L J1 aWeiss, DJ uhttp://iacat.org/content/hardware-and-software-evolution-adaptive-ability-measurement-system00511nas a2200109 4500008004100000245007500041210006900116260008500185100001600270700001700286856009800303 1975 eng d00aBest test design and self-tailored testing (Research Memorandum No 19)0 aBest test design and selftailored testing Research Memorandum No aChicago: University of Chicago, Department of Education, Statistical Laboratory.1 aWright, B D1 aDouglas, G A uhttp://iacat.org/content/best-test-design-and-self-tailored-testing-research-memorandum-no-1900554nas a2200109 4500008004100000245008700041210006900128260011200197100001700309700001400326856010400340 1974 eng d00aA computer software system for adaptive ability measurement (Research Report 74-1)0 acomputer software system for adaptive ability measurement Resear aMinneapolis MN: University of Minnesota, Department of Psychology, Computerized Adaptive Testing Laboratory1 aDe Witt, J J1 aWeiss, DJ uhttp://iacat.org/content/computer-software-system-adaptive-ability-measurement-research-report-74-100736nas a2200145 4500008004100000245018400041210006900225260010800294100001600402700001700418700001500435700001100450700001200461856011700473 1974 eng d00aComputer-based adaptive testing models for the Air Force technical training environment: Phase I: Development of a computerized measurement system for Air Force technical Training0 aComputerbased adaptive testing models for the Air Force technica aJSAS Catalogue of Selected Documents in Psychology, 5, 1-86 (MS No. 882). AFHRL Technical Report 74-48.1 aHansen, D N1 aJohnson, B F1 aFagan, R L1 aTan, P1 aDick, W uhttp://iacat.org/content/computer-based-adaptive-testing-models-air-force-technical-training-environment-phase-i