TY - JOUR T1 - Three Measures of Test Adaptation Based on Optimal Test Information JF - Journal of Computerized Adaotive Testing Y1 - 2020 A1 - G. Gage Kingsbury A1 - Steven L. Wise VL - 8 UR - http://iacat.org/jcat/index.php/jcat/article/view/80/37 IS - 1 ER - TY - JOUR T1 - Three Measures of Test Adaptation Based on Optimal Test Information JF - Journal of Computerized Adaotive Testing Y1 - 2020 A1 - G. Gage Kingsbury A1 - Steven L. Wise VL - 8 UR - http://iacat.org/jcat/index.php/jcat/article/view/80/37 IS - 1 ER - TY - JOUR T1 - Time-Efficient Adaptive Measurement of Change JF - Journal of Computerized Adaptive Testing Y1 - 2019 A1 - Matthew Finkelman A1 - Chun Wang KW - adaptive measurement of change KW - computerized adaptive testing KW - Fisher information KW - item selection KW - response-time modeling AB -

The adaptive measurement of change (AMC) refers to the use of computerized adaptive testing (CAT) at multiple occasions to efficiently assess a respondent’s improvement, decline, or sameness from occasion to occasion. Whereas previous AMC research focused on administering the most informative item to a respondent at each stage of testing, the current research proposes the use of Fisher information per time unit as an item selection procedure for AMC. The latter procedure incorporates not only the amount of information provided by a given item but also the expected amount of time required to complete it. In a simulation study, the use of Fisher information per time unit item selection resulted in a lower false positive rate in the majority of conditions studied, and a higher true positive rate in all conditions studied, compared to item selection via Fisher information without accounting for the expected time taken. Future directions of research are suggested.

VL - 7 UR - http://iacat.org/jcat/index.php/jcat/article/view/73/35 IS - 2 ER - TY - JOUR T1 - A Top-Down Approach to Designing the Computerized Adaptive Multistage Test JF - Journal of Educational Measurement Y1 - 2018 A1 - Luo, Xiao A1 - Kim, Doyoung AB - Abstract The top-down approach to designing a multistage test is relatively understudied in the literature and underused in research and practice. This study introduced a route-based top-down design approach that directly sets design parameters at the test level and utilizes the advanced automated test assembly algorithm seeking global optimality. The design process in this approach consists of five sub-processes: (1) route mapping, (2) setting objectives, (3) setting constraints, (4) routing error control, and (5) test assembly. Results from a simulation study confirmed that the assembly, measurement and routing results of the top-down design eclipsed those of the bottom-up design. Additionally, the top-down design approach provided unique insights into design decisions that could be used to refine the test. Regardless of these advantages, it is recommended applying both top-down and bottom-up approaches in a complementary manner in practice. VL - 55 UR - https://onlinelibrary.wiley.com/doi/abs/10.1111/jedm.12174 ER - TY - JOUR T1 - Termination Criteria in Computerized Adaptive Tests: Do Variable-Length CATs Provide Efficient and Effective Measurement? JF - Journal of Computerized Adaptive Testing Y1 - 2012 A1 - Babcock, B. A1 - Weiss, D. J. VL - 1 IS - 1 ER - TY - CONF T1 - A Test Assembly Model for MST T2 - Annual Conference of the International Association for Computerized Adaptive Testing Y1 - 2011 A1 - Angela Verschoor A1 - Ingrid Radtke A1 - Theo Eggen KW - CAT KW - mst KW - multistage testing KW - Rasch KW - routing KW - tif AB -

This study is just a short exploration in the matter of optimization of a MST. It is extremely hard or maybe impossible to chart influence of item pool and test specifications on optimization process. Simulations are very helpful in finding an acceptable MST.

JF - Annual Conference of the International Association for Computerized Adaptive Testing ER - TY - CHAP T1 - Testlet-Based Adaptive Mastery Testing T2 - Elements of Adaptive Testing Y1 - 2010 A1 - Vos, H. J. A1 - Glas, C. A. W. JF - Elements of Adaptive Testing ER - TY - JOUR T1 - Tests informatizados y otros nuevos tipos de tests [Computerized and other new types of tests] JF - Papeles del Psicólogo Y1 - 2010 A1 - Olea, J. A1 - Abad, F. J. A1 - Barrada, J AB - Recientemente se ha producido un considerable desarrollo de los tests adaptativos informatizados, en los que el test se adapta progresivamente al rendimiento del evaluando, y de otros tipos de tests: a) los test basados en modelos (se dispone de un modelo o teoría de cómo se responde a cada ítem, lo que permite predecir su dificultad), b) los tests ipsativos (el evaluado ha de elegir entre opciones que tienen parecida deseabilidad social, por lo que pueden resultar eficaces para controlar algunos sesgos de respuestas), c) los tests conductuales (miden rasgos que ordinariamente se han venido midiendo con autoinformes, mediante tareas que requieren respuestas no verbales) y d) los tests situacionales (en los que se presenta al evaluado una situación de conflicto laboral, por ejemplo, con varias posibles soluciones, y ha de elegir la que le parece la mejor descripción de lo que el haría en esa situación). El artículo comenta las características, ventajas e inconvenientes de todos ellos y muestra algunos ejemplos de tests concretos. Palabras clave: Test adaptativo informatizado, Test situacional, Test comportamental, Test ipsativo y generación automática de ítems.The paper provides a short description of some test types that are earning considerable interest in both research and applied areas. The main feature of a computerized adaptive test is that in despite of the examinees receiving different sets of items, their test scores are in the same metric and can be directly compared. Four other test types are considered: a) model-based tests (a model or theory is available to explain the item response process and this makes the prediction of item difficulties possible), b) ipsative tests (the examinee has to select one among two or more options with similar social desirability; so, these tests can help to control faking or other examinee’s response biases), c) behavioral tests (personality traits are measured from non-verbal responses rather than from self-reports), and d) situational tests (the examinee faces a conflictive situation and has to select the option that best describes what he or she will do). The paper evaluates these types of tests, comments on their pros and cons and provides some specific examples. Key words: Computerized adaptive test, Situational test, Behavioral test, Ipsative test and y automatic item generation. VL - 31 ER - TY - CHAP T1 - Three-Category Adaptive Classification Testing T2 - Elements of Adaptive Testing Y1 - 2010 A1 - Theo Eggen JF - Elements of Adaptive Testing ER - TY - CHAP T1 - Termination criteria in computerized adaptive tests: Variable-length CATs are not biased. Y1 - 2009 A1 - Babcock, B. A1 - Weiss, D. J. CY - D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. ER - TY - CHAP T1 - Test overlap rate and item exposure rate as indicators of test security in CATs Y1 - 2009 A1 - Barrada, J A1 - Olea, J. A1 - Ponsoda, V. A1 - Abad, F. J. CY - D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - PDF File, 261 K ER - TY - JOUR T1 - To Weight Or Not To Weight? Balancing Influence Of Initial Items In Adaptive Testing JF - Psychometrica Y1 - 2008 A1 - Chang, H.-H. A1 - Ying, Z. AB -

It has been widely reported that in computerized adaptive testing some examinees may get much lower scores than they would normally if an alternative paper-and-pencil version were given. The main purpose of this investigation is to quantitatively reveal the cause for the underestimation phenomenon. The logistic models, including the 1PL, 2PL, and 3PL models, are used to demonstrate our assertions. Our analytical derivation shows that, under the maximum information item selection strategy, if an examinee failed a few items at the beginning of the test, easy but more discriminating items are likely to be administered. Such items are ineffective to move the estimate close to the true theta, unless the test is sufficiently long or a variable-length test is used. Our results also indicate that a certain weighting mechanism is necessary to make the algorithm rely less on the items administered at the beginning of the test.

VL - 73 IS - 3 ER - TY - JOUR T1 - Transitioning from fixed-length questionnaires to computer-adaptive versions JF - Zeitschrift für Psychologie \ Journal of Psychology Y1 - 2008 A1 - Walter, O. B. A1 - Holling, H. VL - 216(1) ER - TY - JOUR T1 - Test design optimization in CAT early stage with the nominal response model JF - Applied Psychological Measurement Y1 - 2007 A1 - Passos, V. L. A1 - Berger, M. P. F. A1 - Tan, F. E. KW - computerized adaptive testing KW - nominal response model KW - robust performance KW - test design optimization AB - The early stage of computerized adaptive testing (CAT) refers to the phase of the trait estimation during the administration of only a few items. This phase can be characterized by bias and instability of estimation. In this study, an item selection criterion is introduced in an attempt to lessen this instability: the D-optimality criterion. A polytomous unconstrained CAT simulation is carried out to evaluate this criterion's performance under different test premises. The simulation shows that the extent of early stage instability depends primarily on the quality of the item pool information and its size and secondarily on the item selection criteria. The efficiency of the D-optimality criterion is similar to the efficiency of other known item selection criteria. Yet, it often yields estimates that, at the beginning of CAT, display a more robust performance against instability. (PsycINFO Database Record (c) 2007 APA, all rights reserved) PB - Sage Publications: US VL - 31 SN - 0146-6216 (Print) ER - TY - JOUR T1 - Two-Phase Item Selection Procedure for Flexible Content Balancing in CAT JF - Applied Psychological Measurement Y1 - 2007 A1 - Ying Cheng, A1 - Chang, Hua-Hua A1 - Qing Yi, AB -

Content balancing is an important issue in the design and implementation of computerized adaptive testing (CAT). Content-balancing techniques that have been applied in fixed content balancing, where the number of items from each content area is fixed, include constrained CAT (CCAT), the modified multinomial model (MMM), modified constrained CAT (MCCAT), and others. In this article, four methods are proposed to address the flexible content-balancing issue with the a-stratification design, named STR_C. The four methods are MMM+, an extension of MMM; MCCAT+, an extension of MCCAT; the TPM method, a two-phase content-balancing method using MMM in both phases; and the TPF method, a two-phase content-balancing method using MMM in the first phase and MCCAT in the second. Simulation results show that all of the methods work well in content balancing, and TPF performs the best in item exposure control and item pool utilization while maintaining measurement precision.

VL - 31 UR - http://apm.sagepub.com/content/31/6/467.abstract ER - TY - JOUR T1 - Two-phase item selection procedure for flexible content balancing in CAT JF - Applied Psychological. Measurement Y1 - 2007 A1 - Cheng, Y A1 - Chang, Hua-Hua A1 - Yi, Q. VL - 3 ER - TY - JOUR T1 - Técnicas para detectar patrones de respuesta atípicos [Aberrant patterns detection methods] JF - Anales de Psicología Y1 - 2006 A1 - Núñez, R. M. N. A1 - Pina, J. A. L. KW - aberrant patterns detection KW - Classical Test Theory KW - generalizability theory KW - Item Response KW - Item Response Theory KW - Mathematics KW - methods KW - person-fit KW - Psychometrics KW - psychometry KW - Test Validity KW - test validity analysis KW - Theory AB - La identificación de patrones de respuesta atípicos es de gran utilidad para la construcción de tests y de bancos de ítems con propiedades psicométricas así como para el análisis de validez de los mismos. En este trabajo de revisión se han recogido los más relevantes y novedosos métodos de ajuste de personas que se han elaborado dentro de cada uno de los principales ámbitos de trabajo de la Psicometría: el escalograma de Guttman, la Teoría Clásica de Tests (TCT), la Teoría de la Generalizabilidad (TG), la Teoría de Respuesta al Ítem (TRI), los Modelos de Respuesta al Ítem No Paramétricos (MRINP), los Modelos de Clase Latente de Orden Restringido (MCL-OR) y el Análisis de Estructura de Covarianzas (AEC).Aberrant patterns detection has a great usefulness in order to make tests and item banks with psychometric characteristics and validity analysis of tests and items. The most relevant and newest person-fit methods have been reviewed. All of them have been made in each one of main areas of Psychometry: Guttman's scalogram, Classical Test Theory (CTT), Generalizability Theory (GT), Item Response Theory (IRT), Non-parametric Response Models (NPRM), Order-Restricted Latent Class Models (OR-LCM) and Covariance Structure Analysis (CSA). VL - 22 SN - 0212-9728 N1 - Spain: Universidad de Murcia ER - TY - JOUR T1 - A testlet assembly design for the uniform CPA Examination JF - Applied Measurement in Education Y1 - 2006 A1 - Luecht, Richard A1 - Brumfield, Terry A1 - Breithaupt, Krista VL - 19 UR - http://www.tandfonline.com/doi/abs/10.1207/s15324818ame1903_2 ER - TY - JOUR T1 - Test construction for cognitive diagnosis JF - Applied Psychological Measurement Y1 - 2005 A1 - Henson, R. K. A1 - Douglas, J. KW - (Measurement) KW - Cognitive Assessment KW - Item Analysis (Statistical) KW - Profiles KW - Test Construction KW - Test Interpretation KW - Test Items AB - Although cognitive diagnostic models (CDMs) can be useful in the analysis and interpretation of existing tests, little has been developed to specify how one might construct a good test using aspects of the CDMs. This article discusses the derivation of a general CDM index based on Kullback-Leibler information that will serve as a measure of how informative an item is for the classification of examinees. The effectiveness of the index is examined for items calibrated using the deterministic input noisy "and" gate model (DINA) and the reparameterized unified model (RUM) by implementing a simple heuristic to construct a test from an item bank. When compared to randomly constructed tests from the same item bank, the heuristic shows significant improvement in classification rates. (PsycINFO Database Record (c) 2005 APA ) (journal abstract) VL - 29 ER - TY - JOUR T1 - Toward efficient and comprehensive measurement of the alcohol problems continuum in college students: The Brief Young Adult Alcohol Consequences Questionnaire JF - Alcoholism: Clinical & Experimental Research Y1 - 2005 A1 - Kahler, C. W. A1 - Strong, D. R. A1 - Read, J. P. A1 - De Boeck, P. A1 - Wilson, M. A1 - Acton, G. S. A1 - Palfai, T. P. A1 - Wood, M. D. A1 - Mehta, P. D. A1 - Neale, M. C. A1 - Flay, B. R. A1 - Conklin, C. A. A1 - Clayton, R. R. A1 - Tiffany, S. T. A1 - Shiffman, S. A1 - Krueger, R. F. A1 - Nichol, P. E. A1 - Hicks, B. M. A1 - Markon, K. E. A1 - Patrick, C. J. A1 - Iacono, William G. A1 - McGue, Matt A1 - Langenbucher, J. W. A1 - Labouvie, E. A1 - Martin, C. S. A1 - Sanjuan, P. M. A1 - Bavly, L. A1 - Kirisci, L. A1 - Chung, T. A1 - Vanyukov, M. A1 - Dunn, M. A1 - Tarter, R. A1 - Handel, R. W. A1 - Ben-Porath, Y. S. A1 - Watt, M. KW - Psychometrics KW - Substance-Related Disorders AB - Background: Although a number of measures of alcohol problems in college students have been studied, the psychometric development and validation of these scales have been limited, for the most part, to methods based on classical test theory. In this study, we conducted analyses based on item response theory to select a set of items for measuring the alcohol problem severity continuum in college students that balances comprehensiveness and efficiency and is free from significant gender bias., Method: We conducted Rasch model analyses of responses to the 48-item Young Adult Alcohol Consequences Questionnaire by 164 male and 176 female college students who drank on at least a weekly basis. An iterative process using item fit statistics, item severities, item discrimination parameters, model residuals, and analysis of differential item functioning by gender was used to pare the items down to those that best fit a Rasch model and that were most efficient in discriminating among levels of alcohol problems in the sample., Results: The process of iterative Rasch model analyses resulted in a final 24-item scale with the data fitting the unidimensional Rasch model very well. The scale showed excellent distributional properties, had items adequately matched to the severity of alcohol problems in the sample, covered a full range of problem severity, and appeared highly efficient in retaining all of the meaningful variance captured by the original set of 48 items., Conclusions: The use of Rasch model analyses to inform item selection produced a final scale that, in both its comprehensiveness and its efficiency, should be a useful tool for researchers studying alcohol problems in college students. To aid interpretation of raw scores, examples of the types of alcohol problems that are likely to be experienced across a range of selected scores are provided., (C)2005Research Society on AlcoholismAn important, sometimes controversial feature of all psychological phenomena is whether they are categorical or dimensional. A conceptual and psychometric framework is described for distinguishing whether the latent structure behind manifest categories (e.g., psychiatric diagnoses, attitude groups, or stages of development) is category-like or dimension-like. Being dimension-like requires (a) within-category heterogeneity and (b) between-category quantitative differences. Being category-like requires (a) within-category homogeneity and (b) between-category qualitative differences. The relation between this classification and abrupt versus smooth differences is discussed. Hybrid structures are possible. Being category-like is itself a matter of degree; the authors offer a formalized framework to determine this degree. Empirical applications to personality disorders, attitudes toward capital punishment, and stages of cognitive development illustrate the approach., (C) 2005 by the American Psychological AssociationThe authors conducted Rasch model ( G. Rasch, 1960) analyses of items from the Young Adult Alcohol Problems Screening Test (YAAPST; S. C. Hurlbut & K. J. Sher, 1992) to examine the relative severity and ordering of alcohol problems in 806 college students. Items appeared to measure a single dimension of alcohol problem severity, covering a broad range of the latent continuum. Items fit the Rasch model well, with less severe symptoms reliably preceding more severe symptoms in a potential progression toward increasing levels of problem severity. However, certain items did not index problem severity consistently across demographic subgroups. A shortened, alternative version of the YAAPST is proposed, and a norm table is provided that allows for a linking of total YAAPST scores to expected symptom expression., (C) 2004 by the American Psychological AssociationA didactic on latent growth curve modeling for ordinal outcomes is presented. The conceptual aspects of modeling growth with ordinal variables and the notion of threshold invariance are illustrated graphically using a hypothetical example. The ordinal growth model is described in terms of 3 nested models: (a) multivariate normality of the underlying continuous latent variables (yt) and its relationship with the observed ordinal response pattern (Yt), (b) threshold invariance over time, and (c) growth model for the continuous latent variable on a common scale. Algebraic implications of the model restrictions are derived, and practical aspects of fitting ordinal growth models are discussed with the help of an empirical example and Mx script ( M. C. Neale, S. M. Boker, G. Xie, & H. H. Maes, 1999). The necessary conditions for the identification of growth models with ordinal data and the methodological implications of the model of threshold invariance are discussed., (C) 2004 by the American Psychological AssociationRecent research points toward the viability of conceptualizing alcohol problems as arrayed along a continuum. Nevertheless, modern statistical techniques designed to scale multiple problems along a continuum (latent trait modeling; LTM) have rarely been applied to alcohol problems. This study applies LTM methods to data on 110 problems reported during in-person interviews of 1,348 middle-aged men (mean age = 43) from the general population. The results revealed a continuum of severity linking the 110 problems, ranging from heavy and abusive drinking, through tolerance and withdrawal, to serious complications of alcoholism. These results indicate that alcohol problems can be arrayed along a dimension of severity and emphasize the relevance of LTM to informing the conceptualization and assessment of alcohol problems., (C) 2004 by the American Psychological AssociationItem response theory (IRT) is supplanting classical test theory as the basis for measures development. This study demonstrated the utility of IRT for evaluating DSM-IV diagnostic criteria. Data on alcohol, cannabis, and cocaine symptoms from 372 adult clinical participants interviewed with the Composite International Diagnostic Interview-Expanded Substance Abuse Module (CIDI-SAM) were analyzed with Mplus ( B. Muthen & L. Muthen, 1998) and MULTILOG ( D. Thissen, 1991) software. Tolerance and legal problems criteria were dropped because of poor fit with a unidimensional model. Item response curves, test information curves, and testing of variously constrained models suggested that DSM-IV criteria in the CIDI-SAM discriminate between only impaired and less impaired cases and may not be useful to scale case severity. IRT can be used to study the construct validity of DSM-IV diagnoses and to identify diagnostic criteria with poor performance., (C) 2004 by the American Psychological AssociationThis study examined the psychometric characteristics of an index of substance use involvement using item response theory. The sample consisted of 292 men and 140 women who qualified for a Diagnostic and Statistical Manual of Mental Disorders (3rd ed., rev.; American Psychiatric Association, 1987) substance use disorder (SUD) diagnosis and 293 men and 445 women who did not qualify for a SUD diagnosis. The results indicated that men had a higher probability of endorsing substance use compared with women. The index significantly predicted health, psychiatric, and psychosocial disturbances as well as level of substance use behavior and severity of SUD after a 2-year follow-up. Finally, this index is a reliable and useful prognostic indicator of the risk for SUD and the medical and psychosocial sequelae of drug consumption., (C) 2002 by the American Psychological AssociationComparability, validity, and impact of loss of information of a computerized adaptive administration of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) were assessed in a sample of 140 Veterans Affairs hospital patients. The countdown method ( Butcher, Keller, & Bacon, 1985) was used to adaptively administer Scales L (Lie) and F (Frequency), the 10 clinical scales, and the 15 content scales. Participants completed the MMPI-2 twice, in 1 of 2 conditions: computerized conventional test-retest, or computerized conventional-computerized adaptive. Mean profiles and test-retest correlations across modalities were comparable. Correlations between MMPI-2 scales and criterion measures supported the validity of the countdown method, although some attenuation of validity was suggested for certain health-related items. Loss of information incurred with this mode of adaptive testing has minimal impact on test validity. Item and time savings were substantial., (C) 1999 by the American Psychological Association VL - 29 N1 - MiscellaneousArticleMiscellaneous Article ER - TY - JOUR T1 - Trait parameter recovery using multidimensional computerized adaptive testing in reading and mathematics JF - Applied Psychological Measurement Y1 - 2005 A1 - Li, Y. H. AB - Under a multidimensional item response theory (MIRT) computerized adaptive testing (CAT) testing scenario, a trait estimate (θ) in onedimension will provide clues for subsequentlyseeking a solution in other dimensions. Thisfeature may enhance the efficiency of MIRT CAT’s item selection and its scoring algorithms compared with its counterpart, the unidimensional CAT (UCAT). The present study used existing Reading and Math test data to generate simulated item parameters. A confirmatory item factor analysis model was applied to the data using NOHARM to produce interpretable MIRT item parameters. Results showed that MIRT CAT, conditional on theconstraints, was quite capable of producing accurate estimates on both measures. Compared with UCAT, MIRT CAT slightly increased the accuracy of both trait estimates, especially for the low-level or high-level trait examinees in both measures, and reduced the rate of unused items in the item pool. Index terms: computerized adaptive testing (CAT), item response theory (IRT), dimensionality, 0-1 linear programming, constraints, item exposure, reading assessment, mathematics assessment. VL - 29 SN - 0146-6216 ER - TY - JOUR T1 - Trait Parameter Recovery Using Multidimensional Computerized Adaptive Testing in Reading and Mathematics JF - Applied Psychological Measurement Y1 - 2005 A1 - Li, Yuan H. A1 - Schafer, William D. AB -

Under a multidimensional item response theory (MIRT) computerized adaptive testing (CAT) testing scenario, a trait estimate (θ) in one dimension will provide clues for subsequently seeking a solution in other dimensions. This feature may enhance the efficiency of MIRT CAT’s item selection and its scoring algorithms compared with its counterpart, the unidimensional CAT (UCAT). The present study used existing Reading and Math test data to generate simulated item parameters. A confirmatory item factor analysis model was applied to the data using NOHARM to produce interpretable MIRT item parameters. Results showed that MIRT CAT, conditional on the constraints, was quite capable of producing accurate estimates on both measures. Compared with UCAT, MIRT CAT slightly increased the accuracy of both trait estimates, especially for the low-level or high-level trait examinees in both measures, and reduced the rate of unused items in the item pool.

VL - 29 UR - http://apm.sagepub.com/content/29/1/3.abstract ER - TY - JOUR T1 - Test difficulty and stereotype threat on the GRE General Test JF - Journal of Applied Social Psychology Y1 - 2004 A1 - Stricker, L. J., A1 - Bejar, I. I. VL - 34(3) ER - TY - JOUR T1 - Testing vocabulary knowledge: Size, strength, and computer adaptiveness JF - Language Learning Y1 - 2004 A1 - Laufer, B. A1 - Goldstein, Z. AB - (from the journal abstract) In this article, we describe the development and trial of a bilingual computerized test of vocabulary size, the number of words the learner knows, and strength, a combination of four aspects of knowledge of meaning that are assumed to constitute a hierarchy of difficulty: passive recognition (easiest), active recognition, passive recall, and active recall (hardest). The participants were 435 learners of English as a second language. We investigated whether the above hierarchy was valid and which strength modality correlated best with classroom language performance. Results showed that the hypothesized hierarchy was present at all word frequency levels, that passive recall was the best predictor of classroom language performance, and that growth in vocabulary knowledge was different for the different strength modalities. (PsycINFO Database Record (c) 2004 APA, all rights reserved). VL - 54 N1 - References .Blackwell Publishing, United Kingdom ER - TY - JOUR T1 - Ten recommendations for advancing patient-centered outcomes measurement for older persons JF - Annals of Internal Medicine Y1 - 2003 A1 - McHorney, C. A. KW - *Health Status Indicators KW - Aged KW - Geriatric Assessment/*methods KW - Humans KW - Patient-Centered Care/*methods KW - Research Support, U.S. Gov't, Non-P.H.S. AB - The past 50 years have seen great progress in the measurement of patient-based outcomes for older populations. Most of the measures now used were created under the umbrella of a set of assumptions and procedures known as classical test theory. A recent alternative for health status assessment is item response theory. Item response theory is superior to classical test theory because it can eliminate test dependency and achieve more precise measurement through computerized adaptive testing. Computerized adaptive testing reduces test administration times and allows varied and precise estimates of ability. Several key challenges must be met before computerized adaptive testing becomes a productive reality. I discuss these challenges for the health assessment of older persons in the form of 10 "Ds": things we need to deliberate, debate, decide, and do. VL - 139 N1 - 1539-3704Journal ArticleReview ER - TY - CONF T1 - Test information targeting strategies for adaptive multistage testlet designs T2 - Paper presented at the Annual meeting of the National Council on Measurement in Education Y1 - 2003 A1 - Luecht, RM A1 - Burgin, W. L. JF - Paper presented at the Annual meeting of the National Council on Measurement in Education CY - Chicago IL N1 - PDF file, 179 K ER - TY - ABST T1 - Tests adaptativos informatizados (Computerized adaptive testing) Y1 - 2003 A1 - Olea, J. A1 - Ponsoda, V. CY - Madrid: UNED Ediciones N1 - [In Spanish] ER - TY - CONF T1 - Test-score comparability, ability estimation, and item-exposure control in computerized adaptive testing T2 - Paper presented at the Annual meeting of the National Council on Measurement in Education Y1 - 2003 A1 - Chang, Hua-Hua A1 - Ying, Z. JF - Paper presented at the Annual meeting of the National Council on Measurement in Education CY - Chicago IL ER - TY - JOUR T1 - Timing behavior in computerized adaptive testing: Response times for correct and incorrect answers are not related to general fluid intelligence/Zum Zeitverhalten beim computergestützten adaptiveb Testen: Antwortlatenzen bei richtigen und falschen Lösun JF - Zeitschrift für Differentielle und Diagnostische Psychologie Y1 - 2003 A1 - Rammsayer, Thomas A1 - Brandler, Susanne KW - Adaptive Testing KW - Cognitive Ability KW - Intelligence KW - Perception KW - Reaction Time computerized adaptive testing AB - Examined the effects of general fluid intelligence on item response times for correct and false responses in computerized adaptive testing. After performing the CFT3 intelligence test, 80 individuals (aged 17-44 yrs) completed perceptual and cognitive discrimination tasks. Results show that response times were related neither to the proficiency dimension reflected by the task nor to the individual level of fluid intelligence. Furthermore, the false > correct-phenomenon as well as substantial positive correlations between item response times for false and correct responses were shown to be independent of intelligence levels. (PsycINFO Database Record (c) 2005 APA ) VL - 24 ER - TY - CONF T1 - To stratify or not: An investigation of CAT item selection procedures under practical constraints T2 - Paper presented at the Annual meeting of the National Council on Measurement in Education Y1 - 2003 A1 - Deng, H. A1 - Ansley, T. JF - Paper presented at the Annual meeting of the National Council on Measurement in Education CY - Chicago IL N1 - {PDF file, 186 KB} ER - TY - JOUR T1 - Technology solutions for testing JF - School Administrator Y1 - 2002 A1 - Olson, A. AB - Northwest Evaluation Association in Portland, Oregon, consults with state and local educators on assessment issues. Describes several approaches in place at school districts that are using some combination of computer-based tests to measure student growth. The computerized adaptive test adjusts items based on a student's answer in "real time." On-demand testing provides almost instant scoring. (MLF) VL - 4 ER - TY - CHAP T1 - Test models for complex computer-based testing Y1 - 2002 A1 - Luecht, RM A1 - Clauser, B. E. CY - C. N. Mille,. M. T. Potenza, J. J. Fremer, and W. C. Ward (Eds.). Computer-based testing: Building the foundation for future assessments (pp. 67-88). Hillsdale NJ: Erlbaum. ER - TY - CONF T1 - A testlet assembly design for the uniform CPA examination T2 - Paper presented at the Annual Meeting of the National Council on Measurement in Education. Y1 - 2002 A1 - Luecht, RM A1 - Brumfield, T. A1 - Breithaupt, K JF - Paper presented at the Annual Meeting of the National Council on Measurement in Education. CY - New Orleans N1 - PDF file 192 KB ER - TY - CONF T1 - To weight or not to weight – balancing influence of initial and later items in CAT T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2002 A1 - Chang, Hua-Hua A1 - Ying, Z. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New Orleans LA N1 - {PDF file, 252 KB} ER - TY - JOUR T1 - Test anxiety and test performance: Comparing paper-based and computer-adaptive versions of the Graduate Record Examinations (GRE) General test JF - Journal of educational computing research Y1 - 2001 A1 - Powers, D. E. VL - 24 IS - 3 ER - TY - CONF T1 - Testing a computerized adaptive personality inventory using simulated response data T2 - Paper presented at the annual meeting of the American Psychological Association Y1 - 2001 A1 - Simms, L. JF - Paper presented at the annual meeting of the American Psychological Association CY - San Francisco CA ER - TY - ABST T1 - Testing via the Internet: A literature review and analysis of issues for Department of Defense Internet testing of the Armed Services Vocational Aptitude Battery (ASVAB) in high schools (FR-01-12) Y1 - 2001 A1 - J. R. McBride A1 - Paddock, A. F. A1 - Wise, L. L. A1 - Strickland, W. J. A1 - B. K. Waters CY - Alexandria VA: Human Resources Research Organization N1 - {PDF file, 894 KB} ER - TY - JOUR T1 - Toepassing van een computergestuurde adaptieve testprocedure op persoonlijkheidsdata [Application of a computerised adaptive test procedure on personality data] JF - Nederlands Tijdschrift voor de Psychologie en haar Grensgebieden Y1 - 2001 A1 - Hol, A. M. A1 - Vorst, H. C. M. A1 - Mellenbergh, G. J. KW - Adaptive Testing KW - Computer Applications KW - Computer Assisted Testing KW - Personality Measures KW - Test Reliability computerized adaptive testing AB - Studied the applicability of a computerized adaptive testing procedure to an existing personality questionnaire within the framework of item response theory. The procedure was applied to the scores of 1,143 male and female university students (mean age 21.8 yrs) in the Netherlands on the Neuroticism scale of the Amsterdam Biographical Questionnaire (G. J. Wilde, 1963). The graded response model (F. Samejima, 1969) was used. The quality of the adaptive test scores was measured based on their correlation with test scores for the entire item bank and on their correlation with scores on other scales from the personality test. The results indicate that computerized adaptive testing can be applied to personality scales. (PsycINFO Database Record (c) 2005 APA ) VL - 56 ER - TY - JOUR T1 - Taylor approximations to logistic IRT models and their use in adaptive testing JF - Journal of Educational and Behavioral Statistics Y1 - 2000 A1 - Veerkamp, W. J. J. KW - computerized adaptive testing AB - Taylor approximation can be used to generate a linear approximation to a logistic ICC and a linear ability estimator. For a specific situation it will be shown to result in a special case of a Robbins-Monro item selection procedure for adaptive testing. The linear estimator can be used for the situation of zero and perfect scores when maximum likelihood estimation fails to come up with a finite estimate. It is also possible to use this estimator to generate starting values for maximum likelihood and weighted likelihood estimation. Approximations to the expectation and variance of the linear estimator for a sequence of Robbins-Monro item selections can be determined analytically. VL - 25 ER - TY - CONF T1 - Test security and item exposure control for computer-based T2 - Paper presented at the annual meeting of the National Council on Measurement in Educatio Y1 - 2000 A1 - Kalohn, J. JF - Paper presented at the annual meeting of the National Council on Measurement in Educatio CY - Chicago ER - TY - CONF T1 - Test security and the development of computerized tests T2 - Paper presented at the National Council on Measurement in Education invited symposium: Maintaining test security in computerized programs–Implications for practice Y1 - 2000 A1 - Guo, F. A1 - Way, W. D. A1 - Reshetar, R. JF - Paper presented at the National Council on Measurement in Education invited symposium: Maintaining test security in computerized programs–Implications for practice CY - New Orleans ER - TY - CHAP T1 - Testlet response theory: An analog for the 3PL model useful in testlet-based adaptive testing Y1 - 2000 A1 - Wainer, H., A1 - Bradlow, E. T. A1 - Du, Z. CY - W. J. van der Linden and C. A. W. Glas (Eds.), Computerized Adaptive Testing: Theory and Practice (pp. 245-270). Norwell MA: Kluwer. ER - TY - CHAP T1 - Testlet-based adaptive mastery testing, W Y1 - 2000 A1 - Vos, H. J. A1 - Glas, C. A. W. CY - J. van der Linden (Ed.), Computerized adaptive testing: Theory and practice (pp. 289-309). Norwell MA: Kluwer. ER - TY - ABST T1 - Testlet-based Designs for Computer-Based Testing in a Certification and Licensure Setting Y1 - 2000 A1 - Pitoniak, M. J. CY - Jersey City, NJ: AICPA Technical Report ER - TY - ABST T1 - Test anxiety and test performance: Comparing paper-based and computer-adaptive versions of the GRE General Test (Research Report 99-15) Y1 - 1999 A1 - Powers, D. E. CY - Princeton NJ: Educational Testing Service ER - TY - CHAP T1 - Testing adaptatif et évaluation des processus cognitifs Y1 - 1999 A1 - Laurier, M. CY - C. Depover and B. Noël (Éds) : L’évaluation des compétences et des processus cognitifs - Modèles, pratiques et contextes. Bruxelles : De Boeck Université. ER - TY - ABST T1 - Tests informatizados: Fundamentos y aplicaciones (Computerized testing: Fundamentals and applications Y1 - 1999 A1 - Olea, J. A1 - Ponsoda, V. A1 - Prieto, G., Eds. CY - Madrid: Pirmide. N1 - [In Spanish] ER - TY - CONF T1 - Test-taking strategies T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1999 A1 - Steffen, M. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Montreal, Canada ER - TY - CONF T1 - Test-taking strategies in computerized adaptive testing T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1999 A1 - Steffen, M. A1 - Way, W. D. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Montreal, Canada ER - TY - JOUR T1 - Threats to score comparability with applications to performance assessments and computerized adaptive tests JF - Educational Assessment Y1 - 1999 A1 - Kolen, M. J. VL - 6 ER - TY - JOUR T1 - Threats to score comparability with applications to performance assessments and computerized adaptive tests JF - Educational Assessment Y1 - 1999 A1 - Kolen, M. J. AB - Develops a conceptual framework that addresses score comparability for performance assessments, adaptive tests, paper-and-pencil tests, and alternate item pools for computerized tests. Outlines testing situation aspects that might threaten score comparability and describes procedures for evaluating the degree of score comparability. Suggests ways to minimize threats to comparability. (SLD) VL - 6 ER - TY - CONF T1 - Test development exposure control for adaptive testing T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1998 A1 - Parshall, C. G. A1 - Davey, T. A1 - Nering, M. L. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Diego, CA ER - TY - JOUR T1 - Testing word knowledge by telephone to estimate general cognitive aptitude using an adaptive test JF - Intelligence Y1 - 1998 A1 - Legree, P. J. A1 - Fischl, M. A A1 - Gade, P. A. A1 - Wilson, M. VL - 26 ER - TY - ABST T1 - Three response types for broadening the conception of mathematical problem solving in computerized-adaptive tests (Research Report 98-45) Y1 - 1998 A1 - Bennett, R. E. A1 - Morley, M. A1 - Quardt, D. CY - Princeton NJ : Educational Testing Service N1 - #BE98-45 (Also presented at National Council on Measurement in Education, 1998) ER - TY - CHAP T1 - Technical perspective Y1 - 1997 A1 - J. R. McBride CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 29-44). Washington, DC: American Psychological Association. ER - TY - CHAP T1 - Test adaptativos informatizados [Computerized adaptive testing] T2 - Psicometría Y1 - 1996 A1 - Olea, J. A1 - Ponsoda, V. JF - Psicometría PB - Universitas CY - Madrid, UNED ER - TY - CONF T1 - A Type I error rate study of a modified SIBTEST DIF procedure with potential application to computerized adaptive tests T2 - Paper presented at the annual meeting of the Psychometric Society Y1 - 1996 A1 - Roussos, L. JF - Paper presented at the annual meeting of the Psychometric Society CY - Alberta Canada ER - TY - CONF T1 - Tests adaptivos y autoadaptados informatizados: Effects en la ansiedad y en la pecision de las estimaciones [SATs and CATS: Effects on enxiety and estimate precision] T2 - Paper presented at the Fourth Symposium de Metodologia de las Ciencies del Comportamiento Y1 - 1995 A1 - Olea, J. A1 - Ponsoda, V. A1 - Wise, S. L. JF - Paper presented at the Fourth Symposium de Metodologia de las Ciencies del Comportamiento CY - Murcia, Spain ER - TY - JOUR T1 - Theoretical results and item selection from multidimensional item bank in the Mokken IRT model for polytomous items JF - Applied Psychological Measurement Y1 - 1995 A1 - Hemker, B. T. A1 - Sijtsma, K. A1 - Molenaar, I. W. VL - 19 ER - TY - ABST T1 - Three practical issues for modern adaptive testing item pools (Research Report 94-5), Y1 - 1994 A1 - Stocking, M. L. CY - Princeton NJ: Educational Testing Service ER - TY - CONF T1 - Test targeting and precision before and after review on computer-adaptive tests T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1993 A1 - Lunz, M. E. A1 - Stahl, J. A. A1 - Bergstrom, Betty A. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Atlanta GA ER - TY - CONF T1 - Test anxiety and test performance under computerized adaptive testing methods T2 - Richmond IN: Indiana University. (ERIC Document Reproduction Service No. ED 334910 and/or TM018223). Paper presented at the annual meeting of the American Educational Research Association Y1 - 1992 A1 - Powell, Z. E. JF - Richmond IN: Indiana University. (ERIC Document Reproduction Service No. ED 334910 and/or TM018223). Paper presented at the annual meeting of the American Educational Research Association CY - San Francisco CA ER - TY - JOUR T1 - Test anxiety and test performance under computerized adaptive testing methods JF - Dissertation Abstracts International Y1 - 1992 A1 - Powell, Zen-Hsiu E. KW - computerized adaptive testing VL - 52 ER - TY - CHAP T1 - Testing algorithms Y1 - 1990 A1 - Wainer, H., A1 - Mislevy, R. J. CY - H. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 103-135). Hillsdale NJ: Erlbaum. ER - TY - CHAP T1 - Testing algorithms Y1 - 1990 A1 - Thissen, D. A1 - Mislevy, R. J. CY - H. Wainer (Ed.), Computerized adaptive testing: A primer (pp. 103-135). Hillsdale NJ: Erlbaum. ER - TY - Generic T1 - Test-retest consistency of computer adaptive tests. T2 - annual meeting of the National Council on Measurement in Education Y1 - 1990 A1 - Lunz, M. E. A1 - Bergstrom, Betty A. A1 - Gershon, R. C. JF - annual meeting of the National Council on Measurement in Education CY - Boston, MA USA ER - TY - JOUR T1 - Toward a psychometrics for testlets JF - Journal of Educational Measurement Y1 - 1990 A1 - Wainer, H., A1 - Lewis, C. VL - 27 ER - TY - JOUR T1 - Tailored interviewing: An application of item response theory for personality measurement JF - Journal of Personality Assessment Y1 - 1989 A1 - Kamakura, W. A., A1 - Balasubramanian, S. K. VL - 53 ER - TY - JOUR T1 - Testing software review: MicroCAT Version 3 JF - . Educational Measurement: Issues and Practice Y1 - 1989 A1 - Stone, C. A. VL - 8 (3) ER - TY - JOUR T1 - Trace lines for testlets: A use of multiple-categorical-response models JF - Journal of Educational Measurement Y1 - 1989 A1 - Thissen, D. A1 - Steinberg, L. A1 - Mooney, J.A. VL - 26 ER - TY - JOUR T1 - Two simulated feasibility studies in computerized adaptive testing JF - Applied Psychology: An International Review Y1 - 1987 A1 - Stocking, M. L. VL - 36 ER - TY - JOUR T1 - Technical guidelines for assessing computerized adaptive tests JF - Journal of Educational Measurement Y1 - 1984 A1 - Green, B. F. A1 - Bock, R. D. A1 - Humphreys, L. G. A1 - Linn, R. L. A1 - Reckase, M. D. KW - computerized adaptive testing KW - Mode effects KW - paper-and-pencil VL - 21 SN - 1745-3984 ER - TY - ABST T1 - Two simulated feasibility studies in computerized adaptive testing (RR-84-15) Y1 - 1984 A1 - Stocking, M. L. CY - Princeton NJ: Educational Testing Service ER - TY - ABST T1 - Tailored testing, its theory and practice. Part I: The basic model, the normal ogive submodels, and the tailored testing algorithm (NPRDC TR-83-00) Y1 - 1983 A1 - Urry, V. W. A1 - Dorans, N. J. CY - San Diego CA: Navy Personnel Research and Development Center ER - TY - ABST T1 - Tailored testing, its theory and practice. Part II: Ability and item parameter estimation, multiple ability application, and allied procedures (NPRDC TR-81) Y1 - 1981 A1 - Urry, V. W. CY - San Diego CA: Navy Personnel Research and Development Center N1 - Part II: Ability and item parameter estimation, multiple ability application, and allied procedures (NPRDC TR-81) ER - TY - JOUR T1 - TAILOR: A FORTRAN procedure for interactive tailored testing JF - Educational and Psychological Measurement Y1 - 1977 A1 - Cudeck, R. A. A1 - Cliff, N. A. A1 - Kehoe, J. VL - 37 ER - TY - JOUR T1 - TAILOR-APL: An interactive computer program for individual tailored testing JF - Educational and Psychological Measurement Y1 - 1977 A1 - McCormick, D. A1 - Cliff, N. A. VL - 37 ER - TY - ABST T1 - Tailored testing: A spectacular success for latent trait theory (TS 77-2) Y1 - 1977 A1 - Urry, V. W. CY - Washington DC: U. S. Civil Service Commission, Personnel Research and Development Center ER - TY - JOUR T1 - Tailored testing: A successful application of latent trait theory JF - Journal of Educational Measurement Y1 - 1977 A1 - Urry, V. W. VL - 14 ER - TY - JOUR T1 - A theory of consistency ordering generalizable to tailored testing JF - Psychometrika Y1 - 1977 A1 - Cliff, N. A. ER - TY - ABST T1 - A two-stage testing procedure (Memorandum 403-77) Y1 - 1977 A1 - de Gruijter, D. N. M. CY - University of Leyden, The Netherlands, Educational Research Center ER - TY - ABST T1 - Test theory and the public interest Y1 - 1976 A1 - Lord, F. M., CY - Proceedings of the Educational Testing Service Invitational Conference ER - TY - CONF T1 - Tailored testing: Maximizing validity and utility for job selection T2 - Paper presented at the 86th Annual Convention of the American Psychological Association. Toronto Y1 - 1975 A1 - Croll, P. R. A1 - Urry, V. W. JF - Paper presented at the 86th Annual Convention of the American Psychological Association. Toronto CY - Canada ER - TY - JOUR T1 - A tailored testing model employing the beta distribution and conditional difficulties JF - Journal of Computer-Based Instruction Y1 - 1974 A1 - Kalisch, S. J. VL - 1 ER - TY - ABST T1 - A tailored testing model employing the beta distribution (unpublished manuscript) Y1 - 1974 A1 - Kalisch, S. J. CY - Florida State University, Educational Evaluation and Research Design Program ER - TY - CONF T1 - A tailored testing system for selection and allocation in the British Army T2 - Paper presented at the 18th International Congress of Applied Psychology Y1 - 1974 A1 - Killcross, M. C. JF - Paper presented at the 18th International Congress of Applied Psychology CY - Montreal Canada ER - TY - JOUR T1 - Testing and decision-making procedures for selected individualized instruction programs JF - Review of Educational Research Y1 - 1974 A1 - Hambleton, R. K. VL - 10 ER - TY - JOUR T1 - A tailored testing model employing the beta distribution and conditional difficulties JF - Journal of Computer-Based Instruction Y1 - 1973 A1 - Kalisch, S. J. VL - 1 ER - TY - ABST T1 - Tailored testing: An application of stochastic approximation (RM 71-2) Y1 - 1971 A1 - Lord, F. M., CY - Princeton NJ: Educational Testing Service ER - TY - JOUR T1 - Tailored testing, an approximation of stochastic approximation JF - Journal of the American Statistical Association Y1 - 1971 A1 - Lord, F. M., VL - 66 ER - TY - JOUR T1 - A theoretical study of the measurement effectiveness of flexilevel tests JF - Educational and Psychological Measurement Y1 - 1971 A1 - Lord, F. M., VL - 31 ER - TY - JOUR T1 - A theoretical study of two-stage testing JF - Psychometrika Y1 - 1971 A1 - Lord, F. M., VL - 36 ER -