%0 Journal Article %J Applied Psychological Measurement %D 2006 %T Optimal testing with easy or difficult items in computerized adaptive testing %A Theo Eggen %A Verschoor, Angela J. %K computer adaptive tests %K individualized tests %K Item Response Theory %K item selection %K Measurement %X Computerized adaptive tests (CATs) are individualized tests that, from a measurement point of view, are optimal for each individual, possibly under some practical conditions. In the present study, it is shown that maximum information item selection in CATs using an item bank that is calibrated with the one- or the two-parameter logistic model results in each individual answering about 50% of the items correctly. Two item selection procedures giving easier (or more difficult) tests for students are presented and evaluated. Item selection on probability points of items yields good results only with the one-parameter logistic model and not with the two-parameter logistic model. An alternative selection procedure, based on maximum information at a shifted ability level, gives satisfactory results with both models. (PsycINFO Database Record (c) 2007 APA, all rights reserved) %B Applied Psychological Measurement %I Sage Publications: US %V 30 %P 379-393 %@ 0146-6216 (Print) %G eng %M 2006-10279-002 %0 Book Section %B Outcomes assessment in cancer %D 2005 %T Applications of item response theory to improve health outcomes assessment: Developing item banks, linking instruments, and computer-adaptive testing %A Hambleton, R. K. %E C. C. Gotay %E C. Snyder %K Computer Assisted Testing %K Health %K Item Response Theory %K Measurement %K Test Construction %K Treatment Outcomes %X (From the chapter) The current chapter builds on Reise's introduction to the basic concepts, assumptions, popular models, and important features of IRT and discusses the applications of item response theory (IRT) modeling to health outcomes assessment. In particular, we highlight the critical role of IRT modeling in: developing an instrument to match a study's population; linking two or more instruments measuring similar constructs on a common metric; and creating item banks that provide the foundation for tailored short-form instruments or for computerized adaptive assessments. (PsycINFO Database Record (c) 2005 APA ) %B Outcomes assessment in cancer %I Cambridge University Press %C Cambridge, UK %P 445-464 %G eng %0 Journal Article %J Acta Comportamentalia %D 2005 %T La Validez desde una óptica psicométrica [Validity from a psychometric perspective] %A Muñiz, J. %K Factor Analysis %K Measurement %K Psychometrics %K Scaling (Testing) %K Statistical %K Technology %K Test Validity %X El estudio de la validez constituye el eje central de los análisis psicométricos de los instrumentos de medida. En esta comunicación se traza una breve nota histórica de los distintos modos de concebir la validez a lo largo de los tiempos, se comentan las líneas actuales, y se tratan de vislumbrar posibles vías futuras, teniendo en cuenta el impacto que las nuevas tecnologías informáticas están ejerciendo sobre los propios instrumentos de medida en Psicología y Educación. Cuestiones como los nuevos formatos multimedia de los ítems, la evaluación a distancia, el uso intercultural de las pruebas, las consecuencias de su uso, o los tests adaptativos informatizados, reclaman nuevas formas de evaluar y conceptualizar la validez. También se analizan críticamente algunos planteamientos recientes sobre el concepto de validez. The study of validity constitutes a central axis of psychometric analyses of measurement instruments. This paper presents a historical sketch of different modes of conceiving validity, with commentary on current views, and it attempts to predict future lines of research by considering the impact of new computerized technologies on measurement instruments in psychology and education. Factors such as the new multimedia format of items, distance assessment, the intercultural use of tests, the consequences of the latter, or the development of computerized adaptive tests demand new ways of conceiving and evaluating validity. Some recent thoughts about the concept of validity are also critically analyzed. (PsycINFO Database Record (c) 2005 APA ) (journal abstract) %B Acta Comportamentalia %V 13 %P 9-20 %G eng %0 Journal Article %J Journal of Educational Measurement %D 2003 %T A comparative study of item exposure control methods in computerized adaptive testing %A Chang, S-W. %A Ansley, T. N. %K Adaptive Testing %K Computer Assisted Testing %K Educational %K Item Analysis (Statistical) %K Measurement %K Strategies computerized adaptive testing %X This study compared the properties of five methods of item exposure control within the purview of estimating examinees' abilities in a computerized adaptive testing (CAT) context. Each exposure control algorithm was incorporated into the item selection procedure and the adaptive testing progressed based on the CAT design established for this study. The merits and shortcomings of these strategies were considered under different item pool sizes and different desired maximum exposure rates and were evaluated in light of the observed maximum exposure rates, the test overlap rates, and the conditional standard errors of measurement. Each method had its advantages and disadvantages, but no one possessed all of the desired characteristics. There was a clear and logical trade-off between item exposure control and measurement precision. The M. L. Stocking and C. Lewis conditional multinomial procedure and, to a slightly lesser extent, the T. Davey and C. G. Parshall method seemed to be the most promising considering all of the factors that this study addressed. (PsycINFO Database Record (c) 2005 APA ) %B Journal of Educational Measurement %V 40 %P 71-103 %G eng %0 Book Section %B Item generation for test development %D 2002 %T Generating abstract reasoning items with cognitive theory %A Embretson, S. E. %E P. Kyllomen %K Cognitive Processes %K Measurement %K Reasoning %K Test Construction %K Test Items %K Test Validity %K Theories %X (From the chapter) Developed and evaluated a generative system for abstract reasoning items based on cognitive theory. The cognitive design system approach was applied to generate matrix completion problems. Study 1 involved developing the cognitive theory with 191 college students who were administered Set I and Set II of the Advanced Progressive Matrices. Study 2 examined item generation by cognitive theory. Study 3 explored the psychometric properties and construct representation of abstract reasoning test items with 728 young adults. Five structurally equivalent forms of Abstract Reasoning Test (ART) items were prepared from the generated item bank and administered to the Ss. In Study 4, the nomothetic span of construct validity of the generated items was examined with 728 young adults who were administered ART items, and 217 young adults who were administered ART items and the Advanced Progressive Matrices. Results indicate the matrix completion items were effectively generated by the cognitive design system approach. (PsycINFO Database Record (c) 2005 APA ) %B Item generation for test development %I Lawrence Erlbaum Associates, Inc. %C Mahwah, N.J. USA %P 219-250 %G eng %0 Book Section %B Computer-based tests: Building the foundation for future assessment %D 2002 %T The work ahead: A psychometric infrastructure for computerized adaptive tests %A F Drasgow %E M. P. Potenza %E J. J. Freemer %E W. C. Ward %K Adaptive Testing %K Computer Assisted Testing %K Educational %K Measurement %K Psychometrics %X (From the chapter) Considers the past and future of computerized adaptive tests and computer-based tests and looks at issues and challenges confronting a testing program as it implements and operates a computer-based test. Recommendations for testing programs from The National Council of Measurement in Education Ad Hoc Committee on Computerized Adaptive Test Disclosure are appended. (PsycINFO Database Record (c) 2005 APA ) %B Computer-based tests: Building the foundation for future assessment %I Lawrence Erlbaum Associates, Inc. %C Mahwah, N.J. USA %G eng %0 Journal Article %J Medical Care %D 2000 %T Emergence of item response modeling in instrument development and data analysis %A Hambleton, R. K. %K Computer Assisted Testing %K Health %K Item Response Theory %K Measurement %K Statistical Validity computerized adaptive testing %K Test Construction %K Treatment Outcomes %B Medical Care %V 38 %P II60-II65 %G eng