TY - JOUR T1 - Deterioro de parámetros de los ítems en tests adaptativos informatizados: estudio con eCAT [Item parameter drift in computerized adaptive testing: Study with eCAT] JF - Psicothema Y1 - 2010 A1 - Abad, F. J. A1 - Olea, J. A1 - Aguado, D. A1 - Ponsoda, V. A1 - Barrada, J KW - *Software KW - Educational Measurement/*methods/*statistics & numerical data KW - Humans KW - Language AB -

En el presente trabajo se muestra el análisis realizado sobre un Test Adaptativo Informatizado (TAI) diseñado para la evaluación del nivel de inglés, denominado eCAT, con el objetivo de estudiar el deterioro de parámetros (parameter drift) producido desde la calibración inicial del banco de ítems. Se ha comparado la calibración original desarrollada para la puesta en servicio del TAI (N= 3224) y la calibración actual obtenida con las aplicaciones reales del TAI (N= 7254). Se ha analizado el Funcionamiento Diferencial de los Ítems (FDI) en función de los parámetros utilizados y se ha simulado el impacto que sobre el nivel de rasgo estimado tiene la variación en los parámetros. Los resultados muestran que se produce especialmente un deterioro de los parámetros a y c, que hay unimportante número de ítems del banco para los que existe FDI y que la variación de los parámetros produce un impacto moderado en la estimación de θ de los evaluados con nivel de inglés alto. Se concluye que los parámetros de los ítems se han deteriorado y deben ser actualizados.Item parameter drift in computerized adaptive testing: Study with eCAT. This study describes the parameter drift analysis conducted on eCAT (a Computerized Adaptive Test to assess the written English level of Spanish speakers). The original calibration of the item bank (N = 3224) was compared to a new calibration obtained from the data provided by most eCAT operative administrations (N =7254). A Differential Item Functioning (DIF) study was conducted between the original and the new calibrations. The impact that the new parameters have on the trait level estimates was obtained by simulation. Results show that parameter drift is found especially for a and c parameters, an important number of bank items show DIF, and the parameter change has a moderate impact on high-level-English θ estimates. It is then recommended to replace the original estimates by the new set. by the new set.

VL - 22 SN - 0214-9915 (Print)0214-9915 (Linking) N1 - Abad, Francisco JOlea, JulioAguado, DavidPonsoda, VicenteBarrada, Juan REnglish AbstractSpainPsicothemaPsicothema. 2010 May;22(2):340-7. ER - TY - JOUR T1 - Item selection rules in computerized adaptive testing: Accuracy and security JF - Methodology Y1 - 2009 A1 - Barrada, J A1 - Olea, J. A1 - Ponsoda, V. A1 - Abad, F. J. VL - 5 N1 - (PDF file, 445 KB) ER - TY - CHAP T1 - Test overlap rate and item exposure rate as indicators of test security in CATs Y1 - 2009 A1 - Barrada, J A1 - Olea, J. A1 - Ponsoda, V. A1 - Abad, F. J. CY - D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - PDF File, 261 K ER - TY - JOUR T1 - Incorporating randomness in the Fisher information for improving item-exposure control in CATs JF - British Journal of Mathematical and Statistical Psychology Y1 - 2008 A1 - Barrada, J A1 - Olea, J. A1 - Ponsoda, V. A1 - Abad, F. J. VL - 61 ER - TY - JOUR T1 - Methods for restricting maximum exposure rate in computerized adaptative testing JF - Methodology: European Journal of Research Methods for the Behavioral and Social Sciences Y1 - 2007 A1 - Barrada, J A1 - Olea, J. A1 - Ponsoda, V. KW - computerized adaptive testing KW - item bank security KW - item exposure control KW - overlap rate KW - Sympson-Hetter method AB - The Sympson-Hetter (1985) method provides a means of controlling maximum exposure rate of items in Computerized Adaptive Testing. Through a series of simulations, control parameters are set that mark the probability of administration of an item on being selected. This method presents two main problems: it requires a long computation time for calculating the parameters and the maximum exposure rate is slightly above the fixed limit. Van der Linden (2003) presented two alternatives which appear to solve both of the problems. The impact of these methods in the measurement accuracy has not been tested yet. We show how these methods over-restrict the exposure of some highly discriminating items and, thus, the accuracy is decreased. It also shown that, when the desired maximum exposure rate is near the minimum possible value, these methods offer an empirical maximum exposure rate clearly above the goal. A new method, based on the initial estimation of the probability of administration and the probability of selection of the items with the restricted method (Revuelta & Ponsoda, 1998), is presented in this paper. It can be used with the Sympson-Hetter method and with the two van der Linden's methods. This option, when used with Sympson-Hetter, speeds the convergence of the control parameters without decreasing the accuracy. (PsycINFO Database Record (c) 2007 APA, all rights reserved) PB - Hogrefe & Huber Publishers GmbH: Germany VL - 3 SN - 1614-1881 (Print); 1614-2241 (Electronic) ER - TY - JOUR T1 - Assisted self-adapted testing: A comparative study JF - European Journal of Psychological Assessment Y1 - 2004 A1 - Hontangas, P. A1 - Olea, J. A1 - Ponsoda, V. A1 - Revuelta, J. A1 - Wise, S. L. KW - Adaptive Testing KW - Anxiety KW - Computer Assisted Testing KW - Psychometrics KW - Test AB - A new type of self-adapted test (S-AT), called Assisted Self-Adapted Test (AS-AT), is presented. It differs from an ordinary S-AT in that prior to selecting the difficulty category, the computer advises examinees on their best difficulty category choice, based on their previous performance. Three tests (computerized adaptive test, AS-AT, and S-AT) were compared regarding both their psychometric (precision and efficiency) and psychological (anxiety) characteristics. Tests were applied in an actual assessment situation, in which test scores determined 20% of term grades. A sample of 173 high school students participated. Neither differences in posttest anxiety nor ability were obtained. Concerning precision, AS-AT was as precise as CAT, and both revealed more precision than S-AT. It was concluded that AS-AT acted as a CAT concerning precision. Some hints, but not conclusive support, of the psychological similarity between AS-AT and S-AT was also found. (PsycINFO Database Record (c) 2005 APA ) (journal abstract) VL - 20 ER - TY - CHAP T1 - Computerized adaptive testing Y1 - 2003 A1 - Ponsoda, V. A1 - Olea, J. CY - R. Fernández-Ballesteros (Ed.): Encyclopaedia of Psychological Assessment. London: Sage. ER - TY - ABST T1 - Tests adaptativos informatizados (Computerized adaptive testing) Y1 - 2003 A1 - Olea, J. A1 - Ponsoda, V. CY - Madrid: UNED Ediciones N1 - [In Spanish] ER - TY - JOUR T1 - Self-adapted testing: An overview JF - International Journal of Continuing Engineering Education and Life-Long Learning Y1 - 2002 A1 - Wise, S. L. A1 - Ponsoda, V. A1 - Olea, J. VL - 12 ER - TY - JOUR T1 - The choice of item difficulty in self adapted testing JF - European Journal of Psychological Assessment Y1 - 2000 A1 - Hontangas, P. A1 - Ponsoda, V. A1 - Olea, J. A1 - Wise, S. L. VL - 16 IS - 1 ER - TY - JOUR T1 - Los tests adaptativos informatizados en la frontera del siglo XXI: Una revisión [Computerized adaptive tests at the turn of the 21st century: A review] JF - Metodología de las Ciencias del Comportamiento Y1 - 2000 A1 - Hontangas, P. A1 - Ponsoda, V. A1 - Olea, J. A1 - Abad, F. J. KW - computerized adaptive testing VL - 2 SN - 1575-9105 ER - TY - JOUR T1 - Overview of the computerized adaptive testing special section JF - Psicológica Y1 - 2000 A1 - Ponsoda, V. KW - Adaptive Testing KW - Computers computerized adaptive testing AB - This paper provides an overview of the five papers included in the Psicologica special section on computerized adaptive testing. A short introduction to this topic is presented as well. The main results, the links between the five papers and the general research topic to which they are more related are also shown. (PsycINFO Database Record (c) 2005 APA ) VL - 21 ER - TY - JOUR T1 - The effects of test difficulty manipulation in computerized adaptive testing and self-adapted testing JF - Applied Measurement in Education Y1 - 1999 A1 - Ponsoda, V. A1 - Olea, J. A1 - Rodriguez, M. S. A1 - Revuelta, J. VL - 12 ER - TY - ABST T1 - Tests informatizados: Fundamentos y aplicaciones (Computerized testing: Fundamentals and applications Y1 - 1999 A1 - Olea, J. A1 - Ponsoda, V. A1 - Prieto, G., Eds. CY - Madrid: Pirmide. N1 - [In Spanish] ER - TY - JOUR T1 - A comparison of item exposure control methods in computerized adaptive testing JF - Journal of Educational Measurement Y1 - 1998 A1 - Revuelta, J., A1 - Ponsoda, V. VL - 35 ER - TY - JOUR T1 - An investigation of self-adapted testing in a Spanish high school population JF - Educational and Psychological Measurement Y1 - 1997 A1 - Ponsoda, V. A1 - Wise, S. L. A1 - Olea, J. A1 - Revuelta, J. VL - 57 ER - TY - JOUR T1 - Una solución a la estimatión inicial en los tests adaptivos informatizados [A solution to initial estimation in CATs.] JF - Revista Electrónica de Metodología Aplicada Y1 - 1997 A1 - Revuelta, J. A1 - Ponsoda, V. VL - 2 ER - TY - JOUR T1 - Metodos sencillos para el control de las tasas de exposicion en tests adaptativos informatizados [Simple methods for item exposure control in CATs] JF - Psicologica Y1 - 1996 A1 - Revuelta, J. A1 - Ponsoda, V. VL - 17 ER - TY - JOUR T1 - Propiedades psicometricas du un test adaptivo informatizado do vocabulario ingles [Psychometric properties of a computerized adaptive tests for the measurement of English vocabulary] JF - Estudios de Psicologica Y1 - 1996 A1 - Olea., J. A1 - Ponsoda, V. A1 - Revuelta, J. A1 - Belchi, J. VL - 55 N1 - [In Spanish] ER - TY - CHAP T1 - Test adaptativos informatizados [Computerized adaptive testing] T2 - Psicometría Y1 - 1996 A1 - Olea, J. A1 - Ponsoda, V. JF - Psicometría PB - Universitas CY - Madrid, UNED ER - TY - CONF T1 - Tests adaptivos y autoadaptados informatizados: Effects en la ansiedad y en la pecision de las estimaciones [SATs and CATS: Effects on enxiety and estimate precision] T2 - Paper presented at the Fourth Symposium de Metodologia de las Ciencies del Comportamiento Y1 - 1995 A1 - Olea, J. A1 - Ponsoda, V. A1 - Wise, S. L. JF - Paper presented at the Fourth Symposium de Metodologia de las Ciencies del Comportamiento CY - Murcia, Spain ER - TY - JOUR T1 - ADTEST: A computer-adaptive tests based on the maximum information principle JF - Educational and Psychological Measurement Y1 - 1994 A1 - Ponsoda, V. A1 - Olea, J., A1 - Revuelta, J. VL - 54 ER -