%0 Generic %D 2001 %T A method for building a realistic model of test taker behavior for computerized adaptive testing (Research Report 01-22) %A Stocking, M. L. %A Steffen, M. %A Eignor, D. R. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 2001 %T Refining a system for computerized adaptive testing pool creation (Research Report 01-18) %A Way, W. D. %A Swanson, L. %A Steffen, M. %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 2000 %T A framework for comparing adaptive test designs %A Stocking, M. L. %C Unpublished manuscript %G eng %0 Generic %D 2000 %T An investigation of approaches to computerizing the GRE subject tests (GRE Board Professional Report No 93-08P; Educational Testing Service Research Report 00-4) %A Stocking, M. L. %A Smith, R. %A Swanson, L. %C Princeton NJ: Educational Testing Service. %G eng %0 Book Section %D 2000 %T Methods of controlling the exposure of items in CAT %A Stocking, M. L. %A Lewis, C. %C W. J. van der Linden and C. A. W. Glas (eds.), Computerized adaptive testing: Theory and practice (pp. 163-182). Norwell MA: Kluwer. %G eng %0 Journal Article %J Journal of Educational & Behavioral Statistics %D 1998 %T Controlling item exposure conditional on ability in computerized adaptive testing %A Stocking, M. L. %A Lewis, C. %X The interest in the application of large-scale adaptive testing for secure tests has served to focus attention on issues that arise when theoretical advances are made operational. One such issue is that of ensuring item and pool security in the continuous testing environment made possible by the computerized admin-istration of a test, as opposed to the more periodic testing environment typically used for linear paper-and-pencil tests. This article presents a new method of controlling the exposure rate of items conditional on ability level in this continuous testing environment. The properties of such conditional control on the exposure rates of items, when used in conjunction with a particular adaptive testing algorithm, are explored through studies with simulated data. %B Journal of Educational & Behavioral Statistics %V 23 %P 57-75 %G eng %0 Generic %D 1998 %T A framework for comparing adaptive test designs %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng %0 Journal Article %J Applied Psychological Measurement %D 1998 %T Optimal design of item pools for computerized adaptive testing %A Stocking, M. L. %A Swanson, L. %B Applied Psychological Measurement %V 22 %P 271-279 %G eng %0 Journal Article %J Journal of Educational Measurement %D 1998 %T Simulating the use of disclosed items in computerized adaptive testing %A Stocking, M. L. %A W. C. Ward %A Potenza, M. T. %K computerized adaptive testing %X Regular use of questions previously made available to the public (i.e., disclosed items) may provide one way to meet the requirement for large numbers of questions in a continuous testing environment, that is, an environment in which testing is offered at test taker convenience throughout the year rather than on a few prespecified test dates. First it must be shown that such use has effects on test scores small enough to be acceptable. In this study simulations are used to explore the use of disclosed items under a worst-case scenario which assumes that disclosed items are always answered correctly. Some item pool and test designs were identified in which the use of disclosed items produces effects on test scores that may be viewed as negligible. %B Journal of Educational Measurement %V 35 %P 48-68 %G eng %0 Journal Article %J Journal of Educational and Behavioral Statistics %D 1997 %T An alternative method for scoring adaptive tests %A Stocking, M. L. %B Journal of Educational and Behavioral Statistics %V 21 %P 365-389 %G eng %0 Journal Article %J Journal of Educational Measurement %D 1997 %T Flawed items in computerized adaptive testing %A Potenza, M. T. %A Stocking, M. L. %B Journal of Educational Measurement %V 4 %P 79-96 %G eng %0 Journal Article %J Applied Psychological Measurement %D 1997 %T Revising item responses in computerized adaptive tests: A comparison of three models %A Stocking, M. L. %K computerized adaptive testing %X Interest in the application of large-scale computerized adaptive testing has focused attention on issues that arise when theoretical advances are made operational. One such issue is that of the order in which exaniinees address questions within a test or separately timed test section. In linear testing, this order is entirely under the control of the examinee, who can look ahead at questions and return and revise answers to questions. Using simulation, this study investigated three models that permit restricted examinee control over revising previous answers in the context of adaptive testing. Even under a worstcase model of examinee revision behavior, two of the models of permitting item revisions worked well in preserving test fairness and accuracy. One model studied may also preserve some cognitive processing styles developed by examinees for a linear testing environment. %B Applied Psychological Measurement %V 21 %P 129-142 %G eng %0 Generic %D 1997 %T Simulating the use of disclosed items in computerized adaptive testing (Research Report 97-10) %A Stocking, M. L. %A W. C. Ward %A Potenza, M. T. %C Princeton NJ: Educational Testing Service %G eng %0 Journal Article %J Journal of Educational and Behavioral Statistics %D 1996 %T An alternative method for scoring adaptive tests %A Stocking, M. L. %B Journal of Educational and Behavioral Statistics %V 21 %P 365-389 %G eng %0 Generic %D 1996 %T Optimal design of item pools for computerized adaptive testing (Research Report 96-34) %A Stocking, M. L. %A Swanson, L. %C Princeton NJ: Educational Testing Service %G eng %0 Journal Article %J Applied Measurement in Education %D 1996 %T Practical issues in large-scale computerized adaptive testing %A Mills, C. N., %A Stocking, M. L. %B Applied Measurement in Education %V 9 %P 287-304 %G eng %0 Generic %D 1996 %T Revising item responses in computerized adaptive testing: A comparison of three models (RR-96-12) %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 1995 %T Controlling item exposure conditional on ability in computerized adaptive testing (Research Report 95-25) %A Stocking, M. L. %A Lewis, C. %C Princeton NJ: Educational Testing Service. %G eng %0 Generic %D 1995 %T A new method of controlling item exposure in computerized adaptive testing (Research Report 95-25) %A Stocking, M. L. %A Lewis, C. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 1995 %T Practical issues in large-scale high-stakes computerized adaptive testing (Research Report 95-23) %A Mills, C. N. %A Stocking, M. L. %C Princeton, NJ: Educational Testing Service. %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1994 %T Pinpointing PRAXIS I CAT characteristics through simulation procedures %A Eignor, D. R. %A Folk, V.G., %A Li, M.-Y. %A Stocking, M. L. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C New Orleans, LA %0 Generic %D 1994 %T Three practical issues for modern adaptive testing item pools (Research Report 94-5), %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng %0 Journal Article %J Applied Psychological Measurement %D 1993 %T The application of an automated item selection method to real data %A Stocking, M. L. %A Swanson, L. %A Pearlman, M. %B Applied Psychological Measurement %V 17 %P 167-176 %G eng %0 Generic %D 1993 %T Case studies in computer adaptive test design through simulation (Research Report RR-93-56) %A Eignor, D. R. %A Stocking, M. L. %A Way, W. D. %A Steffen, M. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 1993 %T Controlling item exposure rates in a realistic adaptive testing paradigm (Research Report 93-2) %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng %0 Journal Article %J Applied Psychological Measurement %D 1993 %T A Method for Severely Constrained Item Selection in Adaptive Testing %A Stocking, M. L. %A Swanson, L. %B Applied Psychological Measurement %V 17 %P 277-292 %G English %N 3 %0 Conference Paper %B Paper presented at the Joint Statistics and Psychometric Seminar %D 1993 %T Modern computerized adaptive testing %A Stocking, M. L. %B Paper presented at the Joint Statistics and Psychometric Seminar %C Princeton NJ %G eng %0 Generic %D 1992 %T A method for severely constrained item selection in adaptive testing %A Stocking, M. L. %A Swanson, L. %C Educational Testing Service Research Report (RR-92-37): Princeton NJ %G eng %0 Generic %D 1991 %T Automatic item selection (AIS) methods in the ETS testing environment (Research Memorandum 91-5) %A Stocking, M. L. %A Swanson, L. %A Pearlman, M. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 1988 %T Scale drift in on-line calibration (Research Report RR-88-28-ONR) %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 1988 %T Scale drift in on-line calibration (Tech Rep. No. ERIC ED389710) %A Stocking, M. L. %C Educational Testing Service, Princeton, N.J. %G eng %0 Generic %D 1988 %T Some considerations in maintaining adaptive test item pools (Research Report 88-33-ONR) %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 1988 %T Some considerations in maintaining adaptive test item pools (Tech Rep. No. ERIC ED391814) %A Stocking, M. L. %C Educational Testing Service, Princeton, N.J. %G eng %0 Journal Article %J Applied Psychology: An International Review %D 1987 %T Two simulated feasibility studies in computerized adaptive testing %A Stocking, M. L. %B Applied Psychology: An International Review %V 36 %P 263-277 %G eng %0 Generic %D 1984 %T Two simulated feasibility studies in computerized adaptive testing (RR-84-15) %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 1969 %T Short tailored tests (RB-69-63) %A Stocking, M. L. %C Princeton NJ: Educational Testing Service %G eng