%0 Book Section %D 2009 %T Optimizing item exposure control algorithms for polytomous computerized adaptive tests with restricted item banks %A Chajewski, M. %A Lewis, C. %C D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. %G eng %0 Book Section %D 2007 %T Some thoughts on controlling item exposure in adaptive testing %A Lewis, C. %C D. J. Weiss (Ed.), Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing. %G eng %0 Journal Article %J Applied Psychological Measurement %D 2003 %T A Bayesian method for the detection of item preknowledge in computerized adaptive testing %A McLeod, L. %A Lewis, C. %A Thissen, D. %K Adaptive Testing %K Cheating %K Computer Assisted Testing %K Individual Differences computerized adaptive testing %K Item %K Item Analysis (Statistical) %K Mathematical Modeling %K Response Theory %X With the increased use of continuous testing in computerized adaptive testing, new concerns about test security have evolved, such as how to ensure that items in an item pool are safeguarded from theft. In this article, procedures to detect test takers using item preknowledge are explored. When test takers use item preknowledge, their item responses deviate from the underlying item response theory (IRT) model, and estimated abilities may be inflated. This deviation may be detected through the use of person-fit indices. A Bayesian posterior log odds ratio index is proposed for detecting the use of item preknowledge. In this approach to person fit, the estimated probability that each test taker has preknowledge of items is updated after each item response. These probabilities are based on the IRT parameters, a model specifying the probability that each item has been memorized, and the test taker's item responses. Simulations based on an operational computerized adaptive test (CAT) pool are used to demonstrate the use of the odds ratio index. (PsycINFO Database Record (c) 2005 APA ) %B Applied Psychological Measurement %V 27 %P 121-137 %G eng %0 Generic %D 2002 %T Adaptive testing without IRT in the presence of multidimensionality (Research Report 02-09) %A Yan, D. %A Lewis, C. %A Stocking, M. %C Princeton NJ: Educational Testing Service %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 2002 %T A comparison of computer mastery models when pool characteristics vary %A Smith, R. L. %A Lewis, C. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C New Orleans LA %G eng %0 Book Section %D 2000 %T Methods of controlling the exposure of items in CAT %A Stocking, M. L. %A Lewis, C. %C W. J. van der Linden and C. A. W. Glas (eds.), Computerized adaptive testing: Theory and practice (pp. 163-182). Norwell MA: Kluwer. %G eng %0 Journal Article %J Applied Psychological Measurement %D 1999 %T Detecting item memorization in the CAT environment %A McLeod L. D., %A Lewis, C. %B Applied Psychological Measurement %V 23 %P 147-160 %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1998 %T Adaptive testing without IRT %A Yan, D. %A Lewis, C. %A Stocking, M. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C San Diego CA %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1998 %T A Bayesian approach to detection of item preknowledge in a CAT %A McLeod, L. D. %A Lewis, C. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C San Diego CA %G eng %0 Generic %D 1998 %T Comparability of paper-and-pencil and computer adaptive test scores on the GRE General Test (GRE Board Professional Report No 95-08P; Educational Testing Service Research Report 98-38) %A Schaeffer, G. %A Bridgeman, B. %A Golub-Smith, M. L. %A Lewis, C. %A Potenza, M. T. %A Steffen, M. %C Princeton, NJ: Educational Testing Service %G eng %0 Report %D 1998 %T Comparability of paper-and-pencil and computer adaptive test scores on the GRE General Test %A Schaeffer, G. A. %A Bridgeman, B. %A Golub-Smith, M. L. %A Lewis, C. %A Potenza, M. T. %A Steffen, M. %I Educational Testing Services %C Princeton, N.J. %8 August, 1998 %@ ETS Research Report 98-38 %G eng %0 Journal Article %J Journal of Educational & Behavioral Statistics %D 1998 %T Controlling item exposure conditional on ability in computerized adaptive testing %A Stocking, M. L. %A Lewis, C. %X The interest in the application of large-scale adaptive testing for secure tests has served to focus attention on issues that arise when theoretical advances are made operational. One such issue is that of ensuring item and pool security in the continuous testing environment made possible by the computerized admin-istration of a test, as opposed to the more periodic testing environment typically used for linear paper-and-pencil tests. This article presents a new method of controlling the exposure rate of items conditional on ability level in this continuous testing environment. The properties of such conditional control on the exposure rates of items, when used in conjunction with a particular adaptive testing algorithm, are explored through studies with simulated data. %B Journal of Educational & Behavioral Statistics %V 23 %P 57-75 %G eng %0 Conference Paper %B Paper presented at the annual meeting of National Council on Measurement in Education %D 1998 %T Expected losses for individuals in Computerized Mastery Testing %A Smith, R. %A Lewis, C. %B Paper presented at the annual meeting of National Council on Measurement in Education %C San Diego %G eng %0 Conference Paper %B Paper presented at the annual meeting of the Psychometric Society %D 1998 %T A new approach for the detection of item preknowledge in computerized adaptive testing %A McLeod, L. D. %A Lewis, C. %B Paper presented at the annual meeting of the Psychometric Society %C Urbana, IL %G eng %0 Conference Paper %B Paper presented at the annual meeting of National Council on Measurement in Education %D 1997 %T Incorporating decision consistency into Bayesian sequential testing %A Smith, R. %A Lewis, C. %B Paper presented at the annual meeting of National Council on Measurement in Education %C Chicago %G eng %0 Conference Paper %B Paper presented at the Annual meeting of the National Council on Measurement in Education %D 1996 %T Person-fit indices and their role in the CAT environment %A David, L. A. %A Lewis, C. %B Paper presented at the Annual meeting of the National Council on Measurement in Education %C New York NY %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1996 %T Person-fit indices and their role in the CAT environment %A McLeod, L. D. %A Lewis, C. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C New York %G eng %0 Conference Paper %B Paper presented at the annual meeting of National Council on Measurement in Education %D 1996 %T A search procedure to determine sets of decision points when using testlet-based Bayesian sequential testing procedures %A Smith, R. %A Lewis, C. %B Paper presented at the annual meeting of National Council on Measurement in Education %C New York %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1995 %T A Bayesian computerized mastery model with multiple cut scores %A Smith, R. L. %A Lewis, C. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C San Francisco CA %G eng %0 Conference Paper %B Paper presented at the annual meeting of the American Educational Research Association %D 1995 %T A comparison of two IRT-based models for computerized mastery testing when item parameter estimates are uncertain %A Way, W. D. %A Lewis, C. %A Smith, R. L. %B Paper presented at the annual meeting of the American Educational Research Association %C San Francisco %G eng %0 Journal Article %J Journal of the American Dietetic Association %D 1995 %T Computer-adaptive testing: A new breed of assessment %A Ruiz, B. %A Fitz, P. A. %A Lewis, C. %A Reidy, C. %B Journal of the American Dietetic Association %V 95 %P 1326-1327 %G eng %0 Journal Article %J Journal of the American Dietetic Association %D 1995 %T Computer-adaptive testing: A new breed of assessment %A Ruiz, B. %A Fitz, P. A. %A Lewis, C. %A Reidy, C. %B Journal of the American Dietetic Association %V 95 %P 1326-1327 %G eng %0 Generic %D 1995 %T Controlling item exposure conditional on ability in computerized adaptive testing (Research Report 95-25) %A Stocking, M. L. %A Lewis, C. %C Princeton NJ: Educational Testing Service. %G eng %0 Generic %D 1995 %T A new method of controlling item exposure in computerized adaptive testing (Research Report 95-25) %A Stocking, M. L. %A Lewis, C. %C Princeton NJ: Educational Testing Service %G eng %0 Generic %D 1994 %T Computerized mastery testing using fuzzy set decision theory (Research Report 94-37) %A Du, Y. %A Lewis, C. %A Pashley, P. J. %C Princeton NJ: Educational Testing Service %G eng %0 Journal Article %J Applied Measurement in Education %D 1993 %T Computerized mastery testing using fuzzy set decision theory %A Du, Y. %A Lewis, C. %A Pashley, P. J. %B Applied Measurement in Education %V 6 %P 181-193 %G eng %0 Journal Article %J Journal of Educational Measurement %D 1992 %T A comparison of the performance of simulated hierarchical and linear testlets %A Wainer, H., %A Kaplan, B. %A Lewis, C. %B Journal of Educational Measurement %V 29 %P 243-251 %G eng %0 Journal Article %J Applied Psychological Measurement %D 1992 %T Computerized mastery testing with nonequivalent testlets %A Sheehan, K., %A Lewis, C. %B Applied Psychological Measurement %V 16 %P 65-76 %G eng %0 Journal Article %J Applied Psychological Measurement %D 1992 %T Computerized Mastery Testing With Nonequivalent Testlets %A Sheehan, K. %A Lewis, C. %B Applied Psychological Measurement %V 16 %P 65-76 %G English %N 1 %0 Journal Article %J Journal of Educational Measurement %D 1991 %T Building algebra testlets: A comparison of hierarchical and linear structures %A Wainer, H., %A Lewis, C. %A Kaplan, B. %A Braswell, J. %B Journal of Educational Measurement %V 8 %P xxx-xxx %G eng %0 Generic %D 1991 %T Some empirical guidelines for building testlets (Technical Report 91-56) %A Wainer, H., %A Kaplan, B. %A Lewis, C. %C Princeton NJ: Educational Testing Service, Program Statistics Research %G eng %0 Generic %D 1990 %T An adaptive algebra test: A testlet-based, hierarchically structured test with validity-based scoring %A Wainer, H., %A Lewis, C. %A Kaplan, B, %A Braswell, J. %C ETS Technical Report 90-92 %G eng %0 Journal Article %J Journal of Educational Measurement %D 1990 %T Toward a psychometrics for testlets %A Wainer, H., %A Lewis, C. %B Journal of Educational Measurement %V 27 %P 1-14 %G eng %0 Journal Article %J Applied Psychological Measurement %D 1990 %T Using Bayesian Decision Theory to Design a Computerized Mastery Test %A Lewis, C. %A Sheehan, K. %B Applied Psychological Measurement %V 14 %P 367-386 %G English %N 4 %0 Journal Article %J Machine-Mediated Learning %D 1988 %T Computerized mastery testing %A Lewis, C. %A Sheehan, K. %B Machine-Mediated Learning %V 2 %P 283-286 %G eng