TY - CHAP T1 - Detecting Person Misfit in Adaptive Testing T2 - Elements of Adaptive Testing Y1 - 2010 A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. L. A. JF - Elements of Adaptive Testing ER - TY - RPRT T1 - The use of person-fit statistics in computerized adaptive testing Y1 - 2005 A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. L. A. JF - LSAC Research Report Series PB - Law School Administration Council CY - Newton, PA. USA SN - Computerized Testing Report 97-14 ER - TY - JOUR T1 - Using response times to detect aberrant responses in computerized adaptive testing JF - Psychometrika Y1 - 2003 A1 - van der Linden, W. J. A1 - van Krimpen-Stoop, E. M. L. A. KW - Adaptive Testing KW - Behavior KW - Computer Assisted Testing KW - computerized adaptive testing KW - Models KW - person Fit KW - Prediction KW - Reaction Time AB - A lognormal model for response times is used to check response times for aberrances in examinee behavior on computerized adaptive tests. Both classical procedures and Bayesian posterior predictive checks are presented. For a fixed examinee, responses and response times are independent; checks based on response times offer thus information independent of the results of checks on response patterns. Empirical examples of the use of classical and Bayesian checks for detecting two different types of aberrances in response times are presented. The detection rates for the Bayesian checks outperformed those for the classical checks, but at the cost of higher false-alarm rates. A guideline for the choice between the two types of checks is offered. VL - 68 ER - TY - JOUR T1 - Detection of person misfit in computerized adaptive tests with polytomous items JF - Applied Psychological Measurement Y1 - 2002 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. AB - Item scores that do not fit an assumed item response theory model may cause the latent trait value to be inaccurately estimated. For a computerized adaptive test (CAT) using dichotomous items, several person-fit statistics for detecting mis.tting item score patterns have been proposed. Both for paper-and-pencil (P&P) tests and CATs, detection ofperson mis.t with polytomous items is hardly explored. In this study, the nominal and empirical null distributions ofthe standardized log-likelihood statistic for polytomous items are compared both for P&P tests and CATs. Results showed that the empirical distribution of this statistic differed from the assumed standard normal distribution for both P&P tests and CATs. Second, a new person-fit statistic based on the cumulative sum (CUSUM) procedure from statistical process control was proposed. By means ofsimulated data, critical values were determined that can be used to classify a pattern as fitting or misfitting. The effectiveness of the CUSUM to detect simulees with item preknowledge was investigated. Detection rates using the CUSUM were high for realistic numbers ofdisclosed items. VL - 26 ER - TY - JOUR T1 - CUSUM-based person-fit statistics for adaptive testing JF - Journal of Educational and Behavioral Statistics Y1 - 2001 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. VL - 26 ER - TY - CONF T1 - Using response times to detect aberrant behavior in computerized adaptive testing T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2001 A1 - van der Linden, W. J. A1 - van Krimpen-Stoop, E. M. L. A. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Seattle WA ER - TY - CHAP T1 - Detecting person misfit in adaptive testing using statistical process control techniques T2 - Computer adaptive testing: Theory and practice Y1 - 2000 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. KW - person Fit JF - Computer adaptive testing: Theory and practice PB - Kluwer Academic. CY - Dordrecht, The Netherlands ER - TY - CHAP T1 - Detecting person misfit in adaptive testing using statistical process control techniques Y1 - 2000 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. CY - W. J. van der Linden, and C. A. W. Glas (Editors). Computerized Adaptive Testing: Theory and Practice. Norwell MA: Kluwer. ER - TY - ABST T1 - Detection of person misfit in computerized adaptive testing with polytomous items (Research Report 00-01) Y1 - 2000 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - JOUR T1 - The null distribution of person-fit statistics for conventional and adaptive tests JF - Applied Psychological Measurement Y1 - 2000 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. VL - 23 ER - TY - ABST T1 - Using response times to detect aberrant behavior in computerized adaptive testing (Research Report 00-09) Y1 - 2000 A1 - van der Linden, W. J. A1 - van Krimpen-Stoop, E. M. L. A. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - JOUR T1 - CUSUM-based person-fit statistics for adaptive testing JF - Journal of Educational and Behavioral Statistics Y1 - 1999 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. VL - 26 ER - TY - ABST T1 - CUSUM-based person-fit statistics for adaptive testing (Research Report 99-05) Y1 - 1999 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - JOUR T1 - The null distribution of person-fit statistics for conventional and adaptive tests JF - Applied Psychological Measurement Y1 - 1999 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. VL - 23 ER - TY - ABST T1 - Person fit based on statistical process control in an adaptive testing environment (Research Report 98-13) Y1 - 1998 A1 - van Krimpen-Stoop, E. M. L. A. A1 - Meijer, R. R. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - ABST T1 - Simulating the null distribution of person-fit statistics for conventional and adaptive tests (Research Report 98-02) Y1 - 1998 A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. L. A. CY - Enschede, The Netherlands: University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER - TY - ABST T1 - Statistical tests for person misfit in computerized adaptive testing (Research Report 98-01) Y1 - 1998 A1 - Glas, C. A. W. A1 - Meijer, R. R. A1 - van Krimpen-Stoop, E. M. L. A. CY - Enschede, The Netherlands : University of Twente, Faculty of Educational Science and Technology, Department of Measurement and Data Analysis ER -