TY - JOUR T1 - Designing item pools to optimize the functioning of a computerized adaptive test JF - Psychological Test and Assessment Modeling Y1 - 2010 A1 - Reckase, M. D. AB - Computerized adaptive testing (CAT) is a testing procedure that can result in improved precision for a specified test length or reduced test length with no loss of precision. However, these attractive psychometric features of CATs are only achieved if appropriate test items are available for administration. This set of test items is commonly called an “item pool.” This paper discusses the optimal characteristics for an item pool that will lead to the desired properties for a CAT. Then, a procedure is described for designing the statistical characteristics of the item parameters for an optimal item pool within an item response theory framework. Because true optimality is impractical, methods for achieving practical approximations to optimality are described. The results of this approach are shown for an operational testing program including comparisons to the results from the item pool currently used in that testing program.Key VL - 52 SN - 2190-0507 ER - TY - CHAP T1 - The design of p-optimal item banks for computerized adaptive tests Y1 - 2007 A1 - Reckase, M. D. CY - D. J. Weiss (Ed.), Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing. {PDF file, 211 KB}. ER - TY - CHAP T1 - Designing optimal item pools for computerized adaptive tests with Sympson-Hetter exposure control Y1 - 2007 A1 - Gu, L. A1 - Reckase, M. D. CY - D. J. Weiss (Ed.), Proceedings of the 2007 GMAC Conference on Computerized Adaptive Testing N1 - 3 MB} ER - TY - CONF T1 - Item pool design for computerized adaptive tests T2 - Paper presented at the Annual meeting of the National Council on Measurement in Education Y1 - 2003 A1 - Reckase, M. D. JF - Paper presented at the Annual meeting of the National Council on Measurement in Education CY - Chicago IL N1 - {PDF file, 135 KB} ER - TY - CONF T1 - Item pool design for computerized adaptive tests T2 - Invited small group session at the 6th Conference of the European Association of Psychological Assessment Y1 - 2001 A1 - Reckase, M. D. JF - Invited small group session at the 6th Conference of the European Association of Psychological Assessment CY - Aachen, Germany ER - TY - CONF T1 - Computerized testing – the adolescent years: Juvenile delinquent or positive role model T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2000 A1 - Reckase, M. D. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New Orleans LA ER - TY - CONF T1 - Identifying similar item content clusters on multiple test forms T2 - Paper presented at the Psychometric Society meeting Y1 - 1997 A1 - Reckase, M. D. A1 - Thompson, T.D. A1 - Nering, M. JF - Paper presented at the Psychometric Society meeting CY - Gatlinburg, TN, June ER - TY - JOUR T1 - Comparison of SPRT and sequential Bayes procedures for classifying examinees into two categories using a computerized test JF - Journal of Educational & Behavioral Statistics Y1 - 1996 A1 - Spray, J. A. A1 - Reckase, M. D. VL - 21 ER - TY - CONF T1 - The selection of test items for decision making with a computer adaptive test T2 - Paper presented at the national meeting of the National Council on Measurement in Education Y1 - 1994 A1 - Spray, J. A. A1 - Reckase, M. D. JF - Paper presented at the national meeting of the National Council on Measurement in Education CY - New Orleans LA N1 - #SP94-01 ER - TY - CONF T1 - The selection of test items for decision making with a computer adaptive test T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1994 A1 - Reckase, M. D. A1 - Spray, J. A. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New Orleans LA ER - TY - CONF T1 - Comparison of SPRT and sequential Bayes procedures for classifying examinees into two categories using an adaptive test T2 - Unpublished manuscript. ( Y1 - 1993 A1 - Spray, J. A. A1 - Reckase, M. D. JF - Unpublished manuscript. ( ER - TY - JOUR T1 - Adaptive testing: The evolution of a good idea JF - Educational Measurement: Issues and Practice Y1 - 1989 A1 - Reckase, M. D. KW - computerized adaptive testing VL - 8 SN - 1745-3992 ER - TY - ABST T1 - The interpretation and application of multidimensional item response theory models; and computerized testing in the instructional environment: Final Report (Research Report ONR 89-2) Y1 - 1989 A1 - Reckase, M. D. CY - Iowa City IA: The American College Testing Program N1 - #RE89-02 ER - TY - CONF T1 - Computerized adaptive testing: a good idea waiting for the right technology T2 - Paper presented at the meeting of the American Educational Research Association Y1 - 1988 A1 - Reckase, M. D. JF - Paper presented at the meeting of the American Educational Research Association CY - New Orleans, April 1988 ER - TY - RPRT T1 - The effect of item parameter estimation error on decisions made using the sequential probability ratio test Y1 - 1987 A1 - Spray, J. A. A1 - Reckase, M. D. KW - computerized adaptive testing KW - Sequential probability ratio test JF - ACT Research Report Series PB - DTIC Document CY - Iowa City, IA. USA ER - TY - ABST T1 - The effect of item parameter estimation error on the decisions made using the sequential probability ratio test (ACT Research Report Series 87-17) Y1 - 1987 A1 - Spray, J. A. A1 - Reckase, M. D. CY - Iowa City IA: American College Testing ER - TY - ABST T1 - Final report: The use of tailored testing with instructional programs (Research Report ONR 86-1) Y1 - 1986 A1 - Reckase, M. D. CY - Iowa City IA: The American College Testing Program, Assessment Programs Area, Test Development Division. ER - TY - ABST T1 - Evaluation plan for the computerized adaptive vocational aptitude battery (Research Report 82-1) Y1 - 1984 A1 - Green, B. F. A1 - Bock, R. D. A1 - Humphreys, L. G. A1 - Linn, R. L. A1 - Reckase, M. D. N1 - Baltimore MD: The Johns Hopkins University, Department of Psychology. ER - TY - JOUR T1 - A plan for scaling the computerized adaptive Armed Services Vocational Aptitude Battery JF - Journal of Educational Measurement Y1 - 1984 A1 - Green, B. F. A1 - Bock, B. D., A1 - Linn, R. L. A1 - Lord, F. M., A1 - Reckase, M. D. VL - 21 ER - TY - CONF T1 - The selection of items for decision making with a computer adaptive test T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1984 A1 - Spray, J. A. A1 - Reckase, M. D. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New Orleans LA ER - TY - JOUR T1 - Technical guidelines for assessing computerized adaptive tests JF - Journal of Educational Measurement Y1 - 1984 A1 - Green, B. F. A1 - Bock, R. D. A1 - Humphreys, L. G. A1 - Linn, R. L. A1 - Reckase, M. D. KW - computerized adaptive testing KW - Mode effects KW - paper-and-pencil VL - 21 SN - 1745-3984 ER - TY - ABST T1 - An evaluation of one- and three-parameter logistic tailored testing procedures for use with small item pools (Research Report ONR83-1) Y1 - 1983 A1 - McKinley, R. L. A1 - Reckase, M. D. CY - Iowa City IA: American College Testing Program ER - TY - CHAP T1 - A procedure for decision making using tailored testing. T2 - New horizons in testing: Latent trait theory and computerized adaptive testing Y1 - 1983 A1 - Reckase, M. D. KW - CCAT KW - CLASSIFICATION Computerized Adaptive Testing KW - sequential probability ratio testing KW - SPRT JF - New horizons in testing: Latent trait theory and computerized adaptive testing PB - Academic Press CY - New York, NY. USA ER - TY - CHAP T1 - Discussion: Adaptive and sequential testing Y1 - 1982 A1 - Reckase, M. D. CY - D. J. Weiss (Ed.). Proceedings of the 1982 Computerized Adaptive Testing Conference (pp. 290-294). Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program. N1 - {PDF file, 288 KB} ER - TY - RPRT T1 - A comparison of a Bayesian and a maximum likelihood tailored testing procedure Y1 - 1981 A1 - McKinley, R. L., A1 - Reckase, M. D. JF - Research Report 81-2 PB - University of Missouri, Department of Educational Psychology, Tailored Testing Research Laboratory CY - Columbia MO ER - TY - CONF T1 - A comparison of a maximum likelihood and a Bayesian estimation procedure for tailored testing T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1981 A1 - Rosso, M. A. A1 - Reckase, M. D. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Los Angeles CA N1 - #RO81-01 ER - TY - ABST T1 - Final report: Procedures for criterion referenced tailored testing Y1 - 1981 A1 - Reckase, M. D. CY - Columbia: University of Missouri, Educational Psychology Department ER - TY - ABST T1 - The use of the sequential probability ratio test in making grade classifications in conjunction with tailored testing (Research Report 81-4) Y1 - 1981 A1 - Reckase, M. D. CY - Columbia MO: University of Missouri, Department of Educational Psychology ER - TY - JOUR T1 - Computer applications to ability testing JF - Association for Educational Data Systems Journal Y1 - 1980 A1 - McKinley, R. L., A1 - Reckase, M. D. VL - 13 ER - TY - CONF T1 - Effects of program parameters and item pool characteristics on the bias of a three-parameter tailored testing procedure T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1980 A1 - Patience, W. M. A1 - Reckase, M. D. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Boston MA, U N1 - A. ER - TY - JOUR T1 - Operational characteristics of a one-parameter tailored testing procedure JF - Catalog of Selected Documents in Psychology Y1 - 1980 A1 - Patience, W. M., A1 - Reckase, M. D. VL - August 1980 N1 - No. 2104). ER - TY - CHAP T1 - Some decision procedures for use with tailored testing Y1 - 1980 A1 - Reckase, M. D. CY - D. J. Weiss (Ed.), Proceedings of the 1979 Computerized Adaptive Testing Conference (pp. 79-100). Minneapolis MN: University of Minnesota, Department of Psychology, Psychometric Methods Program, Computerized Adaptive Testing Laboratory. ER - TY - ABST T1 - A successful application of latent trait theory to tailored achievement testing (Research Report 80-1) Y1 - 1980 A1 - McKinley, R. L. A1 - Reckase, M. D. CY - University of Missouri, Department of Educational Psychology, Tailored Testing Research Laboratory ER - TY - CONF T1 - Operational characteristics of a Rasch model tailored testing procedure when program parameters and item pool attributes are varied T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1979 A1 - Patience, W. M. A1 - Reckase, M. D. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - San Francisco ER - TY - ABST T1 - Problems in application of latent-trait models to tailored testing (Research Report 79-1) Y1 - 1979 A1 - Koch, W. J. A1 - Reckase, M. D. CY - Columbia MO: University of Missouri, Department of Psychology", (also presented at National Council on Measurement in Education, 1979: ERIC No. ED 177 196) note = " ER - TY - CONF T1 - A generalization of sequential analysis to decision making with tailored testing T2 - Paper presented at the meeting of the Military Testing Association Y1 - 1978 A1 - Reckase, M. D. JF - Paper presented at the meeting of the Military Testing Association CY - Oklahoma City OK ER - TY - ABST T1 - A live tailored testing comparison study of the one- and three-parameter logistic models (Research Report 78-1) Y1 - 1978 A1 - Koch, W. J. A1 - Reckase, M. D. CY - Columbia MO: University of Missouri, Department of Psychology ER - TY - JOUR T1 - Application of tailored testing to achievement measurement JF - Behavior Research Methods and Instrumentation Y1 - 1977 A1 - English, R. A. A1 - Reckase, M. D. A1 - Patience, W. M. VL - 9 ER - TY - JOUR T1 - Procedures for computerized testing JF - Behavior Research Methods and Instrumentation Y1 - 1977 A1 - Reckase, M. D. VL - 70 ER - TY - CONF T1 - The effect of item pool characteristics on the operation of a tailored testing procedure T2 - Paper presented at the annual meeting of the Psychometric Society Y1 - 1976 A1 - Reckase, M. D. JF - Paper presented at the annual meeting of the Psychometric Society CY - Murray Hill NJ ER - TY - CONF T1 - Procedures for computerized testing T2 - Paper presented at the sixth annual meeting of the National Conference on the Use of On-Line Computers in Psychology Y1 - 1976 A1 - Reckase, M. D. JF - Paper presented at the sixth annual meeting of the National Conference on the Use of On-Line Computers in Psychology CY - St. Louis MO N1 - #RE76-01 ER - TY - CONF T1 - The effect of item choice on ability estimation when using a simple logistic tailored testing model T2 - Paper presented at the annual meeting of the American Educational Research Association Y1 - 1975 A1 - Reckase, M. D. JF - Paper presented at the annual meeting of the American Educational Research Association CY - Washington, D.C. ER - TY - CONF T1 - An application of the Rasch simple logistic model to tailored testing T2 - Paper presented at the annual meeting of the American Educational Research Association. Y1 - 1974 A1 - Reckase, M. D. JF - Paper presented at the annual meeting of the American Educational Research Association. CY - St. Loius MO ER - TY - JOUR T1 - An interactive computer program for tailored testing based on the one-parameter logistic model JF - Behavior Research Methods and Instrumentation Y1 - 1974 A1 - Reckase, M. D. VL - 6 ER - TY - CONF T1 - An interactive computer program for tailored testing based on the one-parameter logistic model T2 - Paper presented at the National Conference on the Us of On-Line Computers in Psychology Y1 - 1973 A1 - Reckase, M. D. JF - Paper presented at the National Conference on the Us of On-Line Computers in Psychology CY - St. Louis MO ER -