TY - CHAP T1 - Principles of Multidimensional Adaptive Testing T2 - Elements of Adaptive Testing Y1 - 2010 A1 - Segall, D. O. JF - Elements of Adaptive Testing ER - TY - CHAP T1 - The nine lives of CAT-ASVAB: Innovations and revelations Y1 - 2009 A1 - Pommerich, M A1 - Segall, D. O. A1 - Moreno, K. E. AB - The Armed Services Vocational Aptitude Battery (ASVAB) is administered annually to more than one million military applicants and high school students. ASVAB scores are used to determine enlistment eligibility, assign applicants to military occupational specialties, and aid students in career exploration. The ASVAB is administered as both a paper-and-pencil (P&P) test and a computerized adaptive test (CAT). CAT-ASVAB holds the distinction of being the first large-scale adaptive test battery to be administered in a high-stakes setting. Approximately two-thirds of military applicants currently take CAT-ASVAB; long-term plans are to replace P&P-ASVAB with CAT-ASVAB at all test sites. Given CAT-ASVAB’s pedigree—approximately 20 years in development and 20 years in operational administration—much can be learned from revisiting some of the major highlights of CATASVAB history. This paper traces the progression of CAT-ASVAB through nine major phases of development including: research and evelopment of the CAT-ASVAB prototype, the initial development of psychometric procedures and item pools, initial and full-scale operational implementation, the introduction of new item pools, the introduction of Windows administration, the introduction of Internet administration, and research and development of the next generation CATASVAB. A background and history is provided for each phase, including discussions of major research and operational issues, innovative approaches and practices, and lessons learned. CY - In D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing. N1 - {PDF File, 169 KB} ER - TY - CHAP T1 - Computerized adaptive testing Y1 - 2004 A1 - Segall, D. O. CY - Encyclopedia of social measurement. Academic Press. N1 - {PDF file, 180 KB} ER - TY - JOUR T1 - A sharing item response theory model for computerized adaptive testing JF - Journal of Educational and Behavioral Statistics Y1 - 2004 A1 - Segall, D. O. AB - A new sharing item response theory (SIRT) model is presented which explicitly models the effects of sharing item content between informants and testtakers. This model is used to construct adaptive item selection and scoring rules that provide increased precision and reduced score gains in instances where sharing occurs. The adaptive item selection rules are expressed as functions of the item’s exposure rate in addition to other commonly used properties (characterized by difficulty, discrimination, and guessing parameters). Based on the results of simulated item responses, the new item selection and scoring algorithms compare favorably to the Sympson-Hetter exposure control method. The new SIRT approach provides higher reliability and lower score gains in instances where sharing occurs. VL - 29 N1 - References .American Educational Research Assn, US ER - TY - CONF T1 - An adaptive exposure control algorithm for computerized adaptive testing using a sharing item response theory model T2 - Paper presented at the Annual meeting of the National Council on Measurement in Education Y1 - 2003 A1 - Segall, D. O. JF - Paper presented at the Annual meeting of the National Council on Measurement in Education CY - Chicago IL N1 - {PDF file, 191 KB} ER - TY - CONF T1 - Calibrating CAT item pools and online pretest items using MCMC methods T2 - Paper presented at the Annual meeting of the National Council on Measurement in Education Y1 - 2003 A1 - Segall, D. O. JF - Paper presented at the Annual meeting of the National Council on Measurement in Education CY - Chicago IL N1 - {PDF file, 155 KB} ER - TY - CONF T1 - Calibrating CAT pools and online pretest items using marginal maximum likelihood methods T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2003 A1 - Pommerich, M A1 - Segall, D. O. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Chicago IL N1 - {PDF file, 284 KB} ER - TY - CONF T1 - Confirmatory item factor analysis using Markov chain Monte Carlo estimation with applications to online calibration in CAT T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2002 A1 - Segall, D. O. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - New Orleans, LA ER - TY - JOUR T1 - An item response model for characterizing test compromise JF - Journal of Educational and Behavioral Statistics Y1 - 2002 A1 - Segall, D. O. KW - computerized adaptive testing AB - This article presents an item response model for characterizing test-compromise that enables the estimation of item-preview and score-gain distributions observed in on-demand high-stakes testing programs. Model parameters and posterior distributions are estimated by Markov Chain Monte Carlo (MCMC) procedures. Results of a simulation study suggest that when at least some of the items taken by a small sample of test takers are known to be secure (uncompromised), the procedure can provide useful summaries of test-compromise and its impact on test scores. The article includes discussions of operational use of the proposed procedure, possible model violations and extensions, and application to computerized adaptive testing. VL - 27 N1 - References .American Educational Research Assn, US ER - TY - CONF T1 - Measuring test compromise in high-stakes computerized adaptive testing: A Bayesian Strategy for surrogate test-taker detection T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 2001 A1 - Segall, D. O. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Seattle WA N1 - {PDF file, 275 KB} ER - TY - CHAP T1 - Principles of multidimensional adaptive testing Y1 - 2000 A1 - Segall, D. O. CY - W. J. van der Linden and C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 53-73). Norwell MA: Kluwer. ER - TY - CHAP T1 - Development of the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery Y1 - 1999 A1 - Segall, D. O. A1 - Moreno, K. E. CY - F. Drasgow and J. Olson-Buchanan (Eds.). Innovations in computerized assessment. Mahwah NJ: Erlbaum. ER - TY - CONF T1 - Reducing item exposure without reducing precision (much) in computerized adaptive testing T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1999 A1 - Holmes, R. M. A1 - Segall, D. O. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Montreal, CA ER - TY - CONF T1 - Applications of multidimensional adaptive testing T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1997 A1 - Segall, D. O. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Montreal, Canada ER - TY - CHAP T1 - Current and future challenges Y1 - 1997 A1 - Segall, D. O. A1 - Moreno, K. E. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.). Computerized adaptive testing: From inquiry to operation (pp 257-269). Washington DC: American Psychological Association. ER - TY - CONF T1 - The effects of motivation on equating adaptive and conventional tests T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1997 A1 - Segall, D. O. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Chicago IL ER - TY - CHAP T1 - Equating the CAT-ASVAB Y1 - 1997 A1 - Segall, D. O. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 181-198). Washington DC: American Psychological Association. ER - TY - CHAP T1 - Evaluating item calibration medium in computerized adaptive testing Y1 - 1997 A1 - Hetter, R. D. A1 - Segall, D. O. A1 - Bloxom, B. M. CY - W.A. Sands, B.K. Waters and J.R. McBride, Computerized adaptive testing: From inquiry to operation (pp. 161-168). Washington, DC: American Psychological Association. ER - TY - CHAP T1 - Item pool development and evaluation Y1 - 1997 A1 - Segall, D. O. A1 - Moreno, K. E. A1 - Hetter, D. H. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 117-130). Washington DC: American Psychological Association. ER - TY - CONF T1 - Maintaining a CAT item pool with operational data T2 - Paper presented at the annual meeting of the National Council on Measurement in Education Y1 - 1997 A1 - Levine, M. L. A1 - Segall, D. O. A1 - Williams, B. A. JF - Paper presented at the annual meeting of the National Council on Measurement in Education CY - Chicago IL ER - TY - CHAP T1 - Psychometric procedures for administering CAT-ASVAB Y1 - 1997 A1 - Segall, D. O. A1 - Moreno, K. E. A1 - Bloxom, B. M. A1 - Hetter, R. D. CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 131-140). Washington D.C.: American Psychological Association. ER - TY - CHAP T1 - Validation of the experimental CAT-ASVAB system Y1 - 1997 A1 - Segall, D. O. A1 - Moreno, K. E. A1 - Kieckhaefer, W. F. A1 - Vicino, F. L. A1 - J. R. McBride CY - W. A. Sands, B. K. Waters, and J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation. Washington, DC: American Psychological Association. ER - TY - JOUR T1 - Multidimensional adaptive testing JF - Psychometrika Y1 - 1996 A1 - Segall, D. O. VL - 61 ER - TY - JOUR T1 - Multidimensional adaptive testing JF - Psychometrika Y1 - 1996 A1 - Segall, D. O. AB - Maximum likelihood and Bayesian procedures for item selection and scoring of multidimensional adaptive tests are presented. A demonstration using simulated response data illustrates that multidimensional adaptive testing (MAT) can provide equal or higher reliabilities with about one-third fewer items than are required by one-dimensional adaptive testing (OAT). Furthermore, holding test-length constant across the MAT and OAT approaches, substantial improvements in reliability can be obtained from multidimensional assessment. A number of issues relating to the operational use of multidimensional adaptive testing are discussed. VL - 61 N1 - Peer Reviewed Journalhttp://www.psychometrika.org/ ER - TY - CONF T1 - The effects of item compromise on computerized adaptive test scores T2 - Paper presented at the meeting of the Society for Industrial and Organizational Psychology Y1 - 1995 A1 - Segall, D. O. JF - Paper presented at the meeting of the Society for Industrial and Organizational Psychology CY - Orlando, FL ER - TY - CONF T1 - Equating the CAT-ASVAB: Experiences and lessons learned T2 - Paper presented at the meeting of the National Council on Measurement in Education Y1 - 1995 A1 - Segall, D. O. JF - Paper presented at the meeting of the National Council on Measurement in Education CY - San Francisco ER - TY - CONF T1 - Equating the CAT-ASVAB: Issues and approach T2 - Paper presented at the meeting of the National Council on Measurement in Education Y1 - 1995 A1 - Segall, D. O. A1 - Carter, G. JF - Paper presented at the meeting of the National Council on Measurement in Education CY - San Francisco ER - TY - CONF T1 - Some new methods for content balancing adaptive tests T2 - Paper presented at the annual meeting of the Psychometric Society Y1 - 1995 A1 - Segall, D. O. A1 - Davey, T. C. JF - Paper presented at the annual meeting of the Psychometric Society CY - Minneapolis MN ER - TY - ABST T1 - CAT-GATB simulation studies Y1 - 1994 A1 - Segall, D. O. CY - San Diego CA: Navy Personnel Research and Development Center ER - TY - JOUR T1 - A Comparison of Item Calibration Media in Computerized Adaptive Testing JF - Applied Psychological Measurement Y1 - 1994 A1 - Hetter, R. D. A1 - Segall, D. O. A1 - Bloxom, B. M. VL - 18 IS - 3 ER - TY - JOUR T1 - A comparison of item calibration media in computerized adaptive tests JF - Applied Psychological Measurement Y1 - 1994 A1 - Hetter, R. D. A1 - Segall, D. O. A1 - Bloxom, B. M. VL - 18 ER - TY - ABST T1 - Item Calibration: Medium-of-administration effect on computerized adaptive scores (TR-93-9) Y1 - 1993 A1 - Hetter, R. D. A1 - Bloxom, B. M. A1 - Segall, D. O. CY - Navy Personnel Research and Development Center ER - TY - JOUR T1 - CAT-ASVAB precision JF - Proceedings of the 34th Annual Conference of the Military Testing Association Y1 - 1992 A1 - Moreno, K. E., A1 - Segall, D. O. VL - 1 ER - TY - ABST T1 - A procedure for scoring incomplete adaptive tests in high stakes testing Y1 - 1988 A1 - Segall, D. O. CY - Unpublished manuscript. San Diego, CA: Navy Personnel Research and Development Center ER - TY - CONF T1 - A validity study of the computerized adaptive testing version of the Armed Services Vocational Aptitude Battery T2 - Proceedings of the 27th Annual Conference of the Military Testing Association Y1 - 1985 A1 - Moreno, K. E. A1 - Segall, D. O. A1 - Kieckhaefer, W. F. JF - Proceedings of the 27th Annual Conference of the Military Testing Association ER -