00612nas a2200121 4500008004100000245012600041210006900167260009700236100001100333700001700344700001400361856011500375 2009 eng d00aAn evaluation of a new procedure for computing information functions for Bayesian scores from computerized adaptive tests0 aevaluation of a new procedure for computing information function aD. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.1 aIto, K1 aPommerich, M1 aSegall, D uhttp://iacat.org/content/evaluation-new-procedure-computing-information-functions-bayesian-scores-computerized02044nas a2200133 4500008004100000245006100041210005500102260010000157520152600257100001701783700001601800700001601816856007801832 2009 eng d00aThe nine lives of CAT-ASVAB: Innovations and revelations0 anine lives of CATASVAB Innovations and revelations aIn D. J. Weiss (Ed.), Proceedings of the 2009 GMAC Conference on Computerized Adaptive Testing.3 aThe Armed Services Vocational Aptitude Battery (ASVAB) is administered annually to more than one million military applicants and high school students. ASVAB scores are used to determine enlistment eligibility, assign applicants to military occupational specialties, and aid students in career exploration. The ASVAB is administered as both a paper-and-pencil (P&P) test and a computerized adaptive test (CAT). CAT-ASVAB holds the distinction of being the first large-scale adaptive test battery to be administered in a high-stakes setting. Approximately two-thirds of military applicants currently take CAT-ASVAB; long-term plans are to replace P&P-ASVAB with CAT-ASVAB at all test sites. Given CAT-ASVAB’s pedigree—approximately 20 years in development and 20 years in operational administration—much can be learned from revisiting some of the major highlights of CATASVAB history. This paper traces the progression of CAT-ASVAB through nine major phases of development including: research and evelopment of the CAT-ASVAB prototype, the initial development of psychometric procedures and item pools, initial and full-scale operational implementation, the introduction of new item pools, the introduction of Windows administration, the introduction of Internet administration, and research and development of the next generation CATASVAB. A background and history is provided for each phase, including discussions of major research and operational issues, innovative approaches and practices, and lessons learned.1 aPommerich, M1 aSegall, D O1 aMoreno, K E uhttp://iacat.org/content/nine-lives-cat-asvab-innovations-and-revelations02149nas a2200109 4500008003900000245012000039210006900159490000600228520167200234100001701906856011601923 2007 d00aThe Effect of Using Item Parameters Calibrated from Paper Administrations in Computer Adaptive Test Administrations0 aEffect of Using Item Parameters Calibrated from Paper Administra0 v53 a

Computer administered tests are becoming increasingly prevalent as computer technology becomes more readily available on a large scale. For testing programs that utilize both computer and paper administrations, mode effects are problematic in that they can
result in examinee scores that are artificially inflated or deflated. As such, researchers have engaged in extensive studies of whether scores differ across paper and computer presentations of the same tests. The research generally seems to indicate that the more
complicated it is to present or take a test on computer, the greater the possibility of mode effects. In a computer adaptive test, mode effects may be a particular concern if items are calibrated using item responses obtained from one administration mode (i.e., paper), and those parameters are then used operationally in a different administration mode (i.e., computer). This paper studies the suitability of using parameters calibrated from a paper administration for item selection and scoring in a computer adaptive administration, for two tests with lengthy passages that required navigation in the computer administration. The results showed that the use of paper calibrated parameters versus computer calibrated parameters in computer adaptive administrations had small to
moderate effects on the reliability of examinee scores, at fairly short test lengths. This effect was generally diminished for longer test lengths. However, the results suggest that in some cases, some loss in reliability might be inevitable if paper-calibrated parameters
are used in computer adaptive administrations. 

1 aPommerich, M uhttp://iacat.org/content/effect-using-item-parameters-calibrated-paper-administrations-computer-adaptive-test-002152nas a2200133 4500008004100000245012000041210006900161300000900230490000600239520162500245653001701870100001701887856011401904 2007 eng d00aThe effect of using item parameters calibrated from paper administrations in computer adaptive test administrations0 aeffect of using item parameters calibrated from paper administra a1-290 v53 aComputer administered tests are becoming increasingly prevalent as computer technology becomes more readily available on a large scale. For testing programs that utilize both computer and paper administrations, mode effects are problematic in that they can result in examinee scores that are artificially inflated or deflated. As such, researchers have engaged in extensive studies of whether scores differ across paper and computer presentations of the same tests. The research generally seems to indicate that the more complicated it is to present or take a test on computer, the greater the possibility of mode effects. In a computer adaptive test, mode effects may be a particular concern if items are calibrated using item responses obtained from one administration mode (i.e., paper), and those parameters are then used operationally in a different administration mode (i.e., computer). This paper studies the suitability of using parameters calibrated from a paper administration for item selection and scoring in a computer adaptive administration, for two tests with lengthy passages that required navigation in the computer administration. The results showed that the use of paper calibrated parameters versus computer calibrated parameters in computer adaptive administrations had small to moderate effects on the reliability of examinee scores, at fairly short test lengths. This effect was generally diminished for longer test lengths. However, the results suggest that in some cases, some loss in reliability might be inevitable if paper-calibrated parameters are used in computer adaptive administrations.10aMode effects1 aPommerich, M uhttp://iacat.org/content/effect-using-item-parameters-calibrated-paper-administrations-computer-adaptive-test00479nas a2200109 4500008004100000245009300041210006900134260001500203100001700218700001600235856011800251 2003 eng d00aCalibrating CAT pools and online pretest items using marginal maximum likelihood methods0 aCalibrating CAT pools and online pretest items using marginal ma aChicago IL1 aPommerich, M1 aSegall, D O uhttp://iacat.org/content/calibrating-cat-pools-and-online-pretest-items-using-marginal-maximum-likelihood-methods00476nas a2200109 4500008004100000245009900041210006900140260001500209100001400224700001700238856011100255 2001 eng d00aAn examination of item review on a CAT using the specific information item selection algorithm0 aexamination of item review on a CAT using the specific informati aSeattle WA1 aBowles, R1 aPommerich, M uhttp://iacat.org/content/examination-item-review-cat-using-specific-information-item-selection-algorithm-000474nas a2200109 4500008004100000245009900041210006900140260001500209100001400224700001700238856010900255 2001 eng d00aAn examination of item review on a CAT using the specific information item selection algorithm0 aexamination of item review on a CAT using the specific informati aSeattle WA1 aBowles, R1 aPommerich, M uhttp://iacat.org/content/examination-item-review-cat-using-specific-information-item-selection-algorithm00444nas a2200109 4500008004100000245007600041210006900117260002800186100001700214700001400231856008900245 2000 eng d00aFrom simulation to application: Examinees react to computerized testing0 aFrom simulation to application Examinees react to computerized t aNew Orleans, April 20001 aPommerich, M1 aBurden, T uhttp://iacat.org/content/simulation-application-examinees-react-computerized-testing00386nas a2200121 4500008004100000245004400041210004400085260002100129100001300150700001700163700001800180856006600198 1999 eng d00aPretesting alongside an operational CAT0 aPretesting alongside an operational CAT aMontreal, Canada1 aDavey, T1 aPommerich, M1 aThompson, D T uhttp://iacat.org/content/pretesting-alongside-operational-cat