%0 Journal Article %J Educational Measurement: Issues and Practice %D 2015 %T Evaluating Content Alignment in Computerized Adaptive Testing %A Wise, S. L. %A Kingsbury, G. G. %A Webb, N. L. %X The alignment between a test and the content domain it measures represents key evidence for the validation of test score inferences. Although procedures have been developed for evaluating the content alignment of linear tests, these procedures are not readily applicable to computerized adaptive tests (CATs), which require large item pools and do not use fixed test forms. This article describes the decisions made in the development of CATs that influence and might threaten content alignment. It outlines a process for evaluating alignment that is sensitive to these threats and gives an empirical example of the process. %B Educational Measurement: Issues and Practice %V 34 %N 4 %R http://dx.doi.org/10.1111/emip.12094 %0 Journal Article %J Journal of Applied Testing Technology %D 2011 %T Creating a K-12 Adaptive Test: Examining the Stability of Item Parameter Estimates and Measurement Scales %A Kingsbury, G. G. %A Wise, S. L. %X

Development of adaptive tests used in K-12 settings requires the creation of stable measurement scales to measure the growth of individual students from one grade to the next, and to measure change in groups from one year to the next. Accountability systems
like No Child Left Behind require stable measurement scales so that accountability has meaning across time. This study examined the stability of the measurement scales used with the Measures of Academic Progress. Difficulty estimates for test questions from the reading and mathematics scales were examined over a period ranging from 7 to 22 years. Results showed high correlations between item difficulty estimates from the time at which they where originally calibrated and the current calibration. The average drift in item difficulty estimates was less than .01 standard deviations. The average impact of change in item difficulty estimates was less than the smallest reported difference on the score scale for two actual tests. The findings of the study indicate that an IRT scale can be stable enough to allow consistent measurement of student achievement.

%B Journal of Applied Testing Technology %V 12 %G English %U http://www.testpublishers.org/journal-of-applied-testing-technology %0 Journal Article %J European Journal of Psychological Assessment %D 2004 %T Assisted self-adapted testing: A comparative study %A Hontangas, P. %A Olea, J. %A Ponsoda, V. %A Revuelta, J. %A Wise, S. L. %K Adaptive Testing %K Anxiety %K Computer Assisted Testing %K Psychometrics %K Test %X A new type of self-adapted test (S-AT), called Assisted Self-Adapted Test (AS-AT), is presented. It differs from an ordinary S-AT in that prior to selecting the difficulty category, the computer advises examinees on their best difficulty category choice, based on their previous performance. Three tests (computerized adaptive test, AS-AT, and S-AT) were compared regarding both their psychometric (precision and efficiency) and psychological (anxiety) characteristics. Tests were applied in an actual assessment situation, in which test scores determined 20% of term grades. A sample of 173 high school students participated. Neither differences in posttest anxiety nor ability were obtained. Concerning precision, AS-AT was as precise as CAT, and both revealed more precision than S-AT. It was concluded that AS-AT acted as a CAT concerning precision. Some hints, but not conclusive support, of the psychological similarity between AS-AT and S-AT was also found. (PsycINFO Database Record (c) 2005 APA ) (journal abstract) %B European Journal of Psychological Assessment %V 20 %P 2-9 %G eng %0 Journal Article %J International Journal of Continuing Engineering Education and Life-Long Learning %D 2002 %T Self-adapted testing: An overview %A Wise, S. L. %A Ponsoda, V. %A Olea, J. %B International Journal of Continuing Engineering Education and Life-Long Learning %V 12 %P 107-122 %G eng %0 Journal Article %J European Journal of Psychological Assessment %D 2000 %T The choice of item difficulty in self adapted testing %A Hontangas, P. %A Ponsoda, V. %A Olea, J. %A Wise, S. L. %B European Journal of Psychological Assessment %V 16 %P 3-12 %G eng %N 1 %0 Journal Article %J Psicologica %D 2000 %T Practical issues in developing and maintaining a computerized adaptive testing program %A Wise, S. L. %A Kingsbury, G. G. %B Psicologica %V 21 %P 135-155 %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1999 %T Comparison of stratum scored and maximum likelihood scoring %A Wise, S. L. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Montreal, Canada %G eng %0 Journal Article %J Applied Measurement in Education %D 1999 %T Examinee judgments of changes in item difficulty: Implications for item review in computerized adaptive testing %A Wise, S. L. %A Finney, S. J., %A Enders, C. K. %A Freeman, S.A. %A Severance, D.D. %B Applied Measurement in Education %V 12 %P 185-198 %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1999 %T The rationale and principles of stratum scoring %A Wise, S. L. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Montreal, Canada %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1997 %T The accuracy of examinee judgments of relative item difficulty: Implication for computerized adaptive testing %A Wise, S. L. %A Freeman, S.A. %A Finney, S. J. %A Enders, C. K. %A Severance, D.D. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Chicago %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1997 %T Examinee issues in CAT %A Wise, S. L. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Chicago IL %G eng %0 Journal Article %J Educational and Psychological Measurement %D 1997 %T An investigation of self-adapted testing in a Spanish high school population %A Ponsoda, V. %A Wise, S. L. %A Olea, J. %A Revuelta, J. %B Educational and Psychological Measurement %V 57 %P 210-221 %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1997 %T Overview of practical issues in a CAT program %A Wise, S. L. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Chicago IL %G eng %0 Journal Article %J Educational and Psychological Measurement %D 1997 %T The role of item feedback in self-adapted testing %A Roos, L. L. %A Wise, S. L. %A Plake, B. S. %B Educational and Psychological Measurement %V 57 %P 85-98 %G eng %0 Journal Article %J Educational and Psychological Measurement %D 1996 %T Conducting self-adapted testing using MicroCAT %A Roos, L. L. %A Wise, S. L. %A Yoes, M. E. %A Rocklin, T. R. %B Educational and Psychological Measurement %V 56 %P 821-827 %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1996 %T A critical analysis of the argument for and against item review in computerized adaptive testing %A Wise, S. L. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C New York %G eng %0 Conference Paper %B Paper presented at the Third European Conference on Psychological Assessment %D 1995 %T Item review and answer changing in computerized adaptive tests %A Wise, S. L. %B Paper presented at the Third European Conference on Psychological Assessment %C Trier, Germany %G eng %0 Conference Paper %B Paper presented at the Fourth Symposium de Metodologia de las Ciencies del Comportamiento %D 1995 %T Tests adaptivos y autoadaptados informatizados: Effects en la ansiedad y en la pecision de las estimaciones [SATs and CATS: Effects on enxiety and estimate precision] %A Olea, J. %A Ponsoda, V. %A Wise, S. L. %B Paper presented at the Fourth Symposium de Metodologia de las Ciencies del Comportamiento %C Murcia, Spain %G Spanish %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1994 %T Comparing computerized adaptive and self-adapted tests: The influence of examinee achievement locus of control %A Wise, S. L. %A Roos, L. L. %A Plake, B. S. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C New Orleans LA %G eng %0 Journal Article %J Applied Measurement in Education %D 1994 %T The relationship between examinee anxiety and preference for self-adapted testing %A Wise, S. L. %A Roos, L. L. %A Plake, B. S., %A Nebelsick-Gullett, L. J. %B Applied Measurement in Education %V 7 %P 81-91 %G eng %0 Journal Article %J Applied Measurement in Education %D 1994 %T Understanding self-adapted testing: The perceived control hypothesis %A Wise, S. L. %B Applied Measurement in Education %V 7 %P 15-24 %G eng %0 Conference Paper %B Paper presented at the annual meeting of the National Council on Measurement in Education %D 1993 %T An investigation of restricted self-adapted testing %A Wise, S. L. %A Kingsbury, G. G. %A Houser, R.L. %B Paper presented at the annual meeting of the National Council on Measurement in Education %C Atlanta GA %G eng %0 Journal Article %J Journal of Educational Measurement %D 1992 %T A comparison of self-adapted and computerized adaptive achievement tests %A Wise, S. L. %A Plake, S. S %A Johnson, P. L. %A Roos, S. L. %B Journal of Educational Measurement %V 29 %P 329-339 %G eng %0 Conference Paper %B Paper presented at the annual meeting of the NMCE %D 1992 %T The effects of feedback in computerized adaptive and self-adapted tests %A Roos, L. L. %A Plake, B. S. %A Wise, S. L. %B Paper presented at the annual meeting of the NMCE %C San Francisco %G eng %0 Journal Article %J Mid-Western Educational Researcher %D 1991 %T Correlates of examinee item choice behavior in self-adapted testing %A Johnson, J. L. %A Roos, L. L. %A Wise, S. L. %A Plake, B. S. %B Mid-Western Educational Researcher %V 4 %P 25-28 %G eng %0 Journal Article %J Educational and Psychological Measurement %D 1989 %T Providing item feedback in computer-based tests: Effects of initial success and failure %A Wise, S. L. %A Plake, B. S. %A et. al. %B Educational and Psychological Measurement %V 49 %P 479-486 %G eng