TY - JOUR
T1 - Computerized Adaptive Testing of Personality Traits
JF - Zeitschrift für Psychologie / Journal of Psychology
Y1 - 2008
A1 - Hol, A. M.
A1 - Vorst, H. C. M.
A1 - Mellenbergh, G. J.
KW - Adaptive Testing
KW - cmoputer-assisted testing
KW - Item Response Theory
KW - Likert scales
KW - Personality Measures
AB -
A computerized adaptive testing (CAT) procedure was simulated with ordinal polytomous personality data collected using a
conventional paper-and-pencil testing format. An adapted Dutch version of the dominance scale of Gough and Heilbrun’s Adjective
Check List (ACL) was used. This version contained Likert response scales with five categories. Item parameters were estimated using Samejima’s graded response model from the responses of 1,925 subjects. The CAT procedure was simulated using the responses of 1,517 other subjects. The value of the required standard error in the stopping rule of the CAT was manipulated. The relationship between CAT latent trait estimates and estimates based on all dominance items was studied. Additionally, the pattern of relationships between the CAT latent trait estimates and the other ACL scales was compared to that between latent trait estimates based on the entire item pool and the other ACL scales. The CAT procedure resulted in latent trait estimates qualitatively equivalent to latent trait estimates based on all items, while a substantial reduction of the number of used items could be realized (at the stopping rule of 0.4 about 33% of the 36 items was used).
VL - 216
IS - 1
ER -
TY - JOUR
T1 - Computerized adaptive testing for polytomous motivation items: Administration mode effects and a comparison with short forms
JF - Applied Psychological Measurement
Y1 - 2007
A1 - Hol, A. M.
A1 - Vorst, H. C. M.
A1 - Mellenbergh, G. J.
KW - 2220 Tests & Testing
KW - Adaptive Testing
KW - Attitude Measurement
KW - computer adaptive testing
KW - Computer Assisted Testing
KW - items
KW - Motivation
KW - polytomous motivation
KW - Statistical Validity
KW - Test Administration
KW - Test Forms
KW - Test Items
AB - In a randomized experiment (n=515), a computerized and a computerized adaptive test (CAT) are compared. The item pool consists of 24 polytomous motivation items. Although items are carefully selected, calibration data show that Samejima's graded response model did not fit the data optimally. A simulation study is done to assess possible consequences of model misfit. CAT efficiency was studied by a systematic comparison of the CAT with two types of conventional fixed length short forms, which are created to be good CAT competitors. Results showed no essential administration mode effects. Efficiency analyses show that CAT outperformed the short forms in almost all aspects when results are aggregated along the latent trait scale. The real and the simulated data results are very similar, which indicate that the real data results are not affected by model misfit. (PsycINFO Database Record (c) 2007 APA ) (journal abstract)
VL - 31
SN - 0146-6216
N1 - 10.1177/0146621606297314Journal; Peer Reviewed Journal; Journal Article
ER -
TY - JOUR
T1 - A randomized experiment to compare conventional, computerized, and computerized adaptive administration of ordinal polytomous attitude items
JF - Applied Psychological Measurement
Y1 - 2005
A1 - Hol, A. M.
A1 - Vorst, H. C. M.
A1 - Mellenbergh, G. J.
KW - Computer Assisted Testing
KW - Test Administration
KW - Test Items
AB - A total of 520 high school students were randomly assigned to a paper-and-pencil test (PPT), a computerized standard test (CST), or a computerized adaptive test (CAT) version of the Dutch School Attitude Questionnaire (SAQ), consisting of ordinal polytomous items. The CST administered items in the same order as the PPT. The CAT administered all items of three SAQ subscales in adaptive order using Samejima's graded response model, so that six different stopping rule settings could be applied afterwards. School marks were used as external criteria. Results showed significant but small multivariate administration mode effects on conventional raw scores and small to medium effects on maximum likelihood latent trait estimates. When the precision of CAT latent trait estimates decreased, correlations with grade point average in general decreased. However, the magnitude of the decrease was not very large as compared to the PPT, the CST, and the CAT without the stopping rule. (PsycINFO Database Record (c) 2005 APA ) (journal abstract)
VL - 29
ER -
TY - JOUR
T1 - Toepassing van een computergestuurde adaptieve testprocedure op persoonlijkheidsdata [Application of a computerised adaptive test procedure on personality data]
JF - Nederlands Tijdschrift voor de Psychologie en haar Grensgebieden
Y1 - 2001
A1 - Hol, A. M.
A1 - Vorst, H. C. M.
A1 - Mellenbergh, G. J.
KW - Adaptive Testing
KW - Computer Applications
KW - Computer Assisted Testing
KW - Personality Measures
KW - Test Reliability computerized adaptive testing
AB - Studied the applicability of a computerized adaptive testing procedure to an existing personality questionnaire within the framework of item response theory. The procedure was applied to the scores of 1,143 male and female university students (mean age 21.8 yrs) in the Netherlands on the Neuroticism scale of the Amsterdam Biographical Questionnaire (G. J. Wilde, 1963). The graded response model (F. Samejima, 1969) was used. The quality of the adaptive test scores was measured based on their correlation with test scores for the entire item bank and on their correlation with scores on other scales from the personality test. The results indicate that computerized adaptive testing can be applied to personality scales. (PsycINFO Database Record (c) 2005 APA )
VL - 56
ER -